2024-09-10T23:19:04.948 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:19:04.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:19:05.084 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/direct_io}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899791' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNpUcPU9oDFG5hu5ieesZCj9j9fE2CuFcJJvYmi0UI21Tkz1McdlHl0giV1NTsd3v+vUc54Ns4xLZpLBjTN9skA= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLV8KzrgFRc0J9jGr9lL4vm7naEeuL4Qm+9reCmxUej6nZbmVXsuuijfHmty1EcVfpojY1UWQTh2bJIVyO2qrw= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKdaGlRKqan6WumszVur8d4CWk5NqY4dflboyB4c7Ldzew7Oj9rJXZbuD7F4l72Exo7DM6p31fW0D6I3YzqBJJA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:19:05.084 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:19:05.085 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:19:05.085 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:19:05.087 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:19:05.108 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:19:05.108 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:19:05.109 INFO:teuthology.packaging:ref: None 2024-09-10T23:19:05.109 INFO:teuthology.packaging:tag: None 2024-09-10T23:19:05.109 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:19:05.109 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:19:05.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:19:05.268 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:19:05.269 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:19:05.277 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:19:05.277 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:19:05.300 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:19:05.321 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:19:05.329 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:19:05.362 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:13:26.780107', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNpUcPU9oDFG5hu5ieesZCj9j9fE2CuFcJJvYmi0UI21Tkz1McdlHl0giV1NTsd3v+vUc54Ns4xLZpLBjTN9skA='} 2024-09-10T23:19:05.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:13:26.783585', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLV8KzrgFRc0J9jGr9lL4vm7naEeuL4Qm+9reCmxUej6nZbmVXsuuijfHmty1EcVfpojY1UWQTh2bJIVyO2qrw='} 2024-09-10T23:19:05.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:13:26.781964', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKdaGlRKqan6WumszVur8d4CWk5NqY4dflboyB4c7Ldzew7Oj9rJXZbuD7F4l72Exo7DM6p31fW0D6I3YzqBJJA='} 2024-09-10T23:19:05.426 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:19:05.435 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T23:19:05.435 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T23:19:05.435 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T23:19:05.436 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:19:05.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f994cc8fbe0>, signals=[15]) 2024-09-10T23:19:05.553 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:19:05.561 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:19:05.561 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:19:05.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:19:05.646 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-09-10T23:19:05.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:19:05.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T23:19:05.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:19:05.813 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:19:05.820 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-09-10T23:19:05.839 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-09-10T23:19:05.839 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-09-10T23:19:05.896 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-09-10T23:19:05.896 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:19:05.897 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:19:05.898 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:19:05.898 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-09-10T23:19:05.934 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-09-10T23:19:05.953 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-09-10T23:19:05.954 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-09-10T23:19:06.012 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-09-10T23:19:06.012 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:19:06.013 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:19:06.014 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-09-10T23:19:06.042 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-10T23:19:06.061 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-10T23:19:06.061 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-10T23:19:06.120 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:19:06.121 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:19:06.121 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:19:06.121 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:19:06.121 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:19:06.121 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:19:06.121 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-10T23:19:06.151 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:19:06.162 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:19:06.171 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:19:06.172 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:19:06.174 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:19:06.176 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:19:06.193 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:19:06.202 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:19:06.202 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:19:06.231 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:19:06.236 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:19:06.262 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:19:06.367 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:19:06.384 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:19:06.384 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T23:19:06.385 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T23:19:06.385 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:19:06.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:19:06.402 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-09-10T23:19:06.460 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:19:06.460 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.14.0-503.el9.x86_64 2024-09-10T23:19:06.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2024-09-10T23:19:09.073 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T23:19:11.932 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-10T23:19:17.108 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.5 MB 00:01 2024-09-10T23:19:18.525 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 19 kB 00:00 2024-09-10T23:19:20.096 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-10T23:19:25.927 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T23:19:28.034 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T23:19:28.034 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T23:19:28.131 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-09-10T23:19:28.141 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-09-10T23:19:28.141 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-09-10T23:19:28.141 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-09-10T23:19:28.141 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:Install 4 Packages 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 79 M 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 126 M 2024-09-10T23:19:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-09-10T23:19:28.279 INFO:teuthology.orchestra.run.smithi016.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 201 kB/s | 23 kB 00:00 2024-09-10T23:19:29.195 INFO:teuthology.orchestra.run.smithi016.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 34 MB/s | 35 MB 00:01 2024-09-10T23:19:29.704 INFO:teuthology.orchestra.run.smithi016.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-10T23:19:29.863 INFO:teuthology.orchestra.run.smithi016.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.2 MB/s | 16 MB 00:01 2024-09-10T23:19:29.863 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:19:29.863 INFO:teuthology.orchestra.run.smithi016.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-10T23:19:30.578 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-09-10T23:19:30.993 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-09-10T23:19:30.993 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-09-10T23:19:31.962 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-09-10T23:19:31.962 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-09-10T23:19:34.530 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-09-10T23:19:35.197 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:19:35.280 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:19:38.069 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:19:38.201 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:19:43.324 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:19:43.368 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:19:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:20:27.786 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:20:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:20:28.196 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:20:28.196 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:20:28.196 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:20:28.197 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:20:29.026 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:20:29.026 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:20:29.026 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-09-10T23:20:29.026 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T23:20:29.027 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T23:20:29.027 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T23:20:29.027 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T23:20:29.027 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:20:29.027 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-09-10T23:20:29.377 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:20:29.511 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:20:29.511 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:20:29.511 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T23:20:29.511 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T23:20:29.511 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T23:20:29.512 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T23:20:29.512 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T23:20:29.512 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:20:29.570 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:20:29.570 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:20:29.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.06 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 82.el9 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Group : Unspecified 2024-09-10T23:20:29.612 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 8274670 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : builder@centos.org 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:20:29.613 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:20:29.614 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2024-09-10T23:20:29.614 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:20:29.614 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:20:29.615 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:20:29.615 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 5.14.0-505.el9.x86_64 2024-09-10T23:20:29.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:20:30.253 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-09-10T23:20:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:20:31.631 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-09-10T23:20:31.633 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-09-10T23:20:31.649 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.BBjPY2zv5L 2024-09-10T23:20:31.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BBjPY2zv5L 2024-09-10T23:20:31.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.BBjPY2zv5L 2024-09-10T23:20:31.855 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.BBjPY2zv5L is 6KB 2024-09-10T23:20:31.903 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.BBjPY2zv5L 2024-09-10T23:20:31.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:20:31.979 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:20:31.979 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:20:31.979 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:20:31.979 INFO:teuthology.orchestra.run.smithi016.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T23:20:31.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T23:20:32.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-09-10T23:21:02.123 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T23:21:02.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-10T23:21:02.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:21:20.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-09-10T23:21:29.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-10T23:21:29.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:22:29.713 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:22:41.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-10T23:22:41.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:22:42.047 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-09-10T23:22:42.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-10T23:22:42.436 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T23:22:42.436 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-09-10T23:22:42.453 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-505.el9.x86_64 2024-09-10T23:22:42.453 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T23:22:42.453 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:22:42.453 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:22:43.454 DEBUG:teuthology.parallel:result is None 2024-09-10T23:22:43.455 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:22:43.470 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:22:43.471 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:22:43.473 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:22:43.476 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:22:43.496 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:22:43.503 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:22:43.510 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:22:43.510 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:22:43.533 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:22:43.535 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:22:43.665 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:22:43.672 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:22:43.673 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:22:43.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:22:43.691 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:22:43.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:22:43.708 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:22:43.711 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:22:43.733 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:22:43.782 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:22:43.792 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:22:43.801 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:22:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:22:43.811 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:22:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:22:43.822 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:22:43.829 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:22:43.829 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:22:43.832 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:22:43.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:22:43.870 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:22:43.879 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:22:43.879 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:22:43.903 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:22:43.906 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:22:43.927 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:22:44.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:22:44.055 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:22:44.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:22:44.183 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:22:44.183 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:22:44.252 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:22:44.307 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:22:44.354 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:22:44.447 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:22:44.485 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:22:44.486 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:22:44.556 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:22:44.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:22:44.652 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:22:44.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:22:44.781 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:22:44.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:22:44.849 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-09-10T23:22:44.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-09-10T23:22:44.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-10T23:22:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:22:44.907 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:22:44.928 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:22:45.339 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:22:45.359 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:22:45.359 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:22:45.383 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:22:45.390 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T23:22:45.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-09-10T23:22:45.456 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-09-10T23:22:45.458 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-09-10T23:22:45.521 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-09-10T23:22:45.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-10T23:22:45.580 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-10T23:22:45.582 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:22:45.582 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-09-10T23:22:45.609 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-09-10T23:22:45.609 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-09-10T23:22:45.634 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-09-10T23:22:45.634 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-10T23:22:45.693 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-10T23:22:45.693 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:22:45.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:22:45.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:22:45.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:22:45.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:22:45.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:22:45.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:22:45.784 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:22:45.784 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:22:45.820 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:22:45.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:22:45.905 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:22:45.915 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T23:22:45.919 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T23:22:46.061 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:22:46.072 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:22:46.073 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi066.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:26:45.051 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com')] 2024-09-10T23:26:45.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-10T23:26:45.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:26:45.137 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-09-10T23:26:45.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-10T23:26:45.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-10T23:26:45.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:26:45.309 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-10T23:26:45.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-10T23:26:45.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T23:26:45.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:26:45.472 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-10T23:26:45.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T23:26:45.556 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:26:45.567 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:26:45.567 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:26:45.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:26:45.570 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:26:45.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:26:45.573 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:26:45.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:26:45.600 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:26:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:26:45.615 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:26:45.618 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:26:45.629 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:26:45.642 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-09-10T23:26:45.644 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-09-10T23:26:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:26:45.654 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-09-10T23:26:45.655 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-09-10T23:26:45.669 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:26:45.671 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:26:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-10T23:26:45.684 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-10T23:26:45.685 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:26:45.685 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:26:45.699 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:26:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:26:45.747 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:26:45.747 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:26:45.750 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:26:45.750 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-10T23:26:45.750 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.751 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.751 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.751 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.752 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.771 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:26:45.774 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:26:45.774 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-10T23:26:45.774 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.775 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.775 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.775 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:26:45.776 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:26:45.791 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:26:45.791 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:26:45.791 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:26:45.791 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:26:45.797 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:26:45.797 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T23:26:45.797 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:26:45.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:26:45.800 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:26:45.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:26:45.801 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:26:45.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:26:45.952 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:26:45.952 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:26:45.964 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:26:45.964 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:26:45.975 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:26:45.975 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:26:46.072 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:26:46.073 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:26:46.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:26:46.081 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:26:46.082 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:26:46.082 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:26:46.090 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:26:46.090 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:26:46.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:26:46.100 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:26:46.101 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:26:46.109 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:26:46.109 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:26:46.116 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:26:46.116 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:26:46.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:26:46.176 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:26:46.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:26:46.243 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:26:46.253 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:26:46.256 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:26:46.308 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2024-09-10T23:26:46.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2024-09-10T23:26:46.318 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-09-10T23:26:46.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-09-10T23:26:46.320 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-10T23:26:46.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-10T23:26:46.539 INFO:teuthology.orchestra.run.smithi016.stdout:45 files removed 2024-09-10T23:26:46.547 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-10T23:26:46.552 INFO:teuthology.orchestra.run.smithi066.stdout:45 files removed 2024-09-10T23:26:46.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:26:46.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:26:46.580 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:26:47.110 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 326 kB/s | 84 kB 00:00 2024-09-10T23:26:47.140 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-10T23:26:47.153 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-10T23:26:47.410 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-10T23:26:47.424 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-10T23:26:47.446 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-10T23:26:47.683 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-10T23:26:47.686 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T23:26:47.721 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T23:26:48.133 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-10T23:26:48.214 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-10T23:26:48.405 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-10T23:26:49.912 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-10T23:26:49.959 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-10T23:26:54.346 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T23:26:56.635 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-10T23:26:56.747 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 19 kB 00:01 2024-09-10T23:26:56.797 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-10T23:26:58.026 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T23:26:58.161 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-10T23:26:59.415 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T23:27:03.398 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T23:27:03.731 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:02 2024-09-10T23:27:05.105 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-10T23:27:05.299 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-10T23:27:05.708 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:27:05.709 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:27:05.720 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:27:05.721 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:27:05.722 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:27:05.723 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:27:05.724 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:27:05.727 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:27:05.728 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:27:05.790 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:27:05.810 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:27:05.811 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:27:05.812 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T23:27:05.813 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:27:05.814 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:27:05.815 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:27:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:27:05.817 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:27:05.818 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:27:05.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:27:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-10T23:27:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout:Install 149 Packages 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 8 Packages 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 240 M 2024-09-10T23:27:05.822 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T23:27:06.174 INFO:teuthology.orchestra.run.smithi071.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-10T23:27:06.357 INFO:teuthology.orchestra.run.smithi071.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.8 MB/s | 900 kB 00:00 2024-09-10T23:27:06.425 INFO:teuthology.orchestra.run.smithi071.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T23:27:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-10T23:27:06.658 INFO:teuthology.orchestra.run.smithi071.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 2.4 MB 00:00 2024-09-10T23:27:06.694 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T23:27:06.700 INFO:teuthology.orchestra.run.smithi071.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-10T23:27:07.076 INFO:teuthology.orchestra.run.smithi071.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 4.8 MB 00:00 2024-09-10T23:27:07.293 INFO:teuthology.orchestra.run.smithi071.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 17 MB/s | 22 MB 00:01 2024-09-10T23:27:07.334 INFO:teuthology.orchestra.run.smithi071.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 609 kB/s | 25 kB 00:00 2024-09-10T23:27:07.575 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:27:07.576 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:27:07.590 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:27:07.591 INFO:teuthology.orchestra.run.smithi016.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:27:07.592 INFO:teuthology.orchestra.run.smithi016.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:27:07.593 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:27:07.595 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:27:07.598 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:27:07.599 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:27:07.667 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-09-10T23:27:07.684 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-09-10T23:27:07.684 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:27:07.685 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:27:07.686 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:27:07.687 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:27:07.688 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:27:07.689 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:27:07.690 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:27:07.691 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:27:07.692 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:27:07.693 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:27:07.694 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:27:07.695 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:27:07.696 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:27:07.697 INFO:teuthology.orchestra.run.smithi016.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout:Installing weak dependencies: 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-09-10T23:27:07.698 INFO:teuthology.orchestra.run.smithi016.stdout:Install 149 Packages 2024-09-10T23:27:07.699 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 8 Packages 2024-09-10T23:27:07.699 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:27:07.699 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 240 M 2024-09-10T23:27:07.699 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-09-10T23:27:07.726 INFO:teuthology.orchestra.run.smithi071.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 17 MB/s | 17 MB 00:01 2024-09-10T23:27:07.852 INFO:teuthology.orchestra.run.smithi071.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 14 MB/s | 11 MB 00:00 2024-09-10T23:27:07.877 INFO:teuthology.orchestra.run.smithi071.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.5 MB/s | 225 kB 00:00 2024-09-10T23:27:07.902 INFO:teuthology.orchestra.run.smithi071.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 538 kB/s | 27 kB 00:00 2024-09-10T23:27:07.927 INFO:teuthology.orchestra.run.smithi071.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 632 kB/s | 32 kB 00:00 2024-09-10T23:27:07.961 INFO:teuthology.orchestra.run.smithi071.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 755 kB 00:00 2024-09-10T23:27:07.986 INFO:teuthology.orchestra.run.smithi071.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-10T23:27:08.012 INFO:teuthology.orchestra.run.smithi071.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:27:08.045 INFO:teuthology.orchestra.run.smithi071.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-10T23:27:08.104 INFO:teuthology.orchestra.run.smithi071.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 774 kB/s | 45 kB 00:00 2024-09-10T23:27:08.156 INFO:teuthology.orchestra.run.smithi016.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 41 kB/s | 6.6 kB 00:00 2024-09-10T23:27:08.179 INFO:teuthology.orchestra.run.smithi071.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.9 MB/s | 143 kB 00:00 2024-09-10T23:27:08.263 INFO:teuthology.orchestra.run.smithi071.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.9 MB/s | 161 kB 00:00 2024-09-10T23:27:08.338 INFO:teuthology.orchestra.run.smithi071.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-10T23:27:08.363 INFO:teuthology.orchestra.run.smithi071.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 3.1 MB/s | 321 kB 00:00 2024-09-10T23:27:08.388 INFO:teuthology.orchestra.run.smithi071.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 6.0 MB/s | 306 kB 00:00 2024-09-10T23:27:08.439 INFO:teuthology.orchestra.run.smithi071.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.3 MB/s | 99 kB 00:00 2024-09-10T23:27:08.464 INFO:teuthology.orchestra.run.smithi071.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-10T23:27:08.523 INFO:teuthology.orchestra.run.smithi071.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-10T23:27:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.3 MB/s | 900 kB 00:00 2024-09-10T23:27:08.581 INFO:teuthology.orchestra.run.smithi071.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 588 kB/s | 34 kB 00:00 2024-09-10T23:27:08.623 INFO:teuthology.orchestra.run.smithi016.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.7 MB/s | 145 kB 00:00 2024-09-10T23:27:08.632 INFO:teuthology.orchestra.run.smithi071.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 17 MB/s | 3.2 MB 00:00 2024-09-10T23:27:08.657 INFO:teuthology.orchestra.run.smithi071.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.0 MB/s | 154 kB 00:00 2024-09-10T23:27:09.265 INFO:teuthology.orchestra.run.smithi071.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-10T23:27:09.358 INFO:teuthology.orchestra.run.smithi071.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.1 MB/s | 291 kB 00:00 2024-09-10T23:27:09.463 INFO:teuthology.orchestra.run.smithi071.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 466 kB/s | 49 kB 00:00 2024-09-10T23:27:09.556 INFO:teuthology.orchestra.run.smithi016.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 3.5 MB/s | 5.5 MB 00:01 2024-09-10T23:27:09.607 INFO:teuthology.orchestra.run.smithi016.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 2.4 MB/s | 2.4 MB 00:00 2024-09-10T23:27:09.633 INFO:teuthology.orchestra.run.smithi071.stdout:(34/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 14 MB/s | 14 MB 00:01 2024-09-10T23:27:09.658 INFO:teuthology.orchestra.run.smithi071.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 84 kB/s | 16 kB 00:00 2024-09-10T23:27:09.692 INFO:teuthology.orchestra.run.smithi071.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T23:27:09.734 INFO:teuthology.orchestra.run.smithi071.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 10 MB/s | 783 kB 00:00 2024-09-10T23:27:09.759 INFO:teuthology.orchestra.run.smithi071.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 272 kB/s | 18 kB 00:00 2024-09-10T23:27:09.800 INFO:teuthology.orchestra.run.smithi016.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-10T23:27:10.133 INFO:teuthology.orchestra.run.smithi016.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 9.1 MB/s | 4.8 MB 00:00 2024-09-10T23:27:10.218 INFO:teuthology.orchestra.run.smithi071.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 17 MB/s | 50 MB 00:02 2024-09-10T23:27:10.599 INFO:teuthology.orchestra.run.smithi016.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 8.3 MB/s | 22 MB 00:02 2024-09-10T23:27:10.649 INFO:teuthology.orchestra.run.smithi016.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 506 kB/s | 25 kB 00:00 2024-09-10T23:27:10.785 INFO:teuthology.orchestra.run.smithi071.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 76 kB/s | 80 kB 00:01 2024-09-10T23:27:10.875 INFO:teuthology.orchestra.run.smithi016.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 16 MB/s | 17 MB 00:01 2024-09-10T23:27:11.008 INFO:teuthology.orchestra.run.smithi016.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 12 MB/s | 11 MB 00:00 2024-09-10T23:27:11.010 INFO:teuthology.orchestra.run.smithi071.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 241 kB/s | 191 kB 00:00 2024-09-10T23:27:11.033 INFO:teuthology.orchestra.run.smithi016.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.4 MB/s | 225 kB 00:00 2024-09-10T23:27:11.059 INFO:teuthology.orchestra.run.smithi016.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 538 kB/s | 27 kB 00:00 2024-09-10T23:27:11.084 INFO:teuthology.orchestra.run.smithi016.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 633 kB/s | 32 kB 00:00 2024-09-10T23:27:11.110 INFO:teuthology.orchestra.run.smithi071.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 593 kB/s | 801 kB 00:01 2024-09-10T23:27:11.117 INFO:teuthology.orchestra.run.smithi016.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 755 kB 00:00 2024-09-10T23:27:11.143 INFO:teuthology.orchestra.run.smithi016.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-10T23:27:11.168 INFO:teuthology.orchestra.run.smithi016.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:27:11.202 INFO:teuthology.orchestra.run.smithi016.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-10T23:27:11.260 INFO:teuthology.orchestra.run.smithi016.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 775 kB/s | 45 kB 00:00 2024-09-10T23:27:11.327 INFO:teuthology.orchestra.run.smithi016.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.1 MB/s | 143 kB 00:00 2024-09-10T23:27:11.411 INFO:teuthology.orchestra.run.smithi016.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.9 MB/s | 161 kB 00:00 2024-09-10T23:27:11.495 INFO:teuthology.orchestra.run.smithi016.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-10T23:27:11.520 INFO:teuthology.orchestra.run.smithi016.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 2.9 MB/s | 321 kB 00:00 2024-09-10T23:27:11.545 INFO:teuthology.orchestra.run.smithi016.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.9 MB/s | 306 kB 00:00 2024-09-10T23:27:11.571 INFO:teuthology.orchestra.run.smithi016.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T23:27:11.585 INFO:teuthology.orchestra.run.smithi071.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 316 kB/s | 253 kB 00:00 2024-09-10T23:27:11.596 INFO:teuthology.orchestra.run.smithi016.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T23:27:11.646 INFO:teuthology.orchestra.run.smithi016.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-10T23:27:11.730 INFO:teuthology.orchestra.run.smithi016.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 20 MB/s | 3.2 MB 00:00 2024-09-10T23:27:11.755 INFO:teuthology.orchestra.run.smithi016.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 316 kB/s | 34 kB 00:00 2024-09-10T23:27:11.780 INFO:teuthology.orchestra.run.smithi016.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-10T23:27:11.785 INFO:teuthology.orchestra.run.smithi071.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2024-09-10T23:27:11.978 INFO:teuthology.orchestra.run.smithi071.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-10T23:27:12.247 INFO:teuthology.orchestra.run.smithi016.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-10T23:27:12.306 INFO:teuthology.orchestra.run.smithi016.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.9 MB/s | 291 kB 00:00 2024-09-10T23:27:12.344 INFO:teuthology.orchestra.run.smithi071.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 178 kB/s | 135 kB 00:00 2024-09-10T23:27:12.373 INFO:teuthology.orchestra.run.smithi016.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 740 kB/s | 49 kB 00:00 2024-09-10T23:27:12.409 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T23:27:12.439 INFO:teuthology.orchestra.run.smithi016.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 247 kB/s | 16 kB 00:00 2024-09-10T23:27:12.545 INFO:teuthology.orchestra.run.smithi071.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 165 kB/s | 125 kB 00:00 2024-09-10T23:27:12.582 INFO:teuthology.orchestra.run.smithi016.stdout:(35/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 17 MB/s | 14 MB 00:00 2024-09-10T23:27:12.607 INFO:teuthology.orchestra.run.smithi016.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 285 kB 00:00 2024-09-10T23:27:12.641 INFO:teuthology.orchestra.run.smithi016.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 13 MB/s | 783 kB 00:00 2024-09-10T23:27:12.657 INFO:teuthology.orchestra.run.smithi016.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 362 kB/s | 18 kB 00:00 2024-09-10T23:27:12.720 INFO:teuthology.orchestra.run.smithi071.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 289 kB/s | 215 kB 00:00 2024-09-10T23:27:13.078 INFO:teuthology.orchestra.run.smithi071.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 940 kB/s | 689 kB 00:00 2024-09-10T23:27:13.179 INFO:teuthology.orchestra.run.smithi071.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-10T23:27:13.204 INFO:teuthology.orchestra.run.smithi071.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 173 kB/s | 22 kB 00:00 2024-09-10T23:27:13.216 INFO:teuthology.orchestra.run.smithi016.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 20 MB/s | 50 MB 00:02 2024-09-10T23:27:13.233 INFO:teuthology.orchestra.run.smithi016.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 135 kB/s | 80 kB 00:00 2024-09-10T23:27:13.312 INFO:teuthology.orchestra.run.smithi071.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-10T23:27:13.387 INFO:teuthology.orchestra.run.smithi071.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-10T23:27:13.463 INFO:teuthology.orchestra.run.smithi071.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi071.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-10T23:27:13.558 INFO:teuthology.orchestra.run.smithi016.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 559 kB/s | 191 kB 00:00 2024-09-10T23:27:13.571 INFO:teuthology.orchestra.run.smithi071.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-10T23:27:13.583 INFO:teuthology.orchestra.run.smithi016.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 723 kB/s | 253 kB 00:00 2024-09-10T23:27:13.613 INFO:teuthology.orchestra.run.smithi071.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-10T23:27:13.680 INFO:teuthology.orchestra.run.smithi071.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-10T23:27:13.714 INFO:teuthology.orchestra.run.smithi071.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-10T23:27:13.717 INFO:teuthology.orchestra.run.smithi016.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 799 kB/s | 106 kB 00:00 2024-09-10T23:27:13.742 INFO:teuthology.orchestra.run.smithi016.stdout:(44/157): libgfortran-11.5.0-2.el9.x86_64.rpm 739 kB/s | 801 kB 00:01 2024-09-10T23:27:13.823 INFO:teuthology.orchestra.run.smithi071.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-10T23:27:13.859 INFO:teuthology.orchestra.run.smithi016.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-10T23:27:13.940 INFO:teuthology.orchestra.run.smithi071.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 2.5 MB/s | 581 kB 00:00 2024-09-10T23:27:13.956 INFO:teuthology.orchestra.run.smithi071.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 183 kB/s | 24 kB 00:00 2024-09-10T23:27:13.981 INFO:teuthology.orchestra.run.smithi071.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-10T23:27:13.984 INFO:teuthology.orchestra.run.smithi016.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-10T23:27:14.048 INFO:teuthology.orchestra.run.smithi071.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 439 kB/s | 47 kB 00:00 2024-09-10T23:27:14.051 INFO:teuthology.orchestra.run.smithi016.stdout:(47/157): python3-pycparser-2.20-6.el9.noarch.r 405 kB/s | 135 kB 00:00 2024-09-10T23:27:14.073 INFO:teuthology.orchestra.run.smithi071.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-09-10T23:27:14.098 INFO:teuthology.orchestra.run.smithi071.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-10T23:27:14.149 INFO:teuthology.orchestra.run.smithi071.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-10T23:27:14.152 INFO:teuthology.orchestra.run.smithi016.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-09-10T23:27:14.254 INFO:teuthology.orchestra.run.smithi016.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-10T23:27:14.304 INFO:teuthology.orchestra.run.smithi016.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-10T23:27:14.330 INFO:teuthology.orchestra.run.smithi016.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 602 kB/s | 107 kB 00:00 2024-09-10T23:27:14.363 INFO:teuthology.orchestra.run.smithi016.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-10T23:27:14.374 INFO:teuthology.orchestra.run.smithi071.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-09-10T23:27:14.405 INFO:teuthology.orchestra.run.smithi016.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-10T23:27:14.439 INFO:teuthology.orchestra.run.smithi016.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-10T23:27:14.464 INFO:teuthology.orchestra.run.smithi016.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-10T23:27:14.489 INFO:teuthology.orchestra.run.smithi016.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T23:27:14.548 INFO:teuthology.orchestra.run.smithi016.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T23:27:14.607 INFO:teuthology.orchestra.run.smithi016.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-10T23:27:14.623 INFO:teuthology.orchestra.run.smithi016.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-10T23:27:14.691 INFO:teuthology.orchestra.run.smithi016.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.1 MB/s | 3.0 MB 00:00 2024-09-10T23:27:14.724 INFO:teuthology.orchestra.run.smithi071.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-10T23:27:14.732 INFO:teuthology.orchestra.run.smithi016.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-10T23:27:14.783 INFO:teuthology.orchestra.run.smithi016.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-10T23:27:14.797 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:27:14.798 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:27:14.800 INFO:teuthology.orchestra.run.smithi016.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-10T23:27:14.812 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:27:14.813 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:27:14.814 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:27:14.815 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:27:14.816 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:27:14.819 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:27:14.821 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:27:14.842 INFO:teuthology.orchestra.run.smithi016.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T23:27:14.867 INFO:teuthology.orchestra.run.smithi016.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-10T23:27:14.887 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-10T23:27:14.900 INFO:teuthology.orchestra.run.smithi016.stdout:(66/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-10T23:27:14.904 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-10T23:27:14.904 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-10T23:27:14.904 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-10T23:27:14.904 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-10T23:27:14.904 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:27:14.904 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:27:14.904 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:27:14.905 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:27:14.906 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:27:14.907 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:27:14.908 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:27:14.909 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:27:14.910 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:27:14.911 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:27:14.912 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:27:14.913 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:27:14.914 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:27:14.915 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:27:14.916 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout:Install 149 Packages 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 8 Packages 2024-09-10T23:27:14.917 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:27:14.918 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 240 M 2024-09-10T23:27:14.918 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-10T23:27:14.926 INFO:teuthology.orchestra.run.smithi016.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-10T23:27:15.016 INFO:teuthology.orchestra.run.smithi071.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 471 kB/s | 137 kB 00:00 2024-09-10T23:27:15.118 INFO:teuthology.orchestra.run.smithi016.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-10T23:27:15.226 INFO:teuthology.orchestra.run.smithi016.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-10T23:27:15.285 INFO:teuthology.orchestra.run.smithi016.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-10T23:27:15.285 INFO:teuthology.orchestra.run.smithi066.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-10T23:27:15.310 INFO:teuthology.orchestra.run.smithi016.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-10T23:27:15.411 INFO:teuthology.orchestra.run.smithi016.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-10T23:27:15.469 INFO:teuthology.orchestra.run.smithi016.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T23:27:15.485 INFO:teuthology.orchestra.run.smithi066.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.4 MB/s | 900 kB 00:00 2024-09-10T23:27:15.561 INFO:teuthology.orchestra.run.smithi066.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.9 MB/s | 145 kB 00:00 2024-09-10T23:27:15.653 INFO:teuthology.orchestra.run.smithi066.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-10T23:27:15.761 INFO:teuthology.orchestra.run.smithi016.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-09-10T23:27:15.778 INFO:teuthology.orchestra.run.smithi066.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-10T23:27:15.783 INFO:teuthology.orchestra.run.smithi071.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.9 MB/s | 4.9 MB 00:01 2024-09-10T23:27:15.812 INFO:teuthology.orchestra.run.smithi066.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-10T23:27:15.816 INFO:teuthology.orchestra.run.smithi071.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 631 kB/s | 910 kB 00:01 2024-09-10T23:27:15.819 INFO:teuthology.orchestra.run.smithi016.stdout:(75/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-09-10T23:27:15.845 INFO:teuthology.orchestra.run.smithi016.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 734 kB/s | 61 kB 00:00 2024-09-10T23:27:15.920 INFO:teuthology.orchestra.run.smithi016.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-10T23:27:15.946 INFO:teuthology.orchestra.run.smithi016.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T23:27:15.979 INFO:teuthology.orchestra.run.smithi016.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-10T23:27:16.005 INFO:teuthology.orchestra.run.smithi016.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 305 kB/s | 26 kB 00:00 2024-09-10T23:27:16.017 INFO:teuthology.orchestra.run.smithi071.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-09-10T23:27:16.030 INFO:teuthology.orchestra.run.smithi016.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-10T23:27:16.055 INFO:teuthology.orchestra.run.smithi016.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-10T23:27:16.080 INFO:teuthology.orchestra.run.smithi016.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 459 kB/s | 35 kB 00:00 2024-09-10T23:27:16.083 INFO:teuthology.orchestra.run.smithi071.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-10T23:27:16.114 INFO:teuthology.orchestra.run.smithi016.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-10T23:27:16.139 INFO:teuthology.orchestra.run.smithi016.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T23:27:16.198 INFO:teuthology.orchestra.run.smithi016.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-10T23:27:16.200 INFO:teuthology.orchestra.run.smithi071.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-10T23:27:16.223 INFO:teuthology.orchestra.run.smithi016.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 708 kB/s | 77 kB 00:00 2024-09-10T23:27:16.237 INFO:teuthology.orchestra.run.smithi066.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 4.8 MB 00:00 2024-09-10T23:27:16.273 INFO:teuthology.orchestra.run.smithi016.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-10T23:27:16.299 INFO:teuthology.orchestra.run.smithi016.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-10T23:27:16.309 INFO:teuthology.orchestra.run.smithi071.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-10T23:27:16.332 INFO:teuthology.orchestra.run.smithi016.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-10T23:27:16.358 INFO:teuthology.orchestra.run.smithi016.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 868 kB/s | 51 kB 00:00 2024-09-10T23:27:16.425 INFO:teuthology.orchestra.run.smithi016.stdout:(92/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-10T23:27:16.426 INFO:teuthology.orchestra.run.smithi071.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-10T23:27:16.450 INFO:teuthology.orchestra.run.smithi016.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-09-10T23:27:16.454 INFO:teuthology.orchestra.run.smithi066.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 17 MB/s | 22 MB 00:01 2024-09-10T23:27:16.484 INFO:teuthology.orchestra.run.smithi016.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-09-10T23:27:16.496 INFO:teuthology.orchestra.run.smithi066.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 609 kB/s | 25 kB 00:00 2024-09-10T23:27:16.509 INFO:teuthology.orchestra.run.smithi016.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-10T23:27:16.543 INFO:teuthology.orchestra.run.smithi016.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T23:27:16.551 INFO:teuthology.orchestra.run.smithi071.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-10T23:27:16.568 INFO:teuthology.orchestra.run.smithi016.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-10T23:27:16.593 INFO:teuthology.orchestra.run.smithi016.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-10T23:27:16.627 INFO:teuthology.orchestra.run.smithi016.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T23:27:16.652 INFO:teuthology.orchestra.run.smithi016.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-09-10T23:27:16.668 INFO:teuthology.orchestra.run.smithi071.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 165 kB/s | 19 kB 00:00 2024-09-10T23:27:16.685 INFO:teuthology.orchestra.run.smithi016.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T23:27:16.711 INFO:teuthology.orchestra.run.smithi016.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T23:27:16.744 INFO:teuthology.orchestra.run.smithi016.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-09-10T23:27:16.785 INFO:teuthology.orchestra.run.smithi071.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T23:27:16.803 INFO:teuthology.orchestra.run.smithi016.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-10T23:27:16.862 INFO:teuthology.orchestra.run.smithi016.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T23:27:16.895 INFO:teuthology.orchestra.run.smithi016.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T23:27:16.896 INFO:teuthology.orchestra.run.smithi066.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 16 MB/s | 17 MB 00:01 2024-09-10T23:27:16.902 INFO:teuthology.orchestra.run.smithi071.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-10T23:27:16.920 INFO:teuthology.orchestra.run.smithi016.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-10T23:27:16.979 INFO:teuthology.orchestra.run.smithi016.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-10T23:27:17.021 INFO:teuthology.orchestra.run.smithi066.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 14 MB/s | 11 MB 00:00 2024-09-10T23:27:17.046 INFO:teuthology.orchestra.run.smithi016.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-09-10T23:27:17.047 INFO:teuthology.orchestra.run.smithi066.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.5 MB/s | 225 kB 00:00 2024-09-10T23:27:17.072 INFO:teuthology.orchestra.run.smithi066.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 539 kB/s | 27 kB 00:00 2024-09-10T23:27:17.080 INFO:teuthology.orchestra.run.smithi016.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T23:27:17.097 INFO:teuthology.orchestra.run.smithi066.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 633 kB/s | 32 kB 00:00 2024-09-10T23:27:17.105 INFO:teuthology.orchestra.run.smithi016.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T23:27:17.139 INFO:teuthology.orchestra.run.smithi066.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 11 MB/s | 755 kB 00:00 2024-09-10T23:27:17.139 INFO:teuthology.orchestra.run.smithi016.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T23:27:17.164 INFO:teuthology.orchestra.run.smithi066.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-10T23:27:17.169 INFO:teuthology.orchestra.run.smithi071.stdout:(82/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-10T23:27:17.190 INFO:teuthology.orchestra.run.smithi066.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:27:17.198 INFO:teuthology.orchestra.run.smithi016.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T23:27:17.223 INFO:teuthology.orchestra.run.smithi066.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-10T23:27:17.240 INFO:teuthology.orchestra.run.smithi016.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-10T23:27:17.265 INFO:teuthology.orchestra.run.smithi016.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T23:27:17.273 INFO:teuthology.orchestra.run.smithi066.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 903 kB/s | 45 kB 00:00 2024-09-10T23:27:17.282 INFO:teuthology.orchestra.run.smithi016.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T23:27:17.303 INFO:teuthology.orchestra.run.smithi071.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-10T23:27:17.315 INFO:teuthology.orchestra.run.smithi016.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-09-10T23:27:17.333 INFO:teuthology.orchestra.run.smithi016.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T23:27:17.358 INFO:teuthology.orchestra.run.smithi016.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-10T23:27:17.382 INFO:teuthology.orchestra.run.smithi066.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.3 MB/s | 143 kB 00:00 2024-09-10T23:27:17.383 INFO:teuthology.orchestra.run.smithi016.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T23:27:17.417 INFO:teuthology.orchestra.run.smithi016.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-10T23:27:17.436 INFO:teuthology.orchestra.run.smithi071.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-09-10T23:27:17.442 INFO:teuthology.orchestra.run.smithi016.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:27:17.461 INFO:teuthology.orchestra.run.smithi071.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-10T23:27:17.465 INFO:teuthology.orchestra.run.smithi066.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 20 MB/s | 5.5 MB 00:00 2024-09-10T23:27:17.475 INFO:teuthology.orchestra.run.smithi016.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T23:27:17.491 INFO:teuthology.orchestra.run.smithi066.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.5 MB/s | 161 kB 00:00 2024-09-10T23:27:17.501 INFO:teuthology.orchestra.run.smithi016.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-10T23:27:17.516 INFO:teuthology.orchestra.run.smithi066.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-10T23:27:17.526 INFO:teuthology.orchestra.run.smithi016.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-10T23:27:17.541 INFO:teuthology.orchestra.run.smithi066.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 6.0 MB/s | 306 kB 00:00 2024-09-10T23:27:17.545 INFO:teuthology.orchestra.run.smithi071.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 710 kB/s | 77 kB 00:00 2024-09-10T23:27:17.551 INFO:teuthology.orchestra.run.smithi016.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-10T23:27:17.566 INFO:teuthology.orchestra.run.smithi066.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T23:27:17.577 INFO:teuthology.orchestra.run.smithi016.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-10T23:27:17.592 INFO:teuthology.orchestra.run.smithi066.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T23:27:17.602 INFO:teuthology.orchestra.run.smithi016.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-10T23:27:17.637 INFO:teuthology.orchestra.run.smithi071.stdout:(87/157): postgresql-server-13.16-1.el9.x86_64. 2.2 MB/s | 5.8 MB 00:02 2024-09-10T23:27:17.651 INFO:teuthology.orchestra.run.smithi066.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-10T23:27:17.662 INFO:teuthology.orchestra.run.smithi071.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 211 kB/s | 42 kB 00:00 2024-09-10T23:27:17.687 INFO:teuthology.orchestra.run.smithi071.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-09-10T23:27:17.709 INFO:teuthology.orchestra.run.smithi066.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 22 MB/s | 3.2 MB 00:00 2024-09-10T23:27:17.734 INFO:teuthology.orchestra.run.smithi066.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 411 kB/s | 34 kB 00:00 2024-09-10T23:27:17.746 INFO:teuthology.orchestra.run.smithi071.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-10T23:27:17.760 INFO:teuthology.orchestra.run.smithi066.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-10T23:27:17.769 INFO:teuthology.orchestra.run.smithi016.stdout:(129/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-10T23:27:17.779 INFO:teuthology.orchestra.run.smithi071.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-10T23:27:17.805 INFO:teuthology.orchestra.run.smithi071.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-09-10T23:27:17.828 INFO:teuthology.orchestra.run.smithi016.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-09-10T23:27:17.853 INFO:teuthology.orchestra.run.smithi016.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 556 kB/s | 46 kB 00:00 2024-09-10T23:27:17.863 INFO:teuthology.orchestra.run.smithi071.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 457 kB/s | 54 kB 00:00 2024-09-10T23:27:17.878 INFO:teuthology.orchestra.run.smithi016.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-09-10T23:27:17.903 INFO:teuthology.orchestra.run.smithi016.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T23:27:17.922 INFO:teuthology.orchestra.run.smithi071.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-10T23:27:17.929 INFO:teuthology.orchestra.run.smithi016.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-10T23:27:17.954 INFO:teuthology.orchestra.run.smithi016.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T23:27:17.972 INFO:teuthology.orchestra.run.smithi071.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-10T23:27:17.988 INFO:teuthology.orchestra.run.smithi016.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-10T23:27:18.013 INFO:teuthology.orchestra.run.smithi016.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 479 kB/s | 28 kB 00:00 2024-09-10T23:27:18.039 INFO:teuthology.orchestra.run.smithi071.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-10T23:27:18.047 INFO:teuthology.orchestra.run.smithi016.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-09-10T23:27:18.081 INFO:teuthology.orchestra.run.smithi016.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-10T23:27:18.081 INFO:teuthology.orchestra.run.smithi071.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-10T23:27:18.093 INFO:teuthology.orchestra.run.smithi066.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 22 MB/s | 7.4 MB 00:00 2024-09-10T23:27:18.106 INFO:teuthology.orchestra.run.smithi016.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-10T23:27:18.131 INFO:teuthology.orchestra.run.smithi016.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T23:27:18.148 INFO:teuthology.orchestra.run.smithi071.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-10T23:27:18.165 INFO:teuthology.orchestra.run.smithi016.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-10T23:27:18.169 INFO:teuthology.orchestra.run.smithi066.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.8 MB/s | 291 kB 00:00 2024-09-10T23:27:18.190 INFO:teuthology.orchestra.run.smithi016.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-10T23:27:18.198 INFO:teuthology.orchestra.run.smithi071.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-10T23:27:18.215 INFO:teuthology.orchestra.run.smithi016.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:27:18.236 INFO:teuthology.orchestra.run.smithi066.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 737 kB/s | 49 kB 00:00 2024-09-10T23:27:18.241 INFO:teuthology.orchestra.run.smithi016.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T23:27:18.257 INFO:teuthology.orchestra.run.smithi071.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-10T23:27:18.266 INFO:teuthology.orchestra.run.smithi016.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T23:27:18.291 INFO:teuthology.orchestra.run.smithi016.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:27:18.303 INFO:teuthology.orchestra.run.smithi066.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 247 kB/s | 16 kB 00:00 2024-09-10T23:27:18.307 INFO:teuthology.orchestra.run.smithi071.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 882 kB/s | 96 kB 00:00 2024-09-10T23:27:18.316 INFO:teuthology.orchestra.run.smithi016.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T23:27:18.367 INFO:teuthology.orchestra.run.smithi016.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T23:27:18.370 INFO:teuthology.orchestra.run.smithi066.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-10T23:27:18.453 INFO:teuthology.orchestra.run.smithi066.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 9.2 MB/s | 783 kB 00:00 2024-09-10T23:27:18.466 INFO:teuthology.orchestra.run.smithi071.stdout:(102/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-10T23:27:18.491 INFO:teuthology.orchestra.run.smithi071.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 244 kB/s | 45 kB 00:00 2024-09-10T23:27:18.516 INFO:teuthology.orchestra.run.smithi071.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 64 kB 00:00 2024-09-10T23:27:18.520 INFO:teuthology.orchestra.run.smithi066.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 274 kB/s | 18 kB 00:00 2024-09-10T23:27:18.575 INFO:teuthology.orchestra.run.smithi071.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T23:27:18.600 INFO:teuthology.orchestra.run.smithi071.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-10T23:27:18.642 INFO:teuthology.orchestra.run.smithi071.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-10T23:27:18.659 INFO:teuthology.orchestra.run.smithi071.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-09-10T23:27:18.684 INFO:teuthology.orchestra.run.smithi071.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T23:27:18.709 INFO:teuthology.orchestra.run.smithi016.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 8.3 MB/s | 3.5 MB 00:00 2024-09-10T23:27:18.709 INFO:teuthology.orchestra.run.smithi071.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T23:27:18.743 INFO:teuthology.orchestra.run.smithi071.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-09-10T23:27:18.768 INFO:teuthology.orchestra.run.smithi071.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-10T23:27:18.787 INFO:teuthology.orchestra.run.smithi066.stdout:(38/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 13 MB/s | 14 MB 00:01 2024-09-10T23:27:18.827 INFO:teuthology.orchestra.run.smithi071.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-10T23:27:18.911 INFO:teuthology.orchestra.run.smithi071.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-10T23:27:18.936 INFO:teuthology.orchestra.run.smithi071.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-10T23:27:18.961 INFO:teuthology.orchestra.run.smithi071.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-10T23:27:18.986 INFO:teuthology.orchestra.run.smithi071.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 576 kB/s | 43 kB 00:00 2024-09-10T23:27:19.012 INFO:teuthology.orchestra.run.smithi071.stdout:(118/157): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2024-09-10T23:27:19.037 INFO:teuthology.orchestra.run.smithi071.stdout:(119/157): python3-certifi-2023.05.07-4.el9.noa 188 kB/s | 14 kB 00:00 2024-09-10T23:27:19.062 INFO:teuthology.orchestra.run.smithi071.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-10T23:27:19.096 INFO:teuthology.orchestra.run.smithi071.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T23:27:19.121 INFO:teuthology.orchestra.run.smithi071.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:27:19.146 INFO:teuthology.orchestra.run.smithi071.stdout:(123/157): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-10T23:27:19.159 INFO:teuthology.orchestra.run.smithi016.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 3.9 MB/s | 3.2 MB 00:00 2024-09-10T23:27:19.171 INFO:teuthology.orchestra.run.smithi071.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-10T23:27:19.197 INFO:teuthology.orchestra.run.smithi071.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-10T23:27:19.222 INFO:teuthology.orchestra.run.smithi071.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-10T23:27:19.229 INFO:teuthology.orchestra.run.smithi066.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 18 MB/s | 50 MB 00:02 2024-09-10T23:27:19.247 INFO:teuthology.orchestra.run.smithi071.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-10T23:27:19.272 INFO:teuthology.orchestra.run.smithi071.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi071.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T23:27:19.331 INFO:teuthology.orchestra.run.smithi071.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T23:27:19.357 INFO:teuthology.orchestra.run.smithi071.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:27:19.359 INFO:teuthology.orchestra.run.smithi016.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 204 kB/s | 41 kB 00:00 2024-09-10T23:27:19.390 INFO:teuthology.orchestra.run.smithi071.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-10T23:27:19.415 INFO:teuthology.orchestra.run.smithi071.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-09-10T23:27:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-10T23:27:19.466 INFO:teuthology.orchestra.run.smithi071.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T23:27:19.491 INFO:teuthology.orchestra.run.smithi071.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T23:27:19.516 INFO:teuthology.orchestra.run.smithi071.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-10T23:27:19.542 INFO:teuthology.orchestra.run.smithi071.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T23:27:19.567 INFO:teuthology.orchestra.run.smithi071.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T23:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 2.1 MB/s | 1.8 MB 00:00 2024-09-10T23:27:19.592 INFO:teuthology.orchestra.run.smithi071.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T23:27:19.610 INFO:teuthology.orchestra.run.smithi016.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 994 kB/s | 249 kB 00:00 2024-09-10T23:27:19.617 INFO:teuthology.orchestra.run.smithi071.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T23:27:19.643 INFO:teuthology.orchestra.run.smithi071.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T23:27:19.685 INFO:teuthology.orchestra.run.smithi071.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-10T23:27:19.704 INFO:teuthology.orchestra.run.smithi066.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 67 kB/s | 80 kB 00:01 2024-09-10T23:27:19.710 INFO:teuthology.orchestra.run.smithi071.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-10T23:27:19.736 INFO:teuthology.orchestra.run.smithi071.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-10T23:27:19.761 INFO:teuthology.orchestra.run.smithi071.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-09-10T23:27:19.786 INFO:teuthology.orchestra.run.smithi071.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:27:19.811 INFO:teuthology.orchestra.run.smithi071.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T23:27:19.870 INFO:teuthology.orchestra.run.smithi071.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T23:27:19.952 INFO:teuthology.orchestra.run.smithi016.stdout:(155/157): NetworkManager-1.49.90-1.el9.x86_64. 1.5 MB/s | 2.3 MB 00:01 2024-09-10T23:27:20.054 INFO:teuthology.orchestra.run.smithi071.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 3.5 MB 00:00 2024-09-10T23:27:20.113 INFO:teuthology.orchestra.run.smithi066.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 218 kB/s | 191 kB 00:00 2024-09-10T23:27:20.118 INFO:teuthology.orchestra.run.smithi016.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 1.4 MB 00:00 2024-09-10T23:27:20.129 INFO:teuthology.orchestra.run.smithi071.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-10T23:27:20.635 INFO:teuthology.orchestra.run.smithi016.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-10T23:27:20.642 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:27:20.642 INFO:teuthology.orchestra.run.smithi016.stdout:Total 19 MB/s | 240 MB 00:12 2024-09-10T23:27:20.646 INFO:teuthology.orchestra.run.smithi066.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 269 kB/s | 253 kB 00:00 2024-09-10T23:27:20.680 INFO:teuthology.orchestra.run.smithi066.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 423 kB/s | 801 kB 00:01 2024-09-10T23:27:20.704 INFO:teuthology.orchestra.run.smithi071.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 72 kB/s | 41 kB 00:00 2024-09-10T23:27:21.088 INFO:teuthology.orchestra.run.smithi071.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-10T23:27:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 147 kB/s | 106 kB 00:00 2024-09-10T23:27:21.397 INFO:teuthology.orchestra.run.smithi066.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 189 kB/s | 135 kB 00:00 2024-09-10T23:27:21.654 INFO:teuthology.orchestra.run.smithi071.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 262 kB/s | 249 kB 00:00 2024-09-10T23:27:21.873 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-09-10T23:27:22.044 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-09-10T23:27:22.045 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-09-10T23:27:22.131 INFO:teuthology.orchestra.run.smithi066.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 165 kB/s | 125 kB 00:00 2024-09-10T23:27:22.181 INFO:teuthology.orchestra.run.smithi066.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 607 kB/s | 1.2 MB 00:02 2024-09-10T23:27:22.206 INFO:teuthology.orchestra.run.smithi066.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 265 kB/s | 215 kB 00:00 2024-09-10T23:27:22.348 INFO:teuthology.orchestra.run.smithi066.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-10T23:27:22.373 INFO:teuthology.orchestra.run.smithi066.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-10T23:27:22.390 INFO:teuthology.orchestra.run.smithi066.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-10T23:27:22.424 INFO:teuthology.orchestra.run.smithi066.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-10T23:27:22.441 INFO:teuthology.orchestra.run.smithi066.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-10T23:27:22.466 INFO:teuthology.orchestra.run.smithi066.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-10T23:27:22.483 INFO:teuthology.orchestra.run.smithi066.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 433 kB/s | 18 kB 00:00 2024-09-10T23:27:22.500 INFO:teuthology.orchestra.run.smithi066.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-10T23:27:22.550 INFO:teuthology.orchestra.run.smithi066.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-10T23:27:22.575 INFO:teuthology.orchestra.run.smithi066.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-10T23:27:22.601 INFO:teuthology.orchestra.run.smithi066.stdout:(59/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-10T23:27:22.626 INFO:teuthology.orchestra.run.smithi066.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-10T23:27:22.660 INFO:teuthology.orchestra.run.smithi066.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-10T23:27:22.685 INFO:teuthology.orchestra.run.smithi066.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-10T23:27:22.710 INFO:teuthology.orchestra.run.smithi066.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-10T23:27:22.736 INFO:teuthology.orchestra.run.smithi066.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-10T23:27:22.761 INFO:teuthology.orchestra.run.smithi066.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 3.5 MB/s | 581 kB 00:00 2024-09-10T23:27:22.786 INFO:teuthology.orchestra.run.smithi066.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-10T23:27:22.811 INFO:teuthology.orchestra.run.smithi066.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T23:27:22.879 INFO:teuthology.orchestra.run.smithi066.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-10T23:27:22.970 INFO:teuthology.orchestra.run.smithi066.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-10T23:27:23.004 INFO:teuthology.orchestra.run.smithi066.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-10T23:27:23.029 INFO:teuthology.orchestra.run.smithi066.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T23:27:23.104 INFO:teuthology.orchestra.run.smithi066.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-10T23:27:23.146 INFO:teuthology.orchestra.run.smithi066.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-10T23:27:23.171 INFO:teuthology.orchestra.run.smithi066.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T23:27:23.204 INFO:teuthology.orchestra.run.smithi071.stdout:(155/157): NetworkManager-1.49.90-1.el9.x86_64. 712 kB/s | 2.3 MB 00:03 2024-09-10T23:27:23.213 INFO:teuthology.orchestra.run.smithi066.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T23:27:23.238 INFO:teuthology.orchestra.run.smithi071.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 645 kB/s | 1.4 MB 00:02 2024-09-10T23:27:23.289 INFO:teuthology.orchestra.run.smithi066.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-10T23:27:23.314 INFO:teuthology.orchestra.run.smithi066.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T23:27:23.339 INFO:teuthology.orchestra.run.smithi066.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-10T23:27:23.356 INFO:teuthology.orchestra.run.smithi066.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-10T23:27:23.431 INFO:teuthology.orchestra.run.smithi066.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-09-10T23:27:23.448 INFO:teuthology.orchestra.run.smithi066.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-10T23:27:23.474 INFO:teuthology.orchestra.run.smithi066.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T23:27:23.491 INFO:teuthology.orchestra.run.smithi066.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 591 kB/s | 35 kB 00:00 2024-09-10T23:27:23.524 INFO:teuthology.orchestra.run.smithi066.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-10T23:27:23.550 INFO:teuthology.orchestra.run.smithi066.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T23:27:23.575 INFO:teuthology.orchestra.run.smithi066.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T23:27:23.592 INFO:teuthology.orchestra.run.smithi066.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T23:27:23.625 INFO:teuthology.orchestra.run.smithi066.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-10T23:27:23.652 INFO:teuthology.orchestra.run.smithi066.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T23:27:23.676 INFO:teuthology.orchestra.run.smithi066.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T23:27:23.693 INFO:teuthology.orchestra.run.smithi066.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T23:27:23.709 INFO:teuthology.orchestra.run.smithi066.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-10T23:27:23.777 INFO:teuthology.orchestra.run.smithi066.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-10T23:27:23.793 INFO:teuthology.orchestra.run.smithi066.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-10T23:27:23.810 INFO:teuthology.orchestra.run.smithi066.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-10T23:27:23.846 INFO:teuthology.orchestra.run.smithi066.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.1 MB/s | 221 kB 00:00 2024-09-10T23:27:23.871 INFO:teuthology.orchestra.run.smithi066.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 590 kB/s | 36 kB 00:00 2024-09-10T23:27:23.897 INFO:teuthology.orchestra.run.smithi066.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-10T23:27:23.922 INFO:teuthology.orchestra.run.smithi066.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T23:27:23.947 INFO:teuthology.orchestra.run.smithi066.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T23:27:23.972 INFO:teuthology.orchestra.run.smithi066.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T23:27:23.997 INFO:teuthology.orchestra.run.smithi066.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-10T23:27:24.022 INFO:teuthology.orchestra.run.smithi066.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-10T23:27:24.139 INFO:teuthology.orchestra.run.smithi066.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-10T23:27:24.315 INFO:teuthology.orchestra.run.smithi066.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-10T23:27:24.356 INFO:teuthology.orchestra.run.smithi066.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-09-10T23:27:24.382 INFO:teuthology.orchestra.run.smithi066.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 841 kB/s | 19 kB 00:00 2024-09-10T23:27:24.423 INFO:teuthology.orchestra.run.smithi066.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-10T23:27:24.449 INFO:teuthology.orchestra.run.smithi066.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T23:27:24.455 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-09-10T23:27:24.456 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-09-10T23:27:24.483 INFO:teuthology.orchestra.run.smithi066.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-10T23:27:24.508 INFO:teuthology.orchestra.run.smithi066.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 828 kB/s | 49 kB 00:00 2024-09-10T23:27:24.550 INFO:teuthology.orchestra.run.smithi066.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T23:27:24.575 INFO:teuthology.orchestra.run.smithi066.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-10T23:27:24.633 INFO:teuthology.orchestra.run.smithi066.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-10T23:27:24.675 INFO:teuthology.orchestra.run.smithi066.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-10T23:27:24.692 INFO:teuthology.orchestra.run.smithi066.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-10T23:27:24.709 INFO:teuthology.orchestra.run.smithi066.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 963 kB/s | 32 kB 00:00 2024-09-10T23:27:24.726 INFO:teuthology.orchestra.run.smithi066.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 424 kB/s | 14 kB 00:00 2024-09-10T23:27:24.752 INFO:teuthology.orchestra.run.smithi066.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-10T23:27:24.785 INFO:teuthology.orchestra.run.smithi066.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T23:27:24.818 INFO:teuthology.orchestra.run.smithi066.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T23:27:24.844 INFO:teuthology.orchestra.run.smithi066.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:27:24.880 INFO:teuthology.orchestra.run.smithi066.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T23:27:24.894 INFO:teuthology.orchestra.run.smithi066.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 649 kB/s | 11 kB 00:00 2024-09-10T23:27:24.961 INFO:teuthology.orchestra.run.smithi066.stdout:(125/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-09-10T23:27:24.978 INFO:teuthology.orchestra.run.smithi066.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-09-10T23:27:24.995 INFO:teuthology.orchestra.run.smithi066.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2024-09-10T23:27:25.012 INFO:teuthology.orchestra.run.smithi066.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 584 kB/s | 19 kB 00:00 2024-09-10T23:27:25.029 INFO:teuthology.orchestra.run.smithi066.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 590 kB/s | 20 kB 00:00 2024-09-10T23:27:25.046 INFO:teuthology.orchestra.run.smithi066.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-10T23:27:25.071 INFO:teuthology.orchestra.run.smithi066.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:27:25.088 INFO:teuthology.orchestra.run.smithi066.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-10T23:27:25.122 INFO:teuthology.orchestra.run.smithi066.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-09-10T23:27:25.139 INFO:teuthology.orchestra.run.smithi066.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 988 kB/s | 16 kB 00:00 2024-09-10T23:27:25.173 INFO:teuthology.orchestra.run.smithi066.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T23:27:25.198 INFO:teuthology.orchestra.run.smithi066.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-10T23:27:25.223 INFO:teuthology.orchestra.run.smithi066.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-10T23:27:25.265 INFO:teuthology.orchestra.run.smithi066.stdout:(138/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-09-10T23:27:25.290 INFO:teuthology.orchestra.run.smithi066.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-09-10T23:27:25.315 INFO:teuthology.orchestra.run.smithi066.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-10T23:27:25.341 INFO:teuthology.orchestra.run.smithi066.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-10T23:27:25.366 INFO:teuthology.orchestra.run.smithi066.stdout:(142/157): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-09-10T23:27:25.391 INFO:teuthology.orchestra.run.smithi066.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-10T23:27:25.416 INFO:teuthology.orchestra.run.smithi066.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T23:27:25.437 INFO:teuthology.orchestra.run.smithi071.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 647 kB/s | 2.4 MB 00:03 2024-09-10T23:27:25.442 INFO:teuthology.orchestra.run.smithi066.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T23:27:25.444 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:27:25.445 INFO:teuthology.orchestra.run.smithi071.stdout:Total 12 MB/s | 240 MB 00:19 2024-09-10T23:27:25.467 INFO:teuthology.orchestra.run.smithi066.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T23:27:25.492 INFO:teuthology.orchestra.run.smithi066.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T23:27:25.517 INFO:teuthology.orchestra.run.smithi066.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T23:27:25.568 INFO:teuthology.orchestra.run.smithi066.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T23:27:25.776 INFO:teuthology.orchestra.run.smithi066.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 12 MB/s | 3.5 MB 00:00 2024-09-10T23:27:25.860 INFO:teuthology.orchestra.run.smithi066.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-10T23:27:26.435 INFO:teuthology.orchestra.run.smithi066.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 71 kB/s | 41 kB 00:00 2024-09-10T23:27:26.684 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T23:27:26.836 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T23:27:26.837 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T23:27:26.885 INFO:teuthology.orchestra.run.smithi066.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-09-10T23:27:26.944 INFO:teuthology.orchestra.run.smithi066.stdout:(154/157): NetworkManager-1.49.90-1.el9.x86_64. 1.7 MB/s | 2.3 MB 00:01 2024-09-10T23:27:27.244 INFO:teuthology.orchestra.run.smithi066.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 308 kB/s | 249 kB 00:00 2024-09-10T23:27:27.894 INFO:teuthology.orchestra.run.smithi066.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-10T23:27:28.011 INFO:teuthology.orchestra.run.smithi066.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-10T23:27:28.017 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:27:28.017 INFO:teuthology.orchestra.run.smithi066.stdout:Total 18 MB/s | 240 MB 00:13 2024-09-10T23:27:28.718 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T23:27:28.718 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T23:27:29.250 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-10T23:27:29.419 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-10T23:27:29.419 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-10T23:27:31.246 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-09-10T23:27:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:27:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:27:31.420 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-10T23:27:31.420 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-10T23:27:31.467 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:27:31.508 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:27:31.533 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:27:31.584 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:27:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:27:32.050 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:27:32.176 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:27:32.201 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:27:32.295 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:27:32.323 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:27:32.362 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:27:32.549 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:27:32.605 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:27:32.640 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:27:32.746 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:27:32.783 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:27:32.838 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:27:32.860 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:27:32.883 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:27:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:27:33.232 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:27:33.353 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:27:33.464 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:33.554 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:33.789 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:27:33.926 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:27:33.961 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:27:34.053 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:27:34.105 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:27:34.153 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:27:34.196 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:27:34.229 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:27:34.256 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:27:34.328 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:27:34.379 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:27:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:27:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:27:34.541 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:27:34.580 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:27:34.624 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:27:34.652 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:27:34.725 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:27:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:27:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:27:34.990 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:27:35.007 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T23:27:35.063 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:27:35.124 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:27:35.162 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:27:35.215 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:27:35.249 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:27:35.274 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:27:35.317 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:27:35.626 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:27:35.718 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:27:35.736 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:27:35.753 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:27:35.805 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:27:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:27:35.851 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:27:35.885 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:27:35.973 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:27:36.010 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:27:36.057 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:27:36.085 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:27:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:27:36.121 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:27:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:27:36.217 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:27:36.279 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:27:36.294 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:27:36.345 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:27:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:27:36.373 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:27:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:27:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:27:36.477 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:27:36.490 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:27:36.507 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:27:36.525 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:27:36.577 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:27:36.578 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:27:36.600 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:27:36.619 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:27:36.621 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:27:36.764 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:27:36.809 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:27:36.812 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:27:36.854 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:27:36.953 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:27:36.962 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:27:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:27:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:37.263 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:27:37.327 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:27:37.362 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:27:37.386 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:27:37.467 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:37.497 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:27:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:27:37.612 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:27:37.629 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:27:37.655 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:27:37.677 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:27:37.722 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:27:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:27:37.765 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:27:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:27:37.804 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:27:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:27:37.844 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:27:37.873 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:27:37.873 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:27:37.905 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:27:37.908 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:27:37.933 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:27:37.941 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:27:37.984 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:27:38.002 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:27:38.017 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:27:38.050 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-10T23:27:38.055 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:27:38.085 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:27:38.108 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:27:38.121 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:27:38.156 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:27:38.157 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:27:38.187 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:27:38.195 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:27:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:27:38.232 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:27:38.257 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:27:38.275 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:27:38.291 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:27:38.295 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:27:38.304 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:27:38.316 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:27:38.347 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:27:38.359 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:27:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:27:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:27:38.500 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:27:38.637 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:27:38.699 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:27:38.710 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:27:38.808 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:27:38.917 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:27:38.958 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:27:39.035 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:27:39.064 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:27:39.102 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:27:39.110 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:27:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:27:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:27:39.217 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:27:39.262 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:27:39.297 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:27:39.303 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:27:39.320 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:27:39.331 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:27:39.347 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:27:39.364 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:27:39.374 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:27:39.407 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:27:39.412 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:27:39.454 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:27:39.454 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:27:39.482 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:27:39.498 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:27:39.537 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:27:39.558 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:27:39.585 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:27:39.611 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:27:39.665 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:27:39.742 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:27:39.757 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:27:39.773 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:27:39.777 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:27:39.813 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:27:39.853 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:27:39.886 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:27:39.917 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:27:39.922 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:27:39.953 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:27:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:27:40.032 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:27:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:27:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:27:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:27:40.150 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:40.232 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:40.265 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:27:40.306 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:27:40.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:27:40.459 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:27:40.476 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:27:40.496 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:27:40.535 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:27:40.536 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:27:40.562 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:27:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:27:40.653 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:27:40.656 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:27:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:27:40.688 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:27:40.740 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:27:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:27:40.827 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:27:40.855 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:27:40.856 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:27:40.889 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:27:40.922 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:27:40.956 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:27:40.970 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:27:41.002 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:27:41.021 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:27:41.032 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:27:41.064 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:27:41.066 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:27:41.094 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:27:41.099 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:27:41.140 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:27:41.171 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:27:41.175 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:27:41.223 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:27:41.253 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:27:41.260 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:27:41.288 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:27:41.305 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:27:41.336 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:27:41.367 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:27:41.399 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:27:41.434 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:27:41.438 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:27:41.462 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:27:41.495 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:27:41.535 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:27:41.577 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:27:41.654 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:27:41.790 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:27:41.855 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:27:41.975 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:27:42.049 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:27:42.077 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:27:42.109 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:27:42.212 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:27:42.259 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:27:42.293 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:27:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:27:42.409 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:27:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:27:42.450 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:27:42.493 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:27:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:27:42.497 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:27:42.528 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:27:42.572 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:27:42.580 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:27:42.597 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:27:42.601 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:27:42.621 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:27:42.627 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:27:42.643 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:27:42.664 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:27:42.805 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:27:42.813 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:27:42.835 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:27:42.887 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:27:42.913 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:27:42.982 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:27:43.048 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:27:43.121 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:27:43.159 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:27:43.186 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:27:43.195 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:27:43.217 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:27:43.243 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:27:43.278 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:27:43.288 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:27:43.322 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:27:43.329 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:27:43.363 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:27:43.507 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:27:43.550 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:27:43.657 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:27:43.849 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:27:44.101 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:27:44.220 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:27:44.257 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:27:44.297 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:27:44.330 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:27:44.355 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:27:44.436 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:27:44.569 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:27:44.611 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:27:44.631 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:27:44.666 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:27:44.705 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:27:44.745 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:27:44.782 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:27:44.816 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:27:44.850 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:27:44.883 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:27:44.891 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:27:44.926 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:27:44.979 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:27:45.007 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:27:45.009 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:27:45.057 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:27:45.059 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:27:45.087 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:27:45.195 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:27:45.247 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:27:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:27:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:27:45.530 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:27:45.560 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:27:45.596 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:27:46.004 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:27:46.052 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:27:46.086 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:27:46.089 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:27:46.094 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:46.116 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:27:46.124 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:46.187 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:27:46.188 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:27:46.217 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:27:46.242 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:27:46.287 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:27:46.378 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:27:46.413 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:27:46.605 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:27:46.636 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:27:46.709 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:46.715 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:27:46.744 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:27:46.835 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:27:46.835 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:27:46.835 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:27:46.836 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:27:46.879 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:27:47.390 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:27:47.512 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:27:48.560 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:48.589 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:48.810 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:27:48.897 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:27:48.925 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:27:48.958 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:27:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:27:49.262 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:27:49.262 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:27:49.262 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:27:49.263 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:27:49.293 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:27:49.295 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:27:49.329 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:27:49.421 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:27:49.444 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:27:49.478 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:27:49.998 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:27:50.023 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:27:50.128 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:27:50.158 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:27:52.587 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:52.629 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:53.213 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:27:53.258 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:27:53.354 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:27:53.354 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:27:53.354 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:27:53.354 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:27:53.384 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:27:59.198 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:27:59.198 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2024-09-10T23:27:59.198 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2024-09-10T23:27:59.198 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2024-09-10T23:27:59.198 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2024-09-10T23:27:59.198 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2024-09-10T23:27:59.198 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /root 2024-09-10T23:27:59.199 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2024-09-10T23:27:59.199 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:27:59.386 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:27:59.403 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:27:59.404 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:27:59.404 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:27:59.404 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:00.981 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:28:01.009 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:28:01.009 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:01.009 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:28:01.009 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:28:01.009 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:28:01.009 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-10T23:28:01.260 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-10T23:28:01.261 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:28:01.273 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:01.273 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:28:01.273 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:28:01.273 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:28:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:01.435 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:28:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:28:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:28:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:28:01.765 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:28:01.766 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:01.766 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:28:01.766 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:28:01.766 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:28:01.766 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:01.872 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:28:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:28:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:28:02.195 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:28:02.243 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:28:02.324 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:28:02.429 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:28:02.572 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:28:02.614 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:28:02.650 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:28:02.677 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:28:02.963 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:28:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:28:02.990 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:02.990 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:28:02.990 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:28:02.990 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:28:02.990 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:03.130 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:28:03.168 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:28:03.201 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:28:03.214 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:28:03.237 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:28:03.237 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:03.237 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:28:03.237 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:28:03.237 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:28:03.238 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:03.271 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:28:03.299 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:28:03.681 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:28:03.704 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:28:03.705 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:03.705 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:28:03.705 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:28:03.705 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:28:03.705 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:03.810 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:28:03.859 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:28:03.914 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:28:04.100 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:28:04.148 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:28:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:28:04.306 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:28:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:28:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:28:04.521 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:28:04.549 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:28:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:28:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:28:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:28:05.105 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:28:05.129 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:28:05.546 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:28:05.546 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-09-10T23:28:05.546 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-09-10T23:28:05.546 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-09-10T23:28:05.546 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-09-10T23:28:05.547 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-09-10T23:28:05.547 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-09-10T23:28:05.547 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-09-10T23:28:05.547 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:05.729 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:28:05.746 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:28:05.746 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:05.746 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:28:05.746 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:06.671 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:28:06.739 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:28:07.299 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:28:07.327 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:28:07.327 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:07.327 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:28:07.327 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:28:07.327 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:28:07.328 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:07.566 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:28:07.591 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:28:07.591 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:07.591 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:28:07.591 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:28:07.591 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:28:07.591 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:07.754 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:28:07.781 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:28:07.901 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:28:08.059 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:28:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:28:08.083 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:28:08.083 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:08.083 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:28:08.084 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:28:08.084 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:28:08.084 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:28:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:28:08.134 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:08.134 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:28:08.134 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:28:08.134 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:28:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:08.184 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:28:08.189 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:28:08.196 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:28:08.247 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:28:08.296 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:28:08.309 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:28:08.311 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:28:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:28:08.362 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:28:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:28:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:28:08.631 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:28:08.720 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:28:08.871 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:28:08.918 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:28:08.958 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:28:08.985 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:28:09.323 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:28:09.334 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:28:09.351 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:28:09.351 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:28:09.365 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:28:09.383 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:28:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:28:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:28:09.420 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:09.420 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:28:09.420 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:28:09.420 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:28:09.420 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:09.451 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:28:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:28:09.464 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:28:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:28:09.487 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:09.487 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:28:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:09.490 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:28:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:28:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:28:09.563 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:09.563 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:28:09.563 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:28:09.563 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:28:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:28:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:28:09.686 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:28:09.686 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:09.686 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:28:09.686 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:28:09.686 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:28:09.686 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:09.737 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:28:09.749 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:28:09.839 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:28:09.885 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:28:09.897 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:28:09.922 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:28:09.922 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:09.922 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:28:09.922 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:28:09.922 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:28:09.923 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:28:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:28:10.897 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:28:10.897 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:10.897 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:28:10.898 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:28:10.898 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:28:10.898 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:10.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:28:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:28:10.963 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:10.963 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:28:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:11.007 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:28:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:28:11.030 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:11.030 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:28:11.031 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:28:11.031 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:28:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:28:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:28:11.365 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:11.365 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:28:11.365 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:28:11.365 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:28:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:28:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:28:13.919 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:28:13.955 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:28:14.076 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:28:14.241 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:28:14.265 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:28:14.291 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:28:14.291 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:14.291 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:28:14.291 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:28:14.291 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:28:14.291 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:28:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:28:14.446 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:28:14.499 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:28:14.928 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:28:14.977 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:28:15.019 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:28:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:28:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:28:15.283 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:28:15.333 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:28:15.363 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:28:15.393 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:28:15.439 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:28:15.502 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:28:15.535 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:28:15.560 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:28:15.560 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:15.560 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:28:15.560 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:28:15.560 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:28:15.560 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:15.602 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:28:15.626 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:28:15.626 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:15.627 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:28:15.627 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:15.678 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:28:15.703 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:28:15.703 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:15.703 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:28:15.703 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:28:15.703 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:28:15.703 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:16.028 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:28:16.053 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:28:16.053 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:28:16.053 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:28:16.054 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:28:16.054 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:28:16.054 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:28:16.054 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:16.094 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:28:16.104 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:16.143 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:28:16.145 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:16.166 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:16.175 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:28:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:28:16.385 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:28:16.424 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:28:16.455 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:28:16.484 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:28:16.530 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:28:17.077 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:28:17.091 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:17.148 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:28:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:28:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:28:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:28:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:28:17.413 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:28:17.414 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:28:17.506 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:28:17.506 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:28:17.598 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:28:17.623 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:28:17.629 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:17.629 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:28:17.901 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:28:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:17.981 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:28:18.065 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:28:18.106 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:28:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:28:18.227 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:28:18.252 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:28:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:28:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:28:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:28:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:28:18.446 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:28:18.471 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:28:18.476 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:18.476 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:18.656 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:18.656 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:28:18.723 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:28:18.787 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:21.007 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:28:21.049 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:28:21.090 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:28:21.121 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:28:21.149 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:28:21.346 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:28:21.395 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:28:21.425 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:28:21.455 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:28:21.493 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:28:22.100 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:22.140 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:22.161 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:28:23.056 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:28:23.161 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:28:23.203 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:28:23.295 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:28:23.331 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:28:23.356 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:28:23.382 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:28:23.382 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:28:23.466 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:28:23.466 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:28:23.575 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:28:23.591 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:28:23.596 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:23.597 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:23.793 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:28:23.793 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:28:23.886 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:28:23.952 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:28:24.181 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:28:24.182 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:28:24.183 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:28:24.197 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:28:24.197 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:28:24.197 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:28:24.198 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:28:24.199 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:28:24.200 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:28:24.201 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:28:24.202 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:28:24.203 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:28:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:28:24.205 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:28:24.206 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:28:24.207 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:28:24.207 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:28:24.207 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:28:24.207 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:28:24.207 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:28:24.207 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:28:24.208 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:28:24.208 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:28:24.208 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:28:24.208 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:28:24.208 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:28:24.208 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:28:24.208 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:28:24.209 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:28:24.209 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:28:24.209 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:28:24.209 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:28:24.209 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:28:24.209 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:28:24.209 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:28:24.210 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:28:24.210 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:28:24.210 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:28:24.210 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:28:24.210 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:28:24.210 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:28:24.210 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:28:24.211 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:28:24.211 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:28:24.211 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:28:25.423 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:25.423 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:28:25.423 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:28:25.423 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:28:25.424 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:28:25.425 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:28:25.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:28:25.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:28:25.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:28:25.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:28:25.439 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:28:25.440 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:28:25.441 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:28:25.442 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:28:25.443 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:28:25.444 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:28:25.445 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:28:25.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:28:25.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:28:25.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:28:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:28:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:28:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:28:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:28:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:28:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:28:27.270 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-09-10T23:28:27.846 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:27.961 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:28:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:28:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:28:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:28:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:28:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:28:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:28:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:28:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:28:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:28:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:28:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:28:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:28:27.974 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T23:28:28.384 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:30.146 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:28:30.147 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:28:30.148 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:28:30.149 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:28:30.164 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:28:30.164 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:28:30.164 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:28:30.164 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:28:30.164 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:28:30.164 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:28:30.165 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:28:30.166 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:28:30.167 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:28:30.168 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:28:30.169 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:28:30.170 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:28:30.171 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:28:30.172 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:28:30.173 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:28:30.174 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:28:30.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:28:30.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:28:30.175 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.427 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.428 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.429 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:28:32.430 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:28:32.431 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:28:32.432 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:28:32.433 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:28:32.434 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:28:32.435 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:28:32.436 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:28:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:28:32.438 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:28:32.439 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:28:32.440 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:28:32.440 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:28:32.440 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-10T23:28:32.808 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:32.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:28:32.961 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:28:32.989 INFO:teuthology.orchestra.run.smithi016.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:28:32.990 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:28:32.990 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:28:32.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:28:33.143 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:28:33.167 INFO:teuthology.orchestra.run.smithi066.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:28:33.167 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:28:33.167 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:28:33.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:28:33.321 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:28:33.348 INFO:teuthology.orchestra.run.smithi071.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:28:33.348 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:28:33.348 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:28:33.350 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:28:33.350 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:28:33.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:28:33.383 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:28:33.383 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:28:33.415 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:28:33.415 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:28:33.447 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:28:33.447 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:28:33.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:28:33.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:28:33.547 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:28:33.547 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:28:33.576 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:28:33.646 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:28:33.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:28:33.676 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:28:33.745 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:28:33.745 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:28:33.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:28:33.773 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:28:33.839 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:28:33.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:28:33.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:28:33.938 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:28:33.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:28:33.968 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:28:34.039 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:28:34.039 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:28:34.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:28:34.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:28:34.131 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:28:34.131 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:28:34.160 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:28:34.230 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:28:34.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:28:34.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:28:34.328 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T23:28:34.430 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-10T23:28:34.430 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:28:34.430 INFO:tasks.cephadm:Cluster fsid is 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:28:34.431 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T23:28:34.431 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.16', 'mon.b': '172.21.15.66', 'mon.c': '172.21.15.71'} 2024-09-10T23:28:34.431 INFO:tasks.cephadm:First mon is mon.a on smithi016 2024-09-10T23:28:34.431 INFO:tasks.cephadm:First mgr is x 2024-09-10T23:28:34.431 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T23:28:34.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname $(hostname -s) 2024-09-10T23:28:34.458 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname $(hostname -s) 2024-09-10T23:28:34.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-09-10T23:28:34.518 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T23:28:34.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:28:34.671 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T23:28:34.817 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:28:34.818 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:28:34.818 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:28:34.819 DEBUG:teuthology.orchestra.run.smithi016:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:35.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:28 /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:35.191 DEBUG:teuthology.orchestra.run.smithi066:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:35.583 INFO:teuthology.orchestra.run.smithi066.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:28 /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:35.583 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:35.966 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:28 /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:35.967 DEBUG:teuthology.orchestra.run.smithi016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:35.987 DEBUG:teuthology.orchestra.run.smithi066:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:36.008 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:28:36.044 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T23:28:36.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:28:36.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:28:36.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:28:37.639 INFO:teuthology.orchestra.run.smithi066.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:28:37.661 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:28:37.729 INFO:teuthology.orchestra.run.smithi016.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:29:09.849 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T23:29:09.849 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:29:09.849 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:29:09.849 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-09-10T23:29:09.849 INFO:teuthology.orchestra.run.smithi071.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:29:09.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-10T23:29:09.849 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T23:29:32.151 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-10T23:29:32.151 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:29:32.152 INFO:teuthology.orchestra.run.smithi066.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:29:32.152 INFO:teuthology.orchestra.run.smithi066.stdout: "repo_digests": [ 2024-09-10T23:29:32.152 INFO:teuthology.orchestra.run.smithi066.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:29:32.152 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-10T23:29:32.152 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-10T23:29:32.415 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:29:32.415 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:29:32.416 INFO:teuthology.orchestra.run.smithi016.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:29:32.416 INFO:teuthology.orchestra.run.smithi016.stdout: "repo_digests": [ 2024-09-10T23:29:32.416 INFO:teuthology.orchestra.run.smithi016.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:29:32.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:29:32.416 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:29:32.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph 2024-09-10T23:29:32.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph 2024-09-10T23:29:32.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-09-10T23:29:32.542 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /etc/ceph 2024-09-10T23:29:32.567 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /etc/ceph 2024-09-10T23:29:32.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-09-10T23:29:32.623 INFO:tasks.cephadm:Writing seed config... 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T23:29:32.624 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T23:29:32.625 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T23:29:32.626 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T23:29:32.626 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T23:29:32.626 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T23:29:32.626 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T23:29:32.626 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:29:32.627 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T23:29:32.642 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 65d5fa74-6fcc-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-10T23:29:32.643 DEBUG:teuthology.orchestra.run.smithi016:mon.a> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T23:29:32.685 DEBUG:teuthology.orchestra.run.smithi016:mgr.x> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T23:29:32.728 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T23:29:32.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.16 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:29:32.939 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:29:32.939 INFO:teuthology.orchestra.run.smithi016.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.16', '--skip-admin-label'] 2024-09-10T23:29:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T23:29:32.940 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying podman|docker is present... 2024-09-10T23:29:32.963 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:29:32.963 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying lvm2 is present... 2024-09-10T23:29:32.963 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying time synchronization is in place... 2024-09-10T23:29:32.971 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:29:32.971 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:29:32.978 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:29:32.978 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-10T23:29:32.985 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout enabled 2024-09-10T23:29:32.991 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout active 2024-09-10T23:29:32.991 INFO:teuthology.orchestra.run.smithi016.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:29:32.991 INFO:teuthology.orchestra.run.smithi016.stdout:Repeating the final host check... 2024-09-10T23:29:33.015 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:29:33.015 INFO:teuthology.orchestra.run.smithi016.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T23:29:33.015 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl is present 2024-09-10T23:29:33.015 INFO:teuthology.orchestra.run.smithi016.stdout:lvcreate is present 2024-09-10T23:29:33.022 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:29:33.022 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:29:33.028 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:29:33.028 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-10T23:29:33.035 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout enabled 2024-09-10T23:29:33.041 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout active 2024-09-10T23:29:33.042 INFO:teuthology.orchestra.run.smithi016.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:29:33.042 INFO:teuthology.orchestra.run.smithi016.stdout:Host looks OK 2024-09-10T23:29:33.042 INFO:teuthology.orchestra.run.smithi016.stdout:Cluster fsid: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:33.042 INFO:teuthology.orchestra.run.smithi016.stdout:Acquiring lock 140680086479728 on /run/cephadm/65d5fa74-6fcc-11ef-bcea-c7b262605968.lock 2024-09-10T23:29:33.042 INFO:teuthology.orchestra.run.smithi016.stdout:Lock 140680086479728 acquired on /run/cephadm/65d5fa74-6fcc-11ef-bcea-c7b262605968.lock 2024-09-10T23:29:33.043 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying IP 172.21.15.16 port 3300 ... 2024-09-10T23:29:33.043 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying IP 172.21.15.16 port 6789 ... 2024-09-10T23:29:33.043 INFO:teuthology.orchestra.run.smithi016.stdout:Base mon IP(s) is [172.21.15.16:3300, 172.21.15.16:6789], mon addrv is [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-09-10T23:29:33.046 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.16 metric 100 2024-09-10T23:29:33.046 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.16 metric 100 2024-09-10T23:29:33.049 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T23:29:33.049 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T23:29:33.049 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1785sec hoplimit 64 pref medium 2024-09-10T23:29:33.051 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T23:29:33.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T23:29:33.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:29:33.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T23:29:33.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-09-10T23:29:33.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:29:33.053 INFO:teuthology.orchestra.run.smithi016.stdout:Mon IP `172.21.15.16` is in CIDR network `172.21.0.0/20` 2024-09-10T23:29:33.053 INFO:teuthology.orchestra.run.smithi016.stdout:Mon IP `172.21.15.16` is in CIDR network `172.21.0.0/20` 2024-09-10T23:29:33.053 INFO:teuthology.orchestra.run.smithi016.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T23:29:33.053 INFO:teuthology.orchestra.run.smithi016.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T23:29:33.053 INFO:teuthology.orchestra.run.smithi016.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:29:33.535 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:29:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:29:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T23:29:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T23:29:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T23:29:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:29:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T23:29:34.449 INFO:teuthology.orchestra.run.smithi016.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:29:34.449 INFO:teuthology.orchestra.run.smithi016.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:29:34.449 INFO:teuthology.orchestra.run.smithi016.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T23:29:35.514 INFO:teuthology.orchestra.run.smithi016.stdout:stat: stdout 167 167 2024-09-10T23:29:35.514 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial keys... 2024-09-10T23:29:36.402 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQBf1uBmi599MBAAetn8f2uiiNi4OzsvX9RlKw== 2024-09-10T23:29:37.299 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQBg1uBmD0juKhAAS6m/6aHRamuzZKPaWzJbNg== 2024-09-10T23:29:38.215 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQBh1uBmDVGWJhAACBLpEANfLkuALHRI8mopLA== 2024-09-10T23:29:38.216 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial monmap... 2024-09-10T23:29:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:29:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T23:29:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:29:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool for a [v2:172.21.15.16:3300,v1:172.21.15.16:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:29:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-09-10T23:29:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: set fsid to 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:39.171 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:29:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:29:39.171 INFO:teuthology.orchestra.run.smithi016.stdout:Creating mon... 2024-09-10T23:29:40.092 INFO:teuthology.orchestra.run.smithi016.stdout:create mon.a on 2024-09-10T23:29:40.307 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T23:29:40.486 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T23:29:40.695 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968.target. 2024-09-10T23:29:40.695 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968.target. 2024-09-10T23:29:40.957 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:29:40.958 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T23:29:41.135 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968.target.wants/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@.service. 2024-09-10T23:29:41.643 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:29:41.643 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-10T23:29:41.651 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:29:41.651 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-10T23:29:41.651 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-10T23:29:41.651 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:29:41.651 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mon to start... 2024-09-10T23:29:41.652 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mon... 2024-09-10T23:29:41.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:41 smithi016 systemd[1]: Started Ceph mon.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: monmap epoch 1 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: last_changed 2024-09-10T23:29:38.537183+0000 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: created 2024-09-10T23:29:38.537183+0000 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: min_mon_release 19 (squid) 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: election_strategy: 1 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: fsmap 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:29:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: mgrmap e1: no daemons active 2024-09-10T23:29:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:42 smithi016 ceph-mon[30488]: from='client.? 172.21.15.16:0/1115674844' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T23:29:46.351 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T23:29:46.351 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout id: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:46.351 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T23:29:46.351 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:29:46.351 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout services: 2024-09-10T23:29:46.351 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.53912s) 2024-09-10T23:29:46.351 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout data: 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:mon is available 2024-09-10T23:29:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T23:29:49.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:49 smithi016 ceph-mon[30488]: from='client.? 172.21.15.16:0/1442061772' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:29:49.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:49 smithi016 ceph-mon[30488]: from='client.? 172.21.15.16:0/1442061772' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T23:29:55.047 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:29:55.047 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:29:55.047 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout fsid = 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:29:55.048 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:29:55.049 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:29:55.049 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:29:55.049 INFO:teuthology.orchestra.run.smithi016.stdout:Generating new minimal ceph.conf... 2024-09-10T23:29:55.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:55 smithi016 ceph-mon[30488]: from='client.? 172.21.15.16:0/1227222737' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:29:56.027 INFO:teuthology.orchestra.run.smithi016.stdout:Restarting the monitor... 2024-09-10T23:29:56.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:56 smithi016 systemd[1]: Stopping Ceph mon.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:29:56.710 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a[30484]: 2024-09-10T23:29:56.317+0000 7fd4cfd26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:29:56.710 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a[30484]: 2024-09-10T23:29:56.317+0000 7fd4cfd26640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T23:29:56.710 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:56 smithi016 podman[30731]: 2024-09-10 23:29:56.492640905 +0000 UTC m=+0.294349907 container died 6ac23c972debc5e459e4abb7a458cef83914bbbb8119002a207c55a6b0435ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:29:56.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:56 smithi016 podman[30731]: 2024-09-10 23:29:56.793321151 +0000 UTC m=+0.595030224 container cleanup 6ac23c972debc5e459e4abb7a458cef83914bbbb8119002a207c55a6b0435ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:29:56.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:56 smithi016 bash[30731]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:29:57.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 podman[30743]: 2024-09-10 23:29:57.019293602 +0000 UTC m=+0.522453668 container remove 6ac23c972debc5e459e4abb7a458cef83914bbbb8119002a207c55a6b0435ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:29:57.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 systemd[1]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T23:29:57.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 systemd[1]: Stopped Ceph mon.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:29:57.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 systemd[1]: Starting Ceph mon.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:29:57.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 podman[30836]: 2024-09-10 23:29:57.27183466 +0000 UTC m=+0.017078434 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:29:57.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 podman[30836]: 2024-09-10 23:29:57.369828174 +0000 UTC m=+0.115071935 container create 3e2df7a6de6013abc5dd495cadb142345433d4d8a6c8cb482aa87e7391cd1bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T23:29:57.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 podman[30836]: 2024-09-10 23:29:57.597526656 +0000 UTC m=+0.342770425 container init 3e2df7a6de6013abc5dd495cadb142345433d4d8a6c8cb482aa87e7391cd1bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T23:29:57.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 podman[30836]: 2024-09-10 23:29:57.600785804 +0000 UTC m=+0.346029568 container start 3e2df7a6de6013abc5dd495cadb142345433d4d8a6c8cb482aa87e7391cd1bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T23:29:57.685 INFO:teuthology.orchestra.run.smithi016.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: pidfile_write: ignore empty --pid-file 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: load: jerasure load: lrc 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Git sha 0 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: DB SUMMARY 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: DB Session ID: JLA9X25BPLSAK44ARRE2 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:29:57.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95684 ; 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.env: 0x563bf05e9180 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:29:57.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.info_log: 0x563bf13f7700 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.statistics: (nil) 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.use_fsync: 0 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:29:57.887 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.db_log_dir: 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.wal_dir: 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:29:57.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.write_buffer_manager: 0x563bf13fbb80 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.unordered_write: 0 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:29:57.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.row_cache: None 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.wal_filter: None 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.wal_compression: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:29:57.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:29:57.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:29:57.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:29:57.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:29:57.892 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_open_files: -1 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Compression algorithms supported: 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kZSTD supported: 0 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:29:57.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:29:57.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.merge_operator: 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_filter: None 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563bf13f7320) 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_type: 0 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_index_type: 0 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_shortening: 1 2024-09-10T23:29:57.895 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: checksum: 4 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: no_block_cache: 0 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache: 0x563bf13eb610 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_options: 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: capacity : 536870912 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: num_shard_bits : 4 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: strict_capacity_limit : 0 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_compressed: (nil) 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: persistent_cache: (nil) 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size: 4096 2024-09-10T23:29:57.896 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size_deviation: 10 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_restart_interval: 16 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_block_restart_interval: 1 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: metadata_block_size: 4096 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: partition_filters: 0 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: use_delta_encoding: 1 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: filter_policy: bloomfilter 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: whole_key_filtering: 1 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: verify_compression: 0 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: format_version: 5 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_index_compression: 1 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_align: 0 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: max_auto_readahead_size: 262144 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: prepopulate_block_cache: 0 2024-09-10T23:29:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression: NoCompression 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.num_levels: 7 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:29:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:29:57.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:29:57.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:29:57.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:29:57.902 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.ttl: 2592000 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:29:57.903 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: afbbbe73-6ed5-4801-9620-98fe8f1a6b2c 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010997627796, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010997628731, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91820, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 287, "table_properties": {"data_size": 89861, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11819, "raw_average_key_size": 48, "raw_value_size": 83182, "raw_average_value_size": 338, "num_data_blocks": 12, "num_entries": 246, "num_filter_entries": 246, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726010997, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "afbbbe73-6ed5-4801-9620-98fe8f1a6b2c", "db_session_id": "JLA9X25BPLSAK44ARRE2", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726010997628813, "job": 1, "event": "recovery_finished"} 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T23:29:57.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563bf141ae00 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: DB pointer 0x563bf151c000 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** DB Stats ** 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:29:57.905 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: L0 2/0 91.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: Sum 2/0 91.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:29:57.906 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative compaction: 0.00 GB write, 28.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval compaction: 0.00 GB write, 28.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: Block cache BinnedLRUCache@0x563bf13eb610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: starting mon.a rank 0 at public addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] at bind addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:57.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???) e1 preinit fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???).mds e1 new map 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???).mds e1 print_map 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout: e1 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout: btime 2024-09-10T23:29:41:593538+0000 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout: legacy client fscid: -1 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout: No filesystems configured 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:29:57.908 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 bash[30836]: 3e2df7a6de6013abc5dd495cadb142345433d4d8a6c8cb482aa87e7391cd1bfa 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 systemd[1]: Started Ceph mon.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: monmap epoch 1 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: last_changed 2024-09-10T23:29:38.537183+0000 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: created 2024-09-10T23:29:38.537183+0000 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: min_mon_release 19 (squid) 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: election_strategy: 1 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: fsmap 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:29:57.909 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:57 smithi016 ceph-mon[30855]: mgrmap e1: no daemons active 2024-09-10T23:29:58.690 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T23:29:58.711 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:29:58.712 INFO:teuthology.orchestra.run.smithi016.stdout:Creating mgr... 2024-09-10T23:29:58.712 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T23:29:58.713 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T23:29:58.987 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:29:58.988 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T23:29:59.146 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968.target.wants/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@.service. 2024-09-10T23:29:59.356 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:29:59 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4095500709' entity='client.admin' 2024-09-10T23:29:59.356 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:29:59 smithi016 systemd[1]: Starting Ceph mgr.x for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:29:59.675 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:29:59 smithi016 podman[31069]: 2024-09-10 23:29:59.35588801 +0000 UTC m=+0.084350823 container create 73263e313d13751c2eb70955d752629b9288948f8d05d198aec0d5f4af2c19c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T23:29:59.675 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:29:59 smithi016 podman[31069]: 2024-09-10 23:29:59.287598719 +0000 UTC m=+0.016061501 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:29:59.675 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:29:59 smithi016 podman[31069]: 2024-09-10 23:29:59.591505935 +0000 UTC m=+0.319968709 container init 73263e313d13751c2eb70955d752629b9288948f8d05d198aec0d5f4af2c19c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T23:29:59.675 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:29:59 smithi016 podman[31069]: 2024-09-10 23:29:59.594503347 +0000 UTC m=+0.322966117 container start 73263e313d13751c2eb70955d752629b9288948f8d05d198aec0d5f4af2c19c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T23:29:59.675 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:29:59 smithi016 bash[31069]: 73263e313d13751c2eb70955d752629b9288948f8d05d198aec0d5f4af2c19c4 2024-09-10T23:29:59.689 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:29:59.689 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-10T23:29:59.697 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:29:59.697 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-10T23:29:59.697 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-10T23:29:59.697 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:29:59.706 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:29:59.706 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-10T23:29:59.714 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:29:59.714 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-10T23:29:59.714 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-10T23:29:59.714 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T23:29:59.714 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr to start... 2024-09-10T23:29:59.714 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr... 2024-09-10T23:29:59.935 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:29:59 smithi016 systemd[1]: Started Ceph mgr.x for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:30:00.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:00 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2161354643' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:30:02.039 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:30:02.040 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:30:02.040 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:30:02.040 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:30:02.040 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:30:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:29:41:593538+0000", 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:30:02.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:29:41.594346+0000", 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:30:02.045 INFO:teuthology.orchestra.run.smithi016.stdout:mgr not available, waiting (1/15)... 2024-09-10T23:30:04.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:04 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/786613279' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:30:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:30:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:30:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:30:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:30:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:30:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:30:05.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:05.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:30:05.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:29:41:593538+0000", 2024-09-10T23:30:05.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:05.281 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:29:41.594346+0000", 2024-09-10T23:30:05.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:30:05.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:05.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:30:05.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:30:05.282 INFO:teuthology.orchestra.run.smithi016.stdout:mgr not available, waiting (2/15)... 2024-09-10T23:30:05.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: Activating manager daemon x 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: mgrmap e2: x(active, starting, since 0.0037393s) 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: Manager daemon x is now available 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:30:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' 2024-09-10T23:30:05.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:05 smithi016 ceph-mon[30855]: from='mgr.14100 172.21.15.16:0/3158355009' entity='mgr.x' 2024-09-10T23:30:07.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:06 smithi016 ceph-mon[30855]: mgrmap e3: x(active, since 1.0077s) 2024-09-10T23:30:07.942 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:07 smithi016 ceph-mon[30855]: mgrmap e4: x(active, since 2s) 2024-09-10T23:30:08.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:30:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:30:08.540 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:30:08.541 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:30:08.541 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:30:08.544 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:08.544 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:29:41:593538+0000", 2024-09-10T23:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:30:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:30:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:29:41.594346+0000", 2024-09-10T23:30:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:30:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:30:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:30:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:30:08.547 INFO:teuthology.orchestra.run.smithi016.stdout:mgr is available 2024-09-10T23:30:09.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:08 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/366624045' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:30:09.677 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:30:09.677 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:30:09.677 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout fsid = 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:30:09.677 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:30:09.678 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:30:09.679 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:30:09.679 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:30:09.679 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling cephadm module... 2024-09-10T23:30:09.959 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1445785764' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:30:11.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:10 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/947217620' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T23:30:11.235 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:10 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ignoring --setuser ceph since I am not root 2024-09-10T23:30:11.235 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:10 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ignoring --setgroup ceph since I am not root 2024-09-10T23:30:12.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:11 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/947217620' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T23:30:12.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:11 smithi016 ceph-mon[30855]: mgrmap e5: x(active, since 6s) 2024-09-10T23:30:12.655 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:30:12.655 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T23:30:12.655 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:30:12.655 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:30:12.656 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:30:12.656 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:30:12.656 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for the mgr to restart... 2024-09-10T23:30:12.656 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr epoch 5... 2024-09-10T23:30:13.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:12 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1005885571' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:30:16.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: Active manager daemon x restarted 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: Activating manager daemon x 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: mgrmap e6: x(active, starting, since 0.0038708s) 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:30:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:16 smithi016 ceph-mon[30855]: Manager daemon x is now available 2024-09-10T23:30:17.743 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:30:17.743 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T23:30:17.744 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:30:17.744 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:30:17.744 INFO:teuthology.orchestra.run.smithi016.stdout:mgr epoch 5 is available 2024-09-10T23:30:17.744 INFO:teuthology.orchestra.run.smithi016.stdout:Setting orchestrator backend to cephadm... 2024-09-10T23:30:18.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: mgrmap e7: x(active, since 1.00508s) 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: Found migration_current of "None". Setting to last migration. 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:30:18.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:18 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:30:19.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-mon[30855]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:19.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:19.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:19.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-mon[30855]: mgrmap e8: x(active, since 2s) 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:30:19.799+0000 7f624fe28640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:30:19] ENGINE Error in HTTPServer.serve 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: Traceback (most recent call last): 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._connections.run(self.expiration_interval) 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._run(expiration_interval) 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:30:19.871 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: s = self.context.wrap_socket( 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: return self.sslsocket_class._create( 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self.do_handshake() 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._sslobj.do_handshake() 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:30:19.872 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:30:20.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T23:30:20.149 INFO:teuthology.orchestra.run.smithi016.stdout:Generating ssh key... 2024-09-10T23:30:20.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-mon[30855]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:19] ENGINE Bus STARTING 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:19] ENGINE Serving on http://172.21.15.16:8765 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:19] ENGINE Serving on https://172.21.15.16:7150 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:19] ENGINE Bus STARTED 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:19] ENGINE Error in HTTPServer.serve 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._run(expiration_interval) 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:30:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: s = self.context.wrap_socket( 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.sslsocket_class._create( 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: self.do_handshake() 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._sslobj.do_handshake() 2024-09-10T23:30:20.736 INFO:journalctl@ceph.mon.a.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:30:21.218 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: Generating public/private rsa key pair. 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: Your identification has been saved in /tmp/tmpse30qqmj/key 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: Your public key has been saved in /tmp/tmpse30qqmj/key.pub 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: The key fingerprint is: 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: SHA256:iwVRkmcjsQuAIy3FJis3qw55nowcmHU5En2lAQn2tNs ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: The key's randomart image is: 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: +---[RSA 3072]----+ 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: | ==.oo=+o | 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |*.+=..oB+ | 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |.*. = =+ . | 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |o o. * o | 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |..oo= E S | 2024-09-10T23:30:21.219 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |.+.o . o . | 2024-09-10T23:30:21.220 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |=o. . . | 2024-09-10T23:30:21.220 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |+=.. | 2024-09-10T23:30:21.220 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: |oo+ | 2024-09-10T23:30:21.220 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: +----[SHA256]-----+ 2024-09-10T23:30:22.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:21 smithi016 ceph-mon[30855]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:22.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:21 smithi016 ceph-mon[30855]: Generating ssh key... 2024-09-10T23:30:22.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:21 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:22.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:21 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:22.660 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKMvU7sfw7cOlEugP0iEgnUe838p84lH5PCOair7wAmYbYcKDwhXjgFZDQK/IpIau3EL/4YbcW61BOjYxTqb1lSO2wvsIDv7UCocAmvK1BqQrOrHSsvpR7uNXDgH9GoPW/LIEJDWpfm8SnA1iGBB3eKfRfi8CHmv5JPubw384w5t+QdSUkF6E6XE9L1mubGg3gFxFlwVNp+k6qBNT4qNfpCgRQ+oWP5wFvzdOaXBcDne91L1Q71fAGdPUo+i5ZAxsJ0e7dGRko7YPp/N+FqxxAN/A2RwvNW7eULZO8o9FiQr6j7EPLzYOcg7sy3GaBfc6sfztamgF2T3jfiGkUHlYWCAYQK/Q/kkOQdjcZxfu+Zd3aX0o7HAjTtZdVT41Y/AK2rZu64PZAZwxi5yLZYxFO6fJ9ee7Ye/th5RrRmHI63aOUa4GzrDWM1agdDVzK+q9fDzC5XClmz8xhqn4lEhoo7cEbzy6PnwtAza7X0cJumPkHO3l42P/3Y/4Jh+1OqDk= ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:30:22.661 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:30:22.661 INFO:teuthology.orchestra.run.smithi016.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T23:30:22.666 INFO:teuthology.orchestra.run.smithi016.stdout:Adding host smithi016... 2024-09-10T23:30:23.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:23 smithi016 ceph-mon[30855]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:24.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:24 smithi016 ceph-mon[30855]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi016", "addr": "172.21.15.16", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:25.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:25 smithi016 ceph-mon[30855]: Deploying cephadm binary to smithi016 2024-09-10T23:30:27.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Added host 'smithi016' with addr '172.21.15.16' 2024-09-10T23:30:27.760 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying unmanaged mon service... 2024-09-10T23:30:28.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:28 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:28.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:28 smithi016 ceph-mon[30855]: Added host smithi016 2024-09-10T23:30:28.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:28 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:29.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T23:30:29.008 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying unmanaged mgr service... 2024-09-10T23:30:29.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:29 smithi016 ceph-mon[30855]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:29.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:29 smithi016 ceph-mon[30855]: Saving service mon spec with placement count:5 2024-09-10T23:30:29.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:29 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:30.226 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T23:30:30.884 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:30 smithi016 ceph-mon[30855]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:30.884 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:30 smithi016 ceph-mon[30855]: Saving service mgr spec with placement count:2 2024-09-10T23:30:30.884 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:30 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:31.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:31 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2811915890' entity='client.admin' 2024-09-10T23:30:31.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:31 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:33.553 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:33 smithi016 ceph-mon[30855]: from='mgr.14118 172.21.15.16:0/3060124485' entity='mgr.x' 2024-09-10T23:30:33.553 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:33 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3305387350' entity='client.admin' 2024-09-10T23:30:33.555 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling the dashboard module... 2024-09-10T23:30:34.719 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:34 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3019618751' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T23:30:34.719 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:34 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ignoring --setuser ceph since I am not root 2024-09-10T23:30:34.720 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:34 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ignoring --setgroup ceph since I am not root 2024-09-10T23:30:35.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:35 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3019618751' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T23:30:35.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:35 smithi016 ceph-mon[30855]: mgrmap e9: x(active, since 18s) 2024-09-10T23:30:36.387 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:30:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T23:30:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:30:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:30:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:30:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:30:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for the mgr to restart... 2024-09-10T23:30:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr epoch 9... 2024-09-10T23:30:36.518 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:36 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2717959560' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:30:39.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: Active manager daemon x restarted 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: Activating manager daemon x 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: mgrmap e10: x(active, starting, since 0.00333852s) 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:30:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:39 smithi016 ceph-mon[30855]: Manager daemon x is now available 2024-09-10T23:30:40.973 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:40 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:40.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:40 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:30:40.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:40 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:30:40.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:40 smithi016 ceph-mon[30855]: mgrmap e11: x(active, since 1.00652s) 2024-09-10T23:30:41.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:30:41.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T23:30:41.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:30:41.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:30:41.236 INFO:teuthology.orchestra.run.smithi016.stdout:mgr epoch 9 is available 2024-09-10T23:30:41.236 INFO:teuthology.orchestra.run.smithi016.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T23:30:41.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:41] ENGINE Bus STARTING 2024-09-10T23:30:41.963 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:30:41.570+0000 7f80f3d71640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:30:41] ENGINE Error in HTTPServer.serve 2024-09-10T23:30:41.963 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: Traceback (most recent call last): 2024-09-10T23:30:41.963 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:30:41.963 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._connections.run(self.expiration_interval) 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._run(expiration_interval) 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: s = self.context.wrap_socket( 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: return self.sslsocket_class._create( 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self.do_handshake() 2024-09-10T23:30:41.964 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:30:41.965 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._sslobj.do_handshake() 2024-09-10T23:30:41.965 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:30:41.965 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:30:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:30:42.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:42 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:41] ENGINE Serving on https://172.21.15.16:7150 2024-09-10T23:30:42.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:42 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:41] ENGINE Error in HTTPServer.serve 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._run(expiration_interval) 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:30:42.985 INFO:journalctl@ceph.mon.a.smithi016.stdout: s = self.context.wrap_socket( 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.sslsocket_class._create( 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout: self.do_handshake() 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._sslobj.do_handshake() 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:42 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:41] ENGINE Serving on http://172.21.15.16:8765 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:42 smithi016 ceph-mon[30855]: [10/Sep/2024:23:30:41] ENGINE Bus STARTED 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:42 smithi016 ceph-mon[30855]: mgrmap e12: x(active, since 2s) 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:42 smithi016 ceph-mon[30855]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:42.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:42 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:44.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:44 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUYW+s9oPg4n+MQzOLyEcjKuor/CUwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIzMzA0M1oXDTM0\nMDkxMTIzMzA0M1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjE2MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA0kSRl7Q8VWOGXQOHPC44YLKxgiGsBZUYKab2\nH2GAPk89/+vrLPpl0g8XwTu7B3WeGRNVQVHzqLadiOlNThyBSsXBCrjS8veRO0/m\nig0eymGNUA8z1bmUm9/mgMSsx1Um5bTi2REHv0XAR9FSD1TYYQ5JJW+y7U/upmZ9\nO8Svdy9SxLtUiYPFtfSpNZpcnFcjsIQzHyTUdYgdjbVvEgdVvP7GqhhYcNOFjhiO\nk5KTk4wQXG66iVhVpL1FHCB7SS7i/LMsS8kByT+f8V23dMRFqYxXc0qDHMbwAlmp\nvK5sdtzsjnSacrn78sh+vwU403u9xlYuSPva268Dn7qIJdmf+BKq+UUf2UkjBewV\nVkH3zH0VNp5HcpfkOQYCaarUUpAOzfX/5qlx5PqD4KB3P7wInJPezKlYiovCTLMG\nM65pmSJmfFIZyTuHdAAXnYBEAGmWlk9V+lk6Vk0hfiblASR2uRBb5XvSrKQaddkQ\nBbBriV7xHLNb7kciqlH+HtipJ5LbLH1CvaefI5db2eTKOj2jVTvlZTvNol5YHPEU\nq7E2Si+6IzzsXTSl71cZPwEuj/mtuhvj2oAMzJzrXdoyrsE90g+fUbge1uhjC1Qn\nQ9IYwW/KXbOdj+P4uq7LQiD/z5lb2mgt9X7st5ZQUbeXL8WRven2bdTAr+o6GmYf\n2uS5t10CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDE2ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPEDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCt\nMrHG10lSz8IK0I4QE/s/0rSXCLuiHRUbDhKhVC9FDJTQ9ofAKCgQIYLiSUJftW8T\nW2E0/Tvdju5koayg6YwW+xpJq86RSiJ5+vjp8+4cHcM5PQDUP3cKX+I7QTn2tGTA\nRv2lxEJaAfAAeFu77XB0A23ZoxWGNn+SfhgBC0jwXbKc7XrBr2yUqJQ+92FhbR9I\nQW6RfMNgTS0ktqrpxxXIUwSOdbhIooQTWX5qRqpt+DxzhW1+rvmE3Ld93gh+iMII\nKXSLqTIhlZuhkj9UOffe2FwAjIcQql/ef9FuZ3311lxE5vFVXMOpRzdwVUn1UhOO\n6g1kYiPTlYP43h2UMfiTWB97hoEmY/F9TQHGU/v3GPc8EpwoQKXog8qD2oQFOoWJ\nUOmVHP03cIJD4968BPmSrW1n3peWbGiSRNwEbaiPOKUSD17DhqhfBJ6MmyqfMyax\nhxdg9s17b6RptLog4Xm8Qb4Zu+wu+KX21b299y+NsdM96aGwX7hgBj+NITMqcx4h\nl0c3m2raln7JNz0UAxa7onzDKdK782Ee0vHBN6iWjANlgSRqhujTj65GCHrGwVaz\ni3VGWbVz2dE+zALxokuSm7yIScGKRAJpdQUsf1O2EYwNwy5q8KS6lmIQzFvh0aOn\n4ewBZ7PF3aXZKIwC+TY7FYNNrlfqi8rEsc4KnkiqHg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEA0kSRl7Q8VWOGXQOHPC44YLKxgiGsBZUYKab2H2GAPk89/+vr\nLPpl0g8XwTu7B3WeGRNVQVHzqLadiOlNThyBSsXBCrjS8veRO0/mig0eymGNUA8z\n1bmUm9/mgMSsx1Um5bTi2REHv0XAR9FSD1TYYQ5JJW+y7U/upmZ9O8Svdy9SxLtU\niYPFtfSpNZpcnFcjsIQzHyTUdYgdjbVvEgdVvP7GqhhYcNOFjhiOk5KTk4wQXG66\niVhVpL1FHCB7SS7i/LMsS8kByT+f8V23dMRFqYxXc0qDHMbwAlmpvK5sdtzsjnSa\ncrn78sh+vwU403u9xlYuSPva268Dn7qIJdmf+BKq+UUf2UkjBewVVkH3zH0VNp5H\ncpfkOQYCaarUUpAOzfX/5qlx5PqD4KB3P7wInJPezKlYiovCTLMGM65pmSJmfFIZ\nyTuHdAAXnYBEAGmWlk9V+lk6Vk0hfiblASR2uRBb5XvSrKQaddkQBbBriV7xHLNb\n7kciqlH+HtipJ5LbLH1CvaefI5db2eTKOj2jVTvlZTvNol5YHPEUq7E2Si+6Izzs\nXTSl71cZPwEuj/mtuhvj2oAMzJzrXdoyrsE90g+fUbge1uhjC1QnQ9IYwW/KXbOd\nj+P4uq7LQiD/z5lb2mgt9X7st5ZQUbeXL8WRven2bdTAr+o6GmYf2uS5t10CAwEA\nAQKCAgAzwl5Ghj791AB8wAQXq9cD8qjgfDJws1ld03QtmF4tuGruJyBek4rh8QYr\ncm0hMnJHAOvRJv/ATaeszqVRb5HiGpjg70s6NPfirlH1NLKaJfZXuU5Ms6Ch2DVR\nCFjxvoPTMrpOrbMHAgAJjbzR+lRDW/VkikD0yuLXwk3cmxeIUrVgqS5vpWjTWBUZ\nFVTrxUWLS5eb+IB2KBoCSqG7QeP4oIy9zT1kFKWBK4lZSVEblnRmlHlFmuGGKnMr\nL9G5W5nTk7V5OFNAu3E/RI8G5tOxH1NdlX9943isU28Fe7hGcC6pCIoGaMLc6j7M\n/deVs5WtD4TYQWsH/eZ5+LxP+Oi4AQIga0jGKPnj4BBG3TifB1clDJpGxPrULM76\ngRvvHP+Pi4bRNBAaKhc4Hdz1vwJdpOtpfmuSAC9KA84PihRB0/d/qjcp/bLj6jWL\nAGrNJ9QSvuF2n7FMpdLRfP2NEljoswyjLll9wCzu8Gaf+eNiWTIb8oDRjnexlSxr\nrnafvfhsDkrNqdMRTwHXzZBaTs5TaR0oY47EpM9GDfBN6Zfm/ubpIY/l73gBjO3z\nxlREhMX/Wl6C79bMPkKetGJVIXJqXOmsHNTfojFr+Tt8hurHGIpQXxZ4YMo5jbwF\nXxpX3OaJL0I/e8qq+W5FzZfKXlI9W1i9bYohtZivWQH3JT48zwKCAQEA/tbCFLK9\ns/8exy3fZBo4X8Mk/G2cVAAiKOF3FNQHzhdgTWoJnbmT0xageZJdsQIlGc02JjvM\nJUdNwZ2cIbYY/VJl1ELdt3MQxfBxVl645k+PpK+MEnE/TFXFVWmJUOY0A0r17K2q\nFXcaM0ZS3rDPMxYjzNpy5cPQiuNTpvgLxOENhLExluNdJvHyW75EFj+gYnvpDk7j\n6bMy1tFjKrSjrRQ/QGeU4uZZeMFUbHhU3Pl2uWInN1dBaQYeg2UHf5uhNcrRmatP\ntxQo+VK2S2LOlfUAD5879bF5H9dTVqYO8vFDnW6R4avE7YFJiVAxeeFm8TWAU18O\nxRB6KWDZ5k9G4wKCAQEA0znSxCbZt030/4f9+tNxSJlykctwMcJyCNonIiVDJlcr\nuSFuliD/nDamw80sb3zN5IOpIPCzpTJKb7KQ3eFSlSMjGotn8Zc02YGMeIMBB8jS\nbY2ASvXNWNvrOE9kX4aZ4xy49J8X591AsouTL1092wN1bWiLJClRNPR1H+4WnTPL\ngbkVnL0G0yE4rEO71ZOsesNE/cSQA9XxT74BYVZT6NXUPL0HXAIjUng+zpFrDvQp\n/T5PPCU7x44M0kSu8r382CW/Sq9opP9I4yJYL3v06KXxo/rooZV1fzfNEVXXaukn\n0XoaX0bKjtPyj9wWV71DChShVOywnQkcsQrCElEcvwKCAQEAhMiZ7/cCaZtxCg+Y\n6qvO2/bueqkSX6KCKhLw3WVte7EqeKvbvtdHcyHDFBVzxBt+AWev41QdFv+EQHJD\nPD2J39TjQiplJIVMJBcYtww8A6VJD2J49dMUTE4UuGB5MDICwAR7B4ulp/GbMURf\nQbGXBONwW/knDRluvC+fEs0ENN2fEZjSYfCuRPCke7E0APO+OhKeaNoqX0cEInKP\n3VyqPDDklEZkiaXE0OrLdolsjoddmVLPZEKOzo5lr8kgkxkgcsrvU8azjo1unBrA\n6Z7eTbyO/5TUxTxoBHNJ9UgpWeTkek92q8O4pJhNHMMwRHVyEhTyfH53T686N/1D\nDIIaSQKCAQBhHZDeRs6LDPi8FBaeIGFRc9vNVK/88N3lXAfqFx/MnP+pWsmxlPJx\nLF94XvkzOTqg+jfkwUaXiYvX103r9hE2KLWXGslrto3CA2JGdlUe8yJs5EY8MM99\nL3/yn+4STZyrYyVWs18WaA+7B5lgiYpLDEgNSafPtH91zX+ccqdLF+lVd3eMXQyq\nPfgEnA/cns0KlIU/+AQO/2q3szCHRF3IC6hNVMvxbbo3zLlz2EBU28YCfYeIq8XU\ndmdGtfWJ/fgmmRRejk+arRUh+UR6cI+l98YmEtKqmEExgMJ0Wfd1XEXGdlFxxOaU\nzLYVlqdfJ9GO7PVQSpLZYLskW0HnkguZAoIBAQCHLLGbHj2ft2tdorDS7V0pffUX\n3hQV8Asd1ehsBsBgLYJTPsxB/GY+f3f/rpOeRYx6GQXTuUOHevO4kZSt8zOxHyxX\nrWk9HXz57XhBQHszw+bsm18HfrjOu2DVyodqmpJM5q4cyfWKKez946GyV09wL8Ky\nFLqt8YNwpmX5/lvHIPKhlFGPrKhVs9LpE+RbvyfR5qOrjYTUA9wmAVxnOuMbfbXq\nkePJcM5CdBqglqJ9CHbFX7ESl+jN78tbO0tS6HoTQeAvVkvoCRbpyUiq99qqPnMs\nshIrFPVsUQJ/VnJjxU2UR7dN5vpH4kw9r3OuoXAGWK7duoneWCs7GLmNhITf\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T23:30:45.581 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T23:30:45.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:45 smithi016 ceph-mon[30855]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:45.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:45 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:47.223 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T23:30:47.223 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial admin user... 2024-09-10T23:30:47.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:47 smithi016 ceph-mon[30855]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:47.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:47 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:48.705 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$C.BwJ6zqMyLukwuPx4ccp.N9ufCgfanx0qoStyMveX.b1VipdYc5q", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726011048, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T23:30:48.705 INFO:teuthology.orchestra.run.smithi016.stdout:Fetching dashboard port number... 2024-09-10T23:30:49.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:49 smithi016 ceph-mon[30855]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:49.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:49 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:49.868 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T23:30:49.879 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:30:49.879 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-09-10T23:30:49.886 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:30:49.886 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-09-10T23:30:49.886 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-09-10T23:30:49.887 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T23:30:49.888 INFO:teuthology.orchestra.run.smithi016.stdout:Ceph Dashboard is now available at: 2024-09-10T23:30:49.888 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:49.889 INFO:teuthology.orchestra.run.smithi016.stdout: URL: https://smithi016.front.sepia.ceph.com:8443/ 2024-09-10T23:30:49.889 INFO:teuthology.orchestra.run.smithi016.stdout: User: admin 2024-09-10T23:30:49.889 INFO:teuthology.orchestra.run.smithi016.stdout: Password: p6fmwe7h7v 2024-09-10T23:30:49.889 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:49.889 INFO:teuthology.orchestra.run.smithi016.stdout:Saving cluster configuration to /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config directory 2024-09-10T23:30:50.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:50 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2856413113' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T23:30:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T23:30:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T23:30:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:30:51.192 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: ceph telemetry on 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:For more information see: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:30:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:Bootstrap complete. 2024-09-10T23:30:51.236 INFO:tasks.cephadm:Fetching config... 2024-09-10T23:30:51.236 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:30:51.236 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T23:30:51.254 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T23:30:51.254 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:30:51.254 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T23:30:51.312 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T23:30:51.312 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:30:51.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T23:30:51.379 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T23:30:51.379 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:30:51.379 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T23:30:51.435 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T23:30:51.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKMvU7sfw7cOlEugP0iEgnUe838p84lH5PCOair7wAmYbYcKDwhXjgFZDQK/IpIau3EL/4YbcW61BOjYxTqb1lSO2wvsIDv7UCocAmvK1BqQrOrHSsvpR7uNXDgH9GoPW/LIEJDWpfm8SnA1iGBB3eKfRfi8CHmv5JPubw384w5t+QdSUkF6E6XE9L1mubGg3gFxFlwVNp+k6qBNT4qNfpCgRQ+oWP5wFvzdOaXBcDne91L1Q71fAGdPUo+i5ZAxsJ0e7dGRko7YPp/N+FqxxAN/A2RwvNW7eULZO8o9FiQr6j7EPLzYOcg7sy3GaBfc6sfztamgF2T3jfiGkUHlYWCAYQK/Q/kkOQdjcZxfu+Zd3aX0o7HAjTtZdVT41Y/AK2rZu64PZAZwxi5yLZYxFO6fJ9ee7Ye/th5RrRmHI63aOUa4GzrDWM1agdDVzK+q9fDzC5XClmz8xhqn4lEhoo7cEbzy6PnwtAza7X0cJumPkHO3l42P/3Y/4Jh+1OqDk= ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:30:51.513 INFO:teuthology.orchestra.run.smithi016.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKMvU7sfw7cOlEugP0iEgnUe838p84lH5PCOair7wAmYbYcKDwhXjgFZDQK/IpIau3EL/4YbcW61BOjYxTqb1lSO2wvsIDv7UCocAmvK1BqQrOrHSsvpR7uNXDgH9GoPW/LIEJDWpfm8SnA1iGBB3eKfRfi8CHmv5JPubw384w5t+QdSUkF6E6XE9L1mubGg3gFxFlwVNp+k6qBNT4qNfpCgRQ+oWP5wFvzdOaXBcDne91L1Q71fAGdPUo+i5ZAxsJ0e7dGRko7YPp/N+FqxxAN/A2RwvNW7eULZO8o9FiQr6j7EPLzYOcg7sy3GaBfc6sfztamgF2T3jfiGkUHlYWCAYQK/Q/kkOQdjcZxfu+Zd3aX0o7HAjTtZdVT41Y/AK2rZu64PZAZwxi5yLZYxFO6fJ9ee7Ye/th5RrRmHI63aOUa4GzrDWM1agdDVzK+q9fDzC5XClmz8xhqn4lEhoo7cEbzy6PnwtAza7X0cJumPkHO3l42P/3Y/4Jh+1OqDk= ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:30:51.525 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKMvU7sfw7cOlEugP0iEgnUe838p84lH5PCOair7wAmYbYcKDwhXjgFZDQK/IpIau3EL/4YbcW61BOjYxTqb1lSO2wvsIDv7UCocAmvK1BqQrOrHSsvpR7uNXDgH9GoPW/LIEJDWpfm8SnA1iGBB3eKfRfi8CHmv5JPubw384w5t+QdSUkF6E6XE9L1mubGg3gFxFlwVNp+k6qBNT4qNfpCgRQ+oWP5wFvzdOaXBcDne91L1Q71fAGdPUo+i5ZAxsJ0e7dGRko7YPp/N+FqxxAN/A2RwvNW7eULZO8o9FiQr6j7EPLzYOcg7sy3GaBfc6sfztamgF2T3jfiGkUHlYWCAYQK/Q/kkOQdjcZxfu+Zd3aX0o7HAjTtZdVT41Y/AK2rZu64PZAZwxi5yLZYxFO6fJ9ee7Ye/th5RrRmHI63aOUa4GzrDWM1agdDVzK+q9fDzC5XClmz8xhqn4lEhoo7cEbzy6PnwtAza7X0cJumPkHO3l42P/3Y/4Jh+1OqDk= ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:30:51.570 INFO:teuthology.orchestra.run.smithi066.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKMvU7sfw7cOlEugP0iEgnUe838p84lH5PCOair7wAmYbYcKDwhXjgFZDQK/IpIau3EL/4YbcW61BOjYxTqb1lSO2wvsIDv7UCocAmvK1BqQrOrHSsvpR7uNXDgH9GoPW/LIEJDWpfm8SnA1iGBB3eKfRfi8CHmv5JPubw384w5t+QdSUkF6E6XE9L1mubGg3gFxFlwVNp+k6qBNT4qNfpCgRQ+oWP5wFvzdOaXBcDne91L1Q71fAGdPUo+i5ZAxsJ0e7dGRko7YPp/N+FqxxAN/A2RwvNW7eULZO8o9FiQr6j7EPLzYOcg7sy3GaBfc6sfztamgF2T3jfiGkUHlYWCAYQK/Q/kkOQdjcZxfu+Zd3aX0o7HAjTtZdVT41Y/AK2rZu64PZAZwxi5yLZYxFO6fJ9ee7Ye/th5RrRmHI63aOUa4GzrDWM1agdDVzK+q9fDzC5XClmz8xhqn4lEhoo7cEbzy6PnwtAza7X0cJumPkHO3l42P/3Y/4Jh+1OqDk= ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:30:51.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKMvU7sfw7cOlEugP0iEgnUe838p84lH5PCOair7wAmYbYcKDwhXjgFZDQK/IpIau3EL/4YbcW61BOjYxTqb1lSO2wvsIDv7UCocAmvK1BqQrOrHSsvpR7uNXDgH9GoPW/LIEJDWpfm8SnA1iGBB3eKfRfi8CHmv5JPubw384w5t+QdSUkF6E6XE9L1mubGg3gFxFlwVNp+k6qBNT4qNfpCgRQ+oWP5wFvzdOaXBcDne91L1Q71fAGdPUo+i5ZAxsJ0e7dGRko7YPp/N+FqxxAN/A2RwvNW7eULZO8o9FiQr6j7EPLzYOcg7sy3GaBfc6sfztamgF2T3jfiGkUHlYWCAYQK/Q/kkOQdjcZxfu+Zd3aX0o7HAjTtZdVT41Y/AK2rZu64PZAZwxi5yLZYxFO6fJ9ee7Ye/th5RrRmHI63aOUa4GzrDWM1agdDVzK+q9fDzC5XClmz8xhqn4lEhoo7cEbzy6PnwtAza7X0cJumPkHO3l42P/3Y/4Jh+1OqDk= ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:30:51.626 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKMvU7sfw7cOlEugP0iEgnUe838p84lH5PCOair7wAmYbYcKDwhXjgFZDQK/IpIau3EL/4YbcW61BOjYxTqb1lSO2wvsIDv7UCocAmvK1BqQrOrHSsvpR7uNXDgH9GoPW/LIEJDWpfm8SnA1iGBB3eKfRfi8CHmv5JPubw384w5t+QdSUkF6E6XE9L1mubGg3gFxFlwVNp+k6qBNT4qNfpCgRQ+oWP5wFvzdOaXBcDne91L1Q71fAGdPUo+i5ZAxsJ0e7dGRko7YPp/N+FqxxAN/A2RwvNW7eULZO8o9FiQr6j7EPLzYOcg7sy3GaBfc6sfztamgF2T3jfiGkUHlYWCAYQK/Q/kkOQdjcZxfu+Zd3aX0o7HAjTtZdVT41Y/AK2rZu64PZAZwxi5yLZYxFO6fJ9ee7Ye/th5RrRmHI63aOUa4GzrDWM1agdDVzK+q9fDzC5XClmz8xhqn4lEhoo7cEbzy6PnwtAza7X0cJumPkHO3l42P/3Y/4Jh+1OqDk= ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:30:51.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T23:30:51.892 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:51.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:51 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1683801681' entity='client.admin' 2024-09-10T23:30:53.645 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: mgrmap e13: x(active, since 12s) 2024-09-10T23:30:53.646 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1139989810' entity='client.admin' 2024-09-10T23:30:53.646 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:53.646 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:53.646 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"} : dispatch 2024-09-10T23:30:53.646 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:53.646 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:53.646 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:53 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:53.673 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T23:30:53.673 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T23:30:53.924 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:55.278 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi066 2024-09-10T23:30:55.278 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:30:55.278 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:30:55.298 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:30:55.298 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:30:55.357 INFO:tasks.cephadm:Adding host smithi066 to orchestrator... 2024-09-10T23:30:55.357 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch host add smithi066 2024-09-10T23:30:55.612 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:30:55.829 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:30:55.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:30:55.831 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:55.831 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:55.831 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:55 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:30:56.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:56 smithi016 ceph-mon[30855]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:30:57.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:30:57 smithi016 ceph-mon[30855]: Deploying cephadm binary to smithi066 2024-09-10T23:31:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:Added host 'smithi066' with addr '172.21.15.66' 2024-09-10T23:31:00.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:31:01.070 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:01.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:01 smithi016 ceph-mon[30855]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:01.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:01 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:01.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:01 smithi016 ceph-mon[30855]: Added host smithi066 2024-09-10T23:31:01.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:01 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:01.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:01 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:01.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:01 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:01.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:31:01.683 INFO:teuthology.orchestra.run.smithi016.stdout:[{"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}] 2024-09-10T23:31:02.299 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi071 2024-09-10T23:31:02.300 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:31:02.300 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:31:02.318 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:31:02.318 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:02.377 INFO:tasks.cephadm:Adding host smithi071 to orchestrator... 2024-09-10T23:31:02.377 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch host add smithi071 2024-09-10T23:31:02.631 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:02.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:02 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:02.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:02 smithi016 ceph-mon[30855]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:02.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:02 smithi016 ceph-mon[30855]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:31:03.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:03 smithi016 ceph-mon[30855]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:31:05.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:05 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:06.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:06 smithi016 ceph-mon[30855]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:06.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:06 smithi016 ceph-mon[30855]: Deploying cephadm binary to smithi071 2024-09-10T23:31:06.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:06 smithi016 ceph-mon[30855]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:06 smithi016 ceph-mon[30855]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:Added host 'smithi071' with addr '172.21.15.71' 2024-09-10T23:31:07.649 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:07 smithi016 ceph-mon[30855]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:07.941 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:31:08.197 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:08.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:08 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:08.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:08 smithi016 ceph-mon[30855]: Added host smithi071 2024-09-10T23:31:08.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:08 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:08.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:08 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:08.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:08 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:08.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:31:08.883 INFO:teuthology.orchestra.run.smithi016.stdout:[{"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}] 2024-09-10T23:31:09.438 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:09 smithi016 ceph-mon[30855]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:09.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:09 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:09.467 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T23:31:09.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T23:31:09.718 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:10.354 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-09-10T23:31:10.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:10 smithi016 ceph-mon[30855]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:31:10.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:10 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4146671808' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:31:10.943 INFO:tasks.cephadm:Adding mon.a on smithi016 2024-09-10T23:31:10.943 INFO:tasks.cephadm:Adding mon.b on smithi066 2024-09-10T23:31:10.943 INFO:tasks.cephadm:Adding mon.c on smithi071 2024-09-10T23:31:10.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi016:172.21.15.16=a;smithi066:172.21.15.66=b;smithi071:172.21.15.71=c' 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:31:11.412 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:31:11.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4146671808' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:11.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:11 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:12.111 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mon update... 2024-09-10T23:31:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:12 smithi016 ceph-mon[30855]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T23:31:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:12 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:12 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:12 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:12 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:12 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:12 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:12.803 DEBUG:teuthology.orchestra.run.smithi066:mon.b> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T23:31:12.805 DEBUG:teuthology.orchestra.run.smithi071:mon.c> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T23:31:12.808 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:31:12.808 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:31:13.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:13 smithi016 ceph-mon[30855]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:13.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:13 smithi016 ceph-mon[30855]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:13.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:13 smithi016 ceph-mon[30855]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:13.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:13 smithi016 ceph-mon[30855]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:13.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:13 smithi016 ceph-mon[30855]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi016:172.21.15.16=a;smithi066:172.21.15.66=b;smithi071:172.21.15.71=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:31:13.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:13 smithi016 ceph-mon[30855]: Saving service mon spec with placement smithi016:172.21.15.16=a;smithi066:172.21.15.66=b;smithi071:172.21.15.71=c;count:3 2024-09-10T23:31:13.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:13 smithi016 ceph-mon[30855]: Deploying daemon mon.c on smithi071 2024-09-10T23:31:14.996 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:31:15.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:15 smithi016 ceph-mon[30855]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:15.795 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:31:15.795 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":1,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","modified":"2024-09-10T23:29:38.537183Z","created":"2024-09-10T23:29:38.537183Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:31:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 1 2024-09-10T23:31:16.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:16 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/1019232330' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:31:17.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:16 smithi071 systemd[1]: Started Ceph mon.c for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:31:17.397 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:31:17.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:31:17.646 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:31:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: mon.a calling monitor election 2024-09-10T23:31:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: mon.c calling monitor election 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: monmap epoch 2 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: last_changed 2024-09-10T23:31:16.834157+0000 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: created 2024-09-10T23:29:38.537183+0000 2024-09-10T23:31:22.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: min_mon_release 19 (squid) 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: election_strategy: 1 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: fsmap 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: mgrmap e13: x(active, since 42s) 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: overall HEALTH_OK 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:22.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:21 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:22.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: mon.a calling monitor election 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: mon.c calling monitor election 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: monmap epoch 2 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: last_changed 2024-09-10T23:31:16.834157+0000 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: created 2024-09-10T23:29:38.537183+0000 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: min_mon_release 19 (squid) 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: election_strategy: 1 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: fsmap 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: mgrmap e13: x(active, since 42s) 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: overall HEALTH_OK 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:22.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:22.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:22.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:22.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:21 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:22.732 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:31:22.732 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":2,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","modified":"2024-09-10T23:31:16.834157Z","created":"2024-09-10T23:29:38.537183Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:31:22.732 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 2 2024-09-10T23:31:23.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:22 smithi071 ceph-mon[35018]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:23.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:22 smithi071 ceph-mon[35018]: Deploying daemon mon.b on smithi066 2024-09-10T23:31:23.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:22 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/860113632' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:31:23.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:22 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:23.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:22 smithi016 ceph-mon[30855]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:23.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:22 smithi016 ceph-mon[30855]: Deploying daemon mon.b on smithi066 2024-09-10T23:31:23.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:22 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/860113632' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:31:23.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:22 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:24.286 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:31:24.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:31:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:31:25.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:31:25.174 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":2,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","modified":"2024-09-10T23:31:16.834157Z","created":"2024-09-10T23:29:38.537183Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:31:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 2 2024-09-10T23:31:25.174 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:24 smithi071 ceph-mon[35018]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:25.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:24 smithi016 ceph-mon[30855]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:26.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:25 smithi066 systemd[1]: Started Ceph mon.b for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:31:26.728 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:31:26.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:31:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: mon.a calling monitor election 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: mon.c calling monitor election 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: mon.b calling monitor election 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: monmap epoch 3 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: last_changed 2024-09-10T23:31:25.708086+0000 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: created 2024-09-10T23:29:38.537183+0000 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: min_mon_release 19 (squid) 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: election_strategy: 1 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-10T23:31:31.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: fsmap 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: mgrmap e13: x(active, since 51s) 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: overall HEALTH_OK 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.054 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:30 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: mon.a calling monitor election 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: mon.c calling monitor election 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: mon.b calling monitor election 2024-09-10T23:31:31.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: monmap epoch 3 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: last_changed 2024-09-10T23:31:25.708086+0000 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: created 2024-09-10T23:29:38.537183+0000 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: min_mon_release 19 (squid) 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: election_strategy: 1 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-10T23:31:31.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: fsmap 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: mgrmap e13: x(active, since 51s) 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: overall HEALTH_OK 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:30 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: mon.a calling monitor election 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: mon.c calling monitor election 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: mon.b calling monitor election 2024-09-10T23:31:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: monmap epoch 3 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: last_changed 2024-09-10T23:31:25.708086+0000 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: created 2024-09-10T23:29:38.537183+0000 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: min_mon_release 19 (squid) 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: election_strategy: 1 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: fsmap 2024-09-10T23:31:31.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:31:31.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: mgrmap e13: x(active, since 51s) 2024-09-10T23:31:31.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: overall HEALTH_OK 2024-09-10T23:31:31.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:30 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:31.301 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:31:31.301 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","modified":"2024-09-10T23:31:25.708086Z","created":"2024-09-10T23:29:38.537183Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T23:31:31.301 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 3 2024-09-10T23:31:31.942 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:31 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:31.942 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:31 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/2933990658' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:31:31.942 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:31 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:32.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:31 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:32.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:31 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/2933990658' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:31:32.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:31 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:32.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:31 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:32.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:31 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/2933990658' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:31:32.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:31 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:32.569 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T23:31:32.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T23:31:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:33.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:33.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:33.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:32 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:33.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:33.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:33.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:32 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:33.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:33.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:32 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:33.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:33 smithi016 ceph-mon[30855]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:31:33.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:33 smithi016 ceph-mon[30855]: Reconfiguring daemon mon.a on smithi016 2024-09-10T23:31:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:33 smithi071 ceph-mon[35018]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:31:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:33 smithi071 ceph-mon[35018]: Reconfiguring daemon mon.a on smithi016 2024-09-10T23:31:34.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:33 smithi066 ceph-mon[34761]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:31:34.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:33 smithi066 ceph-mon[34761]: Reconfiguring daemon mon.a on smithi016 2024-09-10T23:31:34.364 INFO:teuthology.orchestra.run.smithi016.stdout:# minimal ceph.conf for 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:31:34.364 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-09-10T23:31:34.364 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:31:34.364 INFO:teuthology.orchestra.run.smithi016.stdout: mon_host = [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-10T23:31:35.117 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:34 smithi066 ceph-mon[34761]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:35.117 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:34 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1234816108' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:35.117 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:34 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:35.117 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:34 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:35.117 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:34 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:35.118 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:34 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:35.118 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:34 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:35.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:34 smithi016 ceph-mon[30855]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:35.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:34 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1234816108' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:35.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:34 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:35.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:34 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:35.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:34 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:35.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:34 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:35.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:34 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:35.247 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T23:31:35.247 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:31:35.247 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:31:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:34 smithi071 ceph-mon[35018]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:34 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1234816108' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:34 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:34 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:34 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:34 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:34 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:35.276 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:31:35.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:35.343 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:31:35.343 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:31:35.372 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:31:35.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:35.438 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:31:35.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:31:35.470 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:31:35.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:35.539 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-10T23:31:35.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-10T23:31:35.789 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:36.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:31:36.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: Reconfiguring daemon mon.b on smithi066 2024-09-10T23:31:36.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:36.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:36.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:36 smithi016 ceph-mon[30855]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:31:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: Reconfiguring daemon mon.b on smithi066 2024-09-10T23:31:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:36 smithi066 ceph-mon[34761]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:36.349 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:31:36.350 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: Reconfiguring daemon mon.b on smithi066 2024-09-10T23:31:36.350 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.350 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.350 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' 2024-09-10T23:31:36.350 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:31:36.350 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:31:36.350 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:36 smithi071 ceph-mon[35018]: from='mgr.14150 172.21.15.16:0/1368342687' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:37.376 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:37 smithi071 ceph-mon[35018]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:37.376 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:37 smithi071 ceph-mon[35018]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:31:37.376 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:37 smithi071 ceph-mon[35018]: Reconfiguring daemon mon.c on smithi071 2024-09-10T23:31:37.376 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:37 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3396444020' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:31:37.464 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:37 smithi016 ceph-mon[30855]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:37.465 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:37 smithi016 ceph-mon[30855]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:31:37.465 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:37 smithi016 ceph-mon[30855]: Reconfiguring daemon mon.c on smithi071 2024-09-10T23:31:37.465 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:37 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3396444020' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:31:37.465 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:37 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ignoring --setuser ceph since I am not root 2024-09-10T23:31:37.465 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:37 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ignoring --setgroup ceph since I am not root 2024-09-10T23:31:37.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:37 smithi066 ceph-mon[34761]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:31:37.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:37 smithi066 ceph-mon[34761]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:31:37.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:37 smithi066 ceph-mon[34761]: Reconfiguring daemon mon.c on smithi071 2024-09-10T23:31:37.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:37 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3396444020' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-10T23:31:37.720 INFO:tasks.cephadm:Adding mgr.x on smithi016 2024-09-10T23:31:37.720 INFO:tasks.cephadm:Adding mgr.y on smithi066 2024-09-10T23:31:37.720 INFO:tasks.cephadm:Adding mgr.z on smithi071 2024-09-10T23:31:37.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi016=x;smithi066=y;smithi071=z' 2024-09-10T23:31:37.960 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:31:38.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:38 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3396444020' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:31:38.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:38 smithi071 ceph-mon[35018]: mgrmap e14: x(active, since 57s) 2024-09-10T23:31:38.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:38 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3396444020' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:31:38.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:38 smithi016 ceph-mon[30855]: mgrmap e14: x(active, since 57s) 2024-09-10T23:31:38.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:38 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3396444020' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T23:31:38.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:38 smithi066 ceph-mon[34761]: mgrmap e14: x(active, since 57s) 2024-09-10T23:31:42.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: Active manager daemon x restarted 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: Activating manager daemon x 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: mgrmap e15: x(active, starting, since 0.00436965s) 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:31:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:42 smithi016 ceph-mon[30855]: Manager daemon x is now available 2024-09-10T23:31:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: Active manager daemon x restarted 2024-09-10T23:31:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: Activating manager daemon x 2024-09-10T23:31:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:31:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: mgrmap e15: x(active, starting, since 0.00436965s) 2024-09-10T23:31:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:42.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:42.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:31:42.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:31:42.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:31:42.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:31:42.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:42 smithi071 ceph-mon[35018]: Manager daemon x is now available 2024-09-10T23:31:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: Active manager daemon x restarted 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: Activating manager daemon x 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: mgrmap e15: x(active, starting, since 0.00436965s) 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:31:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:42 smithi066 ceph-mon[34761]: Manager daemon x is now available 2024-09-10T23:31:43.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:43.390 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:31:43.390 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:31:43.390 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:43 smithi066 ceph-mon[34761]: mgrmap e16: x(active, since 1.0093s) 2024-09-10T23:31:43.540 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mgr update... 2024-09-10T23:31:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:31:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:31:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:43 smithi071 ceph-mon[35018]: mgrmap e16: x(active, since 1.0093s) 2024-09-10T23:31:43.652 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:43.653 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:31:43.653 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:31:43.653 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:43 smithi016 ceph-mon[30855]: mgrmap e16: x(active, since 1.0093s) 2024-09-10T23:31:44.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: Saving service mgr spec with placement smithi016=x;smithi066=y;smithi071=z;count:3 2024-09-10T23:31:44.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.656 DEBUG:teuthology.orchestra.run.smithi066:mgr.y> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T23:31:44.659 DEBUG:teuthology.orchestra.run.smithi071:mgr.z> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T23:31:44.661 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T23:31:44.661 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T23:31:44.663 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T23:31:44.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T23:31:44.679 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: Saving service mgr spec with placement smithi016=x;smithi066=y;smithi071=z;count:3 2024-09-10T23:31:44.679 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.680 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.680 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.680 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.680 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.680 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.680 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.684 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: Saving service mgr spec with placement smithi016=x;smithi066=y;smithi071=z;count:3 2024-09-10T23:31:44.684 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.684 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:44.685 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T23:31:44.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T23:31:44.728 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:31:44.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T23:31:44.771 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:31:44.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T23:31:44.814 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T23:31:44.814 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T23:31:44.864 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:31:44.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T23:31:44.914 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T23:31:44.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T23:31:44.964 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T23:31:44.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T23:31:45.027 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T23:31:45.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T23:31:45.073 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T23:31:45.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T23:31:45.117 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T23:31:45.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T23:31:45.170 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T23:31:45.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T23:31:45.171 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:45.193 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:31:45.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T23:31:45.248 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:31:45.248 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T23:31:45.299 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T23:31:45.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T23:31:45.344 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:31:45.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T23:31:45.389 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:31:45.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:31:45.444 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:31:45.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:31:45.500 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-10T23:31:45.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-09-10T23:31:45.544 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-10T23:31:45.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-10T23:31:45.596 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-10T23:31:45.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-10T23:31:45.649 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-10T23:31:45.650 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-10T23:31:45.693 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:31:45.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T23:31:45.747 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:31:45.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:31:45.798 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:31:45.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T23:31:45.850 DEBUG:tasks.cephadm:set 26 configs 2024-09-10T23:31:45.851 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi016') 2024-09-10T23:31:46.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:46.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:46.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:45 smithi016 ceph-mon[30855]: mgrmap e17: x(active, since 2s) 2024-09-10T23:31:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:45 smithi071 ceph-mon[35018]: mgrmap e17: x(active, since 2s) 2024-09-10T23:31:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"} : dispatch 2024-09-10T23:31:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:45 smithi066 ceph-mon[34761]: mgrmap e17: x(active, since 2s) 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:31:46.373+0000 7f9e8ec08640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:31:46] ENGINE Error in HTTPServer.serve 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: Traceback (most recent call last): 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._connections.run(self.expiration_interval) 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._run(expiration_interval) 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:31:46.446 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: s = self.context.wrap_socket( 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: return self.sslsocket_class._create( 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self.do_handshake() 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: self._sslobj.do_handshake() 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:31:46.447 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:31:46.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: [10/Sep/2024:23:31:45] ENGINE Bus STARTING 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: [10/Sep/2024:23:31:46] ENGINE Serving on http://172.21.15.16:8765 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:46.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1858783679' entity='client.admin' 2024-09-10T23:31:46.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:46 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/408142360' entity='client.admin' 2024-09-10T23:31:47.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-10T23:31:47.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: [10/Sep/2024:23:31:45] ENGINE Bus STARTING 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: [10/Sep/2024:23:31:46] ENGINE Serving on http://172.21.15.16:8765 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1858783679' entity='client.admin' 2024-09-10T23:31:47.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:46 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/408142360' entity='client.admin' 2024-09-10T23:31:47.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-10T23:31:47.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: [10/Sep/2024:23:31:45] ENGINE Bus STARTING 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: [10/Sep/2024:23:31:46] ENGINE Serving on http://172.21.15.16:8765 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: Updating smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:47.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:47.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1858783679' entity='client.admin' 2024-09-10T23:31:47.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:46 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/408142360' entity='client.admin' 2024-09-10T23:31:47.631 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi016') 2024-09-10T23:31:47.999 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:48.014 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi016') 2024-09-10T23:31:48.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: [10/Sep/2024:23:31:46] ENGINE Serving on https://172.21.15.16:7150 2024-09-10T23:31:48.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: [10/Sep/2024:23:31:46] ENGINE Bus STARTED 2024-09-10T23:31:48.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: [10/Sep/2024:23:31:46] ENGINE Error in HTTPServer.serve 2024-09-10T23:31:48.020 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-10T23:31:48.020 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:31:48.020 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:31:48.020 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._run(expiration_interval) 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: s = self.context.wrap_socket( 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.sslsocket_class._create( 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:31:48.021 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.do_handshake() 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._sslobj.do_handshake() 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:31:48.022 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:48.023 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:47 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:48.033 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:48.101 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: [10/Sep/2024:23:31:46] ENGINE Serving on https://172.21.15.16:7150 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: [10/Sep/2024:23:31:46] ENGINE Bus STARTED 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: [10/Sep/2024:23:31:46] ENGINE Error in HTTPServer.serve 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._run(expiration_interval) 2024-09-10T23:31:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: s = self.context.wrap_socket( 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.sslsocket_class._create( 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: self.do_handshake() 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: self._sslobj.do_handshake() 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:48.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:48.237 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:47 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:48.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: [10/Sep/2024:23:31:46] ENGINE Serving on https://172.21.15.16:7150 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: [10/Sep/2024:23:31:46] ENGINE Bus STARTED 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: [10/Sep/2024:23:31:46] ENGINE Error in HTTPServer.serve 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: Traceback (most recent call last): 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: self._run(expiration_interval) 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: s = self.context.wrap_socket( 2024-09-10T23:31:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout: return self.sslsocket_class._create( 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout: self.do_handshake() 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout: self._sslobj.do_handshake() 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: Updating smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:31:48.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:48.304 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:47 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 -- 172.21.15.16:0/3416678538 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1dec03f560 msgr2=0x7f1dec041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 --2- 172.21.15.16:0/3416678538 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1dec03f560 0x7f1dec041a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1df0005fd0 tx=0x7f1df0007040 comp rx=0 tx=0).stop 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 -- 172.21.15.16:0/3416678538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e001076e0 msgr2=0x7f1e001994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 --2- 172.21.15.16:0/3416678538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e001076e0 0x7f1e001994f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1de800e9f0 tx=0x7f1de800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 -- 172.21.15.16:0/3416678538 shutdown_connections 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 --2- 172.21.15.16:0/3416678538 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1dec03f560 0x7f1dec041a20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 --2- 172.21.15.16:0/3416678538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e00108060 0x7f1e0019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 --2- 172.21.15.16:0/3416678538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e001076e0 0x7f1e001994f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 --2- 172.21.15.16:0/3416678538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e00101cd0 0x7f1e00198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.069+0000 7f1e070e9640 1 -- 172.21.15.16:0/3416678538 >> 172.21.15.16:0/3416678538 conn(0x7f1e000fd700 msgr2=0x7f1e000fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.070+0000 7f1e070e9640 1 -- 172.21.15.16:0/3416678538 shutdown_connections 2024-09-10T23:31:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.070+0000 7f1e070e9640 1 -- 172.21.15.16:0/3416678538 wait complete. 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 -- 172.21.15.16:0/230155940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 msgr2=0x7fdfa0104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/230155940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa0104080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009900 tx=0x7fdf9c02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 -- 172.21.15.16:0/230155940 shutdown_connections 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/230155940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfa010d100 0x7fdfa010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/230155940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfa01045c0 0x7fdfa010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/230155940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa0104080 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 -- 172.21.15.16:0/230155940 >> 172.21.15.16:0/230155940 conn(0x7fdfa00fd700 msgr2=0x7fdfa00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 -- 172.21.15.16:0/230155940 shutdown_connections 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.122+0000 7fdfa85a0640 1 -- 172.21.15.16:0/230155940 wait complete. 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 Processor -- start 2024-09-10T23:31:49.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 -- start start 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa01990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfa01045c0 0x7fdfa01995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfa010d100 0x7fdfa019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa0112b30 con 0x7fdfa0103ca0 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa01129b0 con 0x7fdfa010d100 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa85a0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa0112cb0 con 0x7fdfa01045c0 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa01990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa01990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33302/0 (socket says 172.21.15.16:33302) 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 -- 172.21.15.16:0/2954790501 learned_addr learned my addr 172.21.15.16:0/2954790501 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa5b3b640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfa01045c0 0x7fdfa01995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa6b3d640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfa010d100 0x7fdfa019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 -- 172.21.15.16:0/2954790501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfa01045c0 msgr2=0x7fdfa01995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfa01045c0 0x7fdfa01995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 -- 172.21.15.16:0/2954790501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfa010d100 msgr2=0x7fdfa019e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfa010d100 0x7fdfa019e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa633c640 1 -- 172.21.15.16:0/2954790501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa019f150 con 0x7fdfa0103ca0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.123+0000 7fdfa6b3d640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfa010d100 0x7fdfa019e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.124+0000 7fdfa633c640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa01990a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c005940 tx=0x7fdf9c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.124+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c03f070 con 0x7fdfa0103ca0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.124+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fdf9c031b20 con 0x7fdfa0103ca0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.124+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa019f3e0 con 0x7fdfa0103ca0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.124+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c035030 con 0x7fdfa0103ca0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.124+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa01a5b00 con 0x7fdfa0103ca0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.125+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7fdf9c0316b0 con 0x7fdfa0103ca0 2024-09-10T23:31:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.125+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa0104080 con 0x7fdfa0103ca0 2024-09-10T23:31:49.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.125+0000 7fdf977fe640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf8c03f560 0x7fdf8c041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.125+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdf9c074890 con 0x7fdfa0103ca0 2024-09-10T23:31:49.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.125+0000 7fdfa5b3b640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf8c03f560 0x7fdf8c041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.126+0000 7fdfa5b3b640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf8c03f560 0x7fdf8c041a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdfa010f6d0 tx=0x7fdf9000b2e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:49.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.130+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf9c03fe40 con 0x7fdfa0103ca0 2024-09-10T23:31:49.213 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:48 smithi016 ceph-mon[30855]: Deploying daemon mgr.z on smithi071 2024-09-10T23:31:49.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:48 smithi071 ceph-mon[35018]: Deploying daemon mgr.z on smithi071 2024-09-10T23:31:49.270 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 systemd[1]: Starting Ceph mgr.z for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:31:49.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:48 smithi066 ceph-mon[34761]: Deploying daemon mgr.z on smithi071 2024-09-10T23:31:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.315+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fdfa0108170 con 0x7fdfa0103ca0 2024-09-10T23:31:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.318+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7fdf9c031cd0 con 0x7fdfa0103ca0 2024-09-10T23:31:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.319+0000 7fdf977fe640 1 -- 172.21.15.16:0/2954790501 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdf9c0433b0 con 0x7fdfa0103ca0 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf8c03f560 msgr2=0x7fdf8c041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf8c03f560 0x7fdf8c041a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdfa010f6d0 tx=0x7fdf9000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 msgr2=0x7fdfa01990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa01990a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c005940 tx=0x7fdf9c003c10 comp rx=0 tx=0).stop 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 shutdown_connections 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf8c03f560 0x7fdf8c041a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfa010d100 0x7fdfa019e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfa01045c0 0x7fdfa01995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 --2- 172.21.15.16:0/2954790501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfa0103ca0 0x7fdfa01990a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 >> 172.21.15.16:0/2954790501 conn(0x7fdfa00fd700 msgr2=0x7fdfa00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 shutdown_connections 2024-09-10T23:31:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.320+0000 7fdfa85a0640 1 -- 172.21.15.16:0/2954790501 wait complete. 2024-09-10T23:31:49.549 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 podman[37773]: 2024-09-10 23:31:49.280434357 +0000 UTC m=+0.112829609 container create ddc124c97762cfe018056fd87b14330e81c2a9797045a2e37fc2931a01fa7bf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:31:49.549 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 podman[37773]: 2024-09-10 23:31:49.183268711 +0000 UTC m=+0.015663920 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:31:49.549 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 podman[37773]: 2024-09-10 23:31:49.549416022 +0000 UTC m=+0.381811231 container init ddc124c97762cfe018056fd87b14330e81c2a9797045a2e37fc2931a01fa7bf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T23:31:49.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 -- 172.21.15.16:0/3511866195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 msgr2=0x7f1a6410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 --2- 172.21.15.16:0/3511866195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 0x7f1a6410e860 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009ca0 tx=0x7f1a5c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 -- 172.21.15.16:0/3511866195 shutdown_connections 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 --2- 172.21.15.16:0/3511866195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 0x7f1a6410e860 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 --2- 172.21.15.16:0/3511866195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a641076e0 0x7f1a64107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 --2- 172.21.15.16:0/3511866195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 0x7f1a641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 -- 172.21.15.16:0/3511866195 >> 172.21.15.16:0/3511866195 conn(0x7f1a640fd720 msgr2=0x7f1a640ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 -- 172.21.15.16:0/3511866195 shutdown_connections 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.753+0000 7f1a68906640 1 -- 172.21.15.16:0/3511866195 wait complete. 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 Processor -- start 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 -- start start 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 0x7f1a64199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a641076e0 0x7f1a641996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 0x7f1a6419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64111c00 con 0x7f1a64108060 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64111a80 con 0x7f1a64101cd0 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.754+0000 7f1a68906640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64111d80 con 0x7f1a641076e0 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 0x7f1a64199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a5bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a641076e0 0x7f1a641996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 0x7f1a64199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:55676/0 (socket says 172.21.15.16:55676) 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 -- 172.21.15.16:0/430239495 learned_addr learned my addr 172.21.15.16:0/430239495 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a5bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a641076e0 0x7f1a641996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:46334/0 (socket says 172.21.15.16:46334) 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a62d9d640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 0x7f1a6419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 -- 172.21.15.16:0/430239495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a641076e0 msgr2=0x7f1a641996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a641076e0 0x7f1a641996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 -- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 msgr2=0x7f1a6419ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 0x7f1a6419ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 -- 172.21.15.16:0/430239495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6419f230 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a6259c640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 0x7f1a64199180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400d950 tx=0x7f1a5400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a5b7fe640 1 -- 172.21.15.16:0/430239495 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54017070 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a5b7fe640 1 -- 172.21.15.16:0/430239495 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1a54009c30 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6419f520 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.755+0000 7f1a5b7fe640 1 -- 172.21.15.16:0/430239495 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400f620 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.756+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641a5be0 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.756+0000 7f1a5b7fe640 1 -- 172.21.15.16:0/430239495 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f1a54010460 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.756+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a641020b0 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.757+0000 7f1a5b7fe640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a5003f560 0x7f1a50041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.757+0000 7f1a5b7fe640 1 -- 172.21.15.16:0/430239495 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1a54053b30 con 0x7f1a64101cd0 2024-09-10T23:31:49.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.757+0000 7f1a5bfff640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a5003f560 0x7f1a50041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.757+0000 7f1a5bfff640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a5003f560 0x7f1a50041a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a64106ef0 tx=0x7f1a4c00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:49.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.762+0000 7f1a5b7fe640 1 -- 172.21.15.16:0/430239495 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1a54015d40 con 0x7f1a64101cd0 2024-09-10T23:31:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.950+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f1a6419a2b0 con 0x7f1a64101cd0 2024-09-10T23:31:49.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.954+0000 7f1a5b7fe640 1 -- 172.21.15.16:0/430239495 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v14)=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f1a5400fce0 con 0x7f1a64101cd0 2024-09-10T23:31:49.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a5003f560 msgr2=0x7f1a50041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a5003f560 0x7f1a50041a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a64106ef0 tx=0x7f1a4c00b410 comp rx=0 tx=0).stop 2024-09-10T23:31:49.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 msgr2=0x7f1a64199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 0x7f1a64199180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400d950 tx=0x7f1a5400de10 comp rx=0 tx=0).stop 2024-09-10T23:31:49.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 shutdown_connections 2024-09-10T23:31:49.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a64108060 0x7f1a6419ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a641076e0 0x7f1a641996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a5003f560 0x7f1a50041a20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 --2- 172.21.15.16:0/430239495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a64101cd0 0x7f1a64199180 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 >> 172.21.15.16:0/430239495 conn(0x7f1a640fd720 msgr2=0x7f1a6406b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:49.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 shutdown_connections 2024-09-10T23:31:49.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:49.956+0000 7f1a68906640 1 -- 172.21.15.16:0/430239495 wait complete. 2024-09-10T23:31:50.019 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 podman[37773]: 2024-09-10 23:31:49.552543409 +0000 UTC m=+0.384938630 container start ddc124c97762cfe018056fd87b14330e81c2a9797045a2e37fc2931a01fa7bf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T23:31:50.019 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 ceph-mgr[37792]: -- 172.21.15.71:0/2742456930 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555a5a890e0 con 0x5555a5a67400 2024-09-10T23:31:50.019 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 bash[37773]: ddc124c97762cfe018056fd87b14330e81c2a9797045a2e37fc2931a01fa7bf2 2024-09-10T23:31:50.019 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:31:49 smithi071 systemd[1]: Started Ceph mgr.z for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:31:50.213 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3416678538' entity='client.admin' 2024-09-10T23:31:50.213 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2954790501' entity='client.admin' 2024-09-10T23:31:50.213 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.213 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.213 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.213 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:50.214 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:31:50.214 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:50.214 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:50.214 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:50 smithi016 ceph-mon[30855]: from='client.? ' entity='client.admin' 2024-09-10T23:31:50.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3416678538' entity='client.admin' 2024-09-10T23:31:50.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2954790501' entity='client.admin' 2024-09-10T23:31:50.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.327 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.328 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.328 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:50.328 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:31:50.328 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:50.328 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:50.328 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:50 smithi066 ceph-mon[34761]: from='client.? ' entity='client.admin' 2024-09-10T23:31:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:50.397 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:50.398 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:50.399 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3416678538' entity='client.admin' 2024-09-10T23:31:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2954790501' entity='client.admin' 2024-09-10T23:31:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:31:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:50 smithi071 ceph-mon[35018]: from='client.? ' entity='client.admin' 2024-09-10T23:31:50.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-10T23:31:50.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-10T23:31:51.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:51 smithi016 ceph-mon[30855]: Deploying daemon mgr.y on smithi066 2024-09-10T23:31:51.349 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:51 smithi066 ceph-mon[34761]: Deploying daemon mgr.y on smithi066 2024-09-10T23:31:51.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:51 smithi071 ceph-mon[35018]: Deploying daemon mgr.y on smithi066 2024-09-10T23:31:51.772 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:51 smithi066 systemd[1]: Starting Ceph mgr.y for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:31:52.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.026+0000 7f4760c98640 1 -- 172.21.15.16:0/3692071437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c108020 msgr2=0x7f475c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.026+0000 7f4760c98640 1 --2- 172.21.15.16:0/3692071437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c108020 0x7f475c10e820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4754009ca0 tx=0x7f475402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 -- 172.21.15.16:0/3692071437 shutdown_connections 2024-09-10T23:31:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 --2- 172.21.15.16:0/3692071437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c108020 0x7f475c10e820 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 --2- 172.21.15.16:0/3692071437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f475c1076a0 0x7f475c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 --2- 172.21.15.16:0/3692071437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c101c90 0x7f475c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 -- 172.21.15.16:0/3692071437 >> 172.21.15.16:0/3692071437 conn(0x7f475c0fd700 msgr2=0x7f475c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 -- 172.21.15.16:0/3692071437 shutdown_connections 2024-09-10T23:31:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 -- 172.21.15.16:0/3692071437 wait complete. 2024-09-10T23:31:52.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 Processor -- start 2024-09-10T23:31:52.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.027+0000 7f4760c98640 1 -- start start 2024-09-10T23:31:52.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4760c98640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f475c101c90 0x7f475c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4760c98640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c1076a0 0x7f475c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4760c98640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c108020 0x7f475c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4760c98640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f475c111b80 con 0x7f475c108020 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4760c98640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f475c111a00 con 0x7f475c1076a0 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4760c98640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f475c111d00 con 0x7f475c101c90 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c108020 0x7f475c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4759d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c1076a0 0x7f475c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f475c101c90 0x7f475c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c108020 0x7f475c19eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33344/0 (socket says 172.21.15.16:33344) 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 -- 172.21.15.16:0/1501183495 learned_addr learned my addr 172.21.15.16:0/1501183495 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 -- 172.21.15.16:0/1501183495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f475c101c90 msgr2=0x7f475c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f475c101c90 0x7f475c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 -- 172.21.15.16:0/1501183495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c1076a0 msgr2=0x7f475c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c1076a0 0x7f475c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 -- 172.21.15.16:0/1501183495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c19f300 con 0x7f475c108020 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f4759d9b640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c1076a0 0x7f475c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.028+0000 7f475ad9d640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c108020 0x7f475c19eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4754031040 tx=0x7f4754032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:52.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.029+0000 7f474b7fe640 1 -- 172.21.15.16:0/1501183495 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754003b70 con 0x7f475c108020 2024-09-10T23:31:52.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.029+0000 7f474b7fe640 1 -- 172.21.15.16:0/1501183495 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4754003d10 con 0x7f475c108020 2024-09-10T23:31:52.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.029+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c19f590 con 0x7f475c108020 2024-09-10T23:31:52.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.029+0000 7f474b7fe640 1 -- 172.21.15.16:0/1501183495 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754030b20 con 0x7f475c108020 2024-09-10T23:31:52.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.029+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c1a5cb0 con 0x7f475c108020 2024-09-10T23:31:52.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.030+0000 7f474b7fe640 1 -- 172.21.15.16:0/1501183495 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f4754030cc0 con 0x7f475c108020 2024-09-10T23:31:52.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.030+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c102070 con 0x7f475c108020 2024-09-10T23:31:52.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.030+0000 7f474b7fe640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f474403f560 0x7f4744041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.030+0000 7f474b7fe640 1 -- 172.21.15.16:0/1501183495 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4754074ef0 con 0x7f475c108020 2024-09-10T23:31:52.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.030+0000 7f475a59c640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f474403f560 0x7f4744041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.031+0000 7f475a59c640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f474403f560 0x7f4744041a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f474c009bd0 tx=0x7f474c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.035+0000 7f474b7fe640 1 -- 172.21.15.16:0/1501183495 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f475402ee00 con 0x7f475c108020 2024-09-10T23:31:52.052 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:51 smithi066 podman[37061]: 2024-09-10 23:31:51.674447332 +0000 UTC m=+0.016312511 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:31:52.052 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:51 smithi066 podman[37061]: 2024-09-10 23:31:51.774101484 +0000 UTC m=+0.115966695 container create 2bf6133cebaacedea921c37933b297983b34f9019f919d37afa3d6243c8e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T23:31:52.052 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:51 smithi066 podman[37061]: 2024-09-10 23:31:51.99293289 +0000 UTC m=+0.334798060 container init 2bf6133cebaacedea921c37933b297983b34f9019f919d37afa3d6243c8e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T23:31:52.052 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:51 smithi066 podman[37061]: 2024-09-10 23:31:51.995682884 +0000 UTC m=+0.337548054 container start 2bf6133cebaacedea921c37933b297983b34f9019f919d37afa3d6243c8e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T23:31:52.052 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mgr[37081]: -- 172.21.15.66:0/3760981175 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f654fe70e0 con 0x55f654fc5000 2024-09-10T23:31:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.223+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f475c1a5fb0 con 0x7f475c108020 2024-09-10T23:31:52.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.226+0000 7f474b7fe640 1 -- 172.21.15.16:0/1501183495 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f475403b410 con 0x7f475c108020 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f474403f560 msgr2=0x7f4744041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f474403f560 0x7f4744041a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f474c009bd0 tx=0x7f474c005f90 comp rx=0 tx=0).stop 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c108020 msgr2=0x7f475c19eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c108020 0x7f475c19eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4754031040 tx=0x7f4754032fb0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 shutdown_connections 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f475c108020 0x7f475c19eb30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f474403f560 0x7f4744041a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f475c1076a0 0x7f475c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 --2- 172.21.15.16:0/1501183495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f475c101c90 0x7f475c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 >> 172.21.15.16:0/1501183495 conn(0x7f475c0fd700 msgr2=0x7f475c106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:52.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.228+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 shutdown_connections 2024-09-10T23:31:52.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:52.229+0000 7f4760c98640 1 -- 172.21.15.16:0/1501183495 wait complete. 2024-09-10T23:31:52.551 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:52 smithi066 bash[37061]: 2bf6133cebaacedea921c37933b297983b34f9019f919d37afa3d6243c8e7cc5 2024-09-10T23:31:52.551 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:31:52 smithi066 systemd[1]: Started Ceph mgr.y for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:31:52.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:52 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1543140562' entity='client.admin' 2024-09-10T23:31:52.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:52 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1501183495' entity='client.admin' 2024-09-10T23:31:52.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:52.880 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:52 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1543140562' entity='client.admin' 2024-09-10T23:31:52.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:52 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1501183495' entity='client.admin' 2024-09-10T23:31:52.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:52.932 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:52.934 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:52.934 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:52.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1543140562' entity='client.admin' 2024-09-10T23:31:52.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.991 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:52.991 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1501183495' entity='client.admin' 2024-09-10T23:31:52.991 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:31:53.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 -- 172.21.15.16:0/3532468718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec70108020 msgr2=0x7fec7010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 --2- 172.21.15.16:0/3532468718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec70108020 0x7fec7010e820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec68009ca0 tx=0x7fec6802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 -- 172.21.15.16:0/3532468718 shutdown_connections 2024-09-10T23:31:53.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 --2- 172.21.15.16:0/3532468718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec70108020 0x7fec7010e820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 --2- 172.21.15.16:0/3532468718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec701076a0 0x7fec70107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 --2- 172.21.15.16:0/3532468718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec70101c90 0x7fec70102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 -- 172.21.15.16:0/3532468718 >> 172.21.15.16:0/3532468718 conn(0x7fec700fd700 msgr2=0x7fec700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 -- 172.21.15.16:0/3532468718 shutdown_connections 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.379+0000 7fec748f7640 1 -- 172.21.15.16:0/3532468718 wait complete. 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 Processor -- start 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 -- start start 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec70101c90 0x7fec70199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec701076a0 0x7fec70199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec70108020 0x7fec7019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec70111bc0 con 0x7fec701076a0 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec70111a40 con 0x7fec70108020 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec748f7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec70111d40 con 0x7fec70101c90 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec701076a0 0x7fec70199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec701076a0 0x7fec70199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33326/0 (socket says 172.21.15.16:33326) 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 -- 172.21.15.16:0/1543140562 learned_addr learned my addr 172.21.15.16:0/1543140562 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6e59c640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec70101c90 0x7fec70199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6ed9d640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec70108020 0x7fec7019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 -- 172.21.15.16:0/1543140562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec70101c90 msgr2=0x7fec70199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec70101c90 0x7fec70199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 -- 172.21.15.16:0/1543140562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec70108020 msgr2=0x7fec7019ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec70108020 0x7fec7019ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.380+0000 7fec6dd9b640 1 -- 172.21.15.16:0/1543140562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7019f200 con 0x7fec701076a0 2024-09-10T23:31:53.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.381+0000 7fec6dd9b640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec701076a0 0x7fec70199690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec6400d950 tx=0x7fec6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.381+0000 7fec5f7fe640 1 -- 172.21.15.16:0/1543140562 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64017030 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.381+0000 7fec5f7fe640 1 -- 172.21.15.16:0/1543140562 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fec64004020 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.381+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7019f4f0 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.381+0000 7fec5f7fe640 1 -- 172.21.15.16:0/1543140562 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec640055e0 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.381+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec701a5d80 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.382+0000 7fec5f7fe640 1 -- 172.21.15.16:0/1543140562 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7fec640047a0 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.382+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec70102070 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.382+0000 7fec5f7fe640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec5803f560 0x7fec58041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.382+0000 7fec5f7fe640 1 -- 172.21.15.16:0/1543140562 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fec64053740 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.382+0000 7fec6e59c640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec5803f560 0x7fec58041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.383+0000 7fec6e59c640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec5803f560 0x7fec58041a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec60009bd0 tx=0x7fec60005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.387+0000 7fec5f7fe640 1 -- 172.21.15.16:0/1543140562 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fec64004ac0 con 0x7fec701076a0 2024-09-10T23:31:53.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.573+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fec7002e5c0 con 0x7fec701076a0 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.577+0000 7fec5f7fe640 1 -- 172.21.15.16:0/1543140562 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v15)=0 v15) ==== 119+0+0 (secure 0 0 0) 0x7fec6401ae30 con 0x7fec701076a0 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec5803f560 msgr2=0x7fec58041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec5803f560 0x7fec58041a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec60009bd0 tx=0x7fec60005f90 comp rx=0 tx=0).stop 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec701076a0 msgr2=0x7fec70199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec701076a0 0x7fec70199690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec6400d950 tx=0x7fec6400de10 comp rx=0 tx=0).stop 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 shutdown_connections 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec5803f560 0x7fec58041a20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec70108020 0x7fec7019ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec701076a0 0x7fec70199690 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 --2- 172.21.15.16:0/1543140562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec70101c90 0x7fec70199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 >> 172.21.15.16:0/1543140562 conn(0x7fec700fd700 msgr2=0x7fec7006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 shutdown_connections 2024-09-10T23:31:53.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:51.579+0000 7fec748f7640 1 -- 172.21.15.16:0/1543140562 wait complete. 2024-09-10T23:31:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.753+0000 7f9fba3fc640 1 -- 172.21.15.16:0/4092293930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb41076a0 msgr2=0x7f9fb4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.753+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/4092293930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb41076a0 0x7f9fb4107ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009860 tx=0x7f9fa802a340 comp rx=0 tx=0).stop 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.753+0000 7f9fba3fc640 1 -- 172.21.15.16:0/4092293930 shutdown_connections 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.753+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/4092293930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb4108020 0x7f9fb410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.753+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/4092293930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb41076a0 0x7f9fb4107ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.753+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/4092293930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fb4101c90 0x7f9fb4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.754+0000 7f9fba3fc640 1 -- 172.21.15.16:0/4092293930 >> 172.21.15.16:0/4092293930 conn(0x7f9fb40fd700 msgr2=0x7f9fb40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.754+0000 7f9fba3fc640 1 -- 172.21.15.16:0/4092293930 shutdown_connections 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.754+0000 7f9fba3fc640 1 -- 172.21.15.16:0/4092293930 wait complete. 2024-09-10T23:31:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.754+0000 7f9fba3fc640 1 Processor -- start 2024-09-10T23:31:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.754+0000 7f9fba3fc640 1 -- start start 2024-09-10T23:31:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fba3fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb4101c90 0x7f9fb4199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fba3fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fb41076a0 0x7f9fb4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fba3fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb4108020 0x7f9fb419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fba3fc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4111b80 con 0x7f9fb41076a0 2024-09-10T23:31:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fba3fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4111a00 con 0x7f9fb4101c90 2024-09-10T23:31:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fba3fc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4111d00 con 0x7f9fb4108020 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb4101c90 0x7f9fb4199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fb41076a0 0x7f9fb4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb8999640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb4108020 0x7f9fb419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb4101c90 0x7f9fb4199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:34340/0 (socket says 172.21.15.16:34340) 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fb41076a0 0x7f9fb4199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60878/0 (socket says 172.21.15.16:60878) 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 -- 172.21.15.16:0/2539979682 learned_addr learned my addr 172.21.15.16:0/2539979682 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 -- 172.21.15.16:0/2539979682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb4108020 msgr2=0x7f9fb419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb4108020 0x7f9fb419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 -- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fb41076a0 msgr2=0x7f9fb4199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fb41076a0 0x7f9fb4199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 -- 172.21.15.16:0/2539979682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb419f2d0 con 0x7f9fb4101c90 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.755+0000 7f9fb3fff640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb4101c90 0x7f9fb4199220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400e9c0 tx=0x7f9fa400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.756+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400cde0 con 0x7f9fb4101c90 2024-09-10T23:31:53.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.756+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9fa40035f0 con 0x7f9fb4101c90 2024-09-10T23:31:53.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.756+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4010670 con 0x7f9fb4101c90 2024-09-10T23:31:53.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.756+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb419f5c0 con 0x7f9fb4101c90 2024-09-10T23:31:53.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.756+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb41a5e50 con 0x7f9fb4101c90 2024-09-10T23:31:53.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.757+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f9fa4004020 con 0x7f9fb4101c90 2024-09-10T23:31:53.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.757+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb4102070 con 0x7f9fb4101c90 2024-09-10T23:31:53.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.757+0000 7f9fb17fa640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9f9c03f560 0x7f9f9c041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.757+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9fa4054210 con 0x7f9fb4101c90 2024-09-10T23:31:53.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.757+0000 7f9fb37fe640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9f9c03f560 0x7f9f9c041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.758+0000 7f9fb37fe640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9f9c03f560 0x7f9f9c041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009830 tx=0x7f9fa80058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.766+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9fa401fd90 con 0x7f9fb4101c90 2024-09-10T23:31:53.869 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:53.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:53.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.956+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f9fb41a6080 con 0x7f9fb4101c90 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.964+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa40037a0 con 0x7f9fb4101c90 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.964+0000 7f9fb17fa640 1 -- 172.21.15.16:0/2539979682 <== mon.2 v2:172.21.15.66:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7f9fa4007d30 con 0x7f9fb4101c90 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9f9c03f560 msgr2=0x7f9f9c041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9f9c03f560 0x7f9f9c041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009830 tx=0x7f9fa80058b0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb4101c90 msgr2=0x7f9fb4199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb4101c90 0x7f9fb4199220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400e9c0 tx=0x7f9fa400ee80 comp rx=0 tx=0).stop 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 shutdown_connections 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fb4108020 0x7f9fb419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fb41076a0 0x7f9fb4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9f9c03f560 0x7f9f9c041a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 --2- 172.21.15.16:0/2539979682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb4101c90 0x7f9fb4199220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 >> 172.21.15.16:0/2539979682 conn(0x7f9fb40fd700 msgr2=0x7f9fb41006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 shutdown_connections 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:53.967+0000 7f9fba3fc640 1 -- 172.21.15.16:0/2539979682 wait complete. 2024-09-10T23:31:54.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:54.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:54.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:54.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:54.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:54.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:54.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:31:54.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:31:54.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:31:54.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:31:54.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:31:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.628 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.628 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.628 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.629 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.633 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi016') 2024-09-10T23:31:54.808 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.808 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:54.808 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: Reconfiguring daemon mgr.x on smithi016 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: from='client.? ' entity='client.admin' 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: Standby manager daemon z started 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:31:55.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:54 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:31:55.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:31:55.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: Reconfiguring daemon mgr.x on smithi016 2024-09-10T23:31:55.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: from='client.? ' entity='client.admin' 2024-09-10T23:31:55.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: Standby manager daemon z started 2024-09-10T23:31:55.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:31:55.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:31:55.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:31:55.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:54 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:31:55.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:31:55.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: Reconfiguring daemon mgr.x on smithi016 2024-09-10T23:31:55.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: from='client.? ' entity='client.admin' 2024-09-10T23:31:55.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: Standby manager daemon z started 2024-09-10T23:31:55.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:31:55.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:31:55.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:31:55.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:54 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.71:0/3479304002' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:31:55.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.604+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/1426693748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e4101d10 msgr2=0x7fb3e41020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.604+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/1426693748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e4101d10 0x7fb3e41020f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009900 tx=0x7fb3d402a410 comp rx=0 tx=0).stop 2024-09-10T23:31:55.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.604+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/1426693748 shutdown_connections 2024-09-10T23:31:55.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.604+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/1426693748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e41080a0 0x7fb3e410e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.604+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/1426693748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e4107720 0x7fb3e4107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.604+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/1426693748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e4101d10 0x7fb3e41020f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.604+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/1426693748 >> 172.21.15.16:0/1426693748 conn(0x7fb3e40fd7c0 msgr2=0x7fb3e40ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:55.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.605+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/1426693748 shutdown_connections 2024-09-10T23:31:55.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.605+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/1426693748 wait complete. 2024-09-10T23:31:55.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 Processor -- start 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 -- start start 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e4101d10 0x7fb3e4197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e4107720 0x7fb3e4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e41080a0 0x7fb3e4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4111d70 con 0x7fb3e41080a0 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4111bf0 con 0x7fb3e4101d10 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3ea1f6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4111ef0 con 0x7fb3e4107720 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e41080a0 0x7fb3e4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3e37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e4101d10 0x7fb3e4197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e41080a0 0x7fb3e4198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60904/0 (socket says 172.21.15.16:60904) 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3e3fff640 1 -- 172.21.15.16:0/758390159 learned_addr learned my addr 172.21.15.16:0/758390159 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.606+0000 7fb3e2ffd640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e4107720 0x7fb3e4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e37fe640 1 -- 172.21.15.16:0/758390159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e4107720 msgr2=0x7fb3e4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e37fe640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e4107720 0x7fb3e4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e37fe640 1 -- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e41080a0 msgr2=0x7fb3e4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e37fe640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e41080a0 0x7fb3e4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e37fe640 1 -- 172.21.15.16:0/758390159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e41a76d0 con 0x7fb3e4101d10 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e3fff640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e41080a0 0x7fb3e4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e37fe640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e4101d10 0x7fb3e4197ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb3d402aa00 tx=0x7fb3d4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e0ff9640 1 -- 172.21.15.16:0/758390159 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d403f070 con 0x7fb3e4101d10 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e0ff9640 1 -- 172.21.15.16:0/758390159 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3d4031b50 con 0x7fb3e4101d10 2024-09-10T23:31:55.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e41a7960 con 0x7fb3e4101d10 2024-09-10T23:31:55.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3e0ff9640 1 -- 172.21.15.16:0/758390159 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4035030 con 0x7fb3e4101d10 2024-09-10T23:31:55.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.607+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e41a7e10 con 0x7fb3e4101d10 2024-09-10T23:31:55.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.609+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e41020f0 con 0x7fb3e4101d10 2024-09-10T23:31:55.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.609+0000 7fb3e0ff9640 1 -- 172.21.15.16:0/758390159 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7fb3d40316a0 con 0x7fb3e4101d10 2024-09-10T23:31:55.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.610+0000 7fb3e0ff9640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc07a400 0x7fb3cc07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.610+0000 7fb3e0ff9640 1 -- 172.21.15.16:0/758390159 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb3d40bc7f0 con 0x7fb3e4101d10 2024-09-10T23:31:55.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.610+0000 7fb3e2ffd640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc07a400 0x7fb3cc07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.611+0000 7fb3e2ffd640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc07a400 0x7fb3cc07c8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4107450 tx=0x7fb3d8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:55.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.619+0000 7fb3e0ff9640 1 -- 172.21.15.16:0/758390159 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3d4031d00 con 0x7fb3e4101d10 2024-09-10T23:31:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.815+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fb3e406b6e0 con 0x7fb3e4101d10 2024-09-10T23:31:55.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.821+0000 7fb3e0ff9640 1 -- 172.21.15.16:0/758390159 <== mon.2 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v18)=0 v18) ==== 125+0+0 (secure 0 0 0) 0x7fb3d4084d20 con 0x7fb3e4101d10 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc07a400 msgr2=0x7fb3cc07c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc07a400 0x7fb3cc07c8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4107450 tx=0x7fb3d8005f90 comp rx=0 tx=0).stop 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e4101d10 msgr2=0x7fb3e4197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e4101d10 0x7fb3e4197ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb3d402aa00 tx=0x7fb3d4003b90 comp rx=0 tx=0).stop 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 shutdown_connections 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e41080a0 0x7fb3e4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e4107720 0x7fb3e4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc07a400 0x7fb3cc07c8c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 --2- 172.21.15.16:0/758390159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e4101d10 0x7fb3e4197ef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 >> 172.21.15.16:0/758390159 conn(0x7fb3e40fd7c0 msgr2=0x7fb3e40ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:55.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 shutdown_connections 2024-09-10T23:31:55.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:55.823+0000 7fb3ea1f6640 1 -- 172.21.15.16:0/758390159 wait complete. 2024-09-10T23:31:56.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:55 smithi016 ceph-mon[30855]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-10T23:31:56.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:31:56.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:55 smithi016 ceph-mon[30855]: from='client.? ' entity='client.admin' 2024-09-10T23:31:56.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:55 smithi071 ceph-mon[35018]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-10T23:31:56.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:31:56.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:55 smithi071 ceph-mon[35018]: from='client.? ' entity='client.admin' 2024-09-10T23:31:56.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:55 smithi066 ceph-mon[34761]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-10T23:31:56.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:31:56.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:55 smithi066 ceph-mon[34761]: from='client.? ' entity='client.admin' 2024-09-10T23:31:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 -- 172.21.15.16:0/383943121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 msgr2=0x7f0eac10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 --2- 172.21.15.16:0/383943121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac10cb50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009900 tx=0x7f0e9c02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 -- 172.21.15.16:0/383943121 shutdown_connections 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 --2- 172.21.15.16:0/383943121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eac10d120 0x7f0eac10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 --2- 172.21.15.16:0/383943121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac10cb50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 --2- 172.21.15.16:0/383943121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac103b70 0x7f0eac103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 -- 172.21.15.16:0/383943121 >> 172.21.15.16:0/383943121 conn(0x7f0eac0fd720 msgr2=0x7f0eac0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 -- 172.21.15.16:0/383943121 shutdown_connections 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 -- 172.21.15.16:0/383943121 wait complete. 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 Processor -- start 2024-09-10T23:31:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.022+0000 7f0eb3721640 1 -- start start 2024-09-10T23:31:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb3721640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eac103b70 0x7f0eac1019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb3721640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb3721640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac10d120 0x7f0eac102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb3721640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac112de0 con 0x7f0eac104570 2024-09-10T23:31:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb3721640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac112c60 con 0x7f0eac10d120 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb3721640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac112f60 con 0x7f0eac103b70 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60924/0 (socket says 172.21.15.16:60924) 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 -- 172.21.15.16:0/196963792 learned_addr learned my addr 172.21.15.16:0/196963792 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb1cbe640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac10d120 0x7f0eac102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb14bd640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eac103b70 0x7f0eac1019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 -- 172.21.15.16:0/196963792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eac103b70 msgr2=0x7f0eac1019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eac103b70 0x7f0eac1019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 -- 172.21.15.16:0/196963792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac10d120 msgr2=0x7f0eac102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac10d120 0x7f0eac102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 -- 172.21.15.16:0/196963792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac1a76d0 con 0x7f0eac104570 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.023+0000 7f0eb0cbc640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac101f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c005940 tx=0x7f0e9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.024+0000 7f0ea27fc640 1 -- 172.21.15.16:0/196963792 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c03f030 con 0x7f0eac104570 2024-09-10T23:31:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.024+0000 7f0ea27fc640 1 -- 172.21.15.16:0/196963792 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e9c003cb0 con 0x7f0eac104570 2024-09-10T23:31:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.024+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eac1a7960 con 0x7f0eac104570 2024-09-10T23:31:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.024+0000 7f0ea27fc640 1 -- 172.21.15.16:0/196963792 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c035070 con 0x7f0eac104570 2024-09-10T23:31:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.024+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eac1a7ec0 con 0x7f0eac104570 2024-09-10T23:31:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.025+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eac103f50 con 0x7f0eac104570 2024-09-10T23:31:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.025+0000 7f0ea27fc640 1 -- 172.21.15.16:0/196963792 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f0e9c03bbf0 con 0x7f0eac104570 2024-09-10T23:31:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.026+0000 7f0ea27fc640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e9807a400 0x7f0e9807c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.026+0000 7f0eb14bd640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e9807a400 0x7f0e9807c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.026+0000 7f0ea27fc640 1 -- 172.21.15.16:0/196963792 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0e9c0bcab0 con 0x7f0eac104570 2024-09-10T23:31:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.027+0000 7f0eb14bd640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e9807a400 0x7f0e9807c8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800bbe0 tx=0x7f0ea800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.031+0000 7f0ea27fc640 1 -- 172.21.15.16:0/196963792 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0e9c084fe0 con 0x7f0eac104570 2024-09-10T23:31:57.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 -- 172.21.15.16:0/436686474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c101c90 msgr2=0x7f4f3c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 --2- 172.21.15.16:0/436686474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c101c90 0x7f4f3c102070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009900 tx=0x7f4f2c02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:57.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 -- 172.21.15.16:0/436686474 shutdown_connections 2024-09-10T23:31:57.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 --2- 172.21.15.16:0/436686474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f3c108020 0x7f4f3c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 --2- 172.21.15.16:0/436686474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f3c1076a0 0x7f4f3c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 --2- 172.21.15.16:0/436686474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c101c90 0x7f4f3c102070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 -- 172.21.15.16:0/436686474 >> 172.21.15.16:0/436686474 conn(0x7f4f3c0fd700 msgr2=0x7f4f3c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 -- 172.21.15.16:0/436686474 shutdown_connections 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.201+0000 7f4f41de2640 1 -- 172.21.15.16:0/436686474 wait complete. 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 Processor -- start 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 -- start start 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f3c101c90 0x7f4f3c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c1076a0 0x7f4f3c198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f3c108020 0x7f4f3c19db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c111ce0 con 0x7f4f3c1076a0 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c111b60 con 0x7f4f3c108020 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f41de2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c111e60 con 0x7f4f3c101c90 2024-09-10T23:31:57.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c1076a0 0x7f4f3c198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c1076a0 0x7f4f3c198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60950/0 (socket says 172.21.15.16:60950) 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f3affd640 1 -- 172.21.15.16:0/2805705623 learned_addr learned my addr 172.21.15.16:0/2805705623 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f3bfff640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f3c108020 0x7f4f3c19db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.202+0000 7f4f3b7fe640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f3c101c90 0x7f4f3c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f3affd640 1 -- 172.21.15.16:0/2805705623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f3c101c90 msgr2=0x7f4f3c198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f3affd640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f3c101c90 0x7f4f3c198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f3affd640 1 -- 172.21.15.16:0/2805705623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f3c108020 msgr2=0x7f4f3c19db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f3affd640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f3c108020 0x7f4f3c19db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f3affd640 1 -- 172.21.15.16:0/2805705623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3c19e300 con 0x7f4f3c1076a0 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f3bfff640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f3c108020 0x7f4f3c19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f3affd640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c1076a0 0x7f4f3c198790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000d950 tx=0x7f4f3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f38ff9640 1 -- 172.21.15.16:0/2805705623 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30017070 con 0x7f4f3c1076a0 2024-09-10T23:31:57.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f38ff9640 1 -- 172.21.15.16:0/2805705623 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f30009c30 con 0x7f4f3c1076a0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3c19e5f0 con 0x7f4f3c1076a0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f38ff9640 1 -- 172.21.15.16:0/2805705623 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000f620 con 0x7f4f3c1076a0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.203+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f3c1a4cb0 con 0x7f4f3c1076a0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.204+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f3c102070 con 0x7f4f3c1076a0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.205+0000 7f4f38ff9640 1 -- 172.21.15.16:0/2805705623 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f4f30010460 con 0x7f4f3c1076a0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.205+0000 7f4f38ff9640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f2407a400 0x7f4f2407c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.205+0000 7f4f38ff9640 1 -- 172.21.15.16:0/2805705623 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4f3009bb50 con 0x7f4f3c1076a0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.205+0000 7f4f3b7fe640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f2407a400 0x7f4f2407c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.206+0000 7f4f3b7fe640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f2407a400 0x7f4f2407c8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c031440 tx=0x7f4f2c005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.210+0000 7f4f38ff9640 1 -- 172.21.15.16:0/2805705623 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4f30009de0 con 0x7f4f3c1076a0 2024-09-10T23:31:57.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.218+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f0eac02e5c0 con 0x7f0eac104570 2024-09-10T23:31:57.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.222+0000 7f0ea27fc640 1 -- 172.21.15.16:0/196963792 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f0e9c089a10 con 0x7f0eac104570 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e9807a400 msgr2=0x7f0e9807c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e9807a400 0x7f0e9807c8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800bbe0 tx=0x7f0ea800b390 comp rx=0 tx=0).stop 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 msgr2=0x7f0eac101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac101f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c005940 tx=0x7f0e9c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 shutdown_connections 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e9807a400 0x7f0e9807c8c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac10d120 0x7f0eac102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0eac104570 0x7f0eac101f30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 --2- 172.21.15.16:0/196963792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eac103b70 0x7f0eac1019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 >> 172.21.15.16:0/196963792 conn(0x7f0eac0fd720 msgr2=0x7f0eac0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 shutdown_connections 2024-09-10T23:31:57.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.225+0000 7f0eb3721640 1 -- 172.21.15.16:0/196963792 wait complete. 2024-09-10T23:31:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.420+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f4f3c109870 con 0x7f4f3c1076a0 2024-09-10T23:31:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.424+0000 7f4f38ff9640 1 -- 172.21.15.16:0/2805705623 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v20)=0 v20) ==== 133+0+0 (secure 0 0 0) 0x7f4f300640e0 con 0x7f4f3c1076a0 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f2407a400 msgr2=0x7f4f2407c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f2407a400 0x7f4f2407c8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c031440 tx=0x7f4f2c005b50 comp rx=0 tx=0).stop 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c1076a0 msgr2=0x7f4f3c198790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c1076a0 0x7f4f3c198790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000d950 tx=0x7f4f3000de10 comp rx=0 tx=0).stop 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 shutdown_connections 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f2407a400 0x7f4f2407c8c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f3c108020 0x7f4f3c19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3c1076a0 0x7f4f3c198790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 --2- 172.21.15.16:0/2805705623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f3c101c90 0x7f4f3c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 >> 172.21.15.16:0/2805705623 conn(0x7f4f3c0fd700 msgr2=0x7f4f3c105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 shutdown_connections 2024-09-10T23:31:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.426+0000 7f4f41de2640 1 -- 172.21.15.16:0/2805705623 wait complete. 2024-09-10T23:31:57.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 -- 172.21.15.16:0/2309768350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 msgr2=0x7feb4c0758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 --2- 172.21.15.16:0/2309768350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c0758c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009900 tx=0x7feb3c02a410 comp rx=0 tx=0).stop 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 -- 172.21.15.16:0/2309768350 shutdown_connections 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 --2- 172.21.15.16:0/2309768350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb4c10f3b0 0x7feb4c1117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 --2- 172.21.15.16:0/2309768350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4c075e00 0x7feb4c10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 --2- 172.21.15.16:0/2309768350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c0758c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 -- 172.21.15.16:0/2309768350 >> 172.21.15.16:0/2309768350 conn(0x7feb4c0fe830 msgr2=0x7feb4c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 -- 172.21.15.16:0/2309768350 shutdown_connections 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.385+0000 7feb512ec640 1 -- 172.21.15.16:0/2309768350 wait complete. 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 Processor -- start 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 -- start start 2024-09-10T23:31:57.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb4c075e00 0x7feb4c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4c10f3b0 0x7feb4c1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c114f70 con 0x7feb4c0754e0 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c114df0 con 0x7feb4c10f3b0 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb512ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c1150f0 con 0x7feb4c075e00 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60966/0 (socket says 172.21.15.16:60966) 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb4affd640 1 -- 172.21.15.16:0/2594063869 learned_addr learned my addr 172.21.15.16:0/2594063869 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb43fff640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb4c075e00 0x7feb4c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.386+0000 7feb4b7fe640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4c10f3b0 0x7feb4c1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb4affd640 1 -- 172.21.15.16:0/2594063869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb4c075e00 msgr2=0x7feb4c19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb4affd640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb4c075e00 0x7feb4c19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb4affd640 1 -- 172.21.15.16:0/2594063869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4c10f3b0 msgr2=0x7feb4c1a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb4affd640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4c10f3b0 0x7feb4c1a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb4affd640 1 -- 172.21.15.16:0/2594063869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c1a15d0 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb4b7fe640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4c10f3b0 0x7feb4c1a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb4affd640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c19b520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb3c005940 tx=0x7feb3c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb48ff9640 1 -- 172.21.15.16:0/2594063869 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c03f030 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb48ff9640 1 -- 172.21.15.16:0/2594063869 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb3c0044c0 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c1a1860 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb48ff9640 1 -- 172.21.15.16:0/2594063869 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c035070 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.387+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c1a7f80 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.388+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c0758c0 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.389+0000 7feb48ff9640 1 -- 172.21.15.16:0/2594063869 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7feb3c03ba20 con 0x7feb4c0754e0 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.389+0000 7feb48ff9640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7feb3807a400 0x7feb3807c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:57.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.390+0000 7feb43fff640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7feb3807a400 0x7feb3807c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:57.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.390+0000 7feb48ff9640 1 -- 172.21.15.16:0/2594063869 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feb3c0bc920 con 0x7feb4c0754e0 2024-09-10T23:31:57.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.390+0000 7feb43fff640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7feb3807a400 0x7feb3807c8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feb4c1119b0 tx=0x7feb34005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:57.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.393+0000 7feb48ff9640 1 -- 172.21.15.16:0/2594063869 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feb3c084e90 con 0x7feb4c0754e0 2024-09-10T23:31:57.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.589+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7feb4c1a8220 con 0x7feb4c0754e0 2024-09-10T23:31:57.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.593+0000 7feb48ff9640 1 -- 172.21.15.16:0/2594063869 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7feb3c0898c0 con 0x7feb4c0754e0 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7feb3807a400 msgr2=0x7feb3807c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7feb3807a400 0x7feb3807c8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feb4c1119b0 tx=0x7feb34005f90 comp rx=0 tx=0).stop 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 msgr2=0x7feb4c19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c19b520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb3c005940 tx=0x7feb3c0040c0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 shutdown_connections 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7feb3807a400 0x7feb3807c8c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4c10f3b0 0x7feb4c1a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb4c075e00 0x7feb4c19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 --2- 172.21.15.16:0/2594063869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb4c0754e0 0x7feb4c19b520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:57.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.595+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 >> 172.21.15.16:0/2594063869 conn(0x7feb4c0fe830 msgr2=0x7feb4c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:57.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.596+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 shutdown_connections 2024-09-10T23:31:57.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.596+0000 7feb512ec640 1 -- 172.21.15.16:0/2594063869 wait complete. 2024-09-10T23:31:58.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 -- 172.21.15.16:0/2710659644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0690102dc0 msgr2=0x7f06901031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 --2- 172.21.15.16:0/2710659644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0690102dc0 0x7f06901031a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0678009900 tx=0x7f067802a410 comp rx=0 tx=0).stop 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 -- 172.21.15.16:0/2710659644 shutdown_connections 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 --2- 172.21.15.16:0/2710659644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0690109150 0x7f069010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 --2- 172.21.15.16:0/2710659644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06901087d0 0x7f0690108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 --2- 172.21.15.16:0/2710659644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0690102dc0 0x7f06901031a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 -- 172.21.15.16:0/2710659644 >> 172.21.15.16:0/2710659644 conn(0x7f06900fe830 msgr2=0x7f0690100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 -- 172.21.15.16:0/2710659644 shutdown_connections 2024-09-10T23:31:58.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.744+0000 7f0696ae6640 1 -- 172.21.15.16:0/2710659644 wait complete. 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 Processor -- start 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 -- start start 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0690102dc0 0x7f06901992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06901087d0 0x7f0690199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0690109150 0x7f069019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0690112e60 con 0x7f06901087d0 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0690112ce0 con 0x7f0690102dc0 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0696ae6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0690112fe0 con 0x7f0690109150 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f068ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06901087d0 0x7f0690199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f068ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06901087d0 0x7f0690199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60994/0 (socket says 172.21.15.16:60994) 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f068ffff640 1 -- 172.21.15.16:0/70866163 learned_addr learned my addr 172.21.15.16:0/70866163 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0694882640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0690102dc0 0x7f06901992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f0695083640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0690109150 0x7f069019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.745+0000 7f068ffff640 1 -- 172.21.15.16:0/70866163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0690109150 msgr2=0x7f069019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068ffff640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0690109150 0x7f069019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068ffff640 1 -- 172.21.15.16:0/70866163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0690102dc0 msgr2=0x7f06901992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068ffff640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0690102dc0 0x7f06901992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068ffff640 1 -- 172.21.15.16:0/70866163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069019f380 con 0x7f06901087d0 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f0694882640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0690102dc0 0x7f06901992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068ffff640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06901087d0 0x7f0690199810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f068000e9f0 tx=0x7f068000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068dffb640 1 -- 172.21.15.16:0/70866163 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068000cd80 con 0x7f06901087d0 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068dffb640 1 -- 172.21.15.16:0/70866163 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06800054d0 con 0x7f06901087d0 2024-09-10T23:31:58.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069019f670 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f068dffb640 1 -- 172.21.15.16:0/70866163 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680010690 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.746+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06901a5d30 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.747+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06901031a0 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.748+0000 7f068dffb640 1 -- 172.21.15.16:0/70866163 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f0680004e90 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.748+0000 7f068dffb640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f067c07a400 0x7f067c07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.748+0000 7f0694882640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f067c07a400 0x7f067c07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.748+0000 7f068dffb640 1 -- 172.21.15.16:0/70866163 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f068009c290 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.749+0000 7f0694882640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f067c07a400 0x7f067c07c8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0678005ab0 tx=0x7f0678005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.753+0000 7f068dffb640 1 -- 172.21.15.16:0/70866163 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0680064960 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.939+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f069010af30 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.942+0000 7f068dffb640 1 -- 172.21.15.16:0/70866163 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f0680069390 con 0x7f06901087d0 2024-09-10T23:31:58.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f067c07a400 msgr2=0x7f067c07c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f067c07a400 0x7f067c07c8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0678005ab0 tx=0x7f0678005a20 comp rx=0 tx=0).stop 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06901087d0 msgr2=0x7f0690199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06901087d0 0x7f0690199810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f068000e9f0 tx=0x7f068000edf0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 shutdown_connections 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0690109150 0x7f069019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06901087d0 0x7f0690199810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f067c07a400 0x7f067c07c8c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 --2- 172.21.15.16:0/70866163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0690102dc0 0x7f06901992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 >> 172.21.15.16:0/70866163 conn(0x7f06900fe830 msgr2=0x7f0690100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 shutdown_connections 2024-09-10T23:31:58.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:57.944+0000 7f0696ae6640 1 -- 172.21.15.16:0/70866163 wait complete. 2024-09-10T23:31:58.477 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/196963792' entity='client.admin' 2024-09-10T23:31:58.477 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: Standby manager daemon y started 2024-09-10T23:31:58.477 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:31:58.477 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:31:58.478 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:31:58.478 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:31:58.478 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2805705623' entity='client.admin' 2024-09-10T23:31:58.478 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2594063869' entity='client.admin' 2024-09-10T23:31:58.478 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:58 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/70866163' entity='client.admin' 2024-09-10T23:31:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/196963792' entity='client.admin' 2024-09-10T23:31:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: Standby manager daemon y started 2024-09-10T23:31:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:31:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:31:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:31:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:31:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2805705623' entity='client.admin' 2024-09-10T23:31:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2594063869' entity='client.admin' 2024-09-10T23:31:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:58 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/70866163' entity='client.admin' 2024-09-10T23:31:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/196963792' entity='client.admin' 2024-09-10T23:31:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: Standby manager daemon y started 2024-09-10T23:31:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:31:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:31:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:31:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='mgr.? 172.21.15.66:0/3013449317' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:31:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2805705623' entity='client.admin' 2024-09-10T23:31:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2594063869' entity='client.admin' 2024-09-10T23:31:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:58 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/70866163' entity='client.admin' 2024-09-10T23:31:58.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 -- 172.21.15.16:0/590249612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c8103ca0 msgr2=0x7f01c8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 --2- 172.21.15.16:0/590249612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c8103ca0 0x7f01c8104080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009860 tx=0x7f01bc02a340 comp rx=0 tx=0).stop 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 -- 172.21.15.16:0/590249612 shutdown_connections 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 --2- 172.21.15.16:0/590249612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c810d100 0x7f01c810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 --2- 172.21.15.16:0/590249612 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c81045c0 0x7f01c810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 --2- 172.21.15.16:0/590249612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c8103ca0 0x7f01c8104080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 -- 172.21.15.16:0/590249612 >> 172.21.15.16:0/590249612 conn(0x7f01c80fd700 msgr2=0x7f01c80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 -- 172.21.15.16:0/590249612 shutdown_connections 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 -- 172.21.15.16:0/590249612 wait complete. 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.887+0000 7f01ceef8640 1 Processor -- start 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ceef8640 1 -- start start 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ceef8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c8103ca0 0x7f01c8101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ceef8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c81045c0 0x7f01c8101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ceef8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c810d100 0x7f01c81023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ceef8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8112d70 con 0x7f01c8103ca0 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ceef8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8112bf0 con 0x7f01c81045c0 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ceef8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8112ef0 con 0x7f01c810d100 2024-09-10T23:31:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c8103ca0 0x7f01c8101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c8103ca0 0x7f01c8101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32812/0 (socket says 172.21.15.16:32812) 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 -- 172.21.15.16:0/1443707820 learned_addr learned my addr 172.21.15.16:0/1443707820 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01cd495640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c810d100 0x7f01c81023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01c7fff640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c81045c0 0x7f01c8101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 -- 172.21.15.16:0/1443707820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c810d100 msgr2=0x7f01c81023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c810d100 0x7f01c81023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 -- 172.21.15.16:0/1443707820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c81045c0 msgr2=0x7f01c8101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c81045c0 0x7f01c8101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.888+0000 7f01ccc94640 1 -- 172.21.15.16:0/1443707820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c81a76c0 con 0x7f01c8103ca0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.889+0000 7f01ccc94640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c8103ca0 0x7f01c8101950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0303f0 tx=0x7f01bc032eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.889+0000 7f01c5ffb640 1 -- 172.21.15.16:0/1443707820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc040020 con 0x7f01c8103ca0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.889+0000 7f01c5ffb640 1 -- 172.21.15.16:0/1443707820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01bc030450 con 0x7f01c8103ca0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.889+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c81a7950 con 0x7f01c8103ca0 2024-09-10T23:31:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.889+0000 7f01c5ffb640 1 -- 172.21.15.16:0/1443707820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc037040 con 0x7f01c8103ca0 2024-09-10T23:31:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.889+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c81a7e30 con 0x7f01c8103ca0 2024-09-10T23:31:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.891+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c8104080 con 0x7f01c8103ca0 2024-09-10T23:31:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.892+0000 7f01c5ffb640 1 -- 172.21.15.16:0/1443707820 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f01bc004040 con 0x7f01c8103ca0 2024-09-10T23:31:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.892+0000 7f01c5ffb640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f01b80b52a0 0x7f01b80b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.893+0000 7f01c7fff640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f01b80b52a0 0x7f01b80b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.893+0000 7f01c5ffb640 1 -- 172.21.15.16:0/1443707820 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f01bc104310 con 0x7f01c8103ca0 2024-09-10T23:31:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.893+0000 7f01c7fff640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f01b80b52a0 0x7f01b80b7760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01b40096c0 tx=0x7f01b4009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.897+0000 7f01c5ffb640 1 -- 172.21.15.16:0/1443707820 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01bc04a020 con 0x7f01c8103ca0 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.079+0000 7f97e5d71640 1 -- 172.21.15.16:0/762932143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e01076a0 msgr2=0x7f97e0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.079+0000 7f97e5d71640 1 --2- 172.21.15.16:0/762932143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e01076a0 0x7f97e0107ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009900 tx=0x7f97d002a410 comp rx=0 tx=0).stop 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.079+0000 7f97e5d71640 1 -- 172.21.15.16:0/762932143 shutdown_connections 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.079+0000 7f97e5d71640 1 --2- 172.21.15.16:0/762932143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97e0108020 0x7f97e010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.079+0000 7f97e5d71640 1 --2- 172.21.15.16:0/762932143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e01076a0 0x7f97e0107ae0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.079+0000 7f97e5d71640 1 --2- 172.21.15.16:0/762932143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97e0101c90 0x7f97e0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.080+0000 7f97e5d71640 1 -- 172.21.15.16:0/762932143 >> 172.21.15.16:0/762932143 conn(0x7f97e00fd700 msgr2=0x7f97e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.080+0000 7f97e5d71640 1 -- 172.21.15.16:0/762932143 shutdown_connections 2024-09-10T23:31:59.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.080+0000 7f97e5d71640 1 -- 172.21.15.16:0/762932143 wait complete. 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.080+0000 7f97e5d71640 1 Processor -- start 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.080+0000 7f97e5d71640 1 -- start start 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97e5d71640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e0101c90 0x7f97e00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97e5d71640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97e01076a0 0x7f97e00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97e5d71640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97e0108020 0x7f97e00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97e5d71640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97e0111ce0 con 0x7f97e0101c90 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97e5d71640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97e0111b60 con 0x7f97e0108020 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97e5d71640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97e0111e60 con 0x7f97e01076a0 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e0101c90 0x7f97e00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e0101c90 0x7f97e00fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32828/0 (socket says 172.21.15.16:32828) 2024-09-10T23:31:59.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 -- 172.21.15.16:0/2605437805 learned_addr learned my addr 172.21.15.16:0/2605437805 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97deffd640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97e01076a0 0x7f97e00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97dffff640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97e0108020 0x7f97e00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 -- 172.21.15.16:0/2605437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97e01076a0 msgr2=0x7f97e00fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97e01076a0 0x7f97e00fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 -- 172.21.15.16:0/2605437805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97e0108020 msgr2=0x7f97e00fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97e0108020 0x7f97e00fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 -- 172.21.15.16:0/2605437805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e01a76e0 con 0x7f97e0101c90 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97dffff640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97e0108020 0x7f97e00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.081+0000 7f97df7fe640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e0101c90 0x7f97e00fdc00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f97c800d950 tx=0x7f97c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.082+0000 7f97dcff9640 1 -- 172.21.15.16:0/2605437805 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8017070 con 0x7f97e0101c90 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.082+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e01a79d0 con 0x7f97e0101c90 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.082+0000 7f97dcff9640 1 -- 172.21.15.16:0/2605437805 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97c8009c30 con 0x7f97e0101c90 2024-09-10T23:31:59.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.082+0000 7f97dcff9640 1 -- 172.21.15.16:0/2605437805 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c800f620 con 0x7f97e0101c90 2024-09-10T23:31:59.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.082+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e01a7f30 con 0x7f97e0101c90 2024-09-10T23:31:59.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.083+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e0102070 con 0x7f97e0101c90 2024-09-10T23:31:59.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.084+0000 7f97dcff9640 1 -- 172.21.15.16:0/2605437805 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f97c8010460 con 0x7f97e0101c90 2024-09-10T23:31:59.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.085+0000 7f97dcff9640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97cc0b52a0 0x7f97cc0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.085+0000 7f97deffd640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97cc0b52a0 0x7f97cc0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.085+0000 7f97dcff9640 1 -- 172.21.15.16:0/2605437805 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f97c80e3c40 con 0x7f97e0101c90 2024-09-10T23:31:59.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.085+0000 7f97deffd640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97cc0b52a0 0x7f97cc0b7760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97d0031440 tx=0x7f97d0005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.089+0000 7f97dcff9640 1 -- 172.21.15.16:0/2605437805 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f97c80ac700 con 0x7f97e0101c90 2024-09-10T23:31:59.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.099+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f01c802e5c0 con 0x7f01c8103ca0 2024-09-10T23:31:59.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.103+0000 7f01c5ffb640 1 -- 172.21.15.16:0/1443707820 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v25)=0 v25) ==== 116+0+0 (secure 0 0 0) 0x7f01bc0ccdd0 con 0x7f01c8103ca0 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f01b80b52a0 msgr2=0x7f01b80b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f01b80b52a0 0x7f01b80b7760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01b40096c0 tx=0x7f01b4009260 comp rx=0 tx=0).stop 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c8103ca0 msgr2=0x7f01c8101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c8103ca0 0x7f01c8101950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0303f0 tx=0x7f01bc032eb0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 shutdown_connections 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01c810d100 0x7f01c81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f01b80b52a0 0x7f01b80b7760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c81045c0 0x7f01c8101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 --2- 172.21.15.16:0/1443707820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01c8103ca0 0x7f01c8101950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.105+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 >> 172.21.15.16:0/1443707820 conn(0x7f01c80fd700 msgr2=0x7f01c80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.106+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 shutdown_connections 2024-09-10T23:31:59.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.106+0000 7f01ceef8640 1 -- 172.21.15.16:0/1443707820 wait complete. 2024-09-10T23:31:59.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.283+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f97e002e5c0 con 0x7f97e0101c90 2024-09-10T23:31:59.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.286+0000 7f97dcff9640 1 -- 172.21.15.16:0/2605437805 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v26)=0 v26) ==== 108+0+0 (secure 0 0 0) 0x7f97c8009de0 con 0x7f97e0101c90 2024-09-10T23:31:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97cc0b52a0 msgr2=0x7f97cc0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97cc0b52a0 0x7f97cc0b7760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97d0031440 tx=0x7f97d0005b50 comp rx=0 tx=0).stop 2024-09-10T23:31:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e0101c90 msgr2=0x7f97e00fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e0101c90 0x7f97e00fdc00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f97c800d950 tx=0x7f97c800de10 comp rx=0 tx=0).stop 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 shutdown_connections 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97cc0b52a0 0x7f97cc0b7760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97e0108020 0x7f97e00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97e01076a0 0x7f97e00fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 --2- 172.21.15.16:0/2605437805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97e0101c90 0x7f97e00fdc00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 >> 172.21.15.16:0/2605437805 conn(0x7f97e00fd700 msgr2=0x7f97e006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 shutdown_connections 2024-09-10T23:31:59.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.289+0000 7f97e5d71640 1 -- 172.21.15.16:0/2605437805 wait complete. 2024-09-10T23:31:59.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:59 smithi016 ceph-mon[30855]: mgrmap e19: x(active, since 15s), standbys: z, y 2024-09-10T23:31:59.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:31:59.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:59 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1698857003' entity='client.admin' 2024-09-10T23:31:59.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:59 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1272300667' entity='client.admin' 2024-09-10T23:31:59.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:31:59 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1443707820' entity='client.admin' 2024-09-10T23:31:59.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:59 smithi071 ceph-mon[35018]: mgrmap e19: x(active, since 15s), standbys: z, y 2024-09-10T23:31:59.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:31:59.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:59 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1698857003' entity='client.admin' 2024-09-10T23:31:59.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:59 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1272300667' entity='client.admin' 2024-09-10T23:31:59.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:31:59 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1443707820' entity='client.admin' 2024-09-10T23:31:59.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:59 smithi066 ceph-mon[34761]: mgrmap e19: x(active, since 15s), standbys: z, y 2024-09-10T23:31:59.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:31:59.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:59 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1698857003' entity='client.admin' 2024-09-10T23:31:59.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:59 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1272300667' entity='client.admin' 2024-09-10T23:31:59.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:31:59 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1443707820' entity='client.admin' 2024-09-10T23:31:59.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 -- 172.21.15.16:0/414076989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 msgr2=0x7f8268107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 --2- 172.21.15.16:0/414076989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f8268107bc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8258009900 tx=0x7f825802a410 comp rx=0 tx=0).stop 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 -- 172.21.15.16:0/414076989 shutdown_connections 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 --2- 172.21.15.16:0/414076989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8268108100 0x7f826810e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 --2- 172.21.15.16:0/414076989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f8268107bc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 --2- 172.21.15.16:0/414076989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268102990 0x7f8268102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 -- 172.21.15.16:0/414076989 >> 172.21.15.16:0/414076989 conn(0x7f8268076e60 msgr2=0x7f8268077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 -- 172.21.15.16:0/414076989 shutdown_connections 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.750+0000 7f8270399640 1 -- 172.21.15.16:0/414076989 wait complete. 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 Processor -- start 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 -- start start 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8268102990 0x7f826819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f826819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268108100 0x7f82681a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8268111d60 con 0x7f8268107780 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8268111be0 con 0x7f8268102990 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f8270399640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8268111ee0 con 0x7f8268108100 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f826819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f826819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32850/0 (socket says 172.21.15.16:32850) 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 -- 172.21.15.16:0/3092257727 learned_addr learned my addr 172.21.15.16:0/3092257727 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826e135640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8268102990 0x7f826819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826e936640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268108100 0x7f82681a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 -- 172.21.15.16:0/3092257727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268108100 msgr2=0x7f82681a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268108100 0x7f82681a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 -- 172.21.15.16:0/3092257727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8268102990 msgr2=0x7f826819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8268102990 0x7f826819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 -- 172.21.15.16:0/3092257727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82681a56d0 con 0x7f8268107780 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826e936640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268108100 0x7f82681a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.751+0000 7f826d934640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f826819a650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8258005ab0 tx=0x7f8258003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.752+0000 7f825f7fe640 1 -- 172.21.15.16:0/3092257727 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825803f070 con 0x7f8268107780 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.752+0000 7f825f7fe640 1 -- 172.21.15.16:0/3092257727 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8258031d60 con 0x7f8268107780 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.752+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82681a58a0 con 0x7f8268107780 2024-09-10T23:31:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.752+0000 7f825f7fe640 1 -- 172.21.15.16:0/3092257727 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258035030 con 0x7f8268107780 2024-09-10T23:31:59.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.752+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82681a5d80 con 0x7f8268107780 2024-09-10T23:31:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.753+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8268102d70 con 0x7f8268107780 2024-09-10T23:31:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.754+0000 7f825f7fe640 1 -- 172.21.15.16:0/3092257727 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f825803b560 con 0x7f8268107780 2024-09-10T23:31:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.755+0000 7f825f7fe640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82540b5320 0x7f82540b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.755+0000 7f826e135640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82540b5320 0x7f82540b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.755+0000 7f825f7fe640 1 -- 172.21.15.16:0/3092257727 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8258105330 con 0x7f8268107780 2024-09-10T23:31:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.755+0000 7f826e135640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82540b5320 0x7f82540b77e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8264005fd0 tx=0x7f8264005e20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.758+0000 7f825f7fe640 1 -- 172.21.15.16:0/3092257727 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f82580cddf0 con 0x7f8268107780 2024-09-10T23:31:59.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.945+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f82681a6140 con 0x7f8268107780 2024-09-10T23:31:59.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.948+0000 7f825f7fe640 1 -- 172.21.15.16:0/3092257727 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f82580cd6f0 con 0x7f8268107780 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82540b5320 msgr2=0x7f82540b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82540b5320 0x7f82540b77e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8264005fd0 tx=0x7f8264005e20 comp rx=0 tx=0).stop 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 msgr2=0x7f826819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f826819a650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8258005ab0 tx=0x7f8258003d50 comp rx=0 tx=0).stop 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 shutdown_connections 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8268108100 0x7f82681a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8268107780 0x7f826819a650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82540b5320 0x7f82540b77e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 --2- 172.21.15.16:0/3092257727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8268102990 0x7f826819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 >> 172.21.15.16:0/3092257727 conn(0x7f8268076e60 msgr2=0x7f8268100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 shutdown_connections 2024-09-10T23:31:59.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:59.951+0000 7f8270399640 1 -- 172.21.15.16:0/3092257727 wait complete. 2024-09-10T23:32:00.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:00 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2605437805' entity='client.admin' 2024-09-10T23:32:00.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:00 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3092257727' entity='client.admin' 2024-09-10T23:32:00.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/118823290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a0108060 msgr2=0x7fe9a010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/118823290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a0108060 0x7fe9a010e860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe998009ca0 tx=0x7fe99802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/118823290 shutdown_connections 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/118823290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a0108060 0x7fe9a010e860 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/118823290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a01076e0 0x7fe9a0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/118823290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0101cd0 0x7fe9a01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/118823290 >> 172.21.15.16:0/118823290 conn(0x7fe9a00fd720 msgr2=0x7fe9a00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/118823290 shutdown_connections 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.278+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/118823290 wait complete. 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 Processor -- start 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 -- start start 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0101cd0 0x7fe9a0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a01076e0 0x7fe9a0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a0108060 0x7fe9a019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0112e00 con 0x7fe9a01076e0 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0112c80 con 0x7fe9a0108060 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe9a4d1d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0112f80 con 0x7fe9a0101cd0 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe997fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a01076e0 0x7fe9a0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe997fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a01076e0 0x7fe9a0199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32790/0 (socket says 172.21.15.16:32790) 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe997fff640 1 -- 172.21.15.16:0/1698857003 learned_addr learned my addr 172.21.15.16:0/1698857003 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.279+0000 7fe99ed9d640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a0108060 0x7fe9a019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe99e59c640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0101cd0 0x7fe9a0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe997fff640 1 -- 172.21.15.16:0/1698857003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0101cd0 msgr2=0x7fe9a0199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe997fff640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0101cd0 0x7fe9a0199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe997fff640 1 -- 172.21.15.16:0/1698857003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a0108060 msgr2=0x7fe9a019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe997fff640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a0108060 0x7fe9a019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe997fff640 1 -- 172.21.15.16:0/1698857003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a019f3c0 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe997fff640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a01076e0 0x7fe9a0199850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe98800e9f0 tx=0x7fe98800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe9977fe640 1 -- 172.21.15.16:0/1698857003 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98800cd80 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe9977fe640 1 -- 172.21.15.16:0/1698857003 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9880108e0 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a019f6b0 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe9977fe640 1 -- 172.21.15.16:0/1698857003 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988018980 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.280+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01a5f40 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.281+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a0102f80 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.282+0000 7fe9977fe640 1 -- 172.21.15.16:0/1698857003 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fe988010430 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.283+0000 7fe9977fe640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe98c0b5320 0x7fe98c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.283+0000 7fe99e59c640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe98c0b5320 0x7fe98c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.283+0000 7fe9977fe640 1 -- 172.21.15.16:0/1698857003 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe9880e42e0 con 0x7fe9a01076e0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.284+0000 7fe99e59c640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe98c0b5320 0x7fe98c0b77e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe990005fd0 tx=0x7fe99000b590 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.287+0000 7fe9977fe640 1 -- 172.21.15.16:0/1698857003 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe9880acda0 con 0x7fe9a01076e0 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.475+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe9a0109e70 con 0x7fe9a01076e0 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.479+0000 7fe9977fe640 1 -- 172.21.15.16:0/1698857003 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7fe9880ac6a0 con 0x7fe9a01076e0 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.481+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe98c0b5320 msgr2=0x7fe98c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.481+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe98c0b5320 0x7fe98c0b77e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe990005fd0 tx=0x7fe99000b590 comp rx=0 tx=0).stop 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.481+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a01076e0 msgr2=0x7fe9a0199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.481+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a01076e0 0x7fe9a0199850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe98800e9f0 tx=0x7fe98800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 shutdown_connections 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe98c0b5320 0x7fe98c0b77e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9a0108060 0x7fe9a019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9a01076e0 0x7fe9a0199850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 --2- 172.21.15.16:0/1698857003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0101cd0 0x7fe9a0199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 >> 172.21.15.16:0/1698857003 conn(0x7fe9a00fd720 msgr2=0x7fe9a00fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 shutdown_connections 2024-09-10T23:32:00.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.482+0000 7fe9a4d1d640 1 -- 172.21.15.16:0/1698857003 wait complete. 2024-09-10T23:32:00.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:00 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2605437805' entity='client.admin' 2024-09-10T23:32:00.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:00 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3092257727' entity='client.admin' 2024-09-10T23:32:00.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:00 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2605437805' entity='client.admin' 2024-09-10T23:32:00.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:00 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3092257727' entity='client.admin' 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 -- 172.21.15.16:0/4178290792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22201076a0 msgr2=0x7f2220107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 --2- 172.21.15.16:0/4178290792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22201076a0 0x7f2220107ae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2214009900 tx=0x7f221402a410 comp rx=0 tx=0).stop 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 -- 172.21.15.16:0/4178290792 shutdown_connections 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 --2- 172.21.15.16:0/4178290792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2220108020 0x7f222010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 --2- 172.21.15.16:0/4178290792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22201076a0 0x7f2220107ae0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 --2- 172.21.15.16:0/4178290792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2220101c90 0x7f2220102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 -- 172.21.15.16:0/4178290792 >> 172.21.15.16:0/4178290792 conn(0x7f22200fd700 msgr2=0x7f22200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.110+0000 7f2225be0640 1 -- 172.21.15.16:0/4178290792 shutdown_connections 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.111+0000 7f2225be0640 1 -- 172.21.15.16:0/4178290792 wait complete. 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.111+0000 7f2225be0640 1 Processor -- start 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f2225be0640 1 -- start start 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f2225be0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2220101c90 0x7f22201981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f2225be0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22201076a0 0x7f2220198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f2225be0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2220108020 0x7f222019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f2225be0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2220111ca0 con 0x7f2220108020 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f2225be0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2220111b20 con 0x7f22201076a0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f2225be0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2220111e20 con 0x7f2220101c90 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2220108020 0x7f222019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2220108020 0x7f222019dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32876/0 (socket says 172.21.15.16:32876) 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 -- 172.21.15.16:0/3966154477 learned_addr learned my addr 172.21.15.16:0/3966154477 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221effd640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22201076a0 0x7f2220198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221f7fe640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2220101c90 0x7f22201981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 -- 172.21.15.16:0/3966154477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2220101c90 msgr2=0x7f22201981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2220101c90 0x7f22201981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 -- 172.21.15.16:0/3966154477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22201076a0 msgr2=0x7f2220198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22201076a0 0x7f2220198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 -- 172.21.15.16:0/3966154477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222019e2a0 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.112+0000 7f221ffff640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2220108020 0x7f222019dad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f221800cad0 tx=0x7f221800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.113+0000 7f221cff9640 1 -- 172.21.15.16:0/3966154477 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221800ae20 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.113+0000 7f221cff9640 1 -- 172.21.15.16:0/3966154477 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2218005020 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.113+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222019e590 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.113+0000 7f221cff9640 1 -- 172.21.15.16:0/3966154477 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221800f6b0 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.113+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22201a4c50 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.114+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2220102070 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.115+0000 7f221cff9640 1 -- 172.21.15.16:0/3966154477 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f22180054f0 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.116+0000 7f221cff9640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22080b52a0 0x7f22080b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.116+0000 7f221f7fe640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22080b52a0 0x7f22080b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.116+0000 7f221cff9640 1 -- 172.21.15.16:0/3966154477 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22180e44c0 con 0x7f2220108020 2024-09-10T23:32:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.116+0000 7f221f7fe640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22080b52a0 0x7f22080b7760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2210005fd0 tx=0x7f2210005e20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.119+0000 7f221cff9640 1 -- 172.21.15.16:0/3966154477 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2218014030 con 0x7f2220108020 2024-09-10T23:32:01.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.304+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2220199320 con 0x7f2220108020 2024-09-10T23:32:01.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.309+0000 7f221cff9640 1 -- 172.21.15.16:0/3966154477 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f22180acee0 con 0x7f2220108020 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22080b52a0 msgr2=0x7f22080b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22080b52a0 0x7f22080b7760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2210005fd0 tx=0x7f2210005e20 comp rx=0 tx=0).stop 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2220108020 msgr2=0x7f222019dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2220108020 0x7f222019dad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f221800cad0 tx=0x7f221800cf90 comp rx=0 tx=0).stop 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 shutdown_connections 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2220108020 0x7f222019dad0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22080b52a0 0x7f22080b7760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22201076a0 0x7f2220198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 --2- 172.21.15.16:0/3966154477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2220101c90 0x7f22201981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 >> 172.21.15.16:0/3966154477 conn(0x7f22200fd700 msgr2=0x7f22200ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 shutdown_connections 2024-09-10T23:32:01.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:01.311+0000 7f2225be0640 1 -- 172.21.15.16:0/3966154477 wait complete. 2024-09-10T23:32:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 -- 172.21.15.16:0/1374538672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 msgr2=0x7fb75810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1374538672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75810e820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb750009ca0 tx=0x7fb75002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 -- 172.21.15.16:0/1374538672 shutdown_connections 2024-09-10T23:32:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1374538672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75810e820 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1374538672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7581076a0 0x7fb758107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1374538672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 0x7fb758102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 -- 172.21.15.16:0/1374538672 >> 172.21.15.16:0/1374538672 conn(0x7fb7580fd700 msgr2=0x7fb7580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 -- 172.21.15.16:0/1374538672 shutdown_connections 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.769+0000 7fb75dd56640 1 -- 172.21.15.16:0/1374538672 wait complete. 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 Processor -- start 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 -- start start 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 0x7fb758199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7581076a0 0x7fb758199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb758111d30 con 0x7fb758108020 2024-09-10T23:32:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb758111bb0 con 0x7fb758101c90 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.770+0000 7fb75dd56640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb758111eb0 con 0x7fb7581076a0 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 0x7fb758199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32800/0 (socket says 172.21.15.16:32800) 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 0x7fb758199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:34478/0 (socket says 172.21.15.16:34478) 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 -- 172.21.15.16:0/1272300667 learned_addr learned my addr 172.21.15.16:0/1272300667 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb756ffd640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7581076a0 0x7fb758199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 -- 172.21.15.16:0/1272300667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7581076a0 msgr2=0x7fb758199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7581076a0 0x7fb758199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 -- 172.21.15.16:0/1272300667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 msgr2=0x7fb758199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 0x7fb758199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 -- 172.21.15.16:0/1272300667 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75819f2e0 con 0x7fb758108020 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb756ffd640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7581076a0 0x7fb758199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb7577fe640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 0x7fb758199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb757fff640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75819eb10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb750009430 tx=0x7fb7500317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb754ff9640 1 -- 172.21.15.16:0/1272300667 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750003b70 con 0x7fb758108020 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb754ff9640 1 -- 172.21.15.16:0/1272300667 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb750003d10 con 0x7fb758108020 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75819f570 con 0x7fb758108020 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb754ff9640 1 -- 172.21.15.16:0/1272300667 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75002fa30 con 0x7fb758108020 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.771+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7581a5c90 con 0x7fb758108020 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.773+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb758102070 con 0x7fb758108020 2024-09-10T23:32:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.774+0000 7fb754ff9640 1 -- 172.21.15.16:0/1272300667 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fb75002fbd0 con 0x7fb758108020 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.775+0000 7fb754ff9640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb7400b5320 0x7fb7400b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.775+0000 7fb7577fe640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb7400b5320 0x7fb7400b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.775+0000 7fb754ff9640 1 -- 172.21.15.16:0/1272300667 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb750105400 con 0x7fb758108020 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.775+0000 7fb7577fe640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb7400b5320 0x7fb7400b77e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb748009fc0 tx=0x7fb748005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.779+0000 7fb754ff9640 1 -- 172.21.15.16:0/1272300667 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb7500cdec0 con 0x7fb758108020 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.970+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb75810ae70 con 0x7fb758108020 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.974+0000 7fb754ff9640 1 -- 172.21.15.16:0/1272300667 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) ==== 106+0+0 (secure 0 0 0) 0x7fb7500cd7c0 con 0x7fb758108020 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.976+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb7400b5320 msgr2=0x7fb7400b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.976+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb7400b5320 0x7fb7400b77e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb748009fc0 tx=0x7fb748005f90 comp rx=0 tx=0).stop 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.976+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 msgr2=0x7fb75819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.976+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75819eb10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb750009430 tx=0x7fb7500317c0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 shutdown_connections 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb758108020 0x7fb75819eb10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7581076a0 0x7fb758199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb7400b5320 0x7fb7400b77e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 --2- 172.21.15.16:0/1272300667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb758101c90 0x7fb758199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 >> 172.21.15.16:0/1272300667 conn(0x7fb7580fd700 msgr2=0x7fb75806acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 shutdown_connections 2024-09-10T23:32:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:31:58.977+0000 7fb75dd56640 1 -- 172.21.15.16:0/1272300667 wait complete. 2024-09-10T23:32:02.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:02 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3966154477' entity='client.admin' 2024-09-10T23:32:02.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:02 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3966154477' entity='client.admin' 2024-09-10T23:32:02.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:02 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3966154477' entity='client.admin' 2024-09-10T23:32:03.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:03 smithi071 ceph-mon[35018]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:03.544 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:03 smithi016 ceph-mon[30855]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:03.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:03 smithi066 ceph-mon[34761]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:03.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 -- 172.21.15.16:0/1199663154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 msgr2=0x7fdb70102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 --2- 172.21.15.16:0/1199663154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb70102070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009ca0 tx=0x7fdb6002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 -- 172.21.15.16:0/1199663154 shutdown_connections 2024-09-10T23:32:03.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 --2- 172.21.15.16:0/1199663154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb70108020 0x7fdb7010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 --2- 172.21.15.16:0/1199663154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb701076a0 0x7fdb70107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 --2- 172.21.15.16:0/1199663154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb70102070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 -- 172.21.15.16:0/1199663154 >> 172.21.15.16:0/1199663154 conn(0x7fdb700fd700 msgr2=0x7fdb700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 -- 172.21.15.16:0/1199663154 shutdown_connections 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.958+0000 7fdb7571d640 1 -- 172.21.15.16:0/1199663154 wait complete. 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 Processor -- start 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 -- start start 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb7019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb701076a0 0x7fdb7019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb70108020 0x7fdb701a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70111ca0 con 0x7fdb70101c90 2024-09-10T23:32:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70111b20 con 0x7fdb701076a0 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.959+0000 7fdb7571d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70111e20 con 0x7fdb70108020 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb7019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb7019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50700/0 (socket says 172.21.15.16:50700) 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 -- 172.21.15.16:0/3266988605 learned_addr learned my addr 172.21.15.16:0/3266988605 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6e7fc640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb701076a0 0x7fdb7019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6f7fe640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb70108020 0x7fdb701a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 -- 172.21.15.16:0/3266988605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb70108020 msgr2=0x7fdb701a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb70108020 0x7fdb701a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 -- 172.21.15.16:0/3266988605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb701076a0 msgr2=0x7fdb7019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb701076a0 0x7fdb7019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 -- 172.21.15.16:0/3266988605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb701a1590 con 0x7fdb70101c90 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6f7fe640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb70108020 0x7fdb701a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb6effd640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb7019b4e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdb6002ade0 tx=0x7fdb60031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb67fff640 1 -- 172.21.15.16:0/3266988605 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60003b70 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701a1820 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb67fff640 1 -- 172.21.15.16:0/3266988605 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb60003d10 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb67fff640 1 -- 172.21.15.16:0/3266988605 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6002fa80 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.960+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a7f40 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.962+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70102070 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.963+0000 7fdb67fff640 1 -- 172.21.15.16:0/3266988605 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fdb6002fc20 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.963+0000 7fdb67fff640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdb5c0b52a0 0x7fdb5c0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.964+0000 7fdb6e7fc640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdb5c0b52a0 0x7fdb5c0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.964+0000 7fdb67fff640 1 -- 172.21.15.16:0/3266988605 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdb60105300 con 0x7fdb70101c90 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.964+0000 7fdb6e7fc640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdb5c0b52a0 0x7fdb5c0b7760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdb70106f20 tx=0x7fdb5800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.972+0000 7fdb67fff640 1 -- 172.21.15.16:0/3266988605 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdb600cddc0 con 0x7fdb70101c90 2024-09-10T23:32:04.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.164+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fdb701a81d0 con 0x7fdb70101c90 2024-09-10T23:32:04.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.168+0000 7fdb67fff640 1 -- 172.21.15.16:0/3266988605 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7fdb600cd6c0 con 0x7fdb70101c90 2024-09-10T23:32:04.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdb5c0b52a0 msgr2=0x7fdb5c0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdb5c0b52a0 0x7fdb5c0b7760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdb70106f20 tx=0x7fdb5800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 msgr2=0x7fdb7019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb7019b4e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdb6002ade0 tx=0x7fdb60031770 comp rx=0 tx=0).stop 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 shutdown_connections 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb70108020 0x7fdb701a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdb5c0b52a0 0x7fdb5c0b7760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb701076a0 0x7fdb7019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 --2- 172.21.15.16:0/3266988605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101c90 0x7fdb7019b4e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 >> 172.21.15.16:0/3266988605 conn(0x7fdb700fd700 msgr2=0x7fdb7006abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 shutdown_connections 2024-09-10T23:32:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.171+0000 7fdb7571d640 1 -- 172.21.15.16:0/3266988605 wait complete. 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 -- 172.21.15.16:0/1922505672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36441087f0 msgr2=0x7f3644108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 --2- 172.21.15.16:0/1922505672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36441087f0 0x7f3644108c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3638009900 tx=0x7f363802a410 comp rx=0 tx=0).stop 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 -- 172.21.15.16:0/1922505672 shutdown_connections 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 --2- 172.21.15.16:0/1922505672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3644109170 0x7f364410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 --2- 172.21.15.16:0/1922505672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36441087f0 0x7f3644108c30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 --2- 172.21.15.16:0/1922505672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3644102de0 0x7f36441031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 -- 172.21.15.16:0/1922505672 >> 172.21.15.16:0/1922505672 conn(0x7f36440fe830 msgr2=0x7f3644100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 -- 172.21.15.16:0/1922505672 shutdown_connections 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.873+0000 7f3648a98640 1 -- 172.21.15.16:0/1922505672 wait complete. 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 Processor -- start 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 -- start start 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3644102de0 0x7f36441992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36441087f0 0x7f3644199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3644109170 0x7f364419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3644112e10 con 0x7f3644102de0 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3644112c90 con 0x7f36441087f0 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f3648a98640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3644112f90 con 0x7f3644109170 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.874+0000 7f364259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3644102de0 0x7f36441992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3644102de0 0x7f36441992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50688/0 (socket says 172.21.15.16:50688) 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 -- 172.21.15.16:0/3106384287 learned_addr learned my addr 172.21.15.16:0/3106384287 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f3641d9b640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36441087f0 0x7f3644199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f3642d9d640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3644109170 0x7f364419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 -- 172.21.15.16:0/3106384287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3644109170 msgr2=0x7f364419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3644109170 0x7f364419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 -- 172.21.15.16:0/3106384287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36441087f0 msgr2=0x7f3644199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36441087f0 0x7f3644199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 -- 172.21.15.16:0/3106384287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364419f370 con 0x7f3644102de0 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f364259c640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3644102de0 0x7f36441992c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f363400d950 tx=0x7f363400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f36337fe640 1 -- 172.21.15.16:0/3106384287 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634017030 con 0x7f3644102de0 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364419f660 con 0x7f3644102de0 2024-09-10T23:32:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f36337fe640 1 -- 172.21.15.16:0/3106384287 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3634004020 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f36337fe640 1 -- 172.21.15.16:0/3106384287 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36340047a0 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.875+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441a5ef0 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.876+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36441031c0 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.878+0000 7f36337fe640 1 -- 172.21.15.16:0/3106384287 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f3634009a30 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.879+0000 7f36337fe640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f362c0b5320 0x7f362c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.879+0000 7f3641d9b640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f362c0b5320 0x7f362c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.879+0000 7f36337fe640 1 -- 172.21.15.16:0/3106384287 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f36340e4140 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.879+0000 7f3641d9b640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f362c0b5320 0x7f362c0b77e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3638005ab0 tx=0x7f3638005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:03.886+0000 7f36337fe640 1 -- 172.21.15.16:0/3106384287 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f36340acb60 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.080+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f364410af50 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.084+0000 7f36337fe640 1 -- 172.21.15.16:0/3106384287 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v29)=0 v29) ==== 127+0+0 (secure 0 0 0) 0x7f36340ac460 con 0x7f3644102de0 2024-09-10T23:32:05.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f362c0b5320 msgr2=0x7f362c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f362c0b5320 0x7f362c0b77e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3638005ab0 tx=0x7f3638005a20 comp rx=0 tx=0).stop 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3644102de0 msgr2=0x7f36441992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3644102de0 0x7f36441992c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f363400d950 tx=0x7f363400de10 comp rx=0 tx=0).stop 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 shutdown_connections 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3644109170 0x7f364419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f362c0b5320 0x7f362c0b77e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36441087f0 0x7f3644199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 --2- 172.21.15.16:0/3106384287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3644102de0 0x7f36441992c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 >> 172.21.15.16:0/3106384287 conn(0x7f36440fe830 msgr2=0x7f3644100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.086+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 shutdown_connections 2024-09-10T23:32:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.087+0000 7f3648a98640 1 -- 172.21.15.16:0/3106384287 wait complete. 2024-09-10T23:32:05.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:05 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3106384287' entity='client.admin' 2024-09-10T23:32:05.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:05 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3266988605' entity='client.admin' 2024-09-10T23:32:05.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:05 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1638433832' entity='client.admin' 2024-09-10T23:32:05.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:05 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3106384287' entity='client.admin' 2024-09-10T23:32:05.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:05 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3266988605' entity='client.admin' 2024-09-10T23:32:05.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:05 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1638433832' entity='client.admin' 2024-09-10T23:32:05.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:05 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3106384287' entity='client.admin' 2024-09-10T23:32:05.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:05 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3266988605' entity='client.admin' 2024-09-10T23:32:05.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:05 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1638433832' entity='client.admin' 2024-09-10T23:32:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 -- 172.21.15.16:0/2183426138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03381087a0 msgr2=0x7f0338108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 --2- 172.21.15.16:0/2183426138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03381087a0 0x7f0338108be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0328009900 tx=0x7f032802a410 comp rx=0 tx=0).stop 2024-09-10T23:32:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 -- 172.21.15.16:0/2183426138 shutdown_connections 2024-09-10T23:32:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 --2- 172.21.15.16:0/2183426138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0338109120 0x7f033810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 --2- 172.21.15.16:0/2183426138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03381087a0 0x7f0338108be0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 --2- 172.21.15.16:0/2183426138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0338102d90 0x7f0338103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 -- 172.21.15.16:0/2183426138 >> 172.21.15.16:0/2183426138 conn(0x7f03380fe820 msgr2=0x7f0338100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 -- 172.21.15.16:0/2183426138 shutdown_connections 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.602+0000 7f03403cc640 1 -- 172.21.15.16:0/2183426138 wait complete. 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 Processor -- start 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 -- start start 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0338102d90 0x7f0338199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03381087a0 0x7f03381997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0338109120 0x7f033819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0338112df0 con 0x7f0338109120 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0338112c70 con 0x7f03381087a0 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f03403cc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0338112f70 con 0x7f0338102d90 2024-09-10T23:32:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f033e969640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0338109120 0x7f033819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f033e969640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0338109120 0x7f033819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50718/0 (socket says 172.21.15.16:50718) 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.603+0000 7f033e969640 1 -- 172.21.15.16:0/2059254616 learned_addr learned my addr 172.21.15.16:0/2059254616 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033d967640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03381087a0 0x7f03381997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033e168640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0338102d90 0x7f0338199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033e969640 1 -- 172.21.15.16:0/2059254616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0338102d90 msgr2=0x7f0338199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033e969640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0338102d90 0x7f0338199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033e969640 1 -- 172.21.15.16:0/2059254616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03381087a0 msgr2=0x7f03381997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033e969640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03381087a0 0x7f03381997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033e969640 1 -- 172.21.15.16:0/2059254616 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033819f310 con 0x7f0338109120 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033d967640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03381087a0 0x7f03381997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f033e969640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0338109120 0x7f033819eb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f033000eaa0 tx=0x7f033000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f032f7fe640 1 -- 172.21.15.16:0/2059254616 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033000cdb0 con 0x7f0338109120 2024-09-10T23:32:05.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f032f7fe640 1 -- 172.21.15.16:0/2059254616 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0330005020 con 0x7f0338109120 2024-09-10T23:32:05.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f032f7fe640 1 -- 172.21.15.16:0/2059254616 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300116d0 con 0x7f0338109120 2024-09-10T23:32:05.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033819f600 con 0x7f0338109120 2024-09-10T23:32:05.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.604+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03381a5e90 con 0x7f0338109120 2024-09-10T23:32:05.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.605+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0338103170 con 0x7f0338109120 2024-09-10T23:32:05.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.607+0000 7f032f7fe640 1 -- 172.21.15.16:0/2059254616 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f033000f040 con 0x7f0338109120 2024-09-10T23:32:05.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.608+0000 7f032f7fe640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f03240b5320 0x7f03240b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.608+0000 7f033e168640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f03240b5320 0x7f03240b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.608+0000 7f032f7fe640 1 -- 172.21.15.16:0/2059254616 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f03300e4260 con 0x7f0338109120 2024-09-10T23:32:05.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.608+0000 7f033e168640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f03240b5320 0x7f03240b77e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0334009b60 tx=0x7f0334005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.611+0000 7f032f7fe640 1 -- 172.21.15.16:0/2059254616 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0330016030 con 0x7f0338109120 2024-09-10T23:32:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.802+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f033819a390 con 0x7f0338109120 2024-09-10T23:32:05.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.805+0000 7f032f7fe640 1 -- 172.21.15.16:0/2059254616 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v32)=0 v32) ==== 129+0+0 (secure 0 0 0) 0x7f033819a390 con 0x7f0338109120 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f03240b5320 msgr2=0x7f03240b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f03240b5320 0x7f03240b77e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0334009b60 tx=0x7f0334005f90 comp rx=0 tx=0).stop 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0338109120 msgr2=0x7f033819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0338109120 0x7f033819eb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f033000eaa0 tx=0x7f033000ef60 comp rx=0 tx=0).stop 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 shutdown_connections 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0338109120 0x7f033819eb40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f03240b5320 0x7f03240b77e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03381087a0 0x7f03381997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 --2- 172.21.15.16:0/2059254616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0338102d90 0x7f0338199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 >> 172.21.15.16:0/2059254616 conn(0x7f03380fe820 msgr2=0x7f0338100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 shutdown_connections 2024-09-10T23:32:05.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.808+0000 7f03403cc640 1 -- 172.21.15.16:0/2059254616 wait complete. 2024-09-10T23:32:06.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:06 smithi016 ceph-mon[30855]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:06.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:06 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2059254616' entity='client.admin' 2024-09-10T23:32:06.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:06 smithi071 ceph-mon[35018]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:06.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:06 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2059254616' entity='client.admin' 2024-09-10T23:32:06.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:06 smithi066 ceph-mon[34761]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:06.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:06 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2059254616' entity='client.admin' 2024-09-10T23:32:07.104 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi016') 2024-09-10T23:32:07.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi016') 2024-09-10T23:32:07.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.065+0000 7fc233fa4640 1 -- 172.21.15.16:0/4258189550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c1087d0 msgr2=0x7fc22c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.065+0000 7fc233fa4640 1 --2- 172.21.15.16:0/4258189550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c1087d0 0x7fc22c108c10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009900 tx=0x7fc21c02a410 comp rx=0 tx=0).stop 2024-09-10T23:32:07.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.065+0000 7fc233fa4640 1 -- 172.21.15.16:0/4258189550 shutdown_connections 2024-09-10T23:32:07.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.065+0000 7fc233fa4640 1 --2- 172.21.15.16:0/4258189550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc22c109150 0x7fc22c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.065+0000 7fc233fa4640 1 --2- 172.21.15.16:0/4258189550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c1087d0 0x7fc22c108c10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.065+0000 7fc233fa4640 1 --2- 172.21.15.16:0/4258189550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22c102dc0 0x7fc22c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.065+0000 7fc233fa4640 1 -- 172.21.15.16:0/4258189550 >> 172.21.15.16:0/4258189550 conn(0x7fc22c0fe830 msgr2=0x7fc22c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.066+0000 7fc233fa4640 1 -- 172.21.15.16:0/4258189550 shutdown_connections 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.066+0000 7fc233fa4640 1 -- 172.21.15.16:0/4258189550 wait complete. 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.066+0000 7fc233fa4640 1 Processor -- start 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc233fa4640 1 -- start start 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc233fa4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c102dc0 0x7fc22c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc233fa4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22c1087d0 0x7fc22c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc233fa4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc22c109150 0x7fc22c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc233fa4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c112da0 con 0x7fc22c102dc0 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc233fa4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c112c20 con 0x7fc22c109150 2024-09-10T23:32:07.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc233fa4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c112f20 con 0x7fc22c1087d0 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c102dc0 0x7fc22c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c102dc0 0x7fc22c199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50748/0 (socket says 172.21.15.16:50748) 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 -- 172.21.15.16:0/3401077206 learned_addr learned my addr 172.21.15.16:0/3401077206 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc23153f640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22c1087d0 0x7fc22c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 -- 172.21.15.16:0/3401077206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22c1087d0 msgr2=0x7fc22c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22c1087d0 0x7fc22c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 -- 172.21.15.16:0/3401077206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc22c109150 msgr2=0x7fc22c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc232541640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc22c109150 0x7fc22c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc22c109150 0x7fc22c19eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 -- 172.21.15.16:0/3401077206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c19f300 con 0x7fc22c102dc0 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.067+0000 7fc231d40640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c102dc0 0x7fc22c199250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d950 tx=0x7fc22800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.068+0000 7fc222ffd640 1 -- 172.21.15.16:0/3401077206 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228017070 con 0x7fc22c102dc0 2024-09-10T23:32:07.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.068+0000 7fc222ffd640 1 -- 172.21.15.16:0/3401077206 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc228009c30 con 0x7fc22c102dc0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.068+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c19f5f0 con 0x7fc22c102dc0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.068+0000 7fc222ffd640 1 -- 172.21.15.16:0/3401077206 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22800f620 con 0x7fc22c102dc0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.068+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c1a5cb0 con 0x7fc22c102dc0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.069+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c104070 con 0x7fc22c102dc0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.070+0000 7fc222ffd640 1 -- 172.21.15.16:0/3401077206 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fc228005030 con 0x7fc22c102dc0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.071+0000 7fc222ffd640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2180b52a0 0x7fc2180b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.071+0000 7fc23153f640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2180b52a0 0x7fc2180b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.071+0000 7fc222ffd640 1 -- 172.21.15.16:0/3401077206 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc2280e3c10 con 0x7fc22c102dc0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.072+0000 7fc23153f640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2180b52a0 0x7fc2180b7760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc21c031440 tx=0x7fc21c005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:07.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.074+0000 7fc222ffd640 1 -- 172.21.15.16:0/3401077206 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc2280ac6d0 con 0x7fc22c102dc0 2024-09-10T23:32:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.267+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fc22c1031a0 con 0x7fc22c102dc0 2024-09-10T23:32:07.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.271+0000 7fc222ffd640 1 -- 172.21.15.16:0/3401077206 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v33)=0 v33) ==== 120+0+0 (secure 0 0 0) 0x7fc228009de0 con 0x7fc22c102dc0 2024-09-10T23:32:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2180b52a0 msgr2=0x7fc2180b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2180b52a0 0x7fc2180b7760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc21c031440 tx=0x7fc21c005b50 comp rx=0 tx=0).stop 2024-09-10T23:32:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c102dc0 msgr2=0x7fc22c199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c102dc0 0x7fc22c199250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d950 tx=0x7fc22800de10 comp rx=0 tx=0).stop 2024-09-10T23:32:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 shutdown_connections 2024-09-10T23:32:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2180b52a0 0x7fc2180b7760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc22c109150 0x7fc22c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22c1087d0 0x7fc22c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 --2- 172.21.15.16:0/3401077206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc22c102dc0 0x7fc22c199250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 >> 172.21.15.16:0/3401077206 conn(0x7fc22c0fe830 msgr2=0x7fc22c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.273+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 shutdown_connections 2024-09-10T23:32:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:07.274+0000 7fc233fa4640 1 -- 172.21.15.16:0/3401077206 wait complete. 2024-09-10T23:32:07.977 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi016') 2024-09-10T23:32:08.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:08 smithi016 ceph-mon[30855]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:08.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:08 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3401077206' entity='client.admin' 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 -- 172.21.15.16:0/143952350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c1076c0 msgr2=0x7f744c107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 --2- 172.21.15.16:0/143952350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c1076c0 0x7f744c107b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7434009900 tx=0x7f743402a410 comp rx=0 tx=0).stop 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 -- 172.21.15.16:0/143952350 shutdown_connections 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 --2- 172.21.15.16:0/143952350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744c108040 0x7f744c10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 --2- 172.21.15.16:0/143952350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c1076c0 0x7f744c107b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 --2- 172.21.15.16:0/143952350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f744c101cb0 0x7f744c102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 -- 172.21.15.16:0/143952350 >> 172.21.15.16:0/143952350 conn(0x7f744c0fd700 msgr2=0x7f744c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 -- 172.21.15.16:0/143952350 shutdown_connections 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.814+0000 7f7452137640 1 -- 172.21.15.16:0/143952350 wait complete. 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 Processor -- start 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 -- start start 2024-09-10T23:32:08.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744c101cb0 0x7f744c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f744c1076c0 0x7f744c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c108040 0x7f744c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f744c111c90 con 0x7f744c108040 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f744c111b10 con 0x7f744c1076c0 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7452137640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f744c111e10 con 0x7f744c101cb0 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f744bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c108040 0x7f744c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f744bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c108040 0x7f744c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50708/0 (socket says 172.21.15.16:50708) 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f744bfff640 1 -- 172.21.15.16:0/1638433832 learned_addr learned my addr 172.21.15.16:0/1638433832 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f744b7fe640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744c101cb0 0x7f744c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.815+0000 7f7442ffd640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f744c1076c0 0x7f744c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f744bfff640 1 -- 172.21.15.16:0/1638433832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744c101cb0 msgr2=0x7f744c19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f744bfff640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744c101cb0 0x7f744c19a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f744bfff640 1 -- 172.21.15.16:0/1638433832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f744c1076c0 msgr2=0x7f744c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f744bfff640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f744c1076c0 0x7f744c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f744bfff640 1 -- 172.21.15.16:0/1638433832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c1a5490 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f744bfff640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c108040 0x7f744c19ab50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f744400eb10 tx=0x7f744400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f74497fa640 1 -- 172.21.15.16:0/1638433832 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444004b20 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744c1a5780 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f74497fa640 1 -- 172.21.15.16:0/1638433832 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7444004cc0 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f74497fa640 1 -- 172.21.15.16:0/1638433832 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444010670 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.816+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744c1a5c90 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.817+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744c102f60 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.818+0000 7f74497fa640 1 -- 172.21.15.16:0/1638433832 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f7444005020 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.819+0000 7f74497fa640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74380b52a0 0x7f74380b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.819+0000 7f744b7fe640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74380b52a0 0x7f74380b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.819+0000 7f74497fa640 1 -- 172.21.15.16:0/1638433832 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f74440e4690 con 0x7f744c108040 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.820+0000 7f744b7fe640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74380b52a0 0x7f74380b7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f743c00bbe0 tx=0x7f743c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:04.823+0000 7f74497fa640 1 -- 172.21.15.16:0/1638433832 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f74440ad150 con 0x7f744c108040 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.012+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f744c102090 con 0x7f744c108040 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.015+0000 7f74497fa640 1 -- 172.21.15.16:0/1638433832 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f74440aca50 con 0x7f744c108040 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74380b52a0 msgr2=0x7f74380b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74380b52a0 0x7f74380b7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f743c00bbe0 tx=0x7f743c00b390 comp rx=0 tx=0).stop 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c108040 msgr2=0x7f744c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c108040 0x7f744c19ab50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f744400eb10 tx=0x7f744400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 shutdown_connections 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f744c108040 0x7f744c19ab50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74380b52a0 0x7f74380b7760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f744c1076c0 0x7f744c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 --2- 172.21.15.16:0/1638433832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f744c101cb0 0x7f744c19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 >> 172.21.15.16:0/1638433832 conn(0x7f744c0fd700 msgr2=0x7f744c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 shutdown_connections 2024-09-10T23:32:08.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:05.018+0000 7f7452137640 1 -- 172.21.15.16:0/1638433832 wait complete. 2024-09-10T23:32:08.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:08 smithi071 ceph-mon[35018]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:08.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:08 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3401077206' entity='client.admin' 2024-09-10T23:32:08.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:08 smithi066 ceph-mon[34761]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:08.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:08 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3401077206' entity='client.admin' 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 -- 172.21.15.16:0/62362666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 msgr2=0x7f07fc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 --2- 172.21.15.16:0/62362666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc10f950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009ca0 tx=0x7f07f402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 -- 172.21.15.16:0/62362666 shutdown_connections 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 --2- 172.21.15.16:0/62362666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc10f950 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 --2- 172.21.15.16:0/62362666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07fc1087d0 0x7f07fc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 --2- 172.21.15.16:0/62362666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07fc102dc0 0x7f07fc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 -- 172.21.15.16:0/62362666 >> 172.21.15.16:0/62362666 conn(0x7f07fc0fe830 msgr2=0x7f07fc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 -- 172.21.15.16:0/62362666 shutdown_connections 2024-09-10T23:32:10.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.148+0000 7f0802159640 1 -- 172.21.15.16:0/62362666 wait complete. 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 Processor -- start 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 -- start start 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07fc102dc0 0x7f07fc199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07fc1087d0 0x7f07fc1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc112dd0 con 0x7f07fc109150 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc112c50 con 0x7f07fc1087d0 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f0802159640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc112f50 con 0x7f07fc102dc0 2024-09-10T23:32:10.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50762/0 (socket says 172.21.15.16:50762) 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fbfff640 1 -- 172.21.15.16:0/1047054351 learned_addr learned my addr 172.21.15.16:0/1047054351 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fb7fe640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07fc102dc0 0x7f07fc199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07faffd640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07fc1087d0 0x7f07fc1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fbfff640 1 -- 172.21.15.16:0/1047054351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07fc102dc0 msgr2=0x7f07fc199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fbfff640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07fc102dc0 0x7f07fc199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fbfff640 1 -- 172.21.15.16:0/1047054351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07fc1087d0 msgr2=0x7f07fc1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.149+0000 7f07fbfff640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07fc1087d0 0x7f07fc1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f07fbfff640 1 -- 172.21.15.16:0/1047054351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc19f310 con 0x7f07fc109150 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f07faffd640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07fc1087d0 0x7f07fc1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f07fbfff640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc19eb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07f40098d0 tx=0x7f07f40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f07f8ff9640 1 -- 172.21.15.16:0/1047054351 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4003b70 con 0x7f07fc109150 2024-09-10T23:32:10.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc19f5a0 con 0x7f07fc109150 2024-09-10T23:32:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f07f8ff9640 1 -- 172.21.15.16:0/1047054351 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f4003d10 con 0x7f07fc109150 2024-09-10T23:32:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f07f8ff9640 1 -- 172.21.15.16:0/1047054351 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f402fa20 con 0x7f07fc109150 2024-09-10T23:32:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.150+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc1a5cc0 con 0x7f07fc109150 2024-09-10T23:32:10.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.151+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc1031a0 con 0x7f07fc109150 2024-09-10T23:32:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.152+0000 7f07f8ff9640 1 -- 172.21.15.16:0/1047054351 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f07f402fc00 con 0x7f07fc109150 2024-09-10T23:32:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.153+0000 7f07f8ff9640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07e40b52a0 0x7f07e40b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.153+0000 7f07fb7fe640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07e40b52a0 0x7f07e40b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.153+0000 7f07f8ff9640 1 -- 172.21.15.16:0/1047054351 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f07f4105330 con 0x7f07fc109150 2024-09-10T23:32:10.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.154+0000 7f07fb7fe640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07e40b52a0 0x7f07e40b7760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005fd0 tx=0x7f07ec00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:10.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.158+0000 7f07f8ff9640 1 -- 172.21.15.16:0/1047054351 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07f40cddf0 con 0x7f07fc109150 2024-09-10T23:32:10.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:10 smithi016 ceph-mon[30855]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:10.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.332+0000 7f8c89e79640 1 -- 172.21.15.16:0/1494049037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c841087f0 msgr2=0x7f8c84108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.332+0000 7f8c89e79640 1 --2- 172.21.15.16:0/1494049037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c841087f0 0x7f8c84108c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009900 tx=0x7f8c6c02a410 comp rx=0 tx=0).stop 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.332+0000 7f8c89e79640 1 -- 172.21.15.16:0/1494049037 shutdown_connections 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.332+0000 7f8c89e79640 1 --2- 172.21.15.16:0/1494049037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c84109170 0x7f8c8410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.332+0000 7f8c89e79640 1 --2- 172.21.15.16:0/1494049037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c841087f0 0x7f8c84108c30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.333+0000 7f8c89e79640 1 --2- 172.21.15.16:0/1494049037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c84102de0 0x7f8c841031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.333+0000 7f8c89e79640 1 -- 172.21.15.16:0/1494049037 >> 172.21.15.16:0/1494049037 conn(0x7f8c840fe830 msgr2=0x7f8c84100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.333+0000 7f8c89e79640 1 -- 172.21.15.16:0/1494049037 shutdown_connections 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.333+0000 7f8c89e79640 1 -- 172.21.15.16:0/1494049037 wait complete. 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.333+0000 7f8c89e79640 1 Processor -- start 2024-09-10T23:32:10.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.333+0000 7f8c89e79640 1 -- start start 2024-09-10T23:32:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c89e79640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c84102de0 0x7f8c84199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c89e79640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c841087f0 0x7f8c84199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c89e79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c84109170 0x7f8c8419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c89e79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84112df0 con 0x7f8c84109170 2024-09-10T23:32:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c89e79640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84112c70 con 0x7f8c841087f0 2024-09-10T23:32:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c89e79640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84112f70 con 0x7f8c84102de0 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c84109170 0x7f8c8419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c84109170 0x7f8c8419ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50780/0 (socket says 172.21.15.16:50780) 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 -- 172.21.15.16:0/3529355641 learned_addr learned my addr 172.21.15.16:0/3529355641 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c7affd640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c841087f0 0x7f8c84199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c837fe640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c84102de0 0x7f8c84199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 -- 172.21.15.16:0/3529355641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c84102de0 msgr2=0x7f8c84199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c84102de0 0x7f8c84199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 -- 172.21.15.16:0/3529355641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c841087f0 msgr2=0x7f8c84199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c841087f0 0x7f8c84199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 -- 172.21.15.16:0/3529355641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8419f3d0 con 0x7f8c84109170 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c837fe640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c84102de0 0x7f8c84199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.334+0000 7f8c83fff640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c84109170 0x7f8c8419ec00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00eaa0 tx=0x7f8c7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.335+0000 7f8c817fa640 1 -- 172.21.15.16:0/3529355641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00cdb0 con 0x7f8c84109170 2024-09-10T23:32:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.335+0000 7f8c817fa640 1 -- 172.21.15.16:0/3529355641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c7c005020 con 0x7f8c84109170 2024-09-10T23:32:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.335+0000 7f8c817fa640 1 -- 172.21.15.16:0/3529355641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0116d0 con 0x7f8c84109170 2024-09-10T23:32:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.335+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8419f6c0 con 0x7f8c84109170 2024-09-10T23:32:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.335+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c841a5d80 con 0x7f8c84109170 2024-09-10T23:32:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.336+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c841031c0 con 0x7f8c84109170 2024-09-10T23:32:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.337+0000 7f8c817fa640 1 -- 172.21.15.16:0/3529355641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f8c7c00f040 con 0x7f8c84109170 2024-09-10T23:32:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.338+0000 7f8c817fa640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8c700b52a0 0x7f8c700b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.338+0000 7f8c837fe640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8c700b52a0 0x7f8c700b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.338+0000 7f8c817fa640 1 -- 172.21.15.16:0/3529355641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8c7c0e3e40 con 0x7f8c84109170 2024-09-10T23:32:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.339+0000 7f8c837fe640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8c700b52a0 0x7f8c700b7760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c74005fd0 tx=0x7f8c7400b5f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:10.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.343+0000 7f8c817fa640 1 -- 172.21.15.16:0/3529355641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8c7c016030 con 0x7f8c84109170 2024-09-10T23:32:10.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.357+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f07fc10af30 con 0x7f07fc109150 2024-09-10T23:32:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.360+0000 7f07f8ff9640 1 -- 172.21.15.16:0/1047054351 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v34)=0 v34) ==== 115+0+0 (secure 0 0 0) 0x7f07f40cd6f0 con 0x7f07fc109150 2024-09-10T23:32:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07e40b52a0 msgr2=0x7f07e40b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07e40b52a0 0x7f07e40b7760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005fd0 tx=0x7f07ec00b390 comp rx=0 tx=0).stop 2024-09-10T23:32:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 msgr2=0x7f07fc19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc19eb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07f40098d0 tx=0x7f07f40317b0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 shutdown_connections 2024-09-10T23:32:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07fc109150 0x7f07fc19eb40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07e40b52a0 0x7f07e40b7760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07fc1087d0 0x7f07fc1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 --2- 172.21.15.16:0/1047054351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07fc102dc0 0x7f07fc199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 >> 172.21.15.16:0/1047054351 conn(0x7f07fc0fe830 msgr2=0x7f07fc0ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 shutdown_connections 2024-09-10T23:32:10.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.363+0000 7f0802159640 1 -- 172.21.15.16:0/1047054351 wait complete. 2024-09-10T23:32:10.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:10 smithi071 ceph-mon[35018]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:10.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:10 smithi066 ceph-mon[34761]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:10.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.552+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f8c8402e5c0 con 0x7f8c84109170 2024-09-10T23:32:10.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.556+0000 7f8c817fa640 1 -- 172.21.15.16:0/3529355641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) ==== 138+0+0 (secure 0 0 0) 0x7f8c7c0ac860 con 0x7f8c84109170 2024-09-10T23:32:10.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.558+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8c700b52a0 msgr2=0x7f8c700b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.558+0000 7f8c89e79640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8c700b52a0 0x7f8c700b7760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c74005fd0 tx=0x7f8c7400b5f0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.558+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c84109170 msgr2=0x7f8c8419ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.558+0000 7f8c89e79640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c84109170 0x7f8c8419ec00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00eaa0 tx=0x7f8c7c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 shutdown_connections 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c84109170 0x7f8c8419ec00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8c700b52a0 0x7f8c700b7760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c841087f0 0x7f8c84199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 --2- 172.21.15.16:0/3529355641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c84102de0 0x7f8c84199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 >> 172.21.15.16:0/3529355641 conn(0x7f8c840fe830 msgr2=0x7f8c84100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 shutdown_connections 2024-09-10T23:32:10.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:10.560+0000 7f8c89e79640 1 -- 172.21.15.16:0/3529355641 wait complete. 2024-09-10T23:32:11.602 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:11 smithi016 ceph-mon[30855]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:11.602 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:11 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1047054351' entity='client.admin' 2024-09-10T23:32:11.602 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:11 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3529355641' entity='client.admin' 2024-09-10T23:32:11.639 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.639 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.639 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.639 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.639 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.639 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.640 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.640 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.640 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-10T23:32:11.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:11 smithi071 ceph-mon[35018]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:11.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:11 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1047054351' entity='client.admin' 2024-09-10T23:32:11.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:11 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3529355641' entity='client.admin' 2024-09-10T23:32:11.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:11 smithi066 ceph-mon[34761]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:11.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:11 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1047054351' entity='client.admin' 2024-09-10T23:32:11.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:11 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3529355641' entity='client.admin' 2024-09-10T23:32:12.173 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi016') 2024-09-10T23:32:12.174 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi016') 2024-09-10T23:32:13.376 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi016') 2024-09-10T23:32:13.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi016') 2024-09-10T23:32:13.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi016') 2024-09-10T23:32:13.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi016') 2024-09-10T23:32:13.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi016') 2024-09-10T23:32:13.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '65d5fa74-6fcc-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi016') 2024-09-10T23:32:13.728 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T23:32:13.728 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:32:13.728 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:32:13.746 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:32:13.746 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-10 23:30:52.058952111 +0000 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-10 23:26:12.615302224 +0000 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-10 23:26:12.615302224 +0000 2024-09-10T23:32:13.803 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-10 23:26:12.615302224 +0000 2024-09-10T23:32:13.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:32:13.870 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-10T23:32:13.871 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-10T23:32:13.871 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000116343 s, 4.4 MB/s 2024-09-10T23:32:13.872 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:32:13.930 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-09-10T23:32:13.986 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:32:13.986 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:13.987 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T23:32:13.987 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:13.987 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:13.987 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-10 23:30:52.087951663 +0000 2024-09-10T23:32:13.987 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-10 23:26:12.932297378 +0000 2024-09-10T23:32:13.987 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-10 23:26:12.932297378 +0000 2024-09-10T23:32:13.987 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-10 23:26:12.932297378 +0000 2024-09-10T23:32:13.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:32:14.052 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-10T23:32:14.052 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-10T23:32:14.052 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000114159 s, 4.5 MB/s 2024-09-10T23:32:14.053 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:32:14.110 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-09-10T23:32:14.166 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:32:14.166 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:14.166 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T23:32:14.166 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:14.166 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:14.166 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-10 23:30:52.117951200 +0000 2024-09-10T23:32:14.166 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-10 23:26:13.254292457 +0000 2024-09-10T23:32:14.167 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-10 23:26:13.254292457 +0000 2024-09-10T23:32:14.167 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-10 23:26:13.254292457 +0000 2024-09-10T23:32:14.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:32:14.230 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-10T23:32:14.230 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-10T23:32:14.230 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000111453 s, 4.6 MB/s 2024-09-10T23:32:14.232 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:32:14.289 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-09-10T23:32:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:32:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:32:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:32:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:14.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:14 smithi066 ceph-mon[34761]: Reconfiguring daemon mon.c on smithi071 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:14.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:14 smithi071 ceph-mon[35018]: Reconfiguring daemon mon.c on smithi071 2024-09-10T23:32:14.345 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:32:14.345 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:14.345 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T23:32:14.345 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:14.345 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:14.345 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-10 23:30:52.147950736 +0000 2024-09-10T23:32:14.346 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-10 23:26:13.576287536 +0000 2024-09-10T23:32:14.346 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-10 23:26:13.576287536 +0000 2024-09-10T23:32:14.346 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-10 23:26:13.576287536 +0000 2024-09-10T23:32:14.346 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:32:14.407 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:14.407 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:14.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:14.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:32:14.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:32:14.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:32:14.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:14.408 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:14 smithi016 ceph-mon[30855]: Reconfiguring daemon mon.c on smithi071 2024-09-10T23:32:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-10T23:32:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-10T23:32:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000105181 s, 4.9 MB/s 2024-09-10T23:32:14.411 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:32:14.468 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-10T23:32:14.468 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:32:14.487 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:32:14.487 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-10 23:31:51.466155889 +0000 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-10 23:26:26.481702380 +0000 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-10 23:26:26.481702380 +0000 2024-09-10T23:32:14.547 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-10 23:26:26.481702380 +0000 2024-09-10T23:32:14.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:32:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-10T23:32:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-10T23:32:14.618 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000270215 s, 1.9 MB/s 2024-09-10T23:32:14.619 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:32:14.679 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-09-10T23:32:14.737 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-10 23:31:51.466155889 +0000 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-10 23:26:26.810699906 +0000 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-10 23:26:26.810699906 +0000 2024-09-10T23:32:14.738 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-10 23:26:26.810699906 +0000 2024-09-10T23:32:14.739 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:32:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-10T23:32:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-10T23:32:14.806 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000214158 s, 2.4 MB/s 2024-09-10T23:32:14.807 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:32:14.865 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-10 23:31:51.467155882 +0000 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-10 23:26:27.152697333 +0000 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-10 23:26:27.152697333 +0000 2024-09-10T23:32:14.925 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-10 23:26:27.152697333 +0000 2024-09-10T23:32:14.926 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:32:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-10T23:32:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-10T23:32:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000203748 s, 2.5 MB/s 2024-09-10T23:32:14.993 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:32:15.051 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-09-10T23:32:15.108 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:32:15.108 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:15.108 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T23:32:15.108 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:15.108 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:15.109 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-10 23:31:51.467155882 +0000 2024-09-10T23:32:15.109 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-10 23:26:27.492694776 +0000 2024-09-10T23:32:15.109 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-10 23:26:27.492694776 +0000 2024-09-10T23:32:15.109 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-10 23:26:27.492694776 +0000 2024-09-10T23:32:15.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:32:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-10T23:32:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-10T23:32:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000193562 s, 2.6 MB/s 2024-09-10T23:32:15.175 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:32:15.232 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T23:32:15.233 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:32:15.250 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:32:15.250 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-10T23:32:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:32:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:15.307 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T23:32:15.307 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:15.307 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:15.308 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 23:31:49.010053715 +0000 2024-09-10T23:32:15.308 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 23:26:24.421322505 +0000 2024-09-10T23:32:15.308 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 23:26:24.421322505 +0000 2024-09-10T23:32:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 23:26:24.421322505 +0000 2024-09-10T23:32:15.308 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:32:15.375 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T23:32:15.375 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T23:32:15.375 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000346838 s, 1.5 MB/s 2024-09-10T23:32:15.377 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:32:15.435 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-10T23:32:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:32:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:15.492 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-10T23:32:15.492 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:15.493 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:15.493 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 23:31:49.011053697 +0000 2024-09-10T23:32:15.493 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 23:26:24.741316886 +0000 2024-09-10T23:32:15.493 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 23:26:24.741316886 +0000 2024-09-10T23:32:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 23:26:24.741316886 +0000 2024-09-10T23:32:15.494 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:32:15.557 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T23:32:15.557 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T23:32:15.557 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000247948 s, 2.1 MB/s 2024-09-10T23:32:15.558 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:32:15.616 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-10T23:32:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:32:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:15.672 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T23:32:15.672 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:15.672 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:15.673 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 23:31:49.011053697 +0000 2024-09-10T23:32:15.673 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 23:26:25.068311145 +0000 2024-09-10T23:32:15.673 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 23:26:25.068311145 +0000 2024-09-10T23:32:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 23:26:25.068311145 +0000 2024-09-10T23:32:15.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:32:15.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:15 smithi071 ceph-mon[35018]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:15.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:15 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:15 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:15 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:15.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:15 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:15 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:15 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:15 smithi016 ceph-mon[30855]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:15 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:15 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:15 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:15 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:15 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:15.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:15 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.736 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T23:32:15.736 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T23:32:15.736 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000189524 s, 2.7 MB/s 2024-09-10T23:32:15.738 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:32:15.794 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-10T23:32:15.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:15 smithi066 ceph-mon[34761]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:15.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:15 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:15 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:15 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:15 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:15 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:15 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 23:31:49.011053697 +0000 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 23:26:25.385305580 +0000 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 23:26:25.385305580 +0000 2024-09-10T23:32:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 23:26:25.385305580 +0000 2024-09-10T23:32:15.850 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:32:15.912 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T23:32:15.912 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T23:32:15.912 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000198866 s, 2.6 MB/s 2024-09-10T23:32:15.913 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:32:15.969 INFO:tasks.cephadm:Deploying osd.0 on smithi016 with /dev/vg_nvme/lv_4... 2024-09-10T23:32:15.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:32:16.231 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:17.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:17 smithi016 ceph-mon[30855]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:18.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:17 smithi066 ceph-mon[34761]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:18.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:17 smithi071 ceph-mon[35018]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:18.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:32:18.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_4 2024-09-10T23:32:18.967 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 -- 172.21.15.16:0/4257103943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 msgr2=0x7f1810075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 --2- 172.21.15.16:0/4257103943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f1810075920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1800009ca0 tx=0x7f180002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 -- 172.21.15.16:0/4257103943 shutdown_connections 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 --2- 172.21.15.16:0/4257103943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f181010f3e0 0x7f18101117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 --2- 172.21.15.16:0/4257103943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1810075f40 0x7f181010ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 --2- 172.21.15.16:0/4257103943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f1810075920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 -- 172.21.15.16:0/4257103943 >> 172.21.15.16:0/4257103943 conn(0x7f18100fe830 msgr2=0x7f1810100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 -- 172.21.15.16:0/4257103943 shutdown_connections 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.392+0000 7f1817657640 1 -- 172.21.15.16:0/4257103943 wait complete. 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 Processor -- start 2024-09-10T23:32:19.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 -- start start 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f181019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1810075f40 0x7f181019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f181010f3e0 0x7f18101a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1810114f70 con 0x7f1810075540 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1810114df0 con 0x7f1810075f40 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1817657640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18101150f0 con 0x7f181010f3e0 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f18153f3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f181019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f18153f3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f181019b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57990/0 (socket says 172.21.15.16:57990) 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f18153f3640 1 -- 172.21.15.16:0/3104917933 learned_addr learned my addr 172.21.15.16:0/3104917933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.393+0000 7f1815bf4640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f181010f3e0 0x7f18101a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f1814bf2640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1810075f40 0x7f181019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f18153f3640 1 -- 172.21.15.16:0/3104917933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f181010f3e0 msgr2=0x7f18101a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:19.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f18153f3640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f181010f3e0 0x7f18101a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f18153f3640 1 -- 172.21.15.16:0/3104917933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1810075f40 msgr2=0x7f181019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f18153f3640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1810075f40 0x7f181019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f18153f3640 1 -- 172.21.15.16:0/3104917933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18101a1530 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f18153f3640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f181019b480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f180002ade0 tx=0x7f1800031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f180e7fc640 1 -- 172.21.15.16:0/3104917933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800003b70 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f180e7fc640 1 -- 172.21.15.16:0/3104917933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1800003d10 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18101a17c0 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f180e7fc640 1 -- 172.21.15.16:0/3104917933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180002fa50 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.394+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101a7ee0 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.395+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1810075920 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.397+0000 7f180e7fc640 1 -- 172.21.15.16:0/3104917933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f1800004580 con 0x7f1810075540 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.398+0000 7f180e7fc640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17f80b53a0 0x7f17f80b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:19.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.398+0000 7f1814bf2640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17f80b53a0 0x7f17f80b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:19.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.398+0000 7f180e7fc640 1 -- 172.21.15.16:0/3104917933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f18001053c0 con 0x7f1810075540 2024-09-10T23:32:19.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.399+0000 7f1814bf2640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17f80b53a0 0x7f17f80b7860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18101119d0 tx=0x7f180400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:19.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.401+0000 7f180e7fc640 1 -- 172.21.15.16:0/3104917933 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f18000cdde0 con 0x7f1810075540 2024-09-10T23:32:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:19.596+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1810100b50 con 0x7f17f80b53a0 2024-09-10T23:32:19.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:19 smithi016 ceph-mon[30855]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:19 smithi071 ceph-mon[35018]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:19.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:19 smithi066 ceph-mon[34761]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:20.662 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:20 smithi016 ceph-mon[30855]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:32:20.662 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:20 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:32:20.662 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:20 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:32:20.662 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:20 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:20.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:20 smithi071 ceph-mon[35018]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:32:20.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:20 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:32:20.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:20 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:32:20.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:20 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:20 smithi066 ceph-mon[34761]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:32:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:20 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:32:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:20 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:32:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:20 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:21.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:21 smithi016 ceph-mon[30855]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:21.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:21 smithi071 ceph-mon[35018]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:21.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:21 smithi066 ceph-mon[34761]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:22.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:22 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1304766327' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "763805be-7761-4d09-a36e-ae89566679dd"} : dispatch 2024-09-10T23:32:22.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:22 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1304766327' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763805be-7761-4d09-a36e-ae89566679dd"}]': finished 2024-09-10T23:32:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:22 smithi016 ceph-mon[30855]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:32:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:22 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:22.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:22 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1304766327' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "763805be-7761-4d09-a36e-ae89566679dd"} : dispatch 2024-09-10T23:32:22.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:22 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1304766327' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763805be-7761-4d09-a36e-ae89566679dd"}]': finished 2024-09-10T23:32:22.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:22 smithi071 ceph-mon[35018]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:32:22.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:22 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:22.703 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:22 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1304766327' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "763805be-7761-4d09-a36e-ae89566679dd"} : dispatch 2024-09-10T23:32:22.703 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:22 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1304766327' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763805be-7761-4d09-a36e-ae89566679dd"}]': finished 2024-09-10T23:32:22.703 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:22 smithi066 ceph-mon[34761]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:32:22.703 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:22 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:23.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:23 smithi016 ceph-mon[30855]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:23.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:23 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2212909677' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:32:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:23 smithi071 ceph-mon[35018]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:23 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2212909677' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:32:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:23 smithi066 ceph-mon[34761]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:23 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2212909677' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:32:25.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:25 smithi016 ceph-mon[30855]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:25.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:25 smithi071 ceph-mon[35018]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:25.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:25 smithi066 ceph-mon[34761]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:27.695 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:27 smithi016 ceph-mon[30855]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:27 smithi071 ceph-mon[35018]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:27.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:27 smithi066 ceph-mon[34761]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:29.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:29 smithi016 ceph-mon[30855]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:29.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:29 smithi071 ceph-mon[35018]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:29.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:29 smithi066 ceph-mon[34761]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:30.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:30 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:32:30.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:30 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:30.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:30 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:32:30.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:30 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:30.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:30 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:32:30.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:30 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:31.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:31 smithi016 ceph-mon[30855]: Deploying daemon osd.0 on smithi016 2024-09-10T23:32:31.685 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:31 smithi016 ceph-mon[30855]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:31 smithi071 ceph-mon[35018]: Deploying daemon osd.0 on smithi016 2024-09-10T23:32:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:31 smithi071 ceph-mon[35018]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:31.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:31 smithi066 ceph-mon[34761]: Deploying daemon osd.0 on smithi016 2024-09-10T23:32:31.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:31 smithi066 ceph-mon[34761]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:33 smithi016 ceph-mon[30855]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:33 smithi071 ceph-mon[35018]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:33 smithi066 ceph-mon[34761]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:35.560 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:35 smithi016 ceph-mon[30855]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:35.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:35 smithi071 ceph-mon[35018]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:35.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:35 smithi066 ceph-mon[34761]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:37.483 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:37 smithi016 ceph-mon[30855]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:37.483 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:37 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:37.483 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:37 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:37.483 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:37 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:37 smithi071 ceph-mon[35018]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:37 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:37 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:37 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:37 smithi066 ceph-mon[34761]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:37 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:37 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:37 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:39 smithi071 ceph-mon[35018]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:39 smithi066 ceph-mon[34761]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:40.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:40.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:40.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:39 smithi016 ceph-mon[30855]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:40.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:40.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:40.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:40.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:41.141 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 0 on host 'smithi016' 2024-09-10T23:32:41.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.140+0000 7f180e7fc640 1 -- 172.21.15.16:0/3104917933 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1810100b50 con 0x7f17f80b53a0 2024-09-10T23:32:41.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17f80b53a0 msgr2=0x7f17f80b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:41.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17f80b53a0 0x7f17f80b7860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18101119d0 tx=0x7f180400b390 comp rx=0 tx=0).stop 2024-09-10T23:32:41.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 msgr2=0x7f181019b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f181019b480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f180002ade0 tx=0x7f1800031770 comp rx=0 tx=0).stop 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 shutdown_connections 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f181010f3e0 0x7f18101a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17f80b53a0 0x7f17f80b7860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1810075f40 0x7f181019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 --2- 172.21.15.16:0/3104917933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1810075540 0x7f181019b480 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 >> 172.21.15.16:0/3104917933 conn(0x7f18100fe830 msgr2=0x7f18100ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 shutdown_connections 2024-09-10T23:32:41.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:32:41.143+0000 7f1817657640 1 -- 172.21.15.16:0/3104917933 wait complete. 2024-09-10T23:32:41.810 DEBUG:teuthology.orchestra.run.smithi016:osd.0> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T23:32:41.812 INFO:tasks.cephadm:Deploying osd.1 on smithi066 with /dev/vg_nvme/lv_4... 2024-09-10T23:32:41.812 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:32:42.078 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:32:42.199 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:41 smithi066 ceph-mon[34761]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:42.199 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:41 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:42.199 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:41 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:42.199 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:41 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:41 smithi071 ceph-mon[35018]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:41 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:41 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:41 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:42.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:41 smithi016 ceph-mon[30855]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:42.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:41 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:32:42.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:41 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:42.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:41 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:42.931 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:32:42 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0[46340]: 2024-09-10T23:32:42.809+0000 7f10968a7640 -1 osd.0 0 log_to_monitors true 2024-09-10T23:32:43.214 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:42 smithi016 ceph-mon[30855]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:32:43.267 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:42 smithi066 ceph-mon[34761]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:32:43.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:42 smithi071 ceph-mon[35018]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:32:44.214 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:44 smithi066 ceph-mon[34761]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:44.215 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:44 smithi066 ceph-mon[34761]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:32:44.215 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:44 smithi066 ceph-mon[34761]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:32:44.215 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:44 smithi066 ceph-mon[34761]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:32:44.215 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:44 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:44.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:44 smithi016 ceph-mon[30855]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:44.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:44 smithi016 ceph-mon[30855]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:32:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:44 smithi016 ceph-mon[30855]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:32:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:44 smithi016 ceph-mon[30855]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:32:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:44 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:44.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:32:44 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0[46340]: 2024-09-10T23:32:44.003+0000 7f109282a640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T23:32:44.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:32:44 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0[46340]: 2024-09-10T23:32:44.006+0000 7f108e651640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:32:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:44 smithi071 ceph-mon[35018]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:44 smithi071 ceph-mon[35018]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:32:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:44 smithi071 ceph-mon[35018]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:32:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:44 smithi071 ceph-mon[35018]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:32:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:44 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:44.402 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:32:44.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_4 2024-09-10T23:32:44.687 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:32:45.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3036454776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4101c90 msgr2=0x7f3bb4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:45.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3036454776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4101c90 0x7f3bb4102070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009ca0 tx=0x7f3ba802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3036454776 shutdown_connections 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3036454776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bb4108020 0x7f3bb410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3036454776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bb41076a0 0x7f3bb4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3036454776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4101c90 0x7f3bb4102070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3036454776 >> 172.21.15.66:0/3036454776 conn(0x7f3bb40fd700 msgr2=0x7f3bb40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3036454776 shutdown_connections 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3036454776 wait complete. 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 Processor -- start 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.132+0000 7f3bbc0fa640 1 -- start start 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bbc0fa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bb4101c90 0x7f3bb4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bbc0fa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bb41076a0 0x7f3bb41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bbc0fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4108020 0x7f3bb419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:45.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bbc0fa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb4111ce0 con 0x7f3bb4101c90 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bbc0fa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb4111b60 con 0x7f3bb4108020 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bbc0fa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb4111e60 con 0x7f3bb41076a0 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4108020 0x7f3bb419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4108020 0x7f3bb419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44310/0 (socket says 172.21.15.66:44310) 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 -- 172.21.15.66:0/3949043763 learned_addr learned my addr 172.21.15.66:0/3949043763 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bb9695640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bb41076a0 0x7f3bb41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bb9e96640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bb4101c90 0x7f3bb4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 -- 172.21.15.66:0/3949043763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bb41076a0 msgr2=0x7f3bb41997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bb41076a0 0x7f3bb41997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 -- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bb4101c90 msgr2=0x7f3bb4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bb4101c90 0x7f3bb4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:45.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 -- 172.21.15.66:0/3949043763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb419f340 con 0x7f3bb4108020 2024-09-10T23:32:45.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.133+0000 7f3bba697640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4108020 0x7f3bb419eb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c970 tx=0x7f3bac00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:45.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.134+0000 7f3ba6ffd640 1 -- 172.21.15.66:0/3949043763 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac007bb0 con 0x7f3bb4108020 2024-09-10T23:32:45.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.134+0000 7f3ba6ffd640 1 -- 172.21.15.66:0/3949043763 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bac007d50 con 0x7f3bb4108020 2024-09-10T23:32:45.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.134+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb419f630 con 0x7f3bb4108020 2024-09-10T23:32:45.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.134+0000 7f3ba6ffd640 1 -- 172.21.15.66:0/3949043763 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac004e60 con 0x7f3bb4108020 2024-09-10T23:32:45.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.134+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb41a5cf0 con 0x7f3bb4108020 2024-09-10T23:32:45.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.135+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb4102070 con 0x7f3bb4108020 2024-09-10T23:32:45.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.137+0000 7f3ba6ffd640 1 -- 172.21.15.66:0/3949043763 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f3bac005000 con 0x7f3bb4108020 2024-09-10T23:32:45.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.138+0000 7f3ba6ffd640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ba00b52a0 0x7f3ba00b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:45.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.138+0000 7f3ba6ffd640 1 -- 172.21.15.66:0/3949043763 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1982+0+0 (secure 0 0 0) 0x7f3bac0e4260 con 0x7f3bb4108020 2024-09-10T23:32:45.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.138+0000 7f3bb9e96640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ba00b52a0 0x7f3ba00b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:45.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.138+0000 7f3bb9e96640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ba00b52a0 0x7f3ba00b7760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80098d0 tx=0x7f3ba8009900 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:45.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.141+0000 7f3ba6ffd640 1 -- 172.21.15.66:0/3949043763 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3bac014030 con 0x7f3bb4108020 2024-09-10T23:32:45.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:32:45.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:32:45.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:32:45.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:32:45.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:32:45.337+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3bb40fee80 con 0x7f3ba00b52a0 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:32:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:32:45.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:32:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:32:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi016 2024-09-10T23:32:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-10T23:32:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] boot 2024-09-10T23:32:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:32:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:32:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:32:46.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:32:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:32:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi016 2024-09-10T23:32:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-10T23:32:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] boot 2024-09-10T23:32:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:32:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:32:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:32:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi016 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: osd.0 [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] boot 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:32:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:32:46.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:47.270 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:47 smithi066 ceph-mon[34761]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:32:47.271 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:47 smithi066 ceph-mon[34761]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:32:47.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:47 smithi016 ceph-mon[30855]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:32:47.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:47 smithi016 ceph-mon[30855]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:32:47.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:47 smithi071 ceph-mon[35018]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:32:47.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:47 smithi071 ceph-mon[35018]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:32:48.181 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:48 smithi066 ceph-mon[34761]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:48.181 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:48 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/1774968448' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"} : dispatch 2024-09-10T23:32:48.182 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:48 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"} : dispatch 2024-09-10T23:32:48.182 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:48 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"}]': finished 2024-09-10T23:32:48.182 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:48 smithi066 ceph-mon[34761]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:32:48.182 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:32:48.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:48 smithi016 ceph-mon[30855]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:48 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/1774968448' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"} : dispatch 2024-09-10T23:32:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:48 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"} : dispatch 2024-09-10T23:32:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:48 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"}]': finished 2024-09-10T23:32:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:48 smithi016 ceph-mon[30855]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:32:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:32:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:48 smithi071 ceph-mon[35018]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:48 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/1774968448' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"} : dispatch 2024-09-10T23:32:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:48 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"} : dispatch 2024-09-10T23:32:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:48 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36db88e0-9ce6-4c36-9b9f-a96493341bb5"}]': finished 2024-09-10T23:32:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:48 smithi071 ceph-mon[35018]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:32:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:32:49.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:49 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/3241447155' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:32:49.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:49 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/3241447155' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:32:49.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:49 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/3241447155' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:32:50.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:50 smithi066 ceph-mon[34761]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:50.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:50 smithi016 ceph-mon[30855]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:50 smithi071 ceph-mon[35018]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:52.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:52 smithi066 ceph-mon[34761]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:52.321 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:52 smithi071 ceph-mon[35018]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:52.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:52 smithi016 ceph-mon[30855]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:54.118 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:54 smithi066 ceph-mon[34761]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:54.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:54 smithi016 ceph-mon[30855]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:54.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:54 smithi071 ceph-mon[35018]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:56.270 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:56 smithi066 ceph-mon[34761]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:56.270 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:32:56.270 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:56.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:56 smithi016 ceph-mon[30855]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:32:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:56.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:56 smithi071 ceph-mon[35018]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:56.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:32:56.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:32:57.275 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:57 smithi066 ceph-mon[34761]: Deploying daemon osd.1 on smithi066 2024-09-10T23:32:57.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:57 smithi016 ceph-mon[30855]: Deploying daemon osd.1 on smithi066 2024-09-10T23:32:57.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:57 smithi071 ceph-mon[35018]: Deploying daemon osd.1 on smithi066 2024-09-10T23:32:58.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:32:58 smithi066 ceph-mon[34761]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:58.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:32:58 smithi016 ceph-mon[30855]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:32:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:32:58 smithi071 ceph-mon[35018]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:00.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:00 smithi016 ceph-mon[30855]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:00.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:00 smithi071 ceph-mon[35018]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:00.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:00 smithi066 ceph-mon[34761]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:02.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:02 smithi066 ceph-mon[34761]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:02.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:02 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:02.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:02 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:02.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:02 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:02.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:02 smithi016 ceph-mon[30855]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:02.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:02 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:02 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:02 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:02 smithi071 ceph-mon[35018]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:02 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:02 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:02 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:04.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:04 smithi066 ceph-mon[34761]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:04.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:04 smithi016 ceph-mon[30855]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:04.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:04 smithi071 ceph-mon[35018]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.514+0000 7f3ba6ffd640 1 -- 172.21.15.66:0/3949043763 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3bb40fee80 con 0x7f3ba00b52a0 2024-09-10T23:33:05.516 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 1 on host 'smithi066' 2024-09-10T23:33:05.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ba00b52a0 msgr2=0x7f3ba00b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ba00b52a0 0x7f3ba00b7760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80098d0 tx=0x7f3ba8009900 comp rx=0 tx=0).stop 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4108020 msgr2=0x7f3bb419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4108020 0x7f3bb419eb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c970 tx=0x7f3bac00ce30 comp rx=0 tx=0).stop 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 shutdown_connections 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ba00b52a0 0x7f3ba00b7760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bb4108020 0x7f3bb419eb70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3bb41076a0 0x7f3bb41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 --2- 172.21.15.66:0/3949043763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bb4101c90 0x7f3bb4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 >> 172.21.15.66:0/3949043763 conn(0x7f3bb40fd700 msgr2=0x7f3bb41059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 shutdown_connections 2024-09-10T23:33:05.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:33:05.517+0000 7f3bbc0fa640 1 -- 172.21.15.66:0/3949043763 wait complete. 2024-09-10T23:33:05.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:05.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:05.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:05.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:05.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:05.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:05.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:06.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:06.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:06.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:06.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:06.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:06.090 DEBUG:teuthology.orchestra.run.smithi066:osd.1> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T23:33:06.093 INFO:tasks.cephadm:Deploying osd.2 on smithi071 with /dev/vg_nvme/lv_4... 2024-09-10T23:33:06.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:33:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:33:07.716 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:07 smithi071 ceph-mon[35018]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:07.964 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:07 smithi066 ceph-mon[34761]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:07.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:07 smithi016 ceph-mon[30855]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:08.615 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:08 smithi066 ceph-mon[34761]: from='osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:33:08.615 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:08 smithi066 ceph-mon[34761]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:33:08.616 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:08 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1[40304]: 2024-09-10T23:33:08.309+0000 7f1fbd756640 -1 osd.1 0 log_to_monitors true 2024-09-10T23:33:08.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:08 smithi071 ceph-mon[35018]: from='osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:33:08.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:08 smithi071 ceph-mon[35018]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:33:08.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:33:08.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-09-10T23:33:08.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:08 smithi016 ceph-mon[30855]: from='osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:33:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:08 smithi016 ceph-mon[30855]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:33:09.042 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:33:09.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3736005409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc104550 msgr2=0x7fb1dc10cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3736005409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc104550 0x7fb1dc10cb30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009900 tx=0x7fb1cc02a410 comp rx=0 tx=0).stop 2024-09-10T23:33:09.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3736005409 shutdown_connections 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3736005409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1dc10d100 0x7fb1dc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3736005409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc104550 0x7fb1dc10cb30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3736005409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1dc103b50 0x7fb1dc103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3736005409 >> 172.21.15.71:0/3736005409 conn(0x7fb1dc0fd700 msgr2=0x7fb1dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3736005409 shutdown_connections 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.482+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3736005409 wait complete. 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 Processor -- start 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 -- start start 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc103b50 0x7fb1dc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1dc104550 0x7fb1dc1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1dc10d100 0x7fb1dc19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc112d60 con 0x7fb1dc10d100 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc112be0 con 0x7fb1dc104550 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1e09b2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc112ee0 con 0x7fb1dc103b50 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1da59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc103b50 0x7fb1dc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1da59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc103b50 0x7fb1dc199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55004/0 (socket says 172.21.15.71:55004) 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1da59c640 1 -- 172.21.15.71:0/3651037313 learned_addr learned my addr 172.21.15.71:0/3651037313 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1d9d9b640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1dc104550 0x7fb1dc1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.483+0000 7fb1dad9d640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1dc10d100 0x7fb1dc19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1da59c640 1 -- 172.21.15.71:0/3651037313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1dc104550 msgr2=0x7fb1dc1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1da59c640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1dc104550 0x7fb1dc1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1da59c640 1 -- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1dc10d100 msgr2=0x7fb1dc19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1da59c640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1dc10d100 0x7fb1dc19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1da59c640 1 -- 172.21.15.71:0/3651037313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc19f340 con 0x7fb1dc103b50 2024-09-10T23:33:09.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1dad9d640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1dc10d100 0x7fb1dc19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:09.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1da59c640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc103b50 0x7fb1dc199290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c970 tx=0x7fb1d000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:09.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1cb7fe640 1 -- 172.21.15.71:0/3651037313 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0007bb0 con 0x7fb1dc103b50 2024-09-10T23:33:09.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc19f630 con 0x7fb1dc103b50 2024-09-10T23:33:09.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1cb7fe640 1 -- 172.21.15.71:0/3651037313 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1d0007d50 con 0x7fb1dc103b50 2024-09-10T23:33:09.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1cb7fe640 1 -- 172.21.15.71:0/3651037313 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000f450 con 0x7fb1dc103b50 2024-09-10T23:33:09.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.484+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc1a5cf0 con 0x7fb1dc103b50 2024-09-10T23:33:09.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.485+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1dc103f30 con 0x7fb1dc103b50 2024-09-10T23:33:09.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.487+0000 7fb1cb7fe640 1 -- 172.21.15.71:0/3651037313 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fb1d0004f00 con 0x7fb1dc103b50 2024-09-10T23:33:09.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.488+0000 7fb1cb7fe640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1c40b52a0 0x7fb1c40b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.488+0000 7fb1cb7fe640 1 -- 172.21.15.71:0/3651037313 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2118+0+0 (secure 0 0 0) 0x7fb1d00e43b0 con 0x7fb1dc103b50 2024-09-10T23:33:09.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.489+0000 7fb1d9d9b640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1c40b52a0 0x7fb1c40b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.489+0000 7fb1d9d9b640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1c40b52a0 0x7fb1c40b7760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc031440 tx=0x7fb1cc005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:09.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.492+0000 7fb1cb7fe640 1 -- 172.21.15.71:0/3651037313 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb1d0014030 con 0x7fb1dc103b50 2024-09-10T23:33:09.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:09.678+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb1dc063590 con 0x7fb1c40b52a0 2024-09-10T23:33:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:33:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:33:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi066 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi066 2024-09-10T23:33:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:09.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-10T23:33:09.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:09.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:09.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi066 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.989 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:09.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-10T23:33:09.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:09.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:09.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:09.990 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:10.301 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1[40304]: 2024-09-10T23:33:09.987+0000 7f1fb96d9640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T23:33:10.301 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:09 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1[40304]: 2024-09-10T23:33:09.990+0000 7f1fb14f8640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:33:10.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:10 smithi071 ceph-mon[35018]: from='osd.1 ' entity='osd.1' 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:10 smithi016 ceph-mon[30855]: from='osd.1 ' entity='osd.1' 2024-09-10T23:33:11.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:33:11.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T23:33:11.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:11.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:11.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:33:11.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:33:11.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:33:11.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:11.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:10 smithi066 ceph-mon[34761]: from='osd.1 ' entity='osd.1' 2024-09-10T23:33:11.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:11 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:33:11.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:11 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:33:11.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:11 smithi016 ceph-mon[30855]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:11.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:11 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:11.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:11 smithi016 ceph-mon[30855]: osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] boot 2024-09-10T23:33:11.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:11 smithi016 ceph-mon[30855]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:33:11.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:11 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:11 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:33:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:11 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:33:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:11 smithi071 ceph-mon[35018]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:11 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:11 smithi071 ceph-mon[35018]: osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] boot 2024-09-10T23:33:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:11 smithi071 ceph-mon[35018]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:33:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:11 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:11 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:33:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:11 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:33:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:11 smithi066 ceph-mon[34761]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:33:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:11 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:11 smithi066 ceph-mon[34761]: osd.1 [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] boot 2024-09-10T23:33:12.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:11 smithi066 ceph-mon[34761]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:33:12.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:11 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:33:12.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:12 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/1075674313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"} : dispatch 2024-09-10T23:33:12.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:12 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"} : dispatch 2024-09-10T23:33:12.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:12 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"}]': finished 2024-09-10T23:33:12.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:12 smithi071 ceph-mon[35018]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:33:12.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:12 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:12.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:12 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/900524022' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:33:12.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:12 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/1075674313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"} : dispatch 2024-09-10T23:33:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:12 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"} : dispatch 2024-09-10T23:33:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:12 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"}]': finished 2024-09-10T23:33:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:12 smithi016 ceph-mon[30855]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:33:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:12 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:12 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/900524022' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:33:13.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:12 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/1075674313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"} : dispatch 2024-09-10T23:33:13.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:12 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"} : dispatch 2024-09-10T23:33:13.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:12 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60a55961-0d3d-415c-8e44-f72d0f544182"}]': finished 2024-09-10T23:33:13.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:12 smithi066 ceph-mon[34761]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:33:13.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:12 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:13.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:12 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/900524022' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:33:14.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:13 smithi016 ceph-mon[30855]: pgmap v48: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:14.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:13 smithi071 ceph-mon[35018]: pgmap v48: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:13 smithi066 ceph-mon[34761]: pgmap v48: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:16.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:15 smithi016 ceph-mon[30855]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:16.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:15 smithi071 ceph-mon[35018]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:16.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:15 smithi066 ceph-mon[34761]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:18.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:17 smithi071 ceph-mon[35018]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:18.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:17 smithi016 ceph-mon[30855]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:18.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:17 smithi066 ceph-mon[34761]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:19.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:19 smithi071 ceph-mon[35018]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:20.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:19 smithi016 ceph-mon[30855]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:20.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:19 smithi066 ceph-mon[34761]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:21.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:20 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:33:21.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:20 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:21.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:20 smithi071 ceph-mon[35018]: Deploying daemon osd.2 on smithi071 2024-09-10T23:33:21.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:20 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:33:21.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:20 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:21.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:20 smithi016 ceph-mon[30855]: Deploying daemon osd.2 on smithi071 2024-09-10T23:33:21.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:20 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:33:21.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:20 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:21.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:20 smithi066 ceph-mon[34761]: Deploying daemon osd.2 on smithi071 2024-09-10T23:33:22.202 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:21 smithi066 ceph-mon[34761]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:22.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:21 smithi016 ceph-mon[30855]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:22.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:21 smithi071 ceph-mon[35018]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:24.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:23 smithi016 ceph-mon[30855]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:24.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:23 smithi071 ceph-mon[35018]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:24.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:23 smithi066 ceph-mon[34761]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:26.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:25 smithi016 ceph-mon[30855]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:26.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:25 smithi071 ceph-mon[35018]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:26.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:25 smithi066 ceph-mon[34761]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:27.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:26 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:27.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:26 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:27.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:26 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:27.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:26 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:27.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:26 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:27.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:26 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:27.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:26 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:27.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:26 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:27.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:26 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:28.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:27 smithi016 ceph-mon[30855]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:28.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:27 smithi071 ceph-mon[35018]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:28.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:27 smithi066 ceph-mon[34761]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:29.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.738+0000 7fb1cb7fe640 1 -- 172.21.15.71:0/3651037313 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb1dc063590 con 0x7fb1c40b52a0 2024-09-10T23:33:29.740 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 2 on host 'smithi071' 2024-09-10T23:33:29.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1c40b52a0 msgr2=0x7fb1c40b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1c40b52a0 0x7fb1c40b7760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc031440 tx=0x7fb1cc005b50 comp rx=0 tx=0).stop 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc103b50 msgr2=0x7fb1dc199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc103b50 0x7fb1dc199290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c970 tx=0x7fb1d000ce30 comp rx=0 tx=0).stop 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 shutdown_connections 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1dc10d100 0x7fb1dc19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1c40b52a0 0x7fb1c40b7760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1dc104550 0x7fb1dc1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 --2- 172.21.15.71:0/3651037313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1dc103b50 0x7fb1dc199290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 >> 172.21.15.71:0/3651037313 conn(0x7fb1dc0fd700 msgr2=0x7fb1dc0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 shutdown_connections 2024-09-10T23:33:29.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:33:29.741+0000 7fb1e09b2640 1 -- 172.21.15.71:0/3651037313 wait complete. 2024-09-10T23:33:30.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:30.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:30.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:30.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:30.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:30.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:30.357 DEBUG:teuthology.orchestra.run.smithi071:osd.2> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T23:33:30.359 INFO:tasks.cephadm:Deploying osd.3 on smithi016 with /dev/vg_nvme/lv_3... 2024-09-10T23:33:30.360 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:33:30.627 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:32.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:31 smithi016 ceph-mon[30855]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:32.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:31 smithi071 ceph-mon[35018]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:32.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:31 smithi066 ceph-mon[34761]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:32.724 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2[41310]: 2024-09-10T23:33:32.482+0000 7ff957f2d640 -1 osd.2 0 log_to_monitors true 2024-09-10T23:33:33.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:32 smithi071 ceph-mon[35018]: from='osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:33:33.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:32 smithi071 ceph-mon[35018]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:33:33.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:32 smithi016 ceph-mon[30855]: from='osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:33:33.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:32 smithi016 ceph-mon[30855]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:33:33.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:32 smithi066 ceph-mon[34761]: from='osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:33:33.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:32 smithi066 ceph-mon[34761]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:33:33.304 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:33:33.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_3 2024-09-10T23:33:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 -- 172.21.15.16:0/3761047539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4101c90 msgr2=0x7f13b4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 --2- 172.21.15.16:0/3761047539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4101c90 0x7f13b4102070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009900 tx=0x7f13b002a410 comp rx=0 tx=0).stop 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 -- 172.21.15.16:0/3761047539 shutdown_connections 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 --2- 172.21.15.16:0/3761047539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13b4108020 0x7f13b410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 --2- 172.21.15.16:0/3761047539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 0x7f13b4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 --2- 172.21.15.16:0/3761047539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4101c90 0x7f13b4102070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 -- 172.21.15.16:0/3761047539 >> 172.21.15.16:0/3761047539 conn(0x7f13b40fd700 msgr2=0x7f13b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 -- 172.21.15.16:0/3761047539 shutdown_connections 2024-09-10T23:33:34.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.116+0000 7f13bc485640 1 -- 172.21.15.16:0/3761047539 wait complete. 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 Processor -- start 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 -- start start 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13b4101c90 0x7f13b4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 0x7f13b4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4108020 0x7f13b419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13b4111ce0 con 0x7f13b4108020 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13b4111b60 con 0x7f13b4101c90 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13bc485640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13b4111e60 con 0x7f13b41076a0 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13b9a20640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 0x7f13b4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13baa22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4108020 0x7f13b419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13b9a20640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 0x7f13b4199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:55698/0 (socket says 172.21.15.16:55698) 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.117+0000 7f13b9a20640 1 -- 172.21.15.16:0/3286865606 learned_addr learned my addr 172.21.15.16:0/3286865606 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:33:34.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13ba221640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13b4101c90 0x7f13b4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13b9a20640 1 -- 172.21.15.16:0/3286865606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13b4101c90 msgr2=0x7f13b4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13b9a20640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13b4101c90 0x7f13b4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13b9a20640 1 -- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4108020 msgr2=0x7f13b419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13b9a20640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4108020 0x7f13b419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13b9a20640 1 -- 172.21.15.16:0/3286865606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b419f3b0 con 0x7f13b41076a0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13baa22640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4108020 0x7f13b419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13b9a20640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 0x7f13b4199840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13a400e9f0 tx=0x7f13a400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a400cd80 con 0x7f13b41076a0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b419f6a0 con 0x7f13b41076a0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13a40054d0 con 0x7f13b41076a0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4010690 con 0x7f13b41076a0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.118+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b41a5d60 con 0x7f13b41076a0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.119+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b4102070 con 0x7f13b41076a0 2024-09-10T23:33:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.121+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f13a4004e30 con 0x7f13b41076a0 2024-09-10T23:33:34.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.122+0000 7f13ab7fe640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f13a00b52a0 0x7f13a00b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:34.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.122+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2786+0+0 (secure 0 0 0) 0x7f13a40e4c00 con 0x7f13b41076a0 2024-09-10T23:33:34.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.122+0000 7f13ba221640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f13a00b52a0 0x7f13a00b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:34.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.122+0000 7f13ba221640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f13a00b52a0 0x7f13a00b7760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13b0031440 tx=0x7f13b0005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:34.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.129+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f13a40ad090 con 0x7f13b41076a0 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi071 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-10T23:33:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:34.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:34.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi071 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:34.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-10T23:33:34.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:34.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:34.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:34.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:33:34.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi071 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:34.329+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f13b4063590 con 0x7f13a00b52a0 2024-09-10T23:33:34.769 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2[41310]: 2024-09-10T23:33:34.351+0000 7ff953eb0640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T23:33:34.769 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2[41310]: 2024-09-10T23:33:34.354+0000 7ff94bccf640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:33:35.016 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:33:35.016 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:33:35.016 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:35.016 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:35.017 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:33:35.017 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:33:35.017 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:35.017 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:34 smithi016 ceph-mon[30855]: from='osd.2 ' entity='osd.2' 2024-09-10T23:33:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:33:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:33:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:33:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:33:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:35.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:34 smithi071 ceph-mon[35018]: from='osd.2 ' entity='osd.2' 2024-09-10T23:33:35.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:33:35.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:33:35.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:35.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:35.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:33:35.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:33:35.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:35.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:34 smithi066 ceph-mon[34761]: from='osd.2 ' entity='osd.2' 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] boot 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:33:36.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:35 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:36.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:33:36.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:33:36.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:33:36.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:36.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:36.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] boot 2024-09-10T23:33:36.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:33:36.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:35 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:33:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:33:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:33:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:33:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: osd.2 [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] boot 2024-09-10T23:33:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:33:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:35 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/753606368' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4451b800-b930-497f-8377-21700cc37299"} : dispatch 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/753606368' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4451b800-b930-497f-8377-21700cc37299"}]': finished 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:37 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:33:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:33:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:33:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/753606368' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4451b800-b930-497f-8377-21700cc37299"} : dispatch 2024-09-10T23:33:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:33:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/753606368' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4451b800-b930-497f-8377-21700cc37299"}]': finished 2024-09-10T23:33:37.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T23:33:37.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:37.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:37 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:33:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:33:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:33:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/753606368' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4451b800-b930-497f-8377-21700cc37299"} : dispatch 2024-09-10T23:33:37.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:33:37.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/753606368' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4451b800-b930-497f-8377-21700cc37299"}]': finished 2024-09-10T23:33:37.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T23:33:37.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:37.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:37 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:33:38.234 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51099]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:33:38.234 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51099]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.234 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51099]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51102]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:33:38.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51102]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:33:37 smithi016 sudo[51102]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51106]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51106]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51106]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51109]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51109]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 sudo[51109]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44932]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:33:38.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44932]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44932]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44935]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:33:38.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44935]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44935]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44938]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44938]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44938]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44941]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44941]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 sudo[44941]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44277]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:33:38.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44277]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44277]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44280]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:33:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44280]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 sudo[44280]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44271]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:33:38.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44271]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44271]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44274]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:33:38.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44274]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:33:38.303 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:33:38.303 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:33:37 smithi066 sudo[44274]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:33:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2810514613' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:33:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:33:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T23:33:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.737 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.737 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:38 smithi016 ceph-mon[30855]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2810514613' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:33:38.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:38 smithi071 ceph-mon[35018]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2810514613' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:33:38.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:33:38.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T23:33:38.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:33:38.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:33:38.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:33:38.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:33:38.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:38 smithi066 ceph-mon[34761]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:33:39.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:39.375+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f13a40a8c00 con 0x7f13b41076a0 2024-09-10T23:33:40.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:39 smithi066 ceph-mon[34761]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:40.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:39 smithi066 ceph-mon[34761]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:33:40.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:40.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:39 smithi066 ceph-mon[34761]: mgrmap e20: x(active, since 117s), standbys: z, y 2024-09-10T23:33:40.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:39 smithi016 ceph-mon[30855]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:40.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:39 smithi016 ceph-mon[30855]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:33:40.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:40.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:39 smithi016 ceph-mon[30855]: mgrmap e20: x(active, since 117s), standbys: z, y 2024-09-10T23:33:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:39 smithi071 ceph-mon[35018]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:39 smithi071 ceph-mon[35018]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:33:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:39 smithi071 ceph-mon[35018]: mgrmap e20: x(active, since 117s), standbys: z, y 2024-09-10T23:33:41.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:41 smithi016 ceph-mon[30855]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:41 smithi071 ceph-mon[35018]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:42.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:41 smithi066 ceph-mon[34761]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:43.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:43 smithi016 ceph-mon[30855]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:43 smithi071 ceph-mon[35018]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:43 smithi066 ceph-mon[34761]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:45.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:45 smithi016 ceph-mon[30855]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:45.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:33:45.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:45 smithi071 ceph-mon[35018]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:33:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:45 smithi066 ceph-mon[34761]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:33:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:46.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:46 smithi016 ceph-mon[30855]: Deploying daemon osd.3 on smithi016 2024-09-10T23:33:47.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:46 smithi071 ceph-mon[35018]: Deploying daemon osd.3 on smithi016 2024-09-10T23:33:47.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:46 smithi066 ceph-mon[34761]: Deploying daemon osd.3 on smithi016 2024-09-10T23:33:48.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:47 smithi016 ceph-mon[30855]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:48.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:47 smithi071 ceph-mon[35018]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:48.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:47 smithi066 ceph-mon[34761]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:50.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:49 smithi016 ceph-mon[30855]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:50.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:49 smithi071 ceph-mon[35018]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:50.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:49 smithi066 ceph-mon[34761]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:52.103 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:51 smithi066 ceph-mon[34761]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:52.104 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:52.104 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:52.104 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:52.140 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:51 smithi016 ceph-mon[30855]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:52.140 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:52.140 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:52.141 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:52.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:51 smithi071 ceph-mon[35018]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:52.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:52.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:52.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:54.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:53 smithi016 ceph-mon[30855]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:54.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:53 smithi071 ceph-mon[35018]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:54.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:53 smithi066 ceph-mon[34761]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:55.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:55 smithi016 ceph-mon[30855]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:55.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:55.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:55.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:55 smithi071 ceph-mon[35018]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:55.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:55.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:55.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.794+0000 7f13ab7fe640 1 -- 172.21.15.16:0/3286865606 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f13b4063590 con 0x7f13a00b52a0 2024-09-10T23:33:55.795 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 3 on host 'smithi016' 2024-09-10T23:33:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f13a00b52a0 msgr2=0x7f13a00b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f13a00b52a0 0x7f13a00b7760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13b0031440 tx=0x7f13b0005b50 comp rx=0 tx=0).stop 2024-09-10T23:33:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 msgr2=0x7f13b4199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 0x7f13b4199840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13a400e9f0 tx=0x7f13a400edf0 comp rx=0 tx=0).stop 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 shutdown_connections 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b4108020 0x7f13b419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b41076a0 0x7f13b4199840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f13a00b52a0 0x7f13a00b7760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 --2- 172.21.15.16:0/3286865606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13b4101c90 0x7f13b4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 >> 172.21.15.16:0/3286865606 conn(0x7f13b40fd700 msgr2=0x7f13b406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 shutdown_connections 2024-09-10T23:33:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:33:55.797+0000 7f13bc485640 1 -- 172.21.15.16:0/3286865606 wait complete. 2024-09-10T23:33:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:55 smithi066 ceph-mon[34761]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:56.490 DEBUG:teuthology.orchestra.run.smithi016:osd.3> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T23:33:56.493 INFO:tasks.cephadm:Deploying osd.4 on smithi066 with /dev/vg_nvme/lv_3... 2024-09-10T23:33:56.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:33:56.693 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:56.693 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:56.693 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:33:56.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:56.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:56.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:56.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:33:56.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:56.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:57.697 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:33:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:33:57.422+0000 7f6fd2525640 -1 osd.3 0 log_to_monitors true 2024-09-10T23:33:57.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:57 smithi016 ceph-mon[30855]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:57.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:57 smithi016 ceph-mon[30855]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:33:58.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:57 smithi066 ceph-mon[34761]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:58.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:57 smithi066 ceph-mon[34761]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:33:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:57 smithi071 ceph-mon[35018]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:57 smithi071 ceph-mon[35018]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:33:59.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:58 smithi066 ceph-mon[34761]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:33:59.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:58 smithi066 ceph-mon[34761]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:33:59.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:58 smithi066 ceph-mon[34761]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:33:59.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:58 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:59.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:58 smithi066 ceph-mon[34761]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:33:59.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:58 smithi066 ceph-mon[34761]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:33:59.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:58 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:59.162 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:33:59.189 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_3 2024-09-10T23:33:59.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:58 smithi016 ceph-mon[30855]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:33:59.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:58 smithi016 ceph-mon[30855]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:33:59.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:58 smithi016 ceph-mon[30855]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:33:59.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:58 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:59.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:58 smithi016 ceph-mon[30855]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:33:59.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:58 smithi016 ceph-mon[30855]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:33:59.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:58 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:59.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:58 smithi071 ceph-mon[35018]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:33:59.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:58 smithi071 ceph-mon[35018]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:33:59.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:58 smithi071 ceph-mon[35018]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:33:59.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:58 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:59.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:58 smithi071 ceph-mon[35018]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:33:59.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:58 smithi071 ceph-mon[35018]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:33:59.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:58 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:59.443 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:33:59.484 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:33:59.229+0000 7f6fcecbc640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T23:33:59.484 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:33:59.234+0000 7f6fc62c7640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:33:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:33:59.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:33:59.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] boot 2024-09-10T23:33:59.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:33:59.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:33:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 -- 172.21.15.66:0/1211941706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 msgr2=0x7f2334107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 --2- 172.21.15.66:0/1211941706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f2334107b20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f231c009900 tx=0x7f231c02a410 comp rx=0 tx=0).stop 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 -- 172.21.15.66:0/1211941706 shutdown_connections 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 --2- 172.21.15.66:0/1211941706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2334108060 0x7f233410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 --2- 172.21.15.66:0/1211941706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f2334107b20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 --2- 172.21.15.66:0/1211941706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2334101cd0 0x7f23341020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 -- 172.21.15.66:0/1211941706 >> 172.21.15.66:0/1211941706 conn(0x7f23340fd700 msgr2=0x7f23340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.007+0000 7f233922d640 1 -- 172.21.15.66:0/1211941706 shutdown_connections 2024-09-10T23:34:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 -- 172.21.15.66:0/1211941706 wait complete. 2024-09-10T23:34:00.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 Processor -- start 2024-09-10T23:34:00.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 -- start start 2024-09-10T23:34:00.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2334101cd0 0x7f233419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:00.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f233419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:00.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2334108060 0x7f23341a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2334111ce0 con 0x7f2334108060 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2334111b60 con 0x7f23341076e0 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.008+0000 7f233922d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2334111e60 con 0x7f2334101cd0 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f233419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f233419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46412/0 (socket says 172.21.15.66:46412) 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 -- 172.21.15.66:0/1573069559 learned_addr learned my addr 172.21.15.66:0/1573069559 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f2332d9d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2334101cd0 0x7f233419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f233359e640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2334108060 0x7f23341a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 -- 172.21.15.66:0/1573069559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2334101cd0 msgr2=0x7f233419b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2334101cd0 0x7f233419b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 -- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2334108060 msgr2=0x7f23341a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2334108060 0x7f23341a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:00.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 -- 172.21.15.66:0/1573069559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23341a1600 con 0x7f23341076e0 2024-09-10T23:34:00.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f232bfff640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f233419ba90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f231c005940 tx=0x7f231c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:00.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f2330d99640 1 -- 172.21.15.66:0/1573069559 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c03f030 con 0x7f23341076e0 2024-09-10T23:34:00.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23341a1890 con 0x7f23341076e0 2024-09-10T23:34:00.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f2330d99640 1 -- 172.21.15.66:0/1573069559 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f231c003aa0 con 0x7f23341076e0 2024-09-10T23:34:00.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f2330d99640 1 -- 172.21.15.66:0/1573069559 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c035070 con 0x7f23341076e0 2024-09-10T23:34:00.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.009+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23341a7fb0 con 0x7f23341076e0 2024-09-10T23:34:00.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.010+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23341020b0 con 0x7f23341076e0 2024-09-10T23:34:00.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.012+0000 7f2330d99640 1 -- 172.21.15.66:0/1573069559 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f231c03bce0 con 0x7f23341076e0 2024-09-10T23:34:00.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.012+0000 7f2330d99640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23200b5330 0x7f23200b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:00.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.013+0000 7f2330d99640 1 -- 172.21.15.66:0/1573069559 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3917+0+0 (secure 0 0 0) 0x7f231c105470 con 0x7f23341076e0 2024-09-10T23:34:00.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.013+0000 7f2332d9d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23200b5330 0x7f23200b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:00.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.013+0000 7f2332d9d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23200b5330 0x7f23200b77f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2324009bd0 tx=0x7f2324005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:00.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.017+0000 7f2330d99640 1 -- 172.21.15.66:0/1573069559 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f231c0cce10 con 0x7f23341076e0 2024-09-10T23:34:00.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:00.210+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f233406bc30 con 0x7f23200b5330 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.211 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:00.212 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:00.212 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.212 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] boot 2024-09-10T23:34:00.212 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:34:00.212 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:33:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:34:00.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:34:00.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:34:00.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772]' entity='osd.3' 2024-09-10T23:34:00.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: osd.3 [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] boot 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:34:00.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:33:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi016 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:00.941 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:00 smithi066 ceph-mon[34761]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:34:01.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:34:01.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:34:01.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi016 2024-09-10T23:34:01.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-10T23:34:01.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:01.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:01.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:01.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:00 smithi016 ceph-mon[30855]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:34:01.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:34:01.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:34:01.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi016 2024-09-10T23:34:01.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-10T23:34:01.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:01.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:01.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:01.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:00 smithi071 ceph-mon[35018]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:34:02.021 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:01 smithi066 ceph-mon[34761]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:02.021 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:01 smithi066 ceph-mon[34761]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:02.021 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:01 smithi066 ceph-mon[34761]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:34:02.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:01 smithi016 ceph-mon[30855]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:02.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:01 smithi016 ceph-mon[30855]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:02.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:01 smithi016 ceph-mon[30855]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:34:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:01 smithi071 ceph-mon[35018]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:01 smithi071 ceph-mon[35018]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:01 smithi071 ceph-mon[35018]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:34:03.066 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:02 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/4047010433' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"} : dispatch 2024-09-10T23:34:03.066 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:02 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"} : dispatch 2024-09-10T23:34:03.066 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:02 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"}]': finished 2024-09-10T23:34:03.066 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:02 smithi066 ceph-mon[34761]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:34:03.066 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:02 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:03.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:02 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/4047010433' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"} : dispatch 2024-09-10T23:34:03.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:02 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"} : dispatch 2024-09-10T23:34:03.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:02 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"}]': finished 2024-09-10T23:34:03.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:02 smithi016 ceph-mon[30855]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:34:03.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:02 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:03.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:02 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/4047010433' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"} : dispatch 2024-09-10T23:34:03.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:02 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"} : dispatch 2024-09-10T23:34:03.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:02 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bbe8aa1-89f3-4850-99aa-5601e9ca5152"}]': finished 2024-09-10T23:34:03.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:02 smithi071 ceph-mon[35018]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:34:03.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:02 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:04.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:03 smithi016 ceph-mon[30855]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:04.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:03 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/4138215024' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:04.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:03 smithi071 ceph-mon[35018]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:04.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:03 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/4138215024' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:04.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:03 smithi066 ceph-mon[34761]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:04.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:03 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/4138215024' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:06.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:05 smithi016 ceph-mon[30855]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:06.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:05 smithi071 ceph-mon[35018]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:06.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:05 smithi066 ceph-mon[34761]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:08.201 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:07 smithi066 ceph-mon[34761]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:08.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:07 smithi016 ceph-mon[30855]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:08.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:07 smithi071 ceph-mon[35018]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:09.927 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:09 smithi066 ceph-mon[34761]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T23:34:10.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:09 smithi016 ceph-mon[30855]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T23:34:10.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:09 smithi071 ceph-mon[35018]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T23:34:11.837 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:11 smithi066 ceph-mon[34761]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T23:34:11.837 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:11 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:34:11.837 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:11 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:11.837 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:11 smithi066 ceph-mon[34761]: Deploying daemon osd.4 on smithi066 2024-09-10T23:34:12.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:11 smithi016 ceph-mon[30855]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T23:34:12.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:11 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:34:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:11 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:11 smithi016 ceph-mon[30855]: Deploying daemon osd.4 on smithi066 2024-09-10T23:34:12.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:11 smithi071 ceph-mon[35018]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T23:34:12.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:11 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:34:12.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:11 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:12.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:11 smithi071 ceph-mon[35018]: Deploying daemon osd.4 on smithi066 2024-09-10T23:34:13.988 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:13 smithi066 ceph-mon[34761]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:34:14.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:13 smithi016 ceph-mon[30855]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:34:14.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:13 smithi071 ceph-mon[35018]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:34:16.106 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:15 smithi066 ceph-mon[34761]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T23:34:16.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:15 smithi016 ceph-mon[30855]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T23:34:16.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:15 smithi071 ceph-mon[35018]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T23:34:18.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:17 smithi066 ceph-mon[34761]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:34:18.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:18.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:18.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:18.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:17 smithi016 ceph-mon[30855]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:34:18.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:18.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:18.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:18.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:17 smithi071 ceph-mon[35018]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:34:18.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:18.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:18.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:20.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:19 smithi016 ceph-mon[30855]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:34:20.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:19 smithi071 ceph-mon[35018]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:34:20.274 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:19 smithi066 ceph-mon[34761]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:34:20.582 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 4 on host 'smithi066' 2024-09-10T23:34:20.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.581+0000 7f2330d99640 1 -- 172.21.15.66:0/1573069559 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f233406bc30 con 0x7f23200b5330 2024-09-10T23:34:20.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23200b5330 msgr2=0x7f23200b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:20.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23200b5330 0x7f23200b77f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2324009bd0 tx=0x7f2324005f90 comp rx=0 tx=0).stop 2024-09-10T23:34:20.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 msgr2=0x7f233419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f233419ba90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f231c005940 tx=0x7f231c004270 comp rx=0 tx=0).stop 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 shutdown_connections 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2334108060 0x7f23341a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23200b5330 0x7f23200b77f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23341076e0 0x7f233419ba90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 --2- 172.21.15.66:0/1573069559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2334101cd0 0x7f233419b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 >> 172.21.15.66:0/1573069559 conn(0x7f23340fd700 msgr2=0x7f233406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 shutdown_connections 2024-09-10T23:34:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:34:20.584+0000 7f233922d640 1 -- 172.21.15.66:0/1573069559 wait complete. 2024-09-10T23:34:21.224 DEBUG:teuthology.orchestra.run.smithi066:osd.4> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T23:34:21.226 INFO:tasks.cephadm:Deploying osd.5 on smithi071 with /dev/vg_nvme/lv_3... 2024-09-10T23:34:21.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:34:21.440 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.440 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.440 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.440 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.480 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:34:21.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:21.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:22.436 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:22 smithi066 ceph-mon[34761]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:22.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:22 smithi016 ceph-mon[30855]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:22.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:22 smithi071 ceph-mon[35018]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:23.051 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:34:22 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:34:22.862+0000 7f82fc13b640 -1 osd.4 0 log_to_monitors true 2024-09-10T23:34:23.323 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:23 smithi071 ceph-mon[35018]: from='osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:34:23.323 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:23 smithi071 ceph-mon[35018]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:34:23.461 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:23 smithi066 ceph-mon[34761]: from='osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:34:23.461 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:23 smithi066 ceph-mon[34761]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:34:23.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:23 smithi016 ceph-mon[30855]: from='osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:34:23.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:23 smithi016 ceph-mon[30855]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:34:24.264 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:34:24.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-09-10T23:34:24.301 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:34:24.205+0000 7f82f80be640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T23:34:24.301 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:34:24.211+0000 7f82f3ee5640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:34:24.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi066 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:24.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:24.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:24.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:24.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:24.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:24 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi066 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:24.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:24 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:34:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:34:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:34:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:34:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi066 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:24.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:24.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:24.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:24 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:24.536 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 -- 172.21.15.71:0/4067223811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c64109130 msgr2=0x7f0c6410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 --2- 172.21.15.71:0/4067223811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c64109130 0x7f0c6410f930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009900 tx=0x7f0c5c02a410 comp rx=0 tx=0).stop 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 -- 172.21.15.71:0/4067223811 shutdown_connections 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 --2- 172.21.15.71:0/4067223811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c64109130 0x7f0c6410f930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 --2- 172.21.15.71:0/4067223811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c641087b0 0x7f0c64108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 --2- 172.21.15.71:0/4067223811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c64102da0 0x7f0c64103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 -- 172.21.15.71:0/4067223811 >> 172.21.15.71:0/4067223811 conn(0x7f0c640fe810 msgr2=0x7f0c64100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 -- 172.21.15.71:0/4067223811 shutdown_connections 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 -- 172.21.15.71:0/4067223811 wait complete. 2024-09-10T23:34:25.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.980+0000 7f0c697d1640 1 Processor -- start 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 -- start start 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c64102da0 0x7f0c640754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c641087b0 0x7f0c640759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c64109130 0x7f0c64075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c64112db0 con 0x7f0c64109130 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0c64112c30 con 0x7f0c64102da0 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0c64112f30 con 0x7f0c641087b0 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c641087b0 0x7f0c640759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c641087b0 0x7f0c640759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54126/0 (socket says 172.21.15.71:54126) 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 -- 172.21.15.71:0/2421383688 learned_addr learned my addr 172.21.15.71:0/2421383688 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T23:34:25.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c62ffd640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c64102da0 0x7f0c640754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 -- 172.21.15.71:0/2421383688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c64102da0 msgr2=0x7f0c640754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c64102da0 0x7f0c640754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 -- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c64109130 msgr2=0x7f0c64075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c64109130 0x7f0c64075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 -- 172.21.15.71:0/2421383688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c641a7700 con 0x7f0c641087b0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c62ffd640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c64102da0 0x7f0c640754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c627fc640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c641087b0 0x7f0c640759e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00d950 tx=0x7f0c4c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c5bfff640 1 -- 172.21.15.71:0/2421383688 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c017070 con 0x7f0c641087b0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.981+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c641a79f0 con 0x7f0c641087b0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.982+0000 7f0c5bfff640 1 -- 172.21.15.71:0/2421383688 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c4c009c30 con 0x7f0c641087b0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.982+0000 7f0c5bfff640 1 -- 172.21.15.71:0/2421383688 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00f620 con 0x7f0c641087b0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.982+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c641a7f80 con 0x7f0c641087b0 2024-09-10T23:34:25.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.982+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c64103180 con 0x7f0c641087b0 2024-09-10T23:34:25.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.985+0000 7f0c5bfff640 1 -- 172.21.15.71:0/2421383688 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f0c4c010460 con 0x7f0c641087b0 2024-09-10T23:34:25.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.985+0000 7f0c5bfff640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0c500b5330 0x7f0c500b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:25.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.985+0000 7f0c5bfff640 1 -- 172.21.15.71:0/2421383688 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7f0c4c0e4800 con 0x7f0c641087b0 2024-09-10T23:34:25.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.986+0000 7f0c62ffd640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0c500b5330 0x7f0c500b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:25.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.986+0000 7f0c62ffd640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0c500b5330 0x7f0c500b77f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c54005fd0 tx=0x7f0c540094d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:25.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:24.988+0000 7f0c5bfff640 1 -- 172.21.15.71:0/2421383688 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0c4c0ac770 con 0x7f0c641087b0 2024-09-10T23:34:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:25.174+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0c64063590 con 0x7f0c500b5330 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:25.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:25.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:34:25.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:34:25.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:25.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:25.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:25.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:25.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:25.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:34:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:34:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:34:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:25.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:25.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:25.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:25.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:26.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:26 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:34:26.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:26 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:34:26.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:26 smithi016 ceph-mon[30855]: osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] boot 2024-09-10T23:34:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:26 smithi016 ceph-mon[30855]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:34:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:26 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:26 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:34:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:26 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:34:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:26 smithi071 ceph-mon[35018]: osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] boot 2024-09-10T23:34:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:26 smithi071 ceph-mon[35018]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:34:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:26 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:26.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:26 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:34:26.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:26 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:34:26.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:26 smithi066 ceph-mon[34761]: osd.4 [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] boot 2024-09-10T23:34:26.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:26 smithi066 ceph-mon[34761]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:34:26.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:26 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:34:27.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:27 smithi016 ceph-mon[30855]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:34:27.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:27 smithi016 ceph-mon[30855]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:27.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:27 smithi071 ceph-mon[35018]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:34:27.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:27 smithi071 ceph-mon[35018]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:27 smithi066 ceph-mon[34761]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:34:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:27 smithi066 ceph-mon[34761]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:28.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:28 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/1238457676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"} : dispatch 2024-09-10T23:34:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:28 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"} : dispatch 2024-09-10T23:34:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:28 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"}]': finished 2024-09-10T23:34:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:28 smithi016 ceph-mon[30855]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:34:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:28 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/2918778597' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:28 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/1238457676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"} : dispatch 2024-09-10T23:34:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:28 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"} : dispatch 2024-09-10T23:34:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:28 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"}]': finished 2024-09-10T23:34:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:28 smithi071 ceph-mon[35018]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:34:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:28 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/2918778597' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:28.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:28 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/1238457676' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"} : dispatch 2024-09-10T23:34:28.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:28 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"} : dispatch 2024-09-10T23:34:28.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:28 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9699d403-60cd-4ba2-b896-9b03c18b2128"}]': finished 2024-09-10T23:34:28.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:28 smithi066 ceph-mon[34761]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:34:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:28 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/2918778597' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:29.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:29 smithi016 ceph-mon[30855]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:29.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:29 smithi071 ceph-mon[35018]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:29.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:29 smithi066 ceph-mon[34761]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:31.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:31 smithi016 ceph-mon[30855]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:31 smithi071 ceph-mon[35018]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:31.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:31 smithi066 ceph-mon[34761]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:33.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:33 smithi016 ceph-mon[30855]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:33 smithi071 ceph-mon[35018]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:33 smithi066 ceph-mon[34761]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:35.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:35 smithi016 ceph-mon[30855]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:35.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:35 smithi071 ceph-mon[35018]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:35.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:35 smithi066 ceph-mon[34761]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:36.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:34:36.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:36.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:36 smithi016 ceph-mon[30855]: Deploying daemon osd.5 on smithi071 2024-09-10T23:34:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:34:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:36 smithi071 ceph-mon[35018]: Deploying daemon osd.5 on smithi071 2024-09-10T23:34:36.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:34:36.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:36.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:36 smithi066 ceph-mon[34761]: Deploying daemon osd.5 on smithi071 2024-09-10T23:34:37.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:37 smithi071 ceph-mon[35018]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:37.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:37 smithi016 ceph-mon[30855]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:37 smithi066 ceph-mon[34761]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:39.716 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:39 smithi071 ceph-mon[35018]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:39.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:39 smithi016 ceph-mon[30855]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:39.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:39 smithi066 ceph-mon[34761]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:41.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:41 smithi016 ceph-mon[30855]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:41.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:41 smithi071 ceph-mon[35018]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:41.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:41 smithi066 ceph-mon[34761]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:42.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:43.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:43 smithi016 ceph-mon[30855]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:43.756 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:43 smithi071 ceph-mon[35018]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:43.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:43 smithi066 ceph-mon[34761]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:45.710 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:45 smithi071 ceph-mon[35018]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:45.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:45 smithi016 ceph-mon[30855]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:45.748 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 5 on host 'smithi071' 2024-09-10T23:34:45.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.746+0000 7f0c5bfff640 1 -- 172.21.15.71:0/2421383688 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0c64063590 con 0x7f0c500b5330 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0c500b5330 msgr2=0x7f0c500b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0c500b5330 0x7f0c500b77f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c54005fd0 tx=0x7f0c540094d0 comp rx=0 tx=0).stop 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c641087b0 msgr2=0x7f0c640759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c641087b0 0x7f0c640759e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00d950 tx=0x7f0c4c00de10 comp rx=0 tx=0).stop 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 shutdown_connections 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c64109130 0x7f0c64075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c641087b0 0x7f0c640759e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0c500b5330 0x7f0c500b77f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 --2- 172.21.15.71:0/2421383688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c64102da0 0x7f0c640754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 >> 172.21.15.71:0/2421383688 conn(0x7f0c640fe810 msgr2=0x7f0c640ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 shutdown_connections 2024-09-10T23:34:45.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:34:45.749+0000 7f0c697d1640 1 -- 172.21.15.71:0/2421383688 wait complete. 2024-09-10T23:34:45.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:45 smithi066 ceph-mon[34761]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:46.416 DEBUG:teuthology.orchestra.run.smithi071:osd.5> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T23:34:46.418 INFO:tasks.cephadm:Deploying osd.6 on smithi016 with /dev/vg_nvme/lv_2... 2024-09-10T23:34:46.418 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:34:46.685 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:46.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:46.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:46.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:46.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:47.866 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:47 smithi071 ceph-mon[35018]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:48.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:47 smithi066 ceph-mon[34761]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:48.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:47 smithi016 ceph-mon[30855]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:48.519 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:34:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:34:48.164+0000 7fe137d65640 -1 osd.5 0 log_to_monitors true 2024-09-10T23:34:48.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:48 smithi016 ceph-mon[30855]: from='osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:34:48.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:48 smithi016 ceph-mon[30855]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:34:49.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:48 smithi066 ceph-mon[34761]: from='osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:34:49.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:48 smithi066 ceph-mon[34761]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:34:49.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:48 smithi071 ceph-mon[35018]: from='osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:34:49.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:48 smithi071 ceph-mon[35018]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:34:49.557 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:34:49.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_2 2024-09-10T23:34:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:34:49.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:49.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:34:49.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:49.976 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:49.977 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:49.977 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:49.977 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:49.977 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:49.977 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.168 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:50.168 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:34:50.168 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:50.169 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:50.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:34:50.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:50.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:34:50.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.435+0000 7f3add78e640 1 -- 172.21.15.16:0/2177942743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8104600 msgr2=0x7f3ad810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.435+0000 7f3add78e640 1 --2- 172.21.15.16:0/2177942743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8104600 0x7f3ad810caf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009900 tx=0x7f3ac002a410 comp rx=0 tx=0).stop 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.435+0000 7f3add78e640 1 -- 172.21.15.16:0/2177942743 shutdown_connections 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.435+0000 7f3add78e640 1 --2- 172.21.15.16:0/2177942743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ad810d140 0x7f3ad810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.435+0000 7f3add78e640 1 --2- 172.21.15.16:0/2177942743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8104600 0x7f3ad810caf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.435+0000 7f3add78e640 1 --2- 172.21.15.16:0/2177942743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ad8103ce0 0x7f3ad81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.435+0000 7f3add78e640 1 -- 172.21.15.16:0/2177942743 >> 172.21.15.16:0/2177942743 conn(0x7f3ad80fd700 msgr2=0x7f3ad80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:34:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.436+0000 7f3add78e640 1 -- 172.21.15.16:0/2177942743 shutdown_connections 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.436+0000 7f3add78e640 1 -- 172.21.15.16:0/2177942743 wait complete. 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.436+0000 7f3add78e640 1 Processor -- start 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3add78e640 1 -- start start 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3add78e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3add78e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ad8104600 0x7f3ad81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3add78e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3add78e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8112e00 con 0x7f3ad8103ce0 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3add78e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8112c80 con 0x7f3ad810d140 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3add78e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8112f80 con 0x7f3ad8104600 2024-09-10T23:34:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50064/0 (socket says 172.21.15.16:50064) 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 -- 172.21.15.16:0/3089119793 learned_addr learned my addr 172.21.15.16:0/3089119793 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ace7fc640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ad8104600 0x7f3ad81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad77fe640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 -- 172.21.15.16:0/3089119793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ad8104600 msgr2=0x7f3ad81997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ad8104600 0x7f3ad81997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 -- 172.21.15.16:0/3089119793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ad810d140 msgr2=0x7f3ad819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:34:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad6ffd640 1 -- 172.21.15.16:0/3089119793 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad819f340 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.437+0000 7f3ad77fe640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.438+0000 7f3ad6ffd640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800d950 tx=0x7f3ac800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.438+0000 7f3ad4ff9640 1 -- 172.21.15.16:0/3089119793 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8017070 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.438+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad819f630 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.438+0000 7f3ad4ff9640 1 -- 172.21.15.16:0/3089119793 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac8009c30 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.438+0000 7f3ad4ff9640 1 -- 172.21.15.16:0/3089119793 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800f620 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.438+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad81a5ec0 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.439+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad806bb90 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.442+0000 7f3ad4ff9640 1 -- 172.21.15.16:0/3089119793 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f3ac8005030 con 0x7f3ad8103ce0 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.442+0000 7f3ad4ff9640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ac40b5330 0x7f3ac40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:34:50.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.443+0000 7f3ad4ff9640 1 -- 172.21.15.16:0/3089119793 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7f3ac80e4940 con 0x7f3ad8103ce0 2024-09-10T23:34:50.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.443+0000 7f3ace7fc640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ac40b5330 0x7f3ac40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:34:50.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.443+0000 7f3ace7fc640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ac40b5330 0x7f3ac40b77f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0031440 tx=0x7f3ac0005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:34:50.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.444+0000 7f3ad4ff9640 1 -- 172.21.15.16:0/3089119793 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3ac80ac700 con 0x7f3ad8103ce0 2024-09-10T23:34:50.519 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:34:50.167+0000 7fe133ce8640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:34:50.519 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:34:50.173+0000 7fe12bb07640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:34:50.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:34:50.643+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3ad80ffa20 con 0x7f3ac40b5330 2024-09-10T23:34:50.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi071 2024-09-10T23:34:50.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-10T23:34:50.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:34:50.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:34:50.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:50.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:50.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: from='osd.5 ' entity='osd.5' 2024-09-10T23:34:50.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:50.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:50.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:51.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi071 2024-09-10T23:34:51.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-10T23:34:51.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:34:51.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:34:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: from='osd.5 ' entity='osd.5' 2024-09-10T23:34:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:51.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi071 2024-09-10T23:34:51.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-10T23:34:51.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:34:51.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:34:51.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:51.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:51.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: from='osd.5 ' entity='osd.5' 2024-09-10T23:34:51.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:34:51.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:34:51.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] boot 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:34:52.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] boot 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:34:52.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: osd.5 [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] boot 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:34:52.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:34:53.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:52 smithi071 ceph-mon[35018]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:34:53.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:52 smithi016 ceph-mon[30855]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:34:53.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:52 smithi066 ceph-mon[34761]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:34:54.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:53 smithi016 ceph-mon[30855]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:54.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:53 smithi016 ceph-mon[30855]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:34:54.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:53 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2515182113' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2ff1e51-01cb-4ecc-bf83-f6250f3c724b"} : dispatch 2024-09-10T23:34:54.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:53 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2515182113' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2ff1e51-01cb-4ecc-bf83-f6250f3c724b"}]': finished 2024-09-10T23:34:54.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:53 smithi016 ceph-mon[30855]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:34:54.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:34:54.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:53 smithi071 ceph-mon[35018]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:54.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:53 smithi071 ceph-mon[35018]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:34:54.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:53 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2515182113' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2ff1e51-01cb-4ecc-bf83-f6250f3c724b"} : dispatch 2024-09-10T23:34:54.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:53 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2515182113' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2ff1e51-01cb-4ecc-bf83-f6250f3c724b"}]': finished 2024-09-10T23:34:54.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:53 smithi071 ceph-mon[35018]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:34:54.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:34:54.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:53 smithi066 ceph-mon[34761]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:54.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:53 smithi066 ceph-mon[34761]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:34:54.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:53 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2515182113' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2ff1e51-01cb-4ecc-bf83-f6250f3c724b"} : dispatch 2024-09-10T23:34:54.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:53 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2515182113' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2ff1e51-01cb-4ecc-bf83-f6250f3c724b"}]': finished 2024-09-10T23:34:54.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:53 smithi066 ceph-mon[34761]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:34:54.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:34:55.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:54 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2707039609' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:55.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:54 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2707039609' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:55.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:54 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2707039609' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:34:56.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:55 smithi016 ceph-mon[30855]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:56.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:55 smithi071 ceph-mon[35018]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:56.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:55 smithi066 ceph-mon[34761]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:57 smithi016 ceph-mon[30855]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:57 smithi071 ceph-mon[35018]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:34:58.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:57 smithi066 ceph-mon[34761]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:00.085 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:34:59 smithi016 ceph-mon[30855]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-10T23:35:00.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:34:59 smithi071 ceph-mon[35018]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-10T23:35:00.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:34:59 smithi066 ceph-mon[34761]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-10T23:35:02.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:01 smithi016 ceph-mon[30855]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:35:02.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:35:02.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:01 smithi071 ceph-mon[35018]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:35:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:35:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:02.304 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:01 smithi066 ceph-mon[34761]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:35:02.304 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:35:02.304 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:03.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:02 smithi016 ceph-mon[30855]: Deploying daemon osd.6 on smithi016 2024-09-10T23:35:03.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:02 smithi071 ceph-mon[35018]: Deploying daemon osd.6 on smithi016 2024-09-10T23:35:03.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:02 smithi066 ceph-mon[34761]: Deploying daemon osd.6 on smithi016 2024-09-10T23:35:04.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:03 smithi016 ceph-mon[30855]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T23:35:04.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:03 smithi071 ceph-mon[35018]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T23:35:04.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:03 smithi066 ceph-mon[34761]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T23:35:05.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:05 smithi016 ceph-mon[30855]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:35:06.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:05 smithi071 ceph-mon[35018]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:35:06.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:05 smithi066 ceph-mon[34761]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T23:35:07.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:07 smithi016 ceph-mon[30855]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:35:08.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:07 smithi071 ceph-mon[35018]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:35:08.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:07 smithi066 ceph-mon[34761]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:35:09.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:09.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:09.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:09.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:09.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:09.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:09.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:09.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:09.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:10.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:09 smithi016 ceph-mon[30855]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:35:10.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:09 smithi071 ceph-mon[35018]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:35:10.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:09 smithi066 ceph-mon[34761]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:35:12.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:12 smithi016 ceph-mon[30855]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:12 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:12 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:12 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:12 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:12 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.373 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 6 on host 'smithi016' 2024-09-10T23:35:12.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.371+0000 7f3ad4ff9640 1 -- 172.21.15.16:0/3089119793 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3ad80ffa20 con 0x7f3ac40b5330 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ac40b5330 msgr2=0x7f3ac40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ac40b5330 0x7f3ac40b77f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0031440 tx=0x7f3ac0005a20 comp rx=0 tx=0).stop 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8103ce0 msgr2=0x7f3ad8199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800d950 tx=0x7f3ac800de10 comp rx=0 tx=0).stop 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 shutdown_connections 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3ac40b5330 0x7f3ac40b77f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ad8104600 0x7f3ad81997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 --2- 172.21.15.16:0/3089119793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199290 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 >> 172.21.15.16:0/3089119793 conn(0x7f3ad80fd700 msgr2=0x7f3ad80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:12.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 shutdown_connections 2024-09-10T23:35:12.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:35:12.374+0000 7f3add78e640 1 -- 172.21.15.16:0/3089119793 wait complete. 2024-09-10T23:35:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:12 smithi071 ceph-mon[35018]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:12 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:12 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:12 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:12.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:12 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:12.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:12 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:12 smithi066 ceph-mon[34761]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:12 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:12 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:12 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:12 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:12.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:12 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:13.079 DEBUG:teuthology.orchestra.run.smithi016:osd.6> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T23:35:13.081 INFO:tasks.cephadm:Deploying osd.7 on smithi066 with /dev/vg_nvme/lv_2... 2024-09-10T23:35:13.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:35:13.352 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:35:13.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:13 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:13.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:13 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:13.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:13 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:13.474 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:13 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:13.474 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:13 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:13.475 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:13 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:13.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:13 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:13.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:13 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:13.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:13 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:14.202 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:35:13 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:35:13.930+0000 7fcbbb3c6640 -1 osd.6 0 log_to_monitors true 2024-09-10T23:35:14.424 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:14 smithi066 ceph-mon[34761]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:14.424 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:14 smithi066 ceph-mon[34761]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:35:14.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:14 smithi016 ceph-mon[30855]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:14.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:14 smithi016 ceph-mon[30855]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:35:14.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:14 smithi071 ceph-mon[35018]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:14.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:14 smithi071 ceph-mon[35018]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:35:15.549 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:35:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:35:15.380+0000 7fcbb7349640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:35:15.549 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:35:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:35:15.394+0000 7fcbb3170640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:35:15.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:15 smithi016 ceph-mon[30855]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:35:15.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:15 smithi016 ceph-mon[30855]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:35:15.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:15 smithi016 ceph-mon[30855]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:35:15.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:15 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:15.550 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:15 smithi016 ceph-mon[30855]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:15.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:15 smithi071 ceph-mon[35018]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:35:15.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:15 smithi071 ceph-mon[35018]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:35:15.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:15 smithi071 ceph-mon[35018]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:35:15.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:15 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:15.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:15 smithi071 ceph-mon[35018]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:15 smithi066 ceph-mon[34761]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:35:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:15 smithi066 ceph-mon[34761]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:35:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:15 smithi066 ceph-mon[34761]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:35:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:15 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:15.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:15 smithi066 ceph-mon[34761]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:15.818 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:35:15.846 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_2 2024-09-10T23:35:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:35:16.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:35:16.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:35:16.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:16.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:16.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi016 2024-09-10T23:35:16.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.485 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:16.486 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:16 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 -- 172.21.15.66:0/3085021636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c1076a0 msgr2=0x7f827c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 --2- 172.21.15.66:0/3085021636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c1076a0 0x7f827c107ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8264009900 tx=0x7f826402a410 comp rx=0 tx=0).stop 2024-09-10T23:35:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 -- 172.21.15.66:0/3085021636 shutdown_connections 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 --2- 172.21.15.66:0/3085021636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f827c108020 0x7f827c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 --2- 172.21.15.66:0/3085021636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c1076a0 0x7f827c107ae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 --2- 172.21.15.66:0/3085021636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f827c101c90 0x7f827c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 -- 172.21.15.66:0/3085021636 >> 172.21.15.66:0/3085021636 conn(0x7f827c0fd700 msgr2=0x7f827c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 -- 172.21.15.66:0/3085021636 shutdown_connections 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.570+0000 7f8281e1e640 1 -- 172.21.15.66:0/3085021636 wait complete. 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.571+0000 7f8281e1e640 1 Processor -- start 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.571+0000 7f8281e1e640 1 -- start start 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.571+0000 7f8281e1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c101c90 0x7f827c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.571+0000 7f8281e1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f827c1076a0 0x7f827c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.571+0000 7f8281e1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f827c108020 0x7f827c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f8281e1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f827c111ce0 con 0x7f827c108020 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f8281e1e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f827c111b60 con 0x7f827c101c90 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f8281e1e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f827c111e60 con 0x7f827c1076a0 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c101c90 0x7f827c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c101c90 0x7f827c199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56982/0 (socket says 172.21.15.66:56982) 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 -- 172.21.15.66:0/4207331201 learned_addr learned my addr 172.21.15.66:0/4207331201 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f8273fff640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f827c1076a0 0x7f827c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 -- 172.21.15.66:0/4207331201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f827c1076a0 msgr2=0x7f827c1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f827c1076a0 0x7f827c1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 -- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f827c108020 msgr2=0x7f827c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f827c108020 0x7f827c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 -- 172.21.15.66:0/4207331201 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c19f340 con 0x7f827c101c90 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f8273fff640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f827c1076a0 0x7f827c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:35:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f827b7fe640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c101c90 0x7f827c199290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f826c00d770 tx=0x7f826c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f82797fa640 1 -- 172.21.15.66:0/4207331201 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c017070 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f82797fa640 1 -- 172.21.15.66:0/4207331201 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f826c0054d0 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f82797fa640 1 -- 172.21.15.66:0/4207331201 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c004c30 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827c19f630 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.572+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827c1a5cf0 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.573+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827c102070 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.575+0000 7f82797fa640 1 -- 172.21.15.66:0/4207331201 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f826c004dd0 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.576+0000 7f82797fa640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82680b53b0 0x7f82680b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.576+0000 7f82797fa640 1 -- 172.21.15.66:0/4207331201 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5180+0+0 (secure 0 0 0) 0x7f826c0e4ed0 con 0x7f827c101c90 2024-09-10T23:35:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.576+0000 7f8273fff640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82680b53b0 0x7f82680b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.576+0000 7f8273fff640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82680b53b0 0x7f82680b7870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8264031440 tx=0x7f8264005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.579+0000 7f82797fa640 1 -- 172.21.15.66:0/4207331201 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f826c0aca50 con 0x7f827c101c90 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi016 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-10T23:35:16.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:16.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:16.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:16 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:35:16.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi016 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:16.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:16.771 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:16 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:16.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:16.774+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f827c063590 con 0x7f82680b53b0 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] boot 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:35:17.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] boot 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:35:17.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:35:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:35:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:35:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: osd.6 [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] boot 2024-09-10T23:35:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:35:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:35:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:35:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:35:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:35:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:18.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:18 smithi016 ceph-mon[30855]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:35:18.750 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:18 smithi066 ceph-mon[34761]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:35:18.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:18 smithi071 ceph-mon[35018]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:35:19.664 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:19 smithi066 ceph-mon[34761]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:19.664 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:19 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/2637602991' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"} : dispatch 2024-09-10T23:35:19.664 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:19 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"} : dispatch 2024-09-10T23:35:19.664 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:19 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"}]': finished 2024-09-10T23:35:19.664 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:19 smithi066 ceph-mon[34761]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:35:19.665 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:19 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:19.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:19 smithi016 ceph-mon[30855]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:19.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:19 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/2637602991' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"} : dispatch 2024-09-10T23:35:19.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:19 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"} : dispatch 2024-09-10T23:35:19.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:19 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"}]': finished 2024-09-10T23:35:19.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:19 smithi016 ceph-mon[30855]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:35:19.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:19 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:19 smithi071 ceph-mon[35018]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:19 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/2637602991' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"} : dispatch 2024-09-10T23:35:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:19 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"} : dispatch 2024-09-10T23:35:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:19 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3"}]': finished 2024-09-10T23:35:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:19 smithi071 ceph-mon[35018]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:35:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:19 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:20.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:20 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/1556604056' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:35:20.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:20 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/1556604056' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:35:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:20 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/1556604056' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:35:21.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:21 smithi016 ceph-mon[30855]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:21.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:21 smithi071 ceph-mon[35018]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:21.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:21 smithi066 ceph-mon[34761]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:23.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:23 smithi066 ceph-mon[34761]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:23.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:23 smithi016 ceph-mon[30855]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:23 smithi071 ceph-mon[35018]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:25.694 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:25 smithi066 ceph-mon[34761]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:25.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:25 smithi016 ceph-mon[30855]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:25.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:25 smithi071 ceph-mon[35018]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:27.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:27 smithi016 ceph-mon[30855]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:27.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:35:27.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:27.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:27 smithi016 ceph-mon[30855]: Deploying daemon osd.7 on smithi066 2024-09-10T23:35:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:27 smithi071 ceph-mon[35018]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:35:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:27 smithi071 ceph-mon[35018]: Deploying daemon osd.7 on smithi066 2024-09-10T23:35:27.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:27 smithi066 ceph-mon[34761]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:27.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:35:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:27 smithi066 ceph-mon[34761]: Deploying daemon osd.7 on smithi066 2024-09-10T23:35:29.480 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:29 smithi066 ceph-mon[34761]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:29.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:29 smithi016 ceph-mon[30855]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:29.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:29 smithi071 ceph-mon[35018]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:31.487 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:31 smithi066 ceph-mon[34761]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:31.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:31 smithi016 ceph-mon[30855]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:31 smithi071 ceph-mon[35018]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:33.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:33 smithi016 ceph-mon[30855]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:33.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:33.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:33.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:33 smithi071 ceph-mon[35018]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:33 smithi066 ceph-mon[34761]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:33.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:35.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:35 smithi066 ceph-mon[34761]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:35.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:35 smithi016 ceph-mon[30855]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:35.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:35 smithi071 ceph-mon[35018]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:36.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.441+0000 7f82797fa640 1 -- 172.21.15.66:0/4207331201 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f827c063590 con 0x7f82680b53b0 2024-09-10T23:35:36.442 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 7 on host 'smithi066' 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82680b53b0 msgr2=0x7f82680b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82680b53b0 0x7f82680b7870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8264031440 tx=0x7f8264005a20 comp rx=0 tx=0).stop 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c101c90 msgr2=0x7f827c199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c101c90 0x7f827c199290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f826c00d770 tx=0x7f826c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 shutdown_connections 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f827c108020 0x7f827c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f827c1076a0 0x7f827c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f82680b53b0 0x7f82680b7870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 --2- 172.21.15.66:0/4207331201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f827c101c90 0x7f827c199290 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 >> 172.21.15.66:0/4207331201 conn(0x7f827c0fd700 msgr2=0x7f827c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 shutdown_connections 2024-09-10T23:35:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:35:36.443+0000 7f8281e1e640 1 -- 172.21.15.66:0/4207331201 wait complete. 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.756 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:36.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:36.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:36.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:37.085 DEBUG:teuthology.orchestra.run.smithi066:osd.7> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T23:35:37.087 INFO:tasks.cephadm:Deploying osd.8 on smithi071 with /dev/vg_nvme/lv_2... 2024-09-10T23:35:37.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:35:37.341 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:35:38.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:37 smithi016 ceph-mon[30855]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:38.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:37 smithi071 ceph-mon[35018]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:38.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:37 smithi066 ceph-mon[34761]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:39.302 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:35:39 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:35:39.001+0000 7ff8ced31640 -1 osd.7 0 log_to_monitors true 2024-09-10T23:35:39.895 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:35:39.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-09-10T23:35:39.980 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:39 smithi066 ceph-mon[34761]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:39.981 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:39 smithi066 ceph-mon[34761]: from='osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:35:39.981 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:39 smithi066 ceph-mon[34761]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:35:40.185 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:35:40.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:39 smithi016 ceph-mon[30855]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:40.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:39 smithi016 ceph-mon[30855]: from='osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:35:40.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:39 smithi016 ceph-mon[30855]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:35:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:39 smithi071 ceph-mon[35018]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:39 smithi071 ceph-mon[35018]: from='osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:35:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:39 smithi071 ceph-mon[35018]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 -- 172.21.15.71:0/2837358945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8730102dc0 msgr2=0x7f87301031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 --2- 172.21.15.71:0/2837358945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8730102dc0 0x7f87301031a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8720009900 tx=0x7f872002a410 comp rx=0 tx=0).stop 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 -- 172.21.15.71:0/2837358945 shutdown_connections 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 --2- 172.21.15.71:0/2837358945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8730109150 0x7f873010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 --2- 172.21.15.71:0/2837358945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87301087d0 0x7f8730108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 --2- 172.21.15.71:0/2837358945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8730102dc0 0x7f87301031a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 -- 172.21.15.71:0/2837358945 >> 172.21.15.71:0/2837358945 conn(0x7f87300fe830 msgr2=0x7f8730100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 -- 172.21.15.71:0/2837358945 shutdown_connections 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.659+0000 7f8736029640 1 -- 172.21.15.71:0/2837358945 wait complete. 2024-09-10T23:35:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 Processor -- start 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 -- start start 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8730102dc0 0x7f8730199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87301087d0 0x7f87301997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8730109150 0x7f873019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112e10 con 0x7f8730102dc0 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112c90 con 0x7f8730109150 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8736029640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112f90 con 0x7f87301087d0 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87301087d0 0x7f87301997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87301087d0 0x7f87301997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50970/0 (socket says 172.21.15.71:50970) 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 -- 172.21.15.71:0/744499553 learned_addr learned my addr 172.21.15.71:0/744499553 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f872f7fe640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8730102dc0 0x7f8730199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:40.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 -- 172.21.15.71:0/744499553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8730109150 msgr2=0x7f873019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f872ffff640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8730109150 0x7f873019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8730109150 0x7f873019eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 -- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8730102dc0 msgr2=0x7f8730199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8730102dc0 0x7f8730199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 -- 172.21.15.71:0/744499553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873019f330 con 0x7f87301087d0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f872f7fe640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8730102dc0 0x7f8730199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.660+0000 7f8727fff640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87301087d0 0x7f87301997c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f871800c920 tx=0x7f871800cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.661+0000 7f872d7fa640 1 -- 172.21.15.71:0/744499553 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718007c70 con 0x7f87301087d0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.661+0000 7f872d7fa640 1 -- 172.21.15.71:0/744499553 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8718007e10 con 0x7f87301087d0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.661+0000 7f872d7fa640 1 -- 172.21.15.71:0/744499553 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718018820 con 0x7f87301087d0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.661+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873019f620 con 0x7f87301087d0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.661+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301a5d60 con 0x7f87301087d0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.662+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87301031a0 con 0x7f87301087d0 2024-09-10T23:35:40.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.663+0000 7f872d7fa640 1 -- 172.21.15.71:0/744499553 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f871800f450 con 0x7f87301087d0 2024-09-10T23:35:40.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.664+0000 7f872d7fa640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f871c0b53b0 0x7f871c0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:35:40.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.664+0000 7f872d7fa640 1 -- 172.21.15.71:0/744499553 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5316+0+0 (secure 0 0 0) 0x7f87180e5200 con 0x7f87301087d0 2024-09-10T23:35:40.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.664+0000 7f872f7fe640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f871c0b53b0 0x7f871c0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:35:40.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.665+0000 7f872f7fe640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f871c0b53b0 0x7f871c0b7870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f8720031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:35:40.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.668+0000 7f872d7fa640 1 -- 172.21.15.71:0/744499553 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8718014030 con 0x7f87301087d0 2024-09-10T23:35:40.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:35:40.854+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8730063590 con 0x7f871c0b53b0 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi066 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:35:41.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:41.268 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:35:41.268 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:35:41.268 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:41.268 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:35:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:35:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi066 2024-09-10T23:35:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-10T23:35:41.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:41.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:41.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:35:41.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:35:41.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:41.292 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:35:41.292 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:35:41.292 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:41.292 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:35:41.292 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi066 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:35:41.293 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:41.551 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:35:41.291+0000 7ff8cacb4640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:35:41.552 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:35:41.299+0000 7ff8c2ad3640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:35:42.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:41 smithi071 ceph-mon[35018]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:42.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:41 smithi071 ceph-mon[35018]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:35:42.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:41 smithi071 ceph-mon[35018]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:35:42.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:41 smithi071 ceph-mon[35018]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:35:42.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:41 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:42.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:41 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:42.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:41 smithi071 ceph-mon[35018]: from='osd.7 ' entity='osd.7' 2024-09-10T23:35:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:41 smithi016 ceph-mon[30855]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:41 smithi016 ceph-mon[30855]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:35:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:41 smithi016 ceph-mon[30855]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:35:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:41 smithi016 ceph-mon[30855]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:35:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:41 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:41 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:41 smithi016 ceph-mon[30855]: from='osd.7 ' entity='osd.7' 2024-09-10T23:35:42.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-mon[34761]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:35:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-mon[34761]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:35:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-mon[34761]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:35:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-mon[34761]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:35:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:41 smithi066 ceph-mon[34761]: from='osd.7 ' entity='osd.7' 2024-09-10T23:35:43.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:42 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:35:43.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:42 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:35:43.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:42 smithi016 ceph-mon[30855]: osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] boot 2024-09-10T23:35:43.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:42 smithi016 ceph-mon[30855]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:35:43.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:43.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:42 smithi016 ceph-mon[30855]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:35:43.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:42 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:35:43.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:42 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:35:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:42 smithi071 ceph-mon[35018]: osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] boot 2024-09-10T23:35:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:42 smithi071 ceph-mon[35018]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:35:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:42 smithi071 ceph-mon[35018]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:35:43.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:42 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:35:43.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:42 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:35:43.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:42 smithi066 ceph-mon[34761]: osd.7 [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] boot 2024-09-10T23:35:43.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:42 smithi066 ceph-mon[34761]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:35:43.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:35:43.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:42 smithi066 ceph-mon[34761]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:35:44.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:43 smithi016 ceph-mon[30855]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:43 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/4254278032' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"} : dispatch 2024-09-10T23:35:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:43 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"} : dispatch 2024-09-10T23:35:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:43 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"}]': finished 2024-09-10T23:35:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:43 smithi016 ceph-mon[30855]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T23:35:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:35:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:43 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/273621313' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:35:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:43 smithi071 ceph-mon[35018]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:43 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/4254278032' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"} : dispatch 2024-09-10T23:35:44.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:43 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"} : dispatch 2024-09-10T23:35:44.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:43 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"}]': finished 2024-09-10T23:35:44.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:43 smithi071 ceph-mon[35018]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T23:35:44.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:35:44.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:43 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/273621313' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:35:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:43 smithi066 ceph-mon[34761]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:43 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/4254278032' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"} : dispatch 2024-09-10T23:35:44.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:43 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"} : dispatch 2024-09-10T23:35:44.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:43 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38"}]': finished 2024-09-10T23:35:44.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:43 smithi066 ceph-mon[34761]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T23:35:44.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:35:44.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:43 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/273621313' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:35:46.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:45 smithi016 ceph-mon[30855]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:45 smithi071 ceph-mon[35018]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:45 smithi066 ceph-mon[34761]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:48.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:47 smithi071 ceph-mon[35018]: pgmap v159: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:48.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:47 smithi016 ceph-mon[30855]: pgmap v159: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:48.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:47 smithi066 ceph-mon[34761]: pgmap v159: 1 pgs: 1 unknown; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:35:50.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:49 smithi071 ceph-mon[35018]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 178 KiB/s, 0 objects/s recovering 2024-09-10T23:35:50.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:49 smithi016 ceph-mon[30855]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 178 KiB/s, 0 objects/s recovering 2024-09-10T23:35:50.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:49 smithi066 ceph-mon[34761]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 178 KiB/s, 0 objects/s recovering 2024-09-10T23:35:52.115 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:51 smithi071 ceph-mon[35018]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T23:35:52.115 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:35:52.116 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:52.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:51 smithi016 ceph-mon[30855]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T23:35:52.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:35:52.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:52.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:51 smithi066 ceph-mon[34761]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T23:35:52.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:35:52.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:35:53.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:52 smithi066 ceph-mon[34761]: Deploying daemon osd.8 on smithi071 2024-09-10T23:35:53.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:52 smithi016 ceph-mon[30855]: Deploying daemon osd.8 on smithi071 2024-09-10T23:35:53.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:52 smithi071 ceph-mon[35018]: Deploying daemon osd.8 on smithi071 2024-09-10T23:35:54.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:53 smithi071 ceph-mon[35018]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-10T23:35:54.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:53 smithi016 ceph-mon[30855]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-10T23:35:54.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:53 smithi066 ceph-mon[34761]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-10T23:35:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:55 smithi071 ceph-mon[35018]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-10T23:35:56.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:55 smithi016 ceph-mon[30855]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-10T23:35:56.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:55 smithi066 ceph-mon[34761]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-10T23:35:58.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:57 smithi016 ceph-mon[30855]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:35:58.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:58.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:58.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:57 smithi071 ceph-mon[35018]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:35:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:58.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:57 smithi066 ceph-mon[34761]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:35:58.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:35:58.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:35:58.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:35:59 smithi071 ceph-mon[35018]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:36:00.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:35:59 smithi016 ceph-mon[30855]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:36:00.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:35:59 smithi066 ceph-mon[34761]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:36:01.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.445+0000 7f872d7fa640 1 -- 172.21.15.71:0/744499553 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8730063590 con 0x7f871c0b53b0 2024-09-10T23:36:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 8 on host 'smithi071' 2024-09-10T23:36:01.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f871c0b53b0 msgr2=0x7f871c0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f871c0b53b0 0x7f871c0b7870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f8720031400 comp rx=0 tx=0).stop 2024-09-10T23:36:01.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87301087d0 msgr2=0x7f87301997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:01.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87301087d0 0x7f87301997c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f871800c920 tx=0x7f871800cde0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 shutdown_connections 2024-09-10T23:36:01.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f871c0b53b0 0x7f871c0b7870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8730109150 0x7f873019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87301087d0 0x7f87301997c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 --2- 172.21.15.71:0/744499553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8730102dc0 0x7f8730199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:01.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 >> 172.21.15.71:0/744499553 conn(0x7f87300fe830 msgr2=0x7f8730100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:01.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 shutdown_connections 2024-09-10T23:36:01.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:01.447+0000 7f8736029640 1 -- 172.21.15.71:0/744499553 wait complete. 2024-09-10T23:36:01.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:01 smithi016 ceph-mon[30855]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:01.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:01.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:01.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:01.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:01 smithi071 ceph-mon[35018]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:01.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:01.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:01 smithi066 ceph-mon[34761]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:02.131 DEBUG:teuthology.orchestra.run.smithi071:osd.8> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T23:36:02.133 INFO:tasks.cephadm:Deploying osd.9 on smithi016 with /dev/vg_nvme/lv_1... 2024-09-10T23:36:02.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:36:02.402 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:02.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:02 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:02.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:02 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:02.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:02 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:02.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:02 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:02.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:02 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:02.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:02 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:03.544 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:03 smithi016 ceph-mon[30855]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:03.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:03 smithi071 ceph-mon[35018]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:03.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:03 smithi066 ceph-mon[34761]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:04.019 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:36:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:36:03.827+0000 7fed4373b640 -1 osd.8 0 log_to_monitors true 2024-09-10T23:36:04.592 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:04 smithi071 ceph-mon[35018]: from='osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:36:04.592 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:04 smithi071 ceph-mon[35018]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:36:04.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:04 smithi016 ceph-mon[30855]: from='osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:36:04.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:04 smithi016 ceph-mon[30855]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:36:04.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:04 smithi066 ceph-mon[34761]: from='osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:36:04.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:04 smithi066 ceph-mon[34761]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:36:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:36:05.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_1 2024-09-10T23:36:05.374 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:36:05.462 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi071 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-10T23:36:05.464 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.464 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:05.464 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:05.464 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:36:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:36:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:36:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:36:05.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi071 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:05.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 -- 172.21.15.16:0/2215325352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850102de0 msgr2=0x7ff8501031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 --2- 172.21.15.16:0/2215325352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850102de0 0x7ff8501031c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff840009900 tx=0x7ff84002a410 comp rx=0 tx=0).stop 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 -- 172.21.15.16:0/2215325352 shutdown_connections 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 --2- 172.21.15.16:0/2215325352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff850109170 0x7ff85010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 --2- 172.21.15.16:0/2215325352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8501087f0 0x7ff850108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 --2- 172.21.15.16:0/2215325352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850102de0 0x7ff8501031c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 -- 172.21.15.16:0/2215325352 >> 172.21.15.16:0/2215325352 conn(0x7ff8500fe830 msgr2=0x7ff850100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 -- 172.21.15.16:0/2215325352 shutdown_connections 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.771+0000 7ff855b6b640 1 -- 172.21.15.16:0/2215325352 wait complete. 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 Processor -- start 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 -- start start 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff850102de0 0x7ff8501992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8501087f0 0x7ff8501997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850109170 0x7ff85019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff850112e80 con 0x7ff850109170 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff850112d00 con 0x7ff8501087f0 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff855b6b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff850113000 con 0x7ff850102de0 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff84ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850109170 0x7ff85019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff84ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850109170 0x7ff85019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33730/0 (socket says 172.21.15.16:33730) 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff84ffff640 1 -- 172.21.15.16:0/3836073419 learned_addr learned my addr 172.21.15.16:0/3836073419 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff84f7fe640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff850102de0 0x7ff8501992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.772+0000 7ff84effd640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8501087f0 0x7ff8501997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84ffff640 1 -- 172.21.15.16:0/3836073419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff850102de0 msgr2=0x7ff8501992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84ffff640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff850102de0 0x7ff8501992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84ffff640 1 -- 172.21.15.16:0/3836073419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8501087f0 msgr2=0x7ff8501997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84ffff640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8501087f0 0x7ff8501997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84ffff640 1 -- 172.21.15.16:0/3836073419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85019f360 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84ffff640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850109170 0x7ff85019eb90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff848009fd0 tx=0x7ff84800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84cff9640 1 -- 172.21.15.16:0/3836073419 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848017070 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85019f650 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84cff9640 1 -- 172.21.15.16:0/3836073419 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff848003e20 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff84cff9640 1 -- 172.21.15.16:0/3836073419 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848010460 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.773+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8501a5d10 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.774+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8501031c0 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.776+0000 7ff84cff9640 1 -- 172.21.15.16:0/3836073419 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7ff848003970 con 0x7ff850109170 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.777+0000 7ff84cff9640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8380b5330 0x7ff8380b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.777+0000 7ff84f7fe640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8380b5330 0x7ff8380b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:05.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.777+0000 7ff84cff9640 1 -- 172.21.15.16:0/3836073419 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7ff8480e4f30 con 0x7ff850109170 2024-09-10T23:36:05.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.777+0000 7ff84f7fe640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8380b5330 0x7ff8380b77f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff840005ab0 tx=0x7ff840005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:05.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.781+0000 7ff84cff9640 1 -- 172.21.15.16:0/3836073419 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff8480ac190 con 0x7ff850109170 2024-09-10T23:36:05.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:05.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:36:05.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:36:05.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:05.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:36:05.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:36:05.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi071 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:05.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:05.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:05.977+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff850100740 con 0x7ff8380b5330 2024-09-10T23:36:06.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:36:05.840+0000 7fed3f6be640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T23:36:06.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:36:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:36:05.848+0000 7fed374dd640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:36:06.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='osd.8 ' entity='osd.8' 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:06 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:06.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:36:06.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:36:06.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:06.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:06.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='osd.8 ' entity='osd.8' 2024-09-10T23:36:06.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:06.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:06.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:06.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:06 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:06.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='osd.8 ' entity='osd.8' 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:06.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:06 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:07.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:07 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:36:07.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:07 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:36:07.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:07 smithi016 ceph-mon[30855]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:07.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:07 smithi016 ceph-mon[30855]: osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] boot 2024-09-10T23:36:07.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:07 smithi016 ceph-mon[30855]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T23:36:07.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:07 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:07.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:07 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:36:07.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:07 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:36:07.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:07 smithi071 ceph-mon[35018]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:07.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:07 smithi071 ceph-mon[35018]: osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] boot 2024-09-10T23:36:07.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:07 smithi071 ceph-mon[35018]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T23:36:07.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:07 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:07.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:07 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:36:07.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:07 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:36:07.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:07 smithi066 ceph-mon[34761]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:36:07.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:07 smithi066 ceph-mon[34761]: osd.8 [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] boot 2024-09-10T23:36:07.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:07 smithi066 ceph-mon[34761]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T23:36:07.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:07 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:36:08.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:08 smithi016 ceph-mon[30855]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:36:08.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:08 smithi071 ceph-mon[35018]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:36:08.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:08 smithi066 ceph-mon[34761]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:36:09.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:09 smithi016 ceph-mon[30855]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:09.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:09 smithi016 ceph-mon[30855]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:36:09.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1589096879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b87feb45-8cb5-4818-983d-4aa333e0276b"} : dispatch 2024-09-10T23:36:09.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1589096879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b87feb45-8cb5-4818-983d-4aa333e0276b"}]': finished 2024-09-10T23:36:09.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:09 smithi016 ceph-mon[30855]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T23:36:09.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:09 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:09.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3868698023' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:36:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:09 smithi071 ceph-mon[35018]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:09 smithi071 ceph-mon[35018]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:36:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1589096879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b87feb45-8cb5-4818-983d-4aa333e0276b"} : dispatch 2024-09-10T23:36:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1589096879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b87feb45-8cb5-4818-983d-4aa333e0276b"}]': finished 2024-09-10T23:36:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:09 smithi071 ceph-mon[35018]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T23:36:09.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:09 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:09.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3868698023' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:36:09.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:09 smithi066 ceph-mon[34761]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:09.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:09 smithi066 ceph-mon[34761]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:36:09.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1589096879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b87feb45-8cb5-4818-983d-4aa333e0276b"} : dispatch 2024-09-10T23:36:09.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1589096879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b87feb45-8cb5-4818-983d-4aa333e0276b"}]': finished 2024-09-10T23:36:09.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:09 smithi066 ceph-mon[34761]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T23:36:09.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:09 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:09.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3868698023' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:36:11.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:11 smithi071 ceph-mon[35018]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:11.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:11 smithi066 ceph-mon[34761]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:11.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:11 smithi016 ceph-mon[30855]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:13.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:13 smithi071 ceph-mon[35018]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-10T23:36:13.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:13 smithi066 ceph-mon[34761]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-10T23:36:13.848 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:13 smithi016 ceph-mon[30855]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-10T23:36:15.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:15 smithi016 ceph-mon[30855]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-10T23:36:15.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:15 smithi071 ceph-mon[35018]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-10T23:36:15.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:15 smithi066 ceph-mon[34761]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-10T23:36:17.762 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:17 smithi016 ceph-mon[30855]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:36:17.762 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:36:17.762 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:17 smithi071 ceph-mon[35018]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:36:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:36:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:17.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:17 smithi066 ceph-mon[34761]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:36:17.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:36:17.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:18.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:18 smithi016 ceph-mon[30855]: Deploying daemon osd.9 on smithi016 2024-09-10T23:36:18.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:18 smithi071 ceph-mon[35018]: Deploying daemon osd.9 on smithi016 2024-09-10T23:36:18.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:18 smithi066 ceph-mon[34761]: Deploying daemon osd.9 on smithi016 2024-09-10T23:36:19.668 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:19 smithi016 ceph-mon[30855]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:36:19.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:19 smithi071 ceph-mon[35018]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:36:19.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:19 smithi066 ceph-mon[34761]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:36:21.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:21 smithi071 ceph-mon[35018]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T23:36:21.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:21 smithi066 ceph-mon[34761]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T23:36:21.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:21 smithi016 ceph-mon[30855]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T23:36:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:23 smithi071 ceph-mon[35018]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:36:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:23.797 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:23 smithi016 ceph-mon[30855]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:36:23.797 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:23.797 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:23.797 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:23 smithi066 ceph-mon[34761]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:36:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:25 smithi071 ceph-mon[35018]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:25.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:25 smithi066 ceph-mon[34761]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:25.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:25 smithi016 ceph-mon[30855]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:26.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.874+0000 7ff84cff9640 1 -- 172.21.15.16:0/3836073419 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff850100740 con 0x7ff8380b5330 2024-09-10T23:36:26.877 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 9 on host 'smithi016' 2024-09-10T23:36:26.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8380b5330 msgr2=0x7ff8380b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8380b5330 0x7ff8380b77f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff840005ab0 tx=0x7ff840005a20 comp rx=0 tx=0).stop 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850109170 msgr2=0x7ff85019eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850109170 0x7ff85019eb90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff848009fd0 tx=0x7ff84800b260 comp rx=0 tx=0).stop 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 shutdown_connections 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff850109170 0x7ff85019eb90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8380b5330 0x7ff8380b77f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8501087f0 0x7ff8501997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.876+0000 7ff855b6b640 1 --2- 172.21.15.16:0/3836073419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff850102de0 0x7ff8501992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.877+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 >> 172.21.15.16:0/3836073419 conn(0x7ff8500fe830 msgr2=0x7ff850100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.877+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 shutdown_connections 2024-09-10T23:36:26.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:36:26.877+0000 7ff855b6b640 1 -- 172.21.15.16:0/3836073419 wait complete. 2024-09-10T23:36:27.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:27.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:27.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:27.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:27.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:27.553 DEBUG:teuthology.orchestra.run.smithi016:osd.9> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T23:36:27.555 INFO:tasks.cephadm:Deploying osd.10 on smithi066 with /dev/vg_nvme/lv_1... 2024-09-10T23:36:27.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:36:27.825 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:28.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:28 smithi016 ceph-mon[30855]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:28.299 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:28 smithi066 ceph-mon[34761]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:28 smithi071 ceph-mon[35018]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:28.912 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:36:28 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:36:28.788+0000 7f59ed48f640 -1 osd.9 0 log_to_monitors true 2024-09-10T23:36:29.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:29 smithi016 ceph-mon[30855]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:36:29.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:29 smithi066 ceph-mon[34761]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:36:29.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:29 smithi071 ceph-mon[35018]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:36:30.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:30 smithi066 ceph-mon[34761]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:30 smithi066 ceph-mon[34761]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:36:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:30 smithi066 ceph-mon[34761]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:36:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:30 smithi066 ceph-mon[34761]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:36:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:30 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:30.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:30 smithi016 ceph-mon[30855]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:30.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:30 smithi016 ceph-mon[30855]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:36:30.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:30 smithi016 ceph-mon[30855]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:36:30.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:30 smithi016 ceph-mon[30855]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:36:30.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:30 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:30 smithi071 ceph-mon[35018]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:30 smithi071 ceph-mon[35018]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:36:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:30 smithi071 ceph-mon[35018]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:36:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:30 smithi071 ceph-mon[35018]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]} : dispatch 2024-09-10T23:36:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:30 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:30.624 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-10T23:36:30.651 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_1 2024-09-10T23:36:30.734 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:36:30 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:36:30.515+0000 7f59e9412640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T23:36:30.735 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:36:30 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:36:30.525+0000 7f59e1231640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:36:30.918 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:36:31.219 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:36:31.219 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:36:31.219 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:31.220 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:31.221 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.221 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:31 smithi066 ceph-mon[34761]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' 2024-09-10T23:36:31.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 -- 172.21.15.66:0/30285747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc103ca0 msgr2=0x7f65fc104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 --2- 172.21.15.66:0/30285747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc103ca0 0x7f65fc104080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009900 tx=0x7f65f002a410 comp rx=0 tx=0).stop 2024-09-10T23:36:31.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 -- 172.21.15.66:0/30285747 shutdown_connections 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 --2- 172.21.15.66:0/30285747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65fc10d100 0x7f65fc10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 --2- 172.21.15.66:0/30285747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65fc1045c0 0x7f65fc10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 --2- 172.21.15.66:0/30285747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc103ca0 0x7f65fc104080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 -- 172.21.15.66:0/30285747 >> 172.21.15.66:0/30285747 conn(0x7f65fc0fd700 msgr2=0x7f65fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 -- 172.21.15.66:0/30285747 shutdown_connections 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.411+0000 7f6602ed5640 1 -- 172.21.15.66:0/30285747 wait complete. 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 Processor -- start 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 -- start start 2024-09-10T23:36:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65fc103ca0 0x7f65fc19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65fc1045c0 0x7f65fc19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc10d100 0x7f65fc1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc112e20 con 0x7f65fc103ca0 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc112ca0 con 0x7f65fc10d100 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6602ed5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc112fa0 con 0x7f65fc1045c0 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6601472640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc10d100 0x7f65fc1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6601472640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc10d100 0x7f65fc1a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52030/0 (socket says 172.21.15.66:52030) 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6601472640 1 -- 172.21.15.66:0/233306106 learned_addr learned my addr 172.21.15.66:0/233306106 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6600c71640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65fc103ca0 0x7f65fc19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f65fbfff640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65fc1045c0 0x7f65fc19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6601472640 1 -- 172.21.15.66:0/233306106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65fc1045c0 msgr2=0x7f65fc19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.412+0000 7f6601472640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65fc1045c0 0x7f65fc19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f6601472640 1 -- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65fc103ca0 msgr2=0x7f65fc19b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f6601472640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65fc103ca0 0x7f65fc19b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f6601472640 1 -- 172.21.15.66:0/233306106 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc1a15d0 con 0x7f65fc10d100 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f6601472640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc10d100 0x7f65fc1a0e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f65f400eaa0 tx=0x7f65f400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f65f9ffb640 1 -- 172.21.15.66:0/233306106 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f400cdb0 con 0x7f65fc10d100 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f65f9ffb640 1 -- 172.21.15.66:0/233306106 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f4005020 con 0x7f65fc10d100 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc1a18c0 con 0x7f65fc10d100 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f65f9ffb640 1 -- 172.21.15.66:0/233306106 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40116d0 con 0x7f65fc10d100 2024-09-10T23:36:31.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.413+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc1a8000 con 0x7f65fc10d100 2024-09-10T23:36:31.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.414+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc104080 con 0x7f65fc10d100 2024-09-10T23:36:31.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.415+0000 7f65f9ffb640 1 -- 172.21.15.66:0/233306106 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f65f400f040 con 0x7f65fc10d100 2024-09-10T23:36:31.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.416+0000 7f65f9ffb640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65ec0b53b0 0x7f65ec0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:31.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.416+0000 7f65f9ffb640 1 -- 172.21.15.66:0/233306106 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6196+0+0 (secure 0 0 0) 0x7f65f40e5130 con 0x7f65fc10d100 2024-09-10T23:36:31.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.416+0000 7f6600c71640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65ec0b53b0 0x7f65ec0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:31.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.417+0000 7f6600c71640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65ec0b53b0 0x7f65ec0b7870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65f0005ab0 tx=0x7f65f0005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:31.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.420+0000 7f65f9ffb640 1 -- 172.21.15.66:0/233306106 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f65f4016030 con 0x7f65fc10d100 2024-09-10T23:36:31.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:36:31.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:36:31.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:31.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:31.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:31 smithi016 ceph-mon[30855]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' 2024-09-10T23:36:31.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-10T23:36:31.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:36:31.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:31.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:31.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:31.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:31.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:31.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:31.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:31 smithi071 ceph-mon[35018]: from='osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838]' entity='osd.9' 2024-09-10T23:36:31.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:31.619+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f65fc103060 con 0x7f65ec0b53b0 2024-09-10T23:36:32.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi016 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] boot 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:36:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:36:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi016 2024-09-10T23:36:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-10T23:36:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:32.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] boot 2024-09-10T23:36:32.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T23:36:32.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:32.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:32.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:32.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:36:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:36:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi016 2024-09-10T23:36:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: osd.9 [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] boot 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:33.373 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:33 smithi066 ceph-mon[34761]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:33.374 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:33 smithi066 ceph-mon[34761]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:36:33.385 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:33 smithi016 ceph-mon[30855]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:33.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:33 smithi016 ceph-mon[30855]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:36:33.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:33 smithi071 ceph-mon[35018]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:33.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:33 smithi071 ceph-mon[35018]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:36:34.357 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:34 smithi066 ceph-mon[34761]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:34.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:34 smithi016 ceph-mon[30855]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:34 smithi071 ceph-mon[35018]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:35 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/1608459056' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"} : dispatch 2024-09-10T23:36:35.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:35 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"} : dispatch 2024-09-10T23:36:35.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:35 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"}]': finished 2024-09-10T23:36:35.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:35 smithi071 ceph-mon[35018]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T23:36:35.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:35 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:35.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:35 smithi071 ceph-mon[35018]: from='client.? 172.21.15.66:0/3894487989' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:36:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:35 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/1608459056' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"} : dispatch 2024-09-10T23:36:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:35 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"} : dispatch 2024-09-10T23:36:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:35 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"}]': finished 2024-09-10T23:36:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:35 smithi016 ceph-mon[30855]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T23:36:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:35 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:35 smithi016 ceph-mon[30855]: from='client.? 172.21.15.66:0/3894487989' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:36:35.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:35 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/1608459056' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"} : dispatch 2024-09-10T23:36:35.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:35 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"} : dispatch 2024-09-10T23:36:35.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:35 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9675564e-158f-4242-b54a-4a710e94ef77"}]': finished 2024-09-10T23:36:35.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:35 smithi066 ceph-mon[34761]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T23:36:35.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:35 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:35.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:35 smithi066 ceph-mon[34761]: from='client.? 172.21.15.66:0/3894487989' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:36:36.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:36 smithi016 ceph-mon[30855]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:36.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:36 smithi071 ceph-mon[35018]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:36.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:36 smithi066 ceph-mon[34761]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:38.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:38 smithi016 ceph-mon[30855]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:38.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:38 smithi071 ceph-mon[35018]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:38.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:38 smithi066 ceph-mon[34761]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:40.383 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:40 smithi066 ceph-mon[34761]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:40 smithi016 ceph-mon[30855]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:40.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:40 smithi071 ceph-mon[35018]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:42.453 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:42 smithi066 ceph-mon[34761]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:42.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:42 smithi016 ceph-mon[30855]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:42.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:42 smithi071 ceph-mon[35018]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:43.377 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:36:43.377 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:36:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:43.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:36:43.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:44 smithi066 ceph-mon[34761]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:44 smithi066 ceph-mon[34761]: Deploying daemon osd.10 on smithi066 2024-09-10T23:36:44.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:44 smithi016 ceph-mon[30855]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:44.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:44 smithi016 ceph-mon[30855]: Deploying daemon osd.10 on smithi066 2024-09-10T23:36:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:44 smithi071 ceph-mon[35018]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:44 smithi071 ceph-mon[35018]: Deploying daemon osd.10 on smithi066 2024-09-10T23:36:46.264 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:46 smithi066 ceph-mon[34761]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:46 smithi016 ceph-mon[30855]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:46.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:46 smithi071 ceph-mon[35018]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:48.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:48 smithi016 ceph-mon[30855]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:48 smithi071 ceph-mon[35018]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:48.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:48 smithi066 ceph-mon[34761]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:49.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:49 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:49.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:49.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:49.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:49 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:49.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:49.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:49.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:49 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:50.407 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:50 smithi066 ceph-mon[34761]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:50 smithi016 ceph-mon[30855]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:50 smithi071 ceph-mon[35018]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:52.059 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 10 on host 'smithi066' 2024-09-10T23:36:52.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.057+0000 7f65f9ffb640 1 -- 172.21.15.66:0/233306106 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f65fc103060 con 0x7f65ec0b53b0 2024-09-10T23:36:52.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.059+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65ec0b53b0 msgr2=0x7f65ec0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:52.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.059+0000 7f6602ed5640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65ec0b53b0 0x7f65ec0b7870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65f0005ab0 tx=0x7f65f0005a20 comp rx=0 tx=0).stop 2024-09-10T23:36:52.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc10d100 msgr2=0x7f65fc1a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:52.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc10d100 0x7f65fc1a0e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f65f400eaa0 tx=0x7f65f400ef60 comp rx=0 tx=0).stop 2024-09-10T23:36:52.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 shutdown_connections 2024-09-10T23:36:52.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65ec0b53b0 0x7f65ec0b7870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:52.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc10d100 0x7f65fc1a0e00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:52.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65fc1045c0 0x7f65fc19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:52.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 --2- 172.21.15.66:0/233306106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65fc103ca0 0x7f65fc19b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:52.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 >> 172.21.15.66:0/233306106 conn(0x7f65fc0fd700 msgr2=0x7f65fc10f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:52.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 shutdown_connections 2024-09-10T23:36:52.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-10T23:36:52.060+0000 7f6602ed5640 1 -- 172.21.15.66:0/233306106 wait complete. 2024-09-10T23:36:52.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:52 smithi066 ceph-mon[34761]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:52.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:52 smithi016 ceph-mon[30855]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:52 smithi071 ceph-mon[35018]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:52.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:52.723 DEBUG:teuthology.orchestra.run.smithi066:osd.10> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T23:36:52.726 INFO:tasks.cephadm:Deploying osd.11 on smithi071 with /dev/vg_nvme/lv_1... 2024-09-10T23:36:52.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:36:52.982 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:36:54.337 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:54 smithi066 ceph-mon[34761]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:54.437 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:54 smithi071 ceph-mon[35018]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:54.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:54 smithi016 ceph-mon[30855]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:54.622 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:36:54 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:36:54.400+0000 7f2b34f26640 -1 osd.10 0 log_to_monitors true 2024-09-10T23:36:55.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:55 smithi071 ceph-mon[35018]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:36:55.416 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:55 smithi066 ceph-mon[34761]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:36:55.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:55 smithi016 ceph-mon[30855]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:36:55.771 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T23:36:55.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-09-10T23:36:56.051 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:36:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:56 smithi016 ceph-mon[30855]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:56 smithi016 ceph-mon[30855]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:36:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:56 smithi016 ceph-mon[30855]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:36:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:56 smithi016 ceph-mon[30855]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:36:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:56.505 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:56 smithi071 ceph-mon[35018]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:56.505 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:56 smithi071 ceph-mon[35018]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:36:56.506 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:56 smithi071 ceph-mon[35018]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:36:56.506 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:56 smithi071 ceph-mon[35018]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:36:56.506 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:56.506 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:56.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-mon[34761]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:56.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-mon[34761]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:36:56.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-mon[34761]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:36:56.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-mon[34761]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-10T23:36:56.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:56.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 -- 172.21.15.71:0/3696529029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc108020 msgr2=0x7fa6dc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3696529029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc108020 0x7fa6dc10e820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009ca0 tx=0x7fa6d402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 -- 172.21.15.71:0/3696529029 shutdown_connections 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3696529029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc108020 0x7fa6dc10e820 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3696529029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc1076a0 0x7fa6dc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3696529029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6dc101c90 0x7fa6dc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 -- 172.21.15.71:0/3696529029 >> 172.21.15.71:0/3696529029 conn(0x7fa6dc0fd700 msgr2=0x7fa6dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 -- 172.21.15.71:0/3696529029 shutdown_connections 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 -- 172.21.15.71:0/3696529029 wait complete. 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 Processor -- start 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.588+0000 7fa6e3380640 1 -- start start 2024-09-10T23:36:56.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e3380640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc101c90 0x7fa6dc198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e3380640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6dc1076a0 0x7fa6dc198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e3380640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc108020 0x7fa6dc19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e3380640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc111ca0 con 0x7fa6dc108020 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e3380640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc111b20 con 0x7fa6dc1076a0 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e3380640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc111e20 con 0x7fa6dc101c90 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc101c90 0x7fa6dc198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc101c90 0x7fa6dc198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49786/0 (socket says 172.21.15.71:49786) 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 -- 172.21.15.71:0/3493437268 learned_addr learned my addr 172.21.15.71:0/3493437268 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e091b640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6dc1076a0 0x7fa6dc198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e191d640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc108020 0x7fa6dc19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 -- 172.21.15.71:0/3493437268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6dc1076a0 msgr2=0x7fa6dc198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6dc1076a0 0x7fa6dc198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:56.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 -- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc108020 msgr2=0x7fa6dc19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc108020 0x7fa6dc19da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 -- 172.21.15.71:0/3493437268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc19e1e0 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e091b640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6dc1076a0 0x7fa6dc198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6e111c640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc101c90 0x7fa6dc198130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800eb00 tx=0x7fa6d8009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.589+0000 7fa6d27fc640 1 -- 172.21.15.71:0/3493437268 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d801c070 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.590+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc19e4d0 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.590+0000 7fa6d27fc640 1 -- 172.21.15.71:0/3493437268 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d800bc30 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.590+0000 7fa6d27fc640 1 -- 172.21.15.71:0/3493437268 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8016610 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.590+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc06aab0 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.590+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6dc102070 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.592+0000 7fa6d27fc640 1 -- 172.21.15.71:0/3493437268 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fa6d8017410 con 0x7fa6dc101c90 2024-09-10T23:36:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.592+0000 7fa6d27fc640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa6c80b5330 0x7fa6c80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:36:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.593+0000 7fa6d27fc640 1 -- 172.21.15.71:0/3493437268 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6629+0+0 (secure 0 0 0) 0x7fa6d80e7080 con 0x7fa6dc101c90 2024-09-10T23:36:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.593+0000 7fa6e091b640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa6c80b5330 0x7fa6c80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:36:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.593+0000 7fa6e091b640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa6c80b5330 0x7fa6c80b77f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc103d70 tx=0x7fa6cc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:36:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.595+0000 7fa6d27fc640 1 -- 172.21.15.71:0/3493437268 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa6d800bde0 con 0x7fa6dc101c90 2024-09-10T23:36:56.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:36:56.781+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa6dc06b6b0 con 0x7fa6c80b5330 2024-09-10T23:36:57.051 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:36:56.579+0000 7f2b30ea9640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T23:36:57.051 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:36:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:36:56.590+0000 7f2b28cc8640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi066 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.444 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:57.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:57 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi066 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:57.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:57 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi066 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242]' entity='osd.10' 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:36:57.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:57 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] boot 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:58.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:58 smithi071 ceph-mon[35018]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] boot 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:58 smithi016 ceph-mon[30855]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:36:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:36:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:36:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:36:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: from='client.24496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:36:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: osd.10 [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] boot 2024-09-10T23:36:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T23:36:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:36:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:58 smithi066 ceph-mon[34761]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:36:59.718 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:59 smithi071 ceph-mon[35018]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:36:59.718 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:59 smithi071 ceph-mon[35018]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:36:59.719 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:59 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/3094475219' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"} : dispatch 2024-09-10T23:36:59.719 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:59 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"} : dispatch 2024-09-10T23:36:59.719 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:59 smithi071 ceph-mon[35018]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"}]': finished 2024-09-10T23:36:59.719 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:59 smithi071 ceph-mon[35018]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T23:36:59.719 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:36:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:36:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:59 smithi016 ceph-mon[30855]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:36:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:59 smithi016 ceph-mon[30855]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:36:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:59 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/3094475219' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"} : dispatch 2024-09-10T23:36:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:59 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"} : dispatch 2024-09-10T23:36:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:59 smithi016 ceph-mon[30855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"}]': finished 2024-09-10T23:36:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:59 smithi016 ceph-mon[30855]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T23:36:59.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:36:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:59 smithi066 ceph-mon[34761]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:59 smithi066 ceph-mon[34761]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:37:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:59 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/3094475219' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"} : dispatch 2024-09-10T23:37:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:59 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"} : dispatch 2024-09-10T23:37:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:59 smithi066 ceph-mon[34761]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e"}]': finished 2024-09-10T23:37:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:59 smithi066 ceph-mon[34761]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T23:37:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:36:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:00.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:00 smithi016 ceph-mon[30855]: from='client.? 172.21.15.71:0/554471546' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:37:01.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:00 smithi071 ceph-mon[35018]: from='client.? 172.21.15.71:0/554471546' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:37:01.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:00 smithi066 ceph-mon[34761]: from='client.? 172.21.15.71:0/554471546' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:37:01.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:01 smithi016 ceph-mon[30855]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:02.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:01 smithi071 ceph-mon[35018]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:02.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:01 smithi066 ceph-mon[34761]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:03.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:03 smithi016 ceph-mon[30855]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-10T23:37:04.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:03 smithi071 ceph-mon[35018]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-10T23:37:04.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:03 smithi066 ceph-mon[34761]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-10T23:37:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:05 smithi016 ceph-mon[30855]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T23:37:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:05 smithi071 ceph-mon[35018]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T23:37:06.036 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:05 smithi066 ceph-mon[34761]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T23:37:07.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:07 smithi016 ceph-mon[30855]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:37:08.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:07 smithi071 ceph-mon[35018]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:37:08.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:07 smithi066 ceph-mon[34761]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:37:09.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:37:09.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:09.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:08 smithi071 ceph-mon[35018]: Deploying daemon osd.11 on smithi071 2024-09-10T23:37:09.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:37:09.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:09.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:08 smithi066 ceph-mon[34761]: Deploying daemon osd.11 on smithi071 2024-09-10T23:37:09.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:37:09.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:09.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:08 smithi016 ceph-mon[30855]: Deploying daemon osd.11 on smithi071 2024-09-10T23:37:09.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:09 smithi071 ceph-mon[35018]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T23:37:10.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:09 smithi066 ceph-mon[34761]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T23:37:10.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:09 smithi016 ceph-mon[30855]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T23:37:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:11 smithi071 ceph-mon[35018]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-10T23:37:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:11 smithi066 ceph-mon[34761]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-10T23:37:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:11 smithi016 ceph-mon[30855]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-10T23:37:13.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:13 smithi071 ceph-mon[35018]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:37:13.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:13 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:13.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:13 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:13.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:13 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:14.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:13 smithi066 ceph-mon[34761]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:37:14.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:13 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:14.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:13 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:14.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:13 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:14.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:13 smithi016 ceph-mon[30855]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T23:37:14.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:13 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:14.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:13 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:14.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:13 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:16.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:15 smithi071 ceph-mon[35018]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:16.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:15 smithi066 ceph-mon[34761]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:16.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:15 smithi016 ceph-mon[30855]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:17.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.237+0000 7fa6d27fc640 1 -- 172.21.15.71:0/3493437268 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa6dc06b6b0 con 0x7fa6c80b5330 2024-09-10T23:37:17.238 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 11 on host 'smithi071' 2024-09-10T23:37:17.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa6c80b5330 msgr2=0x7fa6c80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:17.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa6c80b5330 0x7fa6c80b77f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc103d70 tx=0x7fa6cc005f90 comp rx=0 tx=0).stop 2024-09-10T23:37:17.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc101c90 msgr2=0x7fa6dc198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:17.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc101c90 0x7fa6dc198130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800eb00 tx=0x7fa6d8009f20 comp rx=0 tx=0).stop 2024-09-10T23:37:17.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 shutdown_connections 2024-09-10T23:37:17.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc108020 0x7fa6dc19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:17.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa6c80b5330 0x7fa6c80b77f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:17.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6dc1076a0 0x7fa6dc198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:17.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 --2- 172.21.15.71:0/3493437268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6dc101c90 0x7fa6dc198130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:17.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 >> 172.21.15.71:0/3493437268 conn(0x7fa6dc0fd700 msgr2=0x7fa6dc0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:17.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 shutdown_connections 2024-09-10T23:37:17.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:17.239+0000 7fa6e3380640 1 -- 172.21.15.71:0/3493437268 wait complete. 2024-09-10T23:37:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:17 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:17.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:17.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:17.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:17.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:17 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.972 DEBUG:teuthology.orchestra.run.smithi071:osd.11> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T23:37:17.974 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T23:37:17.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:37:17.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:17 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:18.244 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:18.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3788271129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc10d120 msgr2=0x7fa2cc10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:18.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3788271129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc10d120 0x7fa2cc10f550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009ca0 tx=0x7fa2c402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3788271129 shutdown_connections 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3788271129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc10d120 0x7fa2cc10f550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3788271129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2cc104570 0x7fa2cc10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3788271129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2cc103b70 0x7fa2cc103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3788271129 >> 172.21.15.16:0/3788271129 conn(0x7fa2cc0fd700 msgr2=0x7fa2cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3788271129 shutdown_connections 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3788271129 wait complete. 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 Processor -- start 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.717+0000 7fa2d35c8640 1 -- start start 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d35c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2cc103b70 0x7fa2cc1019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d35c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc104570 0x7fa2cc101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:18.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d35c8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2cc10d120 0x7fa2cc102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d35c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc112d60 con 0x7fa2cc104570 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d35c8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc112be0 con 0x7fa2cc103b70 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d35c8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc112ee0 con 0x7fa2cc10d120 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc104570 0x7fa2cc101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc104570 0x7fa2cc101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33890/0 (socket says 172.21.15.16:33890) 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d1b65640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2cc10d120 0x7fa2cc102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 -- 172.21.15.16:0/3700911731 learned_addr learned my addr 172.21.15.16:0/3700911731 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d1364640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2cc103b70 0x7fa2cc1019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:18.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 -- 172.21.15.16:0/3700911731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2cc10d120 msgr2=0x7fa2cc102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2cc10d120 0x7fa2cc102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 -- 172.21.15.16:0/3700911731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2cc103b70 msgr2=0x7fa2cc1019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2cc103b70 0x7fa2cc1019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 -- 172.21.15.16:0/3700911731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2cc1a7730 con 0x7fa2cc104570 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.718+0000 7fa2d0b63640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc104570 0x7fa2cc101f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00d950 tx=0x7fa2bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.719+0000 7fa2c27fc640 1 -- 172.21.15.16:0/3700911731 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc017030 con 0x7fa2cc104570 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.719+0000 7fa2c27fc640 1 -- 172.21.15.16:0/3700911731 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2bc004020 con 0x7fa2cc104570 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.719+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2cc1a7a20 con 0x7fa2cc104570 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.719+0000 7fa2c27fc640 1 -- 172.21.15.16:0/3700911731 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0047a0 con 0x7fa2cc104570 2024-09-10T23:37:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.719+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2cc1a7f60 con 0x7fa2cc104570 2024-09-10T23:37:18.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.720+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2cc103f50 con 0x7fa2cc104570 2024-09-10T23:37:18.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.722+0000 7fa2c27fc640 1 -- 172.21.15.16:0/3700911731 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fa2bc009a30 con 0x7fa2cc104570 2024-09-10T23:37:18.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.723+0000 7fa2c27fc640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b80b5330 0x7fa2b80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:18.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.723+0000 7fa2d1364640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b80b5330 0x7fa2b80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:18.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.723+0000 7fa2c27fc640 1 -- 172.21.15.16:0/3700911731 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7fa2bc0e5050 con 0x7fa2cc104570 2024-09-10T23:37:18.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.723+0000 7fa2d1364640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b80b5330 0x7fa2b80b77f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009bd0 tx=0x7fa2c8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.728+0000 7fa2c27fc640 1 -- 172.21.15.16:0/3700911731 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa2bc0ac420 con 0x7fa2cc104570 2024-09-10T23:37:18.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.913+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa2cc102cf0 con 0x7fa2cc104570 2024-09-10T23:37:18.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.914+0000 7fa2c27fc640 1 -- 172.21.15.16:0/3700911731 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7fa2bc0abd20 con 0x7fa2cc104570 2024-09-10T23:37:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:18.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b80b5330 msgr2=0x7fa2b80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:18.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b80b5330 0x7fa2b80b77f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009bd0 tx=0x7fa2c8005f90 comp rx=0 tx=0).stop 2024-09-10T23:37:18.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc104570 msgr2=0x7fa2cc101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:18.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc104570 0x7fa2cc101f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00d950 tx=0x7fa2bc00de10 comp rx=0 tx=0).stop 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 shutdown_connections 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2cc10d120 0x7fa2cc102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2cc104570 0x7fa2cc101f30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b80b5330 0x7fa2b80b77f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 --2- 172.21.15.16:0/3700911731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2cc103b70 0x7fa2cc1019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 >> 172.21.15.16:0/3700911731 conn(0x7fa2cc0fd700 msgr2=0x7fa2cc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 shutdown_connections 2024-09-10T23:37:18.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:18.916+0000 7fa2d35c8640 1 -- 172.21.15.16:0/3700911731 wait complete. 2024-09-10T23:37:19.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:19 smithi016 ceph-mon[30855]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:19.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:19 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3700911731' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:37:19.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:19 smithi016 ceph-mon[30855]: from='osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:37:19.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:19 smithi016 ceph-mon[30855]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:37:19.709 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726011417,"num_in_osds":12,"osd_in_since":1726011419,"num_remapped_pgs":0} 2024-09-10T23:37:19.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:19 smithi071 ceph-mon[35018]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:19.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:19 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3700911731' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:37:19.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:19 smithi071 ceph-mon[35018]: from='osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:37:19.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:19 smithi071 ceph-mon[35018]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:37:19.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:37:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:37:19.487+0000 7f25616a4640 -1 osd.11 0 log_to_monitors true 2024-09-10T23:37:19.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:19 smithi066 ceph-mon[34761]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:19.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:19 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3700911731' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:37:19.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:19 smithi066 ceph-mon[34761]: from='osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:37:19.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:19 smithi066 ceph-mon[34761]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:37:20.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:37:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:20 smithi066 ceph-mon[34761]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:37:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:20 smithi066 ceph-mon[34761]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:37:20.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:20 smithi066 ceph-mon[34761]: from='osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:37:20.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:20 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:20.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:20 smithi066 ceph-mon[34761]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:37:20.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:20 smithi066 ceph-mon[34761]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:37:20.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-mon[35018]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:37:20.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-mon[35018]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:37:20.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-mon[35018]: from='osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:37:20.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:20.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-mon[35018]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:37:20.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-mon[35018]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:37:20.855 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:37:20.526+0000 7f255d627640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T23:37:20.855 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:37:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:37:20.539+0000 7f255944e640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:37:20.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:20 smithi016 ceph-mon[30855]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:37:20.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:20 smithi016 ceph-mon[30855]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:37:20.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:20 smithi016 ceph-mon[30855]: from='osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:37:20.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:20 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:20.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:20 smithi016 ceph-mon[30855]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]} : dispatch 2024-09-10T23:37:20.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:20 smithi016 ceph-mon[30855]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T23:37:20.985 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:21.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 -- 172.21.15.16:0/827068262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010d250 msgr2=0x7f65a010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:21.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 --2- 172.21.15.16:0/827068262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010d250 0x7f65a010f640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6598009ca0 tx=0x7f659802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 -- 172.21.15.16:0/827068262 shutdown_connections 2024-09-10T23:37:21.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 --2- 172.21.15.16:0/827068262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010d250 0x7f65a010f640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 --2- 172.21.15.16:0/827068262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65a010a920 0x7f65a010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 --2- 172.21.15.16:0/827068262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a0101810 0x7f65a0101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 -- 172.21.15.16:0/827068262 >> 172.21.15.16:0/827068262 conn(0x7f65a0076f50 msgr2=0x7f65a0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 -- 172.21.15.16:0/827068262 shutdown_connections 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.499+0000 7f65a8142640 1 -- 172.21.15.16:0/827068262 wait complete. 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 Processor -- start 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 -- start start 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65a0101810 0x7f65a01027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010a920 0x7f65a0102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a010d250 0x7f65a0103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0112d90 con 0x7f65a010a920 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0112c10 con 0x7f65a010d250 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a8142640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0112f10 con 0x7f65a0101810 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010a920 0x7f65a0102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010a920 0x7f65a0102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33914/0 (socket says 172.21.15.16:33914) 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 -- 172.21.15.16:0/685004743 learned_addr learned my addr 172.21.15.16:0/685004743 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a66df640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a010d250 0x7f65a0103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a5ede640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65a0101810 0x7f65a01027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 -- 172.21.15.16:0/685004743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65a0101810 msgr2=0x7f65a01027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65a0101810 0x7f65a01027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 -- 172.21.15.16:0/685004743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a010d250 msgr2=0x7f65a0103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a010d250 0x7f65a0103260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.500+0000 7f65a56dd640 1 -- 172.21.15.16:0/685004743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a01a7620 con 0x7f65a010a920 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.501+0000 7f65a56dd640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010a920 0x7f65a0102d20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f659000c920 tx=0x7f659000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.501+0000 7f6596ffd640 1 -- 172.21.15.16:0/685004743 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590007c70 con 0x7f65a010a920 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.501+0000 7f6596ffd640 1 -- 172.21.15.16:0/685004743 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6590007e10 con 0x7f65a010a920 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.501+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a01a7910 con 0x7f65a010a920 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.501+0000 7f6596ffd640 1 -- 172.21.15.16:0/685004743 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590018820 con 0x7f65a010a920 2024-09-10T23:37:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.501+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a01a7e50 con 0x7f65a010a920 2024-09-10T23:37:21.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.502+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0101bf0 con 0x7f65a010a920 2024-09-10T23:37:21.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.503+0000 7f6596ffd640 1 -- 172.21.15.16:0/685004743 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f659000f450 con 0x7f65a010a920 2024-09-10T23:37:21.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.504+0000 7f6596ffd640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f658c0b5330 0x7f658c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:21.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.504+0000 7f65a5ede640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f658c0b5330 0x7f658c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:21.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.504+0000 7f6596ffd640 1 -- 172.21.15.16:0/685004743 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7062+0+0 (secure 0 0 0) 0x7f65900e59c0 con 0x7f65a010a920 2024-09-10T23:37:21.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.504+0000 7f65a5ede640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f658c0b5330 0x7f658c0b77f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f659c0058c0 tx=0x7f659c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:21.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.507+0000 7f6596ffd640 1 -- 172.21.15.16:0/685004743 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6590014030 con 0x7f65a010a920 2024-09-10T23:37:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.694+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f65a01a8290 con 0x7f65a010a920 2024-09-10T23:37:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.695+0000 7f6596ffd640 1 -- 172.21.15.16:0/685004743 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f65900acdf0 con 0x7f65a010a920 2024-09-10T23:37:21.697 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:21.697 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:37:21.697 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:21.697 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:21.697 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: Detected new or changed devices on smithi071 2024-09-10T23:37:21.697 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.698 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.698 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.698 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.698 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.698 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.698 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-10T23:37:21.698 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.699 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:21.699 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:21.699 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.699 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:21 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f658c0b5330 msgr2=0x7f658c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f658c0b5330 0x7f658c0b77f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f659c0058c0 tx=0x7f659c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010a920 msgr2=0x7f65a0102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010a920 0x7f65a0102d20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f659000c920 tx=0x7f659000cde0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 shutdown_connections 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f658c0b5330 0x7f658c0b77f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a010d250 0x7f65a0103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65a010a920 0x7f65a0102d20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 --2- 172.21.15.16:0/685004743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65a0101810 0x7f65a01027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 >> 172.21.15.16:0/685004743 conn(0x7f65a0076f50 msgr2=0x7f65a01005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 shutdown_connections 2024-09-10T23:37:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:21.697+0000 7f65a8142640 1 -- 172.21.15.16:0/685004743 wait complete. 2024-09-10T23:37:21.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:21.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:37:21.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:21.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: Detected new or changed devices on smithi071 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-10T23:37:21.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:21.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:21.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:21.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:21 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:22.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:22.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: Detected new or changed devices on smithi071 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:22.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:22.021 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:22.021 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:22.021 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:21 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:22.474 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726011441,"num_in_osds":12,"osd_in_since":1726011419,"num_remapped_pgs":0} 2024-09-10T23:37:22.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:37:22.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:22 smithi016 ceph-mon[30855]: purged_snaps scrub starts 2024-09-10T23:37:22.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:22 smithi016 ceph-mon[30855]: purged_snaps scrub ok 2024-09-10T23:37:22.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:22 smithi016 ceph-mon[30855]: osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] boot 2024-09-10T23:37:22.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:22 smithi016 ceph-mon[30855]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T23:37:22.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:22 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:22.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:22 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/685004743' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:37:22.737 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:22.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:22 smithi066 ceph-mon[34761]: purged_snaps scrub starts 2024-09-10T23:37:22.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:22 smithi066 ceph-mon[34761]: purged_snaps scrub ok 2024-09-10T23:37:22.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:22 smithi066 ceph-mon[34761]: osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] boot 2024-09-10T23:37:22.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:22 smithi066 ceph-mon[34761]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T23:37:22.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:22 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:22.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:22 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/685004743' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:37:23.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:22 smithi071 ceph-mon[35018]: purged_snaps scrub starts 2024-09-10T23:37:23.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:22 smithi071 ceph-mon[35018]: purged_snaps scrub ok 2024-09-10T23:37:23.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:22 smithi071 ceph-mon[35018]: osd.11 [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] boot 2024-09-10T23:37:23.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:22 smithi071 ceph-mon[35018]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T23:37:23.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:22 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:37:23.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:22 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/685004743' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:37:23.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.263+0000 7fd6557b9640 1 -- 172.21.15.16:0/1787036993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd650103b30 msgr2=0x7fd650103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.263+0000 7fd6557b9640 1 --2- 172.21.15.16:0/1787036993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd650103b30 0x7fd650103f10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ca0 tx=0x7fd64002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 -- 172.21.15.16:0/1787036993 shutdown_connections 2024-09-10T23:37:23.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 --2- 172.21.15.16:0/1787036993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd65010d0e0 0x7fd65010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 --2- 172.21.15.16:0/1787036993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd650104530 0x7fd65010cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 --2- 172.21.15.16:0/1787036993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd650103b30 0x7fd650103f10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 -- 172.21.15.16:0/1787036993 >> 172.21.15.16:0/1787036993 conn(0x7fd6500fd700 msgr2=0x7fd6500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 -- 172.21.15.16:0/1787036993 shutdown_connections 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 -- 172.21.15.16:0/1787036993 wait complete. 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.264+0000 7fd6557b9640 1 Processor -- start 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd6557b9640 1 -- start start 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd6557b9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd650103b30 0x7fd6501019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd6557b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd650104530 0x7fd650101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd6557b9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd65010d0e0 0x7fd650102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd6557b9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd650112da0 con 0x7fd65010d0e0 2024-09-10T23:37:23.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd6557b9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd650112c20 con 0x7fd650104530 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd6557b9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd650112f20 con 0x7fd650103b30 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd65010d0e0 0x7fd650102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd65010d0e0 0x7fd650102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33928/0 (socket says 172.21.15.16:33928) 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 -- 172.21.15.16:0/2918425338 learned_addr learned my addr 172.21.15.16:0/2918425338 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64effd640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd650103b30 0x7fd6501019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64e7fc640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd650104530 0x7fd650101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 -- 172.21.15.16:0/2918425338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd650103b30 msgr2=0x7fd6501019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd650103b30 0x7fd6501019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 -- 172.21.15.16:0/2918425338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd650104530 msgr2=0x7fd650101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd650104530 0x7fd650101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 -- 172.21.15.16:0/2918425338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6501a76f0 con 0x7fd65010d0e0 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64e7fc640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd650104530 0x7fd650101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:37:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd64f7fe640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd65010d0e0 0x7fd650102430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd64800d750 tx=0x7fd64800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:23.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.265+0000 7fd637fff640 1 -- 172.21.15.16:0/2918425338 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648017070 con 0x7fd65010d0e0 2024-09-10T23:37:23.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.266+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6501a79e0 con 0x7fd65010d0e0 2024-09-10T23:37:23.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.266+0000 7fd637fff640 1 -- 172.21.15.16:0/2918425338 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6480054d0 con 0x7fd65010d0e0 2024-09-10T23:37:23.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.266+0000 7fd637fff640 1 -- 172.21.15.16:0/2918425338 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648004c60 con 0x7fd65010d0e0 2024-09-10T23:37:23.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.266+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6501a7fa0 con 0x7fd65010d0e0 2024-09-10T23:37:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.267+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd650103f10 con 0x7fd65010d0e0 2024-09-10T23:37:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.268+0000 7fd637fff640 1 -- 172.21.15.16:0/2918425338 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fd648004e00 con 0x7fd65010d0e0 2024-09-10T23:37:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.269+0000 7fd637fff640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6380b5330 0x7fd6380b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.269+0000 7fd64effd640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6380b5330 0x7fd6380b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.269+0000 7fd637fff640 1 -- 172.21.15.16:0/2918425338 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fd6480e56e0 con 0x7fd65010d0e0 2024-09-10T23:37:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.269+0000 7fd64effd640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6380b5330 0x7fd6380b77f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd640009430 tx=0x7fd640009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.272+0000 7fd637fff640 1 -- 172.21.15.16:0/2918425338 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd6480ac8d0 con 0x7fd65010d0e0 2024-09-10T23:37:23.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.459+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd65002e5c0 con 0x7fd65010d0e0 2024-09-10T23:37:23.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.460+0000 7fd637fff640 1 -- 172.21.15.16:0/2918425338 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18677 (secure 0 0 0) 0x7fd6480ac1d0 con 0x7fd65010d0e0 2024-09-10T23:37:23.462 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:23.462 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":69,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:37:21.528060+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:37:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.462+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6380b5330 msgr2=0x7fd6380b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.462+0000 7fd6557b9640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6380b5330 0x7fd6380b77f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd640009430 tx=0x7fd640009360 comp rx=0 tx=0).stop 2024-09-10T23:37:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.462+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd65010d0e0 msgr2=0x7fd650102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.462+0000 7fd6557b9640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd65010d0e0 0x7fd650102430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd64800d750 tx=0x7fd64800dc10 comp rx=0 tx=0).stop 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 shutdown_connections 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd65010d0e0 0x7fd650102430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6380b5330 0x7fd6380b77f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd650104530 0x7fd650101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 --2- 172.21.15.16:0/2918425338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd650103b30 0x7fd6501019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 >> 172.21.15.16:0/2918425338 conn(0x7fd6500fd700 msgr2=0x7fd6500fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 shutdown_connections 2024-09-10T23:37:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:23.463+0000 7fd6557b9640 1 -- 172.21.15.16:0/2918425338 wait complete. 2024-09-10T23:37:23.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:23 smithi016 ceph-mon[30855]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:23.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:23 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2918425338' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:37:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:23 smithi066 ceph-mon[34761]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:23 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2918425338' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:37:23.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:23 smithi071 ceph-mon[35018]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:37:23.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:23 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2918425338' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:37:24.119 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:33:36.795990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:37:24.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T23:37:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:24.801 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:24 smithi016 ceph-mon[30855]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:37:24.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:24 smithi066 ceph-mon[34761]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 -- 172.21.15.16:0/651330642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc103ce0 msgr2=0x7f40bc1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 --2- 172.21.15.16:0/651330642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc103ce0 0x7f40bc1040c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009900 tx=0x7f40ac02a410 comp rx=0 tx=0).stop 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 -- 172.21.15.16:0/651330642 shutdown_connections 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 --2- 172.21.15.16:0/651330642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40bc10d140 0x7f40bc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 --2- 172.21.15.16:0/651330642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40bc104600 0x7f40bc10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 --2- 172.21.15.16:0/651330642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc103ce0 0x7f40bc1040c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 -- 172.21.15.16:0/651330642 >> 172.21.15.16:0/651330642 conn(0x7f40bc0fd720 msgr2=0x7f40bc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 -- 172.21.15.16:0/651330642 shutdown_connections 2024-09-10T23:37:24.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.884+0000 7f40c2774640 1 -- 172.21.15.16:0/651330642 wait complete. 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 Processor -- start 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 -- start start 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40bc103ce0 0x7f40bc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40bc104600 0x7f40bc1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc10d140 0x7f40bc19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc112e00 con 0x7f40bc10d140 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc112c80 con 0x7f40bc103ce0 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c2774640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc112f80 con 0x7f40bc104600 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c0d11640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc10d140 0x7f40bc19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40bc103ce0 0x7f40bc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:24.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c0d11640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc10d140 0x7f40bc19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49662/0 (socket says 172.21.15.16:49662) 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40c0d11640 1 -- 172.21.15.16:0/199065728 learned_addr learned my addr 172.21.15.16:0/199065728 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.885+0000 7f40b3fff640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40bc104600 0x7f40bc1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c0d11640 1 -- 172.21.15.16:0/199065728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40bc104600 msgr2=0x7f40bc1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c0d11640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40bc104600 0x7f40bc1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c0d11640 1 -- 172.21.15.16:0/199065728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40bc103ce0 msgr2=0x7f40bc1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c0d11640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40bc103ce0 0x7f40bc1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c0d11640 1 -- 172.21.15.16:0/199065728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc19f360 con 0x7f40bc10d140 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40bbfff640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40bc103ce0 0x7f40bc1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c0d11640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc10d140 0x7f40bc19eb90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40b400eb10 tx=0x7f40b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40b9ffb640 1 -- 172.21.15.16:0/199065728 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4004b20 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40b9ffb640 1 -- 172.21.15.16:0/199065728 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40b4004cc0 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc19f650 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40b9ffb640 1 -- 172.21.15.16:0/199065728 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4010670 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.886+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc1a5ee0 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.887+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc1040c0 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.889+0000 7f40b9ffb640 1 -- 172.21.15.16:0/199065728 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f40b4005000 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.890+0000 7f40b9ffb640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f40a80b53b0 0x7f40a80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.890+0000 7f40bbfff640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f40a80b53b0 0x7f40a80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.890+0000 7f40b9ffb640 1 -- 172.21.15.16:0/199065728 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f40b40e5f60 con 0x7f40bc10d140 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.891+0000 7f40bbfff640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f40a80b53b0 0x7f40a80b7870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f40ac005ab0 tx=0x7f40ac005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:24.893+0000 7f40b9ffb640 1 -- 172.21.15.16:0/199065728 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f40b4056220 con 0x7f40bc10d140 2024-09-10T23:37:25.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:24 smithi071 ceph-mon[35018]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:37:25.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.079+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f40bc02e5c0 con 0x7f40bc10d140 2024-09-10T23:37:25.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.080+0000 7f40b9ffb640 1 -- 172.21.15.16:0/199065728 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f40b40ad1f0 con 0x7f40bc10d140 2024-09-10T23:37:25.082 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-09-10T23:37:25.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f40a80b53b0 msgr2=0x7f40a80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:25.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f40a80b53b0 0x7f40a80b7870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f40ac005ab0 tx=0x7f40ac005a20 comp rx=0 tx=0).stop 2024-09-10T23:37:25.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc10d140 msgr2=0x7f40bc19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:25.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc10d140 0x7f40bc19eb90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40b400eb10 tx=0x7f40b400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 shutdown_connections 2024-09-10T23:37:25.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40bc10d140 0x7f40bc19eb90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40bc104600 0x7f40bc1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f40a80b53b0 0x7f40a80b7870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 --2- 172.21.15.16:0/199065728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40bc103ce0 0x7f40bc1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:25.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 >> 172.21.15.16:0/199065728 conn(0x7f40bc0fd720 msgr2=0x7f40bc0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:25.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 shutdown_connections 2024-09-10T23:37:25.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:25.082+0000 7f40c2774640 1 -- 172.21.15.16:0/199065728 wait complete. 2024-09-10T23:37:25.770 INFO:tasks.cephadm:Adding mds.a on smithi016 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.d on smithi016 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.g on smithi016 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.j on smithi016 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.b on smithi066 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.e on smithi066 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.h on smithi066 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.k on smithi066 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.c on smithi071 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.f on smithi071 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.i on smithi071 2024-09-10T23:37:25.771 INFO:tasks.cephadm:Adding mds.l on smithi071 2024-09-10T23:37:25.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l' 2024-09-10T23:37:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:25 smithi016 ceph-mon[30855]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:25 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/199065728' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:37:26.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:25 smithi071 ceph-mon[35018]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:26.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:25 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/199065728' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:37:26.028 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:37:26.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:25 smithi066 ceph-mon[34761]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:26.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:25 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/199065728' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:37:26.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 -- 172.21.15.71:0/2589014209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd508101cb0 msgr2=0x7fd508102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:26.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 --2- 172.21.15.71:0/2589014209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd508101cb0 0x7fd508102090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009900 tx=0x7fd4fc02a410 comp rx=0 tx=0).stop 2024-09-10T23:37:26.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 -- 172.21.15.71:0/2589014209 shutdown_connections 2024-09-10T23:37:26.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 --2- 172.21.15.71:0/2589014209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd508108040 0x7fd50810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 --2- 172.21.15.71:0/2589014209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5081076c0 0x7fd508107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 --2- 172.21.15.71:0/2589014209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd508101cb0 0x7fd508102090 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 -- 172.21.15.71:0/2589014209 >> 172.21.15.71:0/2589014209 conn(0x7fd5080fd740 msgr2=0x7fd5080ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 -- 172.21.15.71:0/2589014209 shutdown_connections 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.516+0000 7fd50f014640 1 -- 172.21.15.71:0/2589014209 wait complete. 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 Processor -- start 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 -- start start 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd508101cb0 0x7fd5081981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5081076c0 0x7fd508198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd508108040 0x7fd50819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd508111d00 con 0x7fd508108040 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd508111b80 con 0x7fd508101cb0 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50f014640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd508111e80 con 0x7fd5081076c0 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd507fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5081076c0 0x7fd508198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd507fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5081076c0 0x7fd508198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38260/0 (socket says 172.21.15.71:38260) 2024-09-10T23:37:26.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd507fff640 1 -- 172.21.15.71:0/1909849316 learned_addr learned my addr 172.21.15.71:0/1909849316 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.517+0000 7fd50cdb0640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd508101cb0 0x7fd5081981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd50d5b1640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd508108040 0x7fd50819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd507fff640 1 -- 172.21.15.71:0/1909849316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd508101cb0 msgr2=0x7fd5081981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd507fff640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd508101cb0 0x7fd5081981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd507fff640 1 -- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd508108040 msgr2=0x7fd50819dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd507fff640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd508108040 0x7fd50819dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd507fff640 1 -- 172.21.15.71:0/1909849316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50819e280 con 0x7fd5081076c0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd507fff640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5081076c0 0x7fd508198710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009860 tx=0x7fd4f4009d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd505ffb640 1 -- 172.21.15.71:0/1909849316 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4005020 con 0x7fd5081076c0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd505ffb640 1 -- 172.21.15.71:0/1909849316 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f40047a0 con 0x7fd5081076c0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50819e570 con 0x7fd5081076c0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd505ffb640 1 -- 172.21.15.71:0/1909849316 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4007b00 con 0x7fd5081076c0 2024-09-10T23:37:26.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.518+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50806b4d0 con 0x7fd5081076c0 2024-09-10T23:37:26.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.519+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd508102090 con 0x7fd5081076c0 2024-09-10T23:37:26.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.520+0000 7fd505ffb640 1 -- 172.21.15.71:0/1909849316 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fd4f4007ca0 con 0x7fd5081076c0 2024-09-10T23:37:26.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.521+0000 7fd505ffb640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4f80b5330 0x7fd4f80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:26.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.521+0000 7fd505ffb640 1 -- 172.21.15.71:0/1909849316 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fd4f40e6c90 con 0x7fd5081076c0 2024-09-10T23:37:26.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.521+0000 7fd50cdb0640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4f80b5330 0x7fd4f80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:26.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.522+0000 7fd50cdb0640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4f80b5330 0x7fd4f80b77f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc031440 tx=0x7fd4fc005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:26.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.525+0000 7fd505ffb640 1 -- 172.21.15.71:0/1909849316 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4f40ad8d0 con 0x7fd5081076c0 2024-09-10T23:37:26.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.714+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}) -- 0x7fd50806c060 con 0x7fd4f80b5330 2024-09-10T23:37:26.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.722+0000 7fd505ffb640 1 -- 172.21.15.71:0/1909849316 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fd50806c060 con 0x7fd4f80b5330 2024-09-10T23:37:26.724 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mds.all update... 2024-09-10T23:37:26.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4f80b5330 msgr2=0x7fd4f80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:26.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4f80b5330 0x7fd4f80b77f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc031440 tx=0x7fd4fc005b50 comp rx=0 tx=0).stop 2024-09-10T23:37:26.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5081076c0 msgr2=0x7fd508198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:26.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5081076c0 0x7fd508198710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009860 tx=0x7fd4f4009d20 comp rx=0 tx=0).stop 2024-09-10T23:37:26.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 shutdown_connections 2024-09-10T23:37:26.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd508108040 0x7fd50819dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5081076c0 0x7fd508198710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4f80b5330 0x7fd4f80b77f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 --2- 172.21.15.71:0/1909849316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd508101cb0 0x7fd5081981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:26.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 >> 172.21.15.71:0/1909849316 conn(0x7fd5080fd740 msgr2=0x7fd5080ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:26.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 shutdown_connections 2024-09-10T23:37:26.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T23:37:26.725+0000 7fd50f014640 1 -- 172.21.15.71:0/1909849316 wait complete. 2024-09-10T23:37:27.376 DEBUG:teuthology.orchestra.run.smithi016:mds.a> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T23:37:27.379 DEBUG:teuthology.orchestra.run.smithi016:mds.d> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T23:37:27.423 DEBUG:teuthology.orchestra.run.smithi016:mds.g> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T23:37:27.465 DEBUG:teuthology.orchestra.run.smithi016:mds.j> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T23:37:27.509 DEBUG:teuthology.orchestra.run.smithi066:mds.b> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T23:37:27.512 DEBUG:teuthology.orchestra.run.smithi066:mds.e> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T23:37:27.556 DEBUG:teuthology.orchestra.run.smithi066:mds.h> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T23:37:27.601 DEBUG:teuthology.orchestra.run.smithi066:mds.k> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T23:37:27.644 DEBUG:teuthology.orchestra.run.smithi071:mds.c> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T23:37:27.647 DEBUG:teuthology.orchestra.run.smithi071:mds.f> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T23:37:27.689 DEBUG:teuthology.orchestra.run.smithi071:mds.i> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T23:37:27.733 DEBUG:teuthology.orchestra.run.smithi071:mds.l> sudo journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T23:37:27.775 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T23:37:27.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:27.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:27.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: Saving service mds.all spec with placement smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:27.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:27 smithi066 ceph-mon[34761]: Deploying daemon mds.l on smithi071 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: Saving service mds.all spec with placement smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:27.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:27.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:27.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:27 smithi071 ceph-mon[35018]: Deploying daemon mds.l on smithi071 2024-09-10T23:37:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:37:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: Saving service mds.all spec with placement smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-10T23:37:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:37:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:37:27.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:27.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:27.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:27.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:27.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:27 smithi016 ceph-mon[30855]: Deploying daemon mds.l on smithi071 2024-09-10T23:37:28.036 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 -- 172.21.15.16:0/464430478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 msgr2=0x7fc314103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 --2- 172.21.15.16:0/464430478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc314103f80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc304009900 tx=0x7fc30402a410 comp rx=0 tx=0).stop 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 -- 172.21.15.16:0/464430478 shutdown_connections 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 --2- 172.21.15.16:0/464430478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31410d150 0x7fc31410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 --2- 172.21.15.16:0/464430478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3141045a0 0x7fc31410cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 --2- 172.21.15.16:0/464430478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc314103f80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 -- 172.21.15.16:0/464430478 >> 172.21.15.16:0/464430478 conn(0x7fc3140fd730 msgr2=0x7fc3140ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 -- 172.21.15.16:0/464430478 shutdown_connections 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.481+0000 7fc31921b640 1 -- 172.21.15.16:0/464430478 wait complete. 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 Processor -- start 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 -- start start 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc31419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3141045a0 0x7fc31419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31410d150 0x7fc3141a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc314112d70 con 0x7fc314103ba0 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc314112bf0 con 0x7fc31410d150 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31921b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc314112ef0 con 0x7fc3141045a0 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc312d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc31419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc312d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc31419b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49684/0 (socket says 172.21.15.16:49684) 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc312d9d640 1 -- 172.21.15.16:0/1876113925 learned_addr learned my addr 172.21.15.16:0/1876113925 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31259c640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3141045a0 0x7fc31419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.482+0000 7fc31359e640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31410d150 0x7fc3141a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc312d9d640 1 -- 172.21.15.16:0/1876113925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3141045a0 msgr2=0x7fc31419b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc312d9d640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3141045a0 0x7fc31419b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc312d9d640 1 -- 172.21.15.16:0/1876113925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31410d150 msgr2=0x7fc3141a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc312d9d640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31410d150 0x7fc3141a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc312d9d640 1 -- 172.21.15.16:0/1876113925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3141a14d0 con 0x7fc314103ba0 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc312d9d640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc31419b420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc304006010 tx=0x7fc3040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:28.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc2fbfff640 1 -- 172.21.15.16:0/1876113925 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30403f030 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc2fbfff640 1 -- 172.21.15.16:0/1876113925 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc304003800 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3141a1760 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc2fbfff640 1 -- 172.21.15.16:0/1876113925 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304035070 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.483+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3141a7e80 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.484+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc314103f80 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.485+0000 7fc2fbfff640 1 -- 172.21.15.16:0/1876113925 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc304031b10 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.486+0000 7fc2fbfff640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2fc0b5330 0x7fc2fc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.486+0000 7fc31259c640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2fc0b5330 0x7fc2fc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.486+0000 7fc2fbfff640 1 -- 172.21.15.16:0/1876113925 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fc304106380 con 0x7fc314103ba0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.487+0000 7fc31259c640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2fc0b5330 0x7fc2fc0b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc31410e660 tx=0x7fc3080075b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:28.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.489+0000 7fc2fbfff640 1 -- 172.21.15.16:0/1876113925 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc3040ccfc0 con 0x7fc314103ba0 2024-09-10T23:37:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.709+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3141a81b0 con 0x7fc314103ba0 2024-09-10T23:37:28.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.710+0000 7fc2fbfff640 1 -- 172.21.15.16:0/1876113925 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fc3040d19f0 con 0x7fc314103ba0 2024-09-10T23:37:28.712 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:28.712 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":1,"btime":"2024-09-10T23:29:41:593538+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T23:37:28.712 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 1 2024-09-10T23:37:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2fc0b5330 msgr2=0x7fc2fc0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2fc0b5330 0x7fc2fc0b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc31410e660 tx=0x7fc3080075b0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 msgr2=0x7fc31419b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc31419b420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc304006010 tx=0x7fc3040042f0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 shutdown_connections 2024-09-10T23:37:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc2fc0b5330 0x7fc2fc0b77f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31410d150 0x7fc3141a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3141045a0 0x7fc31419b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 --2- 172.21.15.16:0/1876113925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc314103ba0 0x7fc31419b420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 >> 172.21.15.16:0/1876113925 conn(0x7fc3140fd730 msgr2=0x7fc31410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 shutdown_connections 2024-09-10T23:37:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:28.712+0000 7fc31921b640 1 -- 172.21.15.16:0/1876113925 wait complete. 2024-09-10T23:37:28.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:28 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1876113925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:28.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:28 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1876113925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:29.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:28 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1876113925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:29.270 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 systemd[1]: Starting Ceph mds.l for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:29.573 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 podman[65361]: 2024-09-10 23:37:29.205446707 +0000 UTC m=+0.015837118 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:29.573 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 podman[65361]: 2024-09-10 23:37:29.327655137 +0000 UTC m=+0.138045535 container create 44f070f54c21da7b39b27c4960bbc12ac998888685e07164f7b40f5a9b95d177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T23:37:29.573 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 podman[65361]: 2024-09-10 23:37:29.547152951 +0000 UTC m=+0.357543348 container init 44f070f54c21da7b39b27c4960bbc12ac998888685e07164f7b40f5a9b95d177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T23:37:29.573 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 podman[65361]: 2024-09-10 23:37:29.549940385 +0000 UTC m=+0.360330783 container start 44f070f54c21da7b39b27c4960bbc12ac998888685e07164f7b40f5a9b95d177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T23:37:29.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6832/3386039321,v1:172.21.15.71:6833/3386039321] up:boot 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: fsmap 1 up:standby 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:30.019 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mds[65380]: -- 172.21.15.71:0/1690344285 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x556a435aeea0 con 0x556a43583400 2024-09-10T23:37:30.019 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mds[65380]: -- 172.21.15.71:0/1690344285 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a435a5860 con 0x556a43583400 2024-09-10T23:37:30.019 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l[65376]: starting mds.l at 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 bash[65361]: 44f070f54c21da7b39b27c4960bbc12ac998888685e07164f7b40f5a9b95d177 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:37:29 smithi071 systemd[1]: Started Ceph mds.l for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6832/3386039321,v1:172.21.15.71:6833/3386039321] up:boot 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: fsmap 1 up:standby 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:30.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:30.021 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:30.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6832/3386039321,v1:172.21.15.71:6833/3386039321] up:boot 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: fsmap 1 up:standby 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:30.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:30.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:30 smithi016 ceph-mon[30855]: Deploying daemon mds.k on smithi066 2024-09-10T23:37:31.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:30 smithi071 ceph-mon[35018]: Deploying daemon mds.k on smithi066 2024-09-10T23:37:31.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:30 smithi066 ceph-mon[34761]: Deploying daemon mds.k on smithi066 2024-09-10T23:37:31.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:31.735 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:31 smithi066 systemd[1]: Starting Ceph mds.k for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:31.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:31 smithi016 ceph-mon[30855]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:32.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:31 smithi071 ceph-mon[35018]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:32.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:31 smithi066 ceph-mon[34761]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:32.051 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:31 smithi066 podman[64988]: 2024-09-10 23:37:31.723082138 +0000 UTC m=+0.016585722 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:32.052 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:31 smithi066 podman[64988]: 2024-09-10 23:37:31.831329165 +0000 UTC m=+0.124832713 container create 70f9ee2e6735d428c5ff77572f5d6c47d77bb986f411e1277acfc09784c9ccf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T23:37:32.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 -- 172.21.15.16:0/1256466267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8174101c90 msgr2=0x7f8174102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 --2- 172.21.15.16:0/1256466267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8174101c90 0x7f8174102070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8170009900 tx=0x7f817002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 -- 172.21.15.16:0/1256466267 shutdown_connections 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 --2- 172.21.15.16:0/1256466267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8174108020 0x7f817410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 --2- 172.21.15.16:0/1256466267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81741076a0 0x7f8174107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 --2- 172.21.15.16:0/1256466267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8174101c90 0x7f8174102070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 -- 172.21.15.16:0/1256466267 >> 172.21.15.16:0/1256466267 conn(0x7f81740fd700 msgr2=0x7f81740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 -- 172.21.15.16:0/1256466267 shutdown_connections 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.344+0000 7f817bd90640 1 -- 172.21.15.16:0/1256466267 wait complete. 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 Processor -- start 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 -- start start 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8174101c90 0x7f817419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81741076a0 0x7f817419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8174108020 0x7f817419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8174111ce0 con 0x7f81741076a0 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8174111b60 con 0x7f8174101c90 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817bd90640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8174111e60 con 0x7f8174108020 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81741076a0 0x7f817419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81741076a0 0x7f817419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49694/0 (socket says 172.21.15.16:49694) 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 -- 172.21.15.16:0/508759661 learned_addr learned my addr 172.21.15.16:0/508759661 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f8179b2c640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8174101c90 0x7f817419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817a32d640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8174108020 0x7f817419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 -- 172.21.15.16:0/508759661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8174108020 msgr2=0x7f817419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8174108020 0x7f817419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 -- 172.21.15.16:0/508759661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8174101c90 msgr2=0x7f817419a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8174101c90 0x7f817419a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f817932b640 1 -- 172.21.15.16:0/508759661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81741a5410 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.345+0000 7f8179b2c640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8174101c90 0x7f817419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.346+0000 7f817932b640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81741076a0 0x7f817419a550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f816400c920 tx=0x7f816400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.346+0000 7f816affd640 1 -- 172.21.15.16:0/508759661 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164007c70 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.346+0000 7f816affd640 1 -- 172.21.15.16:0/508759661 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8164007e10 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.346+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81741a5700 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.346+0000 7f816affd640 1 -- 172.21.15.16:0/508759661 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164018820 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.346+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81741a5c40 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.347+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8174102070 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.348+0000 7f816affd640 1 -- 172.21.15.16:0/508759661 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f816400f450 con 0x7f81741076a0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.349+0000 7f816affd640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81600b5330 0x7f81600b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.349+0000 7f8179b2c640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81600b5330 0x7f81600b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.349+0000 7f816affd640 1 -- 172.21.15.16:0/508759661 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f81640e5d70 con 0x7f81741076a0 2024-09-10T23:37:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.350+0000 7f8179b2c640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81600b5330 0x7f81600b77f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8170031440 tx=0x7f81700095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.352+0000 7f816affd640 1 -- 172.21.15.16:0/508759661 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8164014030 con 0x7f81741076a0 2024-09-10T23:37:32.552 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:32 smithi066 podman[64988]: 2024-09-10 23:37:32.079004626 +0000 UTC m=+0.372508174 container init 70f9ee2e6735d428c5ff77572f5d6c47d77bb986f411e1277acfc09784c9ccf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T23:37:32.552 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:32 smithi066 podman[64988]: 2024-09-10 23:37:32.082041816 +0000 UTC m=+0.375545375 container start 70f9ee2e6735d428c5ff77572f5d6c47d77bb986f411e1277acfc09784c9ccf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T23:37:32.552 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:32 smithi066 ceph-mds[65007]: -- 172.21.15.66:0/3396337123 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574cbb8d860 con 0x5574cbb6b000 2024-09-10T23:37:32.552 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:32 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k[65003]: starting mds.k at 2024-09-10T23:37:32.552 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:32 smithi066 bash[64988]: 70f9ee2e6735d428c5ff77572f5d6c47d77bb986f411e1277acfc09784c9ccf0 2024-09-10T23:37:32.552 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:37:32 smithi066 systemd[1]: Started Ceph mds.k for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.592+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f817406aee0 con 0x7f81741076a0 2024-09-10T23:37:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.593+0000 7f816affd640 1 -- 172.21.15.16:0/508759661 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f81640acff0 con 0x7f81741076a0 2024-09-10T23:37:32.593 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:32.594 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"btime":"2024-09-10T23:37:29:577970+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:37:32.594 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-09-10T23:37:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81600b5330 msgr2=0x7f81600b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81600b5330 0x7f81600b77f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8170031440 tx=0x7f81700095f0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81741076a0 msgr2=0x7f817419a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81741076a0 0x7f817419a550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f816400c920 tx=0x7f816400cde0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 shutdown_connections 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8174108020 0x7f817419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81741076a0 0x7f817419a550 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81600b5330 0x7f81600b77f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 --2- 172.21.15.16:0/508759661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8174101c90 0x7f817419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 >> 172.21.15.16:0/508759661 conn(0x7f81740fd700 msgr2=0x7f81740feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 shutdown_connections 2024-09-10T23:37:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:32.595+0000 7f817bd90640 1 -- 172.21.15.16:0/508759661 wait complete. 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/508759661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6832/1708771330,v1:172.21.15.66:6833/1708771330] up:boot 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: fsmap 2 up:standby 2024-09-10T23:37:33.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:33 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:37:33.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/508759661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6832/1708771330,v1:172.21.15.66:6833/1708771330] up:boot 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: fsmap 2 up:standby 2024-09-10T23:37:33.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:33 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:37:33.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/508759661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6832/1708771330,v1:172.21.15.66:6833/1708771330] up:boot 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: fsmap 2 up:standby 2024-09-10T23:37:33.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:33 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:37:34.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:34 smithi016 ceph-mon[30855]: Deploying daemon mds.j on smithi016 2024-09-10T23:37:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:34 smithi016 ceph-mon[30855]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:34 smithi071 ceph-mon[35018]: Deploying daemon mds.j on smithi016 2024-09-10T23:37:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:34 smithi071 ceph-mon[35018]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:34.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:34 smithi066 ceph-mon[34761]: Deploying daemon mds.j on smithi016 2024-09-10T23:37:34.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:34 smithi066 ceph-mon[34761]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:35.207 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 systemd[1]: Starting Ceph mds.j for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:35 smithi016 ceph-mon[30855]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:35.485 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 podman[72061]: 2024-09-10 23:37:35.262864132 +0000 UTC m=+0.019268363 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:35.485 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 podman[72061]: 2024-09-10 23:37:35.377558472 +0000 UTC m=+0.133962682 container create ce66644e9da97a8b1598ec7e3e4bebe1433379161fc403b436dc08d77c4656e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:37:35.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:35 smithi071 ceph-mon[35018]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:35.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:35 smithi066 ceph-mon[34761]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:35.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:35.912 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:35.985 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 podman[72061]: 2024-09-10 23:37:35.621969441 +0000 UTC m=+0.378373651 container init ce66644e9da97a8b1598ec7e3e4bebe1433379161fc403b436dc08d77c4656e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:37:35.985 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 podman[72061]: 2024-09-10 23:37:35.62510546 +0000 UTC m=+0.381509670 container start ce66644e9da97a8b1598ec7e3e4bebe1433379161fc403b436dc08d77c4656e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T23:37:35.985 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 ceph-mds[72089]: -- 172.21.15.16:0/121087871 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ab1cc5860 con 0x560ab1ca3400 2024-09-10T23:37:35.985 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j[72085]: starting mds.j at 2024-09-10T23:37:35.985 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 bash[72061]: ce66644e9da97a8b1598ec7e3e4bebe1433379161fc403b436dc08d77c4656e8 2024-09-10T23:37:35.985 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:37:35 smithi016 systemd[1]: Started Ceph mds.j for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 -- 172.21.15.16:0/515937066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8102160 msgr2=0x7facc810eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 --2- 172.21.15.16:0/515937066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8102160 0x7facc810eeb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7facb8009900 tx=0x7facb802a480 comp rx=0 tx=0).stop 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 -- 172.21.15.16:0/515937066 shutdown_connections 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 --2- 172.21.15.16:0/515937066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facc810f3f0 0x7facc81117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 --2- 172.21.15.16:0/515937066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8102160 0x7facc810eeb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 --2- 172.21.15.16:0/515937066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc8101840 0x7facc8101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 -- 172.21.15.16:0/515937066 >> 172.21.15.16:0/515937066 conn(0x7facc80fd6f0 msgr2=0x7facc80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:36.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 -- 172.21.15.16:0/515937066 shutdown_connections 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 -- 172.21.15.16:0/515937066 wait complete. 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 Processor -- start 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.470+0000 7faccf8f9640 1 -- start start 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8101840 0x7facc819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc8102160 0x7facc819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facc810f3f0 0x7facc81a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7facc8114fb0 con 0x7facc8101840 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7facc8114e30 con 0x7facc8102160 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facc8115130 con 0x7facc810f3f0 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8101840 0x7facc819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8101840 0x7facc819b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43462/0 (socket says 172.21.15.16:43462) 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 -- 172.21.15.16:0/3169856557 learned_addr learned my addr 172.21.15.16:0/3169856557 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:36.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccde96640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facc810f3f0 0x7facc81a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccce94640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc8102160 0x7facc819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 -- 172.21.15.16:0/3169856557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facc810f3f0 msgr2=0x7facc81a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facc810f3f0 0x7facc81a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 -- 172.21.15.16:0/3169856557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc8102160 msgr2=0x7facc819ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc8102160 0x7facc819ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 -- 172.21.15.16:0/3169856557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc81a1590 con 0x7facc8101840 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccce94640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc8102160 0x7facc819ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccd695640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8101840 0x7facc819b4e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7facc400b4a0 tx=0x7facc400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7facbe7fc640 1 -- 172.21.15.16:0/3169856557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4014070 con 0x7facc8101840 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7facbe7fc640 1 -- 172.21.15.16:0/3169856557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facc4010ac0 con 0x7facc8101840 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc81a1880 con 0x7facc8101840 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7facbe7fc640 1 -- 172.21.15.16:0/3169856557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4017c30 con 0x7facc8101840 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.471+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81a7fc0 con 0x7facc8101840 2024-09-10T23:37:36.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.472+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc8101c20 con 0x7facc8101840 2024-09-10T23:37:36.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.475+0000 7facbe7fc640 1 -- 172.21.15.16:0/3169856557 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7facc4010610 con 0x7facc8101840 2024-09-10T23:37:36.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.475+0000 7facbe7fc640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7facb40b5330 0x7facb40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:36.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.475+0000 7faccce94640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7facb40b5330 0x7facb40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:36.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.475+0000 7facbe7fc640 1 -- 172.21.15.16:0/3169856557 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7facc40e5180 con 0x7facc8101840 2024-09-10T23:37:36.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.476+0000 7faccce94640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7facb40b5330 0x7facb40b77f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:36.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.478+0000 7facbe7fc640 1 -- 172.21.15.16:0/3169856557 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7facc40ac410 con 0x7facc8101840 2024-09-10T23:37:36.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.715+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facc819c610 con 0x7facc8101840 2024-09-10T23:37:36.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.715+0000 7facbe7fc640 1 -- 172.21.15.16:0/3169856557 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7facc40abd10 con 0x7facc8101840 2024-09-10T23:37:36.717 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:36.717 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":4,"btime":"2024-09-10T23:37:36:233649+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:37:36.717 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 4 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7facb40b5330 msgr2=0x7facb40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7facb40b5330 0x7facb40b77f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb8031400 comp rx=0 tx=0).stop 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8101840 msgr2=0x7facc819b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8101840 0x7facc819b4e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7facc400b4a0 tx=0x7facc400b960 comp rx=0 tx=0).stop 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 shutdown_connections 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facc810f3f0 0x7facc81a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7facb40b5330 0x7facb40b77f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facc8102160 0x7facc819ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 --2- 172.21.15.16:0/3169856557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc8101840 0x7facc819b4e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:36.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 >> 172.21.15.16:0/3169856557 conn(0x7facc80fd6f0 msgr2=0x7facc80ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:36.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 shutdown_connections 2024-09-10T23:37:36.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:36.718+0000 7faccf8f9640 1 -- 172.21.15.16:0/3169856557 wait complete. 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: Deploying daemon mds.d on smithi016 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.16:6834/3416253581,v1:172.21.15.16:6835/3416253581] up:boot 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: fsmap 3 up:standby 2024-09-10T23:37:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:37:36.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:36 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3169856557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: Deploying daemon mds.d on smithi016 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.16:6834/3416253581,v1:172.21.15.16:6835/3416253581] up:boot 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: fsmap 3 up:standby 2024-09-10T23:37:37.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:37:37.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:36 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3169856557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: Deploying daemon mds.d on smithi016 2024-09-10T23:37:37.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.16:6834/3416253581,v1:172.21.15.16:6835/3416253581] up:boot 2024-09-10T23:37:37.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: fsmap 3 up:standby 2024-09-10T23:37:37.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:37:37.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:36 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3169856557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:37.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:37 smithi016 ceph-mon[30855]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:38.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:37 smithi066 ceph-mon[34761]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:38.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:37 smithi071 ceph-mon[35018]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:39.205 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:38 smithi016 systemd[1]: Starting Ceph mds.d for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:39.479 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 podman[72489]: 2024-09-10 23:37:39.107616155 +0000 UTC m=+0.016553772 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:39.479 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 podman[72489]: 2024-09-10 23:37:39.217218203 +0000 UTC m=+0.126155849 container create 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:39.479 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 podman[72489]: 2024-09-10 23:37:39.478431286 +0000 UTC m=+0.387368898 container init 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T23:37:39.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:39.735 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 podman[72489]: 2024-09-10 23:37:39.481787718 +0000 UTC m=+0.390725322 container start 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T23:37:39.735 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mds[72509]: -- 172.21.15.16:0/2847935410 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562adf9f3860 con 0x562adf9d1400 2024-09-10T23:37:39.735 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d[72505]: starting mds.d at 2024-09-10T23:37:39.735 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 bash[72489]: 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 2024-09-10T23:37:39.735 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:37:39 smithi016 systemd[1]: Started Ceph mds.d for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:39.841 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:40.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:39 smithi066 ceph-mon[34761]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:40.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:40.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:40.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:39 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:40.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mon[30855]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:40.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:40.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:40.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:39 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:39 smithi071 ceph-mon[35018]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:39 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:40.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 -- 172.21.15.16:0/2837500583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c101c90 msgr2=0x7f0e7c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:40.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 --2- 172.21.15.16:0/2837500583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c101c90 0x7f0e7c102070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009900 tx=0x7f0e6c02a410 comp rx=0 tx=0).stop 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 -- 172.21.15.16:0/2837500583 shutdown_connections 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 --2- 172.21.15.16:0/2837500583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e7c108020 0x7f0e7c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 --2- 172.21.15.16:0/2837500583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e7c1076a0 0x7f0e7c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 --2- 172.21.15.16:0/2837500583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c101c90 0x7f0e7c102070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 -- 172.21.15.16:0/2837500583 >> 172.21.15.16:0/2837500583 conn(0x7f0e7c0fd700 msgr2=0x7f0e7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 -- 172.21.15.16:0/2837500583 shutdown_connections 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.365+0000 7f0e8130d640 1 -- 172.21.15.16:0/2837500583 wait complete. 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 Processor -- start 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 -- start start 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e7c101c90 0x7f0e7c10f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c1076a0 0x7f0e7c10f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e7c108020 0x7f0e7c10fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c112e00 con 0x7f0e7c1076a0 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c112c80 con 0x7f0e7c108020 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e8130d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c112f80 con 0x7f0e7c101c90 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e73fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c1076a0 0x7f0e7c10f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e73fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c1076a0 0x7f0e7c10f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43496/0 (socket says 172.21.15.16:43496) 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e73fff640 1 -- 172.21.15.16:0/1302026483 learned_addr learned my addr 172.21.15.16:0/1302026483 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e7b7fe640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e7c108020 0x7f0e7c10fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.366+0000 7f0e7affd640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e7c101c90 0x7f0e7c10f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e73fff640 1 -- 172.21.15.16:0/1302026483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e7c101c90 msgr2=0x7f0e7c10f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e73fff640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e7c101c90 0x7f0e7c10f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e73fff640 1 -- 172.21.15.16:0/1302026483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e7c108020 msgr2=0x7f0e7c10fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e73fff640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e7c108020 0x7f0e7c10fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e73fff640 1 -- 172.21.15.16:0/1302026483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7c1a76b0 con 0x7f0e7c1076a0 2024-09-10T23:37:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e7affd640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e7c101c90 0x7f0e7c10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e73fff640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c1076a0 0x7f0e7c10f870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c890 tx=0x7f0e6400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e78ff9640 1 -- 172.21.15.16:0/1302026483 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64004220 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7c1a79a0 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e78ff9640 1 -- 172.21.15.16:0/1302026483 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e640043c0 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e78ff9640 1 -- 172.21.15.16:0/1302026483 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64004a00 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.367+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7c1a7f30 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.368+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7c102070 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.370+0000 7f0e78ff9640 1 -- 172.21.15.16:0/1302026483 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f0e640079b0 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.370+0000 7f0e78ff9640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e680b5330 0x7f0e680b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.371+0000 7f0e7affd640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e680b5330 0x7f0e680b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.371+0000 7f0e78ff9640 1 -- 172.21.15.16:0/1302026483 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f0e640e5a60 con 0x7f0e7c1076a0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.371+0000 7f0e7affd640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e680b5330 0x7f0e680b77f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c000c00 tx=0x7f0e6c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.373+0000 7f0e78ff9640 1 -- 172.21.15.16:0/1302026483 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0e64014030 con 0x7f0e7c1076a0 2024-09-10T23:37:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.595+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e7c02e5c0 con 0x7f0e7c1076a0 2024-09-10T23:37:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.596+0000 7f0e78ff9640 1 -- 172.21.15.16:0/1302026483 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f0e640accd0 con 0x7f0e7c1076a0 2024-09-10T23:37:40.597 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:40.597 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"btime":"2024-09-10T23:37:39:794261+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:37:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 5 2024-09-10T23:37:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e680b5330 msgr2=0x7f0e680b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e680b5330 0x7f0e680b77f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c000c00 tx=0x7f0e6c031400 comp rx=0 tx=0).stop 2024-09-10T23:37:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c1076a0 msgr2=0x7f0e7c10f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c1076a0 0x7f0e7c10f870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c890 tx=0x7f0e6400cd50 comp rx=0 tx=0).stop 2024-09-10T23:37:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 shutdown_connections 2024-09-10T23:37:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0e680b5330 0x7f0e680b77f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e7c108020 0x7f0e7c10fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e7c1076a0 0x7f0e7c10f870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 --2- 172.21.15.16:0/1302026483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e7c101c90 0x7f0e7c10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 >> 172.21.15.16:0/1302026483 conn(0x7f0e7c0fd700 msgr2=0x7f0e7c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 shutdown_connections 2024-09-10T23:37:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:40.598+0000 7f0e8130d640 1 -- 172.21.15.16:0/1302026483 wait complete. 2024-09-10T23:37:41.114 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:40 smithi066 ceph-mon[34761]: Deploying daemon mds.e on smithi066 2024-09-10T23:37:41.114 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:40 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.16:6836/3189484685,v1:172.21.15.16:6837/3189484685] up:boot 2024-09-10T23:37:41.114 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:40 smithi066 ceph-mon[34761]: fsmap 4 up:standby 2024-09-10T23:37:41.115 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:40 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:37:41.115 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:40 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1302026483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:40 smithi016 ceph-mon[30855]: Deploying daemon mds.e on smithi066 2024-09-10T23:37:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:40 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.16:6836/3189484685,v1:172.21.15.16:6837/3189484685] up:boot 2024-09-10T23:37:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:40 smithi016 ceph-mon[30855]: fsmap 4 up:standby 2024-09-10T23:37:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:40 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:37:41.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:40 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1302026483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:40 smithi071 ceph-mon[35018]: Deploying daemon mds.e on smithi066 2024-09-10T23:37:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:40 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.16:6836/3189484685,v1:172.21.15.16:6837/3189484685] up:boot 2024-09-10T23:37:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:40 smithi071 ceph-mon[35018]: fsmap 4 up:standby 2024-09-10T23:37:41.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:40 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:37:41.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:40 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1302026483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:41.801 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:41 smithi066 systemd[1]: Starting Ceph mds.e for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:42.072 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:41 smithi066 ceph-mon[34761]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:42.073 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:41 smithi066 podman[65289]: 2024-09-10 23:37:41.74753383 +0000 UTC m=+0.017202180 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:42.073 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:41 smithi066 podman[65289]: 2024-09-10 23:37:41.845034874 +0000 UTC m=+0.114703224 container create 3fc3d5aeb3bd012164db6a53418cfdae62bf6d009215d25df8b53b6e96f466b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:42.073 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:42 smithi066 podman[65289]: 2024-09-10 23:37:42.072781604 +0000 UTC m=+0.342449954 container init 3fc3d5aeb3bd012164db6a53418cfdae62bf6d009215d25df8b53b6e96f466b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T23:37:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:41 smithi016 ceph-mon[30855]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:41 smithi071 ceph-mon[35018]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:42.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:42 smithi066 podman[65289]: 2024-09-10 23:37:42.075781858 +0000 UTC m=+0.345450215 container start 3fc3d5aeb3bd012164db6a53418cfdae62bf6d009215d25df8b53b6e96f466b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T23:37:42.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:42 smithi066 ceph-mds[65308]: -- 172.21.15.66:0/913913063 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632d0e9d860 con 0x5632d0e7b000 2024-09-10T23:37:42.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:42 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e[65304]: starting mds.e at 2024-09-10T23:37:42.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:42 smithi066 bash[65289]: 3fc3d5aeb3bd012164db6a53418cfdae62bf6d009215d25df8b53b6e96f466b2 2024-09-10T23:37:42.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:37:42 smithi066 systemd[1]: Started Ceph mds.e for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:43.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6834/1868979678,v1:172.21.15.66:6835/1868979678] up:boot 2024-09-10T23:37:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: fsmap 5 up:standby 2024-09-10T23:37:43.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:37:43.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6834/1868979678,v1:172.21.15.66:6835/1868979678] up:boot 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: fsmap 5 up:standby 2024-09-10T23:37:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:37:43.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6834/1868979678,v1:172.21.15.66:6835/1868979678] up:boot 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: fsmap 5 up:standby 2024-09-10T23:37:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:37:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:44.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/2556359839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 msgr2=0x7fb1e41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/2556359839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e41031a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009900 tx=0x7fb1d402a410 comp rx=0 tx=0).stop 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/2556359839 shutdown_connections 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/2556359839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1e4109150 0x7fb1e410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/2556359839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1e41087d0 0x7fb1e4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/2556359839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e41031a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/2556359839 >> 172.21.15.16:0/2556359839 conn(0x7fb1e40fe830 msgr2=0x7fb1e4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/2556359839 shutdown_connections 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/2556359839 wait complete. 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.130+0000 7fb1e9a8a640 1 Processor -- start 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e9a8a640 1 -- start start 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e9a8a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e9a8a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1e41087d0 0x7fb1e4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:44.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e9a8a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1e4109150 0x7fb1e419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e9a8a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e4112e10 con 0x7fb1e4102dc0 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e9a8a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e4112c90 con 0x7fb1e41087d0 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e9a8a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e4112f90 con 0x7fb1e4109150 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52160/0 (socket says 172.21.15.16:52160) 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 -- 172.21.15.16:0/559218358 learned_addr learned my addr 172.21.15.16:0/559218358 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e3fff640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1e4109150 0x7fb1e419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e2ffd640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1e41087d0 0x7fb1e4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 -- 172.21.15.16:0/559218358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1e4109150 msgr2=0x7fb1e419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1e4109150 0x7fb1e419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 -- 172.21.15.16:0/559218358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1e41087d0 msgr2=0x7fb1e4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1e41087d0 0x7fb1e4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e37fe640 1 -- 172.21.15.16:0/559218358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e419f3b0 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.131+0000 7fb1e3fff640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1e4109150 0x7fb1e419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.132+0000 7fb1e37fe640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e4199300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005940 tx=0x7fb1d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.132+0000 7fb1e0ff9640 1 -- 172.21.15.16:0/559218358 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d403f030 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.132+0000 7fb1e0ff9640 1 -- 172.21.15.16:0/559218358 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1d4003cb0 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.132+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e419f640 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.132+0000 7fb1e0ff9640 1 -- 172.21.15.16:0/559218358 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4035070 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.132+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e41a5d60 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.133+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e41031a0 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.134+0000 7fb1e0ff9640 1 -- 172.21.15.16:0/559218358 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fb1d4003800 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.135+0000 7fb1e0ff9640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1cc0b5430 0x7fb1cc0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.135+0000 7fb1e2ffd640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1cc0b5430 0x7fb1cc0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.135+0000 7fb1e0ff9640 1 -- 172.21.15.16:0/559218358 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb1d4106170 con 0x7fb1e4102dc0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.135+0000 7fb1e2ffd640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1cc0b5430 0x7fb1cc0b78f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8005d00 tx=0x7fb1d8005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:44.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.139+0000 7fb1e0ff9640 1 -- 172.21.15.16:0/559218358 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb1d40cd360 con 0x7fb1e4102dc0 2024-09-10T23:37:44.217 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 systemd[1]: Starting Ceph mds.f for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:44.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.361+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1e419a430 con 0x7fb1e4102dc0 2024-09-10T23:37:44.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:44 smithi016 ceph-mon[30855]: Deploying daemon mds.f on smithi071 2024-09-10T23:37:44.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:44 smithi016 ceph-mon[30855]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:44.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.361+0000 7fb1e0ff9640 1 -- 172.21.15.16:0/559218358 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fb1d40ccc60 con 0x7fb1e4102dc0 2024-09-10T23:37:44.362 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:44.363 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":6,"btime":"2024-09-10T23:37:42:806091+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24563,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T23:37:44.363 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 6 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1cc0b5430 msgr2=0x7fb1cc0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1cc0b5430 0x7fb1cc0b78f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8005d00 tx=0x7fb1d8005c50 comp rx=0 tx=0).stop 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 msgr2=0x7fb1e4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e4199300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005940 tx=0x7fb1d40042f0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 shutdown_connections 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1e4109150 0x7fb1e419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1cc0b5430 0x7fb1cc0b78f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1e41087d0 0x7fb1e4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 --2- 172.21.15.16:0/559218358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1e4102dc0 0x7fb1e4199300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 >> 172.21.15.16:0/559218358 conn(0x7fb1e40fe830 msgr2=0x7fb1e4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 shutdown_connections 2024-09-10T23:37:44.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:44.364+0000 7fb1e9a8a640 1 -- 172.21.15.16:0/559218358 wait complete. 2024-09-10T23:37:44.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:44 smithi071 ceph-mon[35018]: Deploying daemon mds.f on smithi071 2024-09-10T23:37:44.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:44 smithi071 ceph-mon[35018]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:44.470 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 podman[65663]: 2024-09-10 23:37:44.224456746 +0000 UTC m=+0.016308274 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:44.471 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 podman[65663]: 2024-09-10 23:37:44.341998829 +0000 UTC m=+0.133850358 container create f9294f6f77cc56639b68bf7370c68958c9c9263457bad50ac79292dfb9cd0436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T23:37:44.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:44 smithi066 ceph-mon[34761]: Deploying daemon mds.f on smithi071 2024-09-10T23:37:44.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:44 smithi066 ceph-mon[34761]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:45.019 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 podman[65663]: 2024-09-10 23:37:44.545309688 +0000 UTC m=+0.337161226 container init f9294f6f77cc56639b68bf7370c68958c9c9263457bad50ac79292dfb9cd0436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:37:45.020 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 podman[65663]: 2024-09-10 23:37:44.54828512 +0000 UTC m=+0.340136649 container start f9294f6f77cc56639b68bf7370c68958c9c9263457bad50ac79292dfb9cd0436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T23:37:45.020 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 ceph-mds[65682]: -- 172.21.15.71:0/3559891768 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5599b065bc20 con 0x5599b0638800 2024-09-10T23:37:45.020 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f[65678]: starting mds.f at 2024-09-10T23:37:45.020 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 bash[65663]: f9294f6f77cc56639b68bf7370c68958c9c9263457bad50ac79292dfb9cd0436 2024-09-10T23:37:45.020 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:37:44 smithi071 systemd[1]: Started Ceph mds.f for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:45.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:45 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/559218358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:45.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.374 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.374 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:45.374 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:45.374 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:45 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:45 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/559218358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:45.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:45 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:45.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:45 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/559218358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:45.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:45.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:45.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:45.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:45 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:46.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:46 smithi071 ceph-mon[35018]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:46.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:46 smithi071 ceph-mon[35018]: Deploying daemon mds.c on smithi071 2024-09-10T23:37:46.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:46 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6834/583734619,v1:172.21.15.71:6835/583734619] up:boot 2024-09-10T23:37:46.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:46 smithi071 ceph-mon[35018]: fsmap 6 up:standby 2024-09-10T23:37:46.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:46 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:37:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:46 smithi016 ceph-mon[30855]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:46 smithi016 ceph-mon[30855]: Deploying daemon mds.c on smithi071 2024-09-10T23:37:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:46 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6834/583734619,v1:172.21.15.71:6835/583734619] up:boot 2024-09-10T23:37:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:46 smithi016 ceph-mon[30855]: fsmap 6 up:standby 2024-09-10T23:37:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:46 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:37:46.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:46 smithi066 ceph-mon[34761]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:46 smithi066 ceph-mon[34761]: Deploying daemon mds.c on smithi071 2024-09-10T23:37:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:46 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6834/583734619,v1:172.21.15.71:6835/583734619] up:boot 2024-09-10T23:37:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:46 smithi066 ceph-mon[34761]: fsmap 6 up:standby 2024-09-10T23:37:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:46 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:37:46.769 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:46 smithi071 systemd[1]: Starting Ceph mds.c for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:47.069 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:46 smithi071 podman[65965]: 2024-09-10 23:37:46.686319036 +0000 UTC m=+0.015959783 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:47.069 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:46 smithi071 podman[65965]: 2024-09-10 23:37:46.824356919 +0000 UTC m=+0.153997654 container create e5a938f68e6196b8ff81a3cdea8eb713d5920a6de3ed6d892c6483b25e7028b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:37:47.069 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:47 smithi071 podman[65965]: 2024-09-10 23:37:47.069113896 +0000 UTC m=+0.398754630 container init e5a938f68e6196b8ff81a3cdea8eb713d5920a6de3ed6d892c6483b25e7028b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:47.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:47.463 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:47.519 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:47 smithi071 podman[65965]: 2024-09-10 23:37:47.071813312 +0000 UTC m=+0.401454055 container start e5a938f68e6196b8ff81a3cdea8eb713d5920a6de3ed6d892c6483b25e7028b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:37:47.519 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:47 smithi071 ceph-mds[65984]: -- 172.21.15.71:0/2155486805 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564977829860 con 0x564977807400 2024-09-10T23:37:47.520 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c[65980]: starting mds.c at 2024-09-10T23:37:47.520 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:47 smithi071 bash[65965]: e5a938f68e6196b8ff81a3cdea8eb713d5920a6de3ed6d892c6483b25e7028b4 2024-09-10T23:37:47.520 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:37:47 smithi071 systemd[1]: Started Ceph mds.c for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 -- 172.21.15.16:0/1313095096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 msgr2=0x7fefb011bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 --2- 172.21.15.16:0/1313095096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb011bcb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009900 tx=0x7fefa402a410 comp rx=0 tx=0).stop 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 -- 172.21.15.16:0/1313095096 shutdown_connections 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 --2- 172.21.15.16:0/1313095096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefb011c1f0 0x7fefb011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 --2- 172.21.15.16:0/1313095096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb011bcb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 --2- 172.21.15.16:0/1313095096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb006eb80 0x7fefb006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 -- 172.21.15.16:0/1313095096 >> 172.21.15.16:0/1313095096 conn(0x7fefb006dce0 msgr2=0x7fefb006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 -- 172.21.15.16:0/1313095096 shutdown_connections 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.958+0000 7fefb7e62640 1 -- 172.21.15.16:0/1313095096 wait complete. 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 Processor -- start 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 -- start start 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb006eb80 0x7fefb01a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb01a8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefb011c1f0 0x7fefb01ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0121ba0 con 0x7fefb006f4a0 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0121a20 con 0x7fefb011c1f0 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb7e62640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0121d20 con 0x7fefb006eb80 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb53fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb01a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb53fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb01a8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52174/0 (socket says 172.21.15.16:52174) 2024-09-10T23:37:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb53fd640 1 -- 172.21.15.16:0/2808417864 learned_addr learned my addr 172.21.15.16:0/2808417864 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.959+0000 7fefb63ff640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefb011c1f0 0x7fefb01ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb5bfe640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb006eb80 0x7fefb01a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb53fd640 1 -- 172.21.15.16:0/2808417864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb006eb80 msgr2=0x7fefb01a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb53fd640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb006eb80 0x7fefb01a8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb53fd640 1 -- 172.21.15.16:0/2808417864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefb011c1f0 msgr2=0x7fefb01ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb53fd640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefb011c1f0 0x7fefb01ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb53fd640 1 -- 172.21.15.16:0/2808417864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb01ae0c0 con 0x7fefb006f4a0 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb5bfe640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb006eb80 0x7fefb01a8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb53fd640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb01a8550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fefa4006010 tx=0x7fefa40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefaeffd640 1 -- 172.21.15.16:0/2808417864 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa403f030 con 0x7fefb006f4a0 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb01ae350 con 0x7fefb006f4a0 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefaeffd640 1 -- 172.21.15.16:0/2808417864 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefa4003800 con 0x7fefb006f4a0 2024-09-10T23:37:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefaeffd640 1 -- 172.21.15.16:0/2808417864 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4035070 con 0x7fefb006f4a0 2024-09-10T23:37:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.960+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb01b4a70 con 0x7fefb006f4a0 2024-09-10T23:37:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.961+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb006ef60 con 0x7fefb006f4a0 2024-09-10T23:37:47.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.963+0000 7fefaeffd640 1 -- 172.21.15.16:0/2808417864 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fefa4003cb0 con 0x7fefb006f4a0 2024-09-10T23:37:47.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.963+0000 7fefaeffd640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fef980b5330 0x7fef980b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:47.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.963+0000 7fefb5bfe640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fef980b5330 0x7fef980b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:47.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.963+0000 7fefaeffd640 1 -- 172.21.15.16:0/2808417864 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fefa4106460 con 0x7fefb006f4a0 2024-09-10T23:37:47.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.964+0000 7fefb5bfe640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fef980b5330 0x7fef980b77f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefa0008e00 tx=0x7fefa0008350 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:47.966+0000 7fefaeffd640 1 -- 172.21.15.16:0/2808417864 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fefa40cd6f0 con 0x7fefb006f4a0 2024-09-10T23:37:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.188+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefb01b4d60 con 0x7fefb006f4a0 2024-09-10T23:37:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.189+0000 7fefaeffd640 1 -- 172.21.15.16:0/2808417864 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6382 (secure 0 0 0) 0x7fefa40ccff0 con 0x7fefb006f4a0 2024-09-10T23:37:48.190 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:48.190 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"btime":"2024-09-10T23:37:47:225496+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24563,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T23:37:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-09-10T23:37:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fef980b5330 msgr2=0x7fef980b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fef980b5330 0x7fef980b77f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefa0008e00 tx=0x7fefa0008350 comp rx=0 tx=0).stop 2024-09-10T23:37:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 msgr2=0x7fefb01a8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb01a8550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fefa4006010 tx=0x7fefa40042f0 comp rx=0 tx=0).stop 2024-09-10T23:37:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 shutdown_connections 2024-09-10T23:37:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fef980b5330 0x7fef980b77f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefb011c1f0 0x7fefb01ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb006f4a0 0x7fefb01a8550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 --2- 172.21.15.16:0/2808417864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb006eb80 0x7fefb01a8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 >> 172.21.15.16:0/2808417864 conn(0x7fefb006dce0 msgr2=0x7fefb011c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 shutdown_connections 2024-09-10T23:37:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:48.191+0000 7fefb7e62640 1 -- 172.21.15.16:0/2808417864 wait complete. 2024-09-10T23:37:48.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] up:boot 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: fsmap 7 up:standby 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:37:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:48 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2808417864' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] up:boot 2024-09-10T23:37:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: fsmap 7 up:standby 2024-09-10T23:37:48.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:37:48.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:48 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2808417864' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] up:boot 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: fsmap 7 up:standby 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:37:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:48 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2808417864' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:49 smithi016 ceph-mon[30855]: Deploying daemon mds.h on smithi066 2024-09-10T23:37:49.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:49 smithi071 ceph-mon[35018]: Deploying daemon mds.h on smithi066 2024-09-10T23:37:49.529 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:49 smithi066 ceph-mon[34761]: Deploying daemon mds.h on smithi066 2024-09-10T23:37:49.530 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 systemd[1]: Starting Ceph mds.h for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:37:49.802 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 podman[65589]: 2024-09-10 23:37:49.432269159 +0000 UTC m=+0.016669526 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:37:49.802 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 podman[65589]: 2024-09-10 23:37:49.542505574 +0000 UTC m=+0.126906009 container create 6ca599a42820ab6c623871f107bff2041e42f1bf5ef64e1590ec444b301893ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:37:50.222 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 podman[65589]: 2024-09-10 23:37:49.820694922 +0000 UTC m=+0.405095301 container init 6ca599a42820ab6c623871f107bff2041e42f1bf5ef64e1590ec444b301893ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:37:50.222 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 podman[65589]: 2024-09-10 23:37:49.823751155 +0000 UTC m=+0.408151524 container start 6ca599a42820ab6c623871f107bff2041e42f1bf5ef64e1590ec444b301893ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T23:37:50.223 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 ceph-mds[65608]: -- 172.21.15.66:0/2653763424 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd1b6fd860 con 0x55cd1b6db000 2024-09-10T23:37:50.223 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h[65604]: starting mds.h at 2024-09-10T23:37:50.223 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 bash[65589]: 6ca599a42820ab6c623871f107bff2041e42f1bf5ef64e1590ec444b301893ea 2024-09-10T23:37:50.223 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:37:49 smithi066 systemd[1]: Started Ceph mds.h for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:50 smithi016 ceph-mon[30855]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:50 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:50 smithi071 ceph-mon[35018]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:50 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:50.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:50 smithi066 ceph-mon[34761]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:50.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:50.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:50.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:50.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:50 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:50.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:51.174 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:51.479 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:51 smithi016 ceph-mon[30855]: Deploying daemon mds.i on smithi071 2024-09-10T23:37:51.479 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:51 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6836/3622450021,v1:172.21.15.66:6837/3622450021] up:boot 2024-09-10T23:37:51.479 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:51 smithi016 ceph-mon[30855]: fsmap 8 up:standby 2024-09-10T23:37:51.479 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:51 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:37:51.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:51 smithi071 ceph-mon[35018]: Deploying daemon mds.i on smithi071 2024-09-10T23:37:51.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:51 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6836/3622450021,v1:172.21.15.66:6837/3622450021] up:boot 2024-09-10T23:37:51.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:51 smithi071 ceph-mon[35018]: fsmap 8 up:standby 2024-09-10T23:37:51.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:51 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:37:51.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:51 smithi066 ceph-mon[34761]: Deploying daemon mds.i on smithi071 2024-09-10T23:37:51.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:51 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6836/3622450021,v1:172.21.15.66:6837/3622450021] up:boot 2024-09-10T23:37:51.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:51 smithi066 ceph-mon[34761]: fsmap 8 up:standby 2024-09-10T23:37:51.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:51 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:37:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 -- 172.21.15.16:0/2172354562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc118104600 msgr2=0x7fc11810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 --2- 172.21.15.16:0/2172354562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc118104600 0x7fc11810caf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc100009900 tx=0x7fc10002a410 comp rx=0 tx=0).stop 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 -- 172.21.15.16:0/2172354562 shutdown_connections 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 --2- 172.21.15.16:0/2172354562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11810d140 0x7fc11810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 --2- 172.21.15.16:0/2172354562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc118104600 0x7fc11810caf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 --2- 172.21.15.16:0/2172354562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 0x7fc1181040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 -- 172.21.15.16:0/2172354562 >> 172.21.15.16:0/2172354562 conn(0x7fc1180fd700 msgr2=0x7fc1180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 -- 172.21.15.16:0/2172354562 shutdown_connections 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.688+0000 7fc11cb31640 1 -- 172.21.15.16:0/2172354562 wait complete. 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 Processor -- start 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 -- start start 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 0x7fc118199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc118104600 0x7fc118199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc11810d140 0x7fc11819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc118112df0 con 0x7fc11810d140 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc118112c70 con 0x7fc118104600 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11cb31640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc118112f70 con 0x7fc118103ce0 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc116d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc11810d140 0x7fc11819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 0x7fc118199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 0x7fc118199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:41350/0 (socket says 172.21.15.16:41350) 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc11659c640 1 -- 172.21.15.16:0/749021922 learned_addr learned my addr 172.21.15.16:0/749021922 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.689+0000 7fc10ffff640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc118104600 0x7fc118199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc116d9d640 1 -- 172.21.15.16:0/749021922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 msgr2=0x7fc118199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc116d9d640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 0x7fc118199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc116d9d640 1 -- 172.21.15.16:0/749021922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc118104600 msgr2=0x7fc118199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc116d9d640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc118104600 0x7fc118199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc116d9d640 1 -- 172.21.15.16:0/749021922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11819f3d0 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc11659c640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 0x7fc118199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc116d9d640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc11810d140 0x7fc11819ec00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc11000be20 tx=0x7fc11000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc10f7fe640 1 -- 172.21.15.16:0/749021922 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110019070 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11819f6c0 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc10f7fe640 1 -- 172.21.15.16:0/749021922 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1100148f0 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc10f7fe640 1 -- 172.21.15.16:0/749021922 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110012840 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.690+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1181a5d80 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.691+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1181040c0 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.692+0000 7fc10f7fe640 1 -- 172.21.15.16:0/749021922 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc110014440 con 0x7fc11810d140 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.693+0000 7fc10f7fe640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc1040b5330 0x7fc1040b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.693+0000 7fc11659c640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc1040b5330 0x7fc1040b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.693+0000 7fc10f7fe640 1 -- 172.21.15.16:0/749021922 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fc1100e5250 con 0x7fc11810d140 2024-09-10T23:37:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.694+0000 7fc11659c640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc1040b5330 0x7fc1040b77f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc108005fd0 tx=0x7fc10800b480 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.697+0000 7fc10f7fe640 1 -- 172.21.15.16:0/749021922 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc1100abe90 con 0x7fc11810d140 2024-09-10T23:37:51.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.922+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1181a6110 con 0x7fc11810d140 2024-09-10T23:37:51.923 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:51.924 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":9,"btime":"2024-09-10T23:37:50:216353+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24563,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T23:37:51.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.922+0000 7fc10f7fe640 1 -- 172.21.15.16:0/749021922 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fc1100b08c0 con 0x7fc11810d140 2024-09-10T23:37:51.924 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 9 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.924+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc1040b5330 msgr2=0x7fc1040b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.924+0000 7fc11cb31640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc1040b5330 0x7fc1040b77f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc108005fd0 tx=0x7fc10800b480 comp rx=0 tx=0).stop 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.924+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc11810d140 msgr2=0x7fc11819ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.924+0000 7fc11cb31640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc11810d140 0x7fc11819ec00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc11000be20 tx=0x7fc11000bf10 comp rx=0 tx=0).stop 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 shutdown_connections 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc11810d140 0x7fc11819ec00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc1040b5330 0x7fc1040b77f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc118104600 0x7fc118199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 --2- 172.21.15.16:0/749021922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc118103ce0 0x7fc118199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 >> 172.21.15.16:0/749021922 conn(0x7fc1180fd700 msgr2=0x7fc1180fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 shutdown_connections 2024-09-10T23:37:51.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:51.925+0000 7fc11cb31640 1 -- 172.21.15.16:0/749021922 wait complete. 2024-09-10T23:37:52.229 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:37:52 smithi071 podman[66266]: 2024-09-10 23:37:52.166266593 +0000 UTC m=+0.140233495 container create 5587b0520d03799d94c521e9e060255bc81f49c7d34e1995141a8ab71df9b3fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:52.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:52 smithi016 ceph-mon[30855]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:52.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:52 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/749021922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:52.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:52 smithi071 ceph-mon[35018]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:52.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:52 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/749021922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:52.486 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:37:52 smithi071 podman[66266]: 2024-09-10 23:37:52.3940363 +0000 UTC m=+0.368003163 container init 5587b0520d03799d94c521e9e060255bc81f49c7d34e1995141a8ab71df9b3fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-10T23:37:52.486 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:37:52 smithi071 podman[66266]: 2024-09-10 23:37:52.396610696 +0000 UTC m=+0.370577566 container start 5587b0520d03799d94c521e9e060255bc81f49c7d34e1995141a8ab71df9b3fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T23:37:52.486 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:37:52 smithi071 ceph-mds[66285]: -- 172.21.15.71:0/2118465388 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3d8fa9860 con 0x55a3d8f86800 2024-09-10T23:37:52.486 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:37:52 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: starting mds.i at 2024-09-10T23:37:52.486 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:37:52 smithi071 bash[66266]: 5587b0520d03799d94c521e9e060255bc81f49c7d34e1995141a8ab71df9b3fd 2024-09-10T23:37:52.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:52 smithi066 ceph-mon[34761]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:52.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:52 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/749021922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:52.769 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:37:52 smithi071 systemd[1]: Started Ceph mds.i for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: Deploying daemon mds.g on smithi016 2024-09-10T23:37:53.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] up:boot 2024-09-10T23:37:53.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: fsmap 9 up:standby 2024-09-10T23:37:53.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:53 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:37:53.866 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:53.866 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.866 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.866 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.866 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:53.867 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:53.867 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:53.867 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: Deploying daemon mds.g on smithi016 2024-09-10T23:37:53.867 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] up:boot 2024-09-10T23:37:53.867 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: fsmap 9 up:standby 2024-09-10T23:37:53.867 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:53 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:37:53.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:53.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:53.941 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:53.941 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:53.941 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:53.941 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: Deploying daemon mds.g on smithi016 2024-09-10T23:37:53.941 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] up:boot 2024-09-10T23:37:53.941 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: fsmap 9 up:standby 2024-09-10T23:37:53.941 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:53 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:37:54.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:37:55.444 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 10 23:37:55 smithi016 systemd[1]: Started Ceph mds.g for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:55.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:55 smithi016 ceph-mon[30855]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:55.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:55.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:55.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:55.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:55.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:55.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:55 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:55 smithi066 ceph-mon[34761]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:55.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:55.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:55.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:55.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:55.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:55.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:55 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.801+0000 7fbdab335640 1 -- 172.21.15.16:0/4176115042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda41076e0 msgr2=0x7fbda4107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.801+0000 7fbdab335640 1 --2- 172.21.15.16:0/4176115042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda41076e0 0x7fbda4107b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009900 tx=0x7fbd9402a410 comp rx=0 tx=0).stop 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.801+0000 7fbdab335640 1 -- 172.21.15.16:0/4176115042 shutdown_connections 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.801+0000 7fbdab335640 1 --2- 172.21.15.16:0/4176115042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda4108060 0x7fbda410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.801+0000 7fbdab335640 1 --2- 172.21.15.16:0/4176115042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda41076e0 0x7fbda4107b20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.801+0000 7fbdab335640 1 --2- 172.21.15.16:0/4176115042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbda4101cd0 0x7fbda41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.801+0000 7fbdab335640 1 -- 172.21.15.16:0/4176115042 >> 172.21.15.16:0/4176115042 conn(0x7fbda40fd720 msgr2=0x7fbda40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.802+0000 7fbdab335640 1 -- 172.21.15.16:0/4176115042 shutdown_connections 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.802+0000 7fbdab335640 1 -- 172.21.15.16:0/4176115042 wait complete. 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.802+0000 7fbdab335640 1 Processor -- start 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.802+0000 7fbdab335640 1 -- start start 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbdab335640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda4101cd0 0x7fbda4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbdab335640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbda41076e0 0x7fbda4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbdab335640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda4108060 0x7fbda419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbdab335640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4111cb0 con 0x7fbda4108060 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbdab335640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4111b30 con 0x7fbda4101cd0 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbdab335640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4111e30 con 0x7fbda41076e0 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda4108060 0x7fbda419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda90d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda4101cd0 0x7fbda4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda4108060 0x7fbda419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58398/0 (socket says 172.21.15.16:58398) 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 -- 172.21.15.16:0/107882014 learned_addr learned my addr 172.21.15.16:0/107882014 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda88d0640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbda41076e0 0x7fbda4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 -- 172.21.15.16:0/107882014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbda41076e0 msgr2=0x7fbda4199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbda41076e0 0x7fbda4199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 -- 172.21.15.16:0/107882014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda4101cd0 msgr2=0x7fbda4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda4101cd0 0x7fbda4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 -- 172.21.15.16:0/107882014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda419f3c0 con 0x7fbda4108060 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda88d0640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbda41076e0 0x7fbda4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda90d1640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda4101cd0 0x7fbda4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbda98d2640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda4108060 0x7fbda419ebf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00eaa0 tx=0x7fbd9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbd9a7fc640 1 -- 172.21.15.16:0/107882014 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00cdb0 con 0x7fbda4108060 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbd9a7fc640 1 -- 172.21.15.16:0/107882014 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd9c005020 con 0x7fbda4108060 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda419f6b0 con 0x7fbda4108060 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.803+0000 7fbd9a7fc640 1 -- 172.21.15.16:0/107882014 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0116d0 con 0x7fbda4108060 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.804+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda41a5d70 con 0x7fbda4108060 2024-09-10T23:37:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.804+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda4102f80 con 0x7fbda4108060 2024-09-10T23:37:55.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.806+0000 7fbd9a7fc640 1 -- 172.21.15.16:0/107882014 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fbd9c00f040 con 0x7fbda4108060 2024-09-10T23:37:55.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.807+0000 7fbd9a7fc640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbd900b53b0 0x7fbd900b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:37:55.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.807+0000 7fbda90d1640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbd900b53b0 0x7fbd900b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:37:55.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.807+0000 7fbd9a7fc640 1 -- 172.21.15.16:0/107882014 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fbd9c0e5a50 con 0x7fbda4108060 2024-09-10T23:37:55.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.807+0000 7fbda90d1640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbd900b53b0 0x7fbd900b7870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbda0005d00 tx=0x7fbda000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:37:55.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:55.810+0000 7fbd9a7fc640 1 -- 172.21.15.16:0/107882014 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbd9c016030 con 0x7fbda4108060 2024-09-10T23:37:56.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:55 smithi071 ceph-mon[35018]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:55 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:56.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.037+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbda419a440 con 0x7fbda4108060 2024-09-10T23:37:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.038+0000 7fbd9a7fc640 1 -- 172.21.15.16:0/107882014 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8857 (secure 0 0 0) 0x7fbd9c0accc0 con 0x7fbda4108060 2024-09-10T23:37:56.039 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:37:56.039 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":11,"btime":"2024-09-10T23:37:55:537229+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24563,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24610,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T23:37:56.039 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 11 2024-09-10T23:37:56.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbd900b53b0 msgr2=0x7fbd900b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:56.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbd900b53b0 0x7fbd900b7870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbda0005d00 tx=0x7fbda000b410 comp rx=0 tx=0).stop 2024-09-10T23:37:56.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda4108060 msgr2=0x7fbda419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:37:56.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda4108060 0x7fbda419ebf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00eaa0 tx=0x7fbd9c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:37:56.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 shutdown_connections 2024-09-10T23:37:56.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbda4108060 0x7fbda419ebf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:56.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbda41076e0 0x7fbda4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:56.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbd900b53b0 0x7fbd900b7870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:56.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 --2- 172.21.15.16:0/107882014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbda4101cd0 0x7fbda4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:37:56.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 >> 172.21.15.16:0/107882014 conn(0x7fbda40fd720 msgr2=0x7fbda406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:37:56.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 shutdown_connections 2024-09-10T23:37:56.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:37:56.040+0000 7fbdab335640 1 -- 172.21.15.16:0/107882014 wait complete. 2024-09-10T23:37:56.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:56 smithi066 ceph-mon[34761]: Deploying daemon mds.a on smithi016 2024-09-10T23:37:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:56 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.16:6838/1264367217,v1:172.21.15.16:6839/1264367217] up:boot 2024-09-10T23:37:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:56 smithi066 ceph-mon[34761]: fsmap 10 up:standby 2024-09-10T23:37:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:56 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:37:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:56 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/107882014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:56.944 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:56 smithi016 ceph-mon[30855]: Deploying daemon mds.a on smithi016 2024-09-10T23:37:56.945 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:56 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.16:6838/1264367217,v1:172.21.15.16:6839/1264367217] up:boot 2024-09-10T23:37:56.945 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:56 smithi016 ceph-mon[30855]: fsmap 10 up:standby 2024-09-10T23:37:56.945 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:56 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:37:56.945 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:56 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/107882014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:57.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:56 smithi071 ceph-mon[35018]: Deploying daemon mds.a on smithi016 2024-09-10T23:37:57.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:56 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.16:6838/1264367217,v1:172.21.15.16:6839/1264367217] up:boot 2024-09-10T23:37:57.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:56 smithi071 ceph-mon[35018]: fsmap 10 up:standby 2024-09-10T23:37:57.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:56 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:37:57.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:56 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/107882014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:37:57.763 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:57 smithi016 ceph-mon[30855]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:57.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:57 smithi066 ceph-mon[34761]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:58.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:57 smithi071 ceph-mon[35018]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:58.485 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 10 23:37:58 smithi016 systemd[1]: Started Ceph mds.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:37:59.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:59.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:59.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:59.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:59.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: Deploying daemon mds.b on smithi066 2024-09-10T23:37:59.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.16:6840/3690738179,v1:172.21.15.16:6841/3690738179] up:boot 2024-09-10T23:37:59.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: fsmap 11 up:standby 2024-09-10T23:37:59.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:37:59 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:37:59.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:37:59.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:59.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: Deploying daemon mds.b on smithi066 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.16:6840/3690738179,v1:172.21.15.16:6841/3690738179] up:boot 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: fsmap 11 up:standby 2024-09-10T23:37:59.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:37:59 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: Deploying daemon mds.b on smithi066 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.16:6840/3690738179,v1:172.21.15.16:6841/3690738179] up:boot 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: fsmap 11 up:standby 2024-09-10T23:37:59.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:37:59 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:38:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:00.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 -- 172.21.15.16:0/2978461013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe24102dc0 msgr2=0x7efe241031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:00.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 --2- 172.21.15.16:0/2978461013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe24102dc0 0x7efe241031a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efe20009900 tx=0x7efe2002a410 comp rx=0 tx=0).stop 2024-09-10T23:38:00.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 -- 172.21.15.16:0/2978461013 shutdown_connections 2024-09-10T23:38:00.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 --2- 172.21.15.16:0/2978461013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe24109150 0x7efe2410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 --2- 172.21.15.16:0/2978461013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe241087d0 0x7efe24108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 --2- 172.21.15.16:0/2978461013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe24102dc0 0x7efe241031a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 -- 172.21.15.16:0/2978461013 >> 172.21.15.16:0/2978461013 conn(0x7efe240fe830 msgr2=0x7efe24100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 -- 172.21.15.16:0/2978461013 shutdown_connections 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.559+0000 7efe2c087640 1 -- 172.21.15.16:0/2978461013 wait complete. 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 Processor -- start 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 -- start start 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe24102dc0 0x7efe240754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe241087d0 0x7efe240759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109150 0x7efe24075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe24112e10 con 0x7efe241087d0 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe24112c90 con 0x7efe24109150 2024-09-10T23:38:00.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2c087640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe24112f90 con 0x7efe24102dc0 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe241087d0 0x7efe240759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe241087d0 0x7efe240759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58442/0 (socket says 172.21.15.16:58442) 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2a624640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109150 0x7efe24075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 -- 172.21.15.16:0/1706681584 learned_addr learned my addr 172.21.15.16:0/1706681584 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29e23640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe24102dc0 0x7efe240754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 -- 172.21.15.16:0/1706681584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe24102dc0 msgr2=0x7efe240754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe24102dc0 0x7efe240754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 -- 172.21.15.16:0/1706681584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109150 msgr2=0x7efe24075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109150 0x7efe24075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe29622640 1 -- 172.21.15.16:0/1706681584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe241a7780 con 0x7efe241087d0 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.560+0000 7efe2a624640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109150 0x7efe24075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.561+0000 7efe29622640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe241087d0 0x7efe240759e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efe1400e9f0 tx=0x7efe1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.561+0000 7efe1affd640 1 -- 172.21.15.16:0/1706681584 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1400cd80 con 0x7efe241087d0 2024-09-10T23:38:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.561+0000 7efe1affd640 1 -- 172.21.15.16:0/1706681584 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe140108e0 con 0x7efe241087d0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.561+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe241a7a70 con 0x7efe241087d0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.561+0000 7efe1affd640 1 -- 172.21.15.16:0/1706681584 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14018980 con 0x7efe241087d0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.561+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241a8000 con 0x7efe241087d0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.562+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe241031a0 con 0x7efe241087d0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.563+0000 7efe1affd640 1 -- 172.21.15.16:0/1706681584 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7efe14010430 con 0x7efe241087d0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.564+0000 7efe1affd640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe100b53b0 0x7efe100b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.564+0000 7efe29e23640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe100b53b0 0x7efe100b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.564+0000 7efe1affd640 1 -- 172.21.15.16:0/1706681584 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7efe140e5fd0 con 0x7efe241087d0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.565+0000 7efe29e23640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe100b53b0 0x7efe100b7870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe20031440 tx=0x7efe20005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.567+0000 7efe1affd640 1 -- 172.21.15.16:0/1706681584 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efe140acc10 con 0x7efe241087d0 2024-09-10T23:38:00.590 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:00 smithi066 systemd[1]: Starting Ceph mds.b for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:38:00.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.788+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe2410af30 con 0x7efe241087d0 2024-09-10T23:38:00.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.788+0000 7efe1affd640 1 -- 172.21.15.16:0/1706681584 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9683 (secure 0 0 0) 0x7efe140b1640 con 0x7efe241087d0 2024-09-10T23:38:00.790 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:00.790 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":12,"btime":"2024-09-10T23:37:58:550667+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24563,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24610,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T23:38:00.790 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 12 2024-09-10T23:38:00.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.790+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe100b53b0 msgr2=0x7efe100b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:00.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.790+0000 7efe2c087640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe100b53b0 0x7efe100b7870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe20031440 tx=0x7efe20005b50 comp rx=0 tx=0).stop 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.790+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe241087d0 msgr2=0x7efe240759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.790+0000 7efe2c087640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe241087d0 0x7efe240759e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efe1400e9f0 tx=0x7efe1400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 shutdown_connections 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe100b53b0 0x7efe100b7870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109150 0x7efe24075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe241087d0 0x7efe240759e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 --2- 172.21.15.16:0/1706681584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe24102dc0 0x7efe240754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 >> 172.21.15.16:0/1706681584 conn(0x7efe240fe830 msgr2=0x7efe24100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 shutdown_connections 2024-09-10T23:38:00.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:00.791+0000 7efe2c087640 1 -- 172.21.15.16:0/1706681584 wait complete. 2024-09-10T23:38:01.060 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:00 smithi066 podman[65902]: 2024-09-10 23:38:00.707456373 +0000 UTC m=+0.016328948 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:38:01.060 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:00 smithi066 podman[65902]: 2024-09-10 23:38:00.832330686 +0000 UTC m=+0.141203316 container create d3f88bd26baa7c071104820043cb3f4306bad8acdac9f9af91b07667e4e00184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T23:38:01.060 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:01 smithi066 podman[65902]: 2024-09-10 23:38:01.060281172 +0000 UTC m=+0.369153743 container init d3f88bd26baa7c071104820043cb3f4306bad8acdac9f9af91b07667e4e00184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T23:38:01.433 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:01 smithi066 podman[65902]: 2024-09-10 23:38:01.063316488 +0000 UTC m=+0.372189057 container start d3f88bd26baa7c071104820043cb3f4306bad8acdac9f9af91b07667e4e00184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:38:01.433 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mds[65921]: -- 172.21.15.66:0/3213361551 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558736e6d860 con 0x558736e4b400 2024-09-10T23:38:01.433 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b[65917]: starting mds.b at 2024-09-10T23:38:01.433 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:01 smithi066 bash[65902]: d3f88bd26baa7c071104820043cb3f4306bad8acdac9f9af91b07667e4e00184 2024-09-10T23:38:01.433 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:38:01 smithi066 systemd[1]: Started Ceph mds.b for 65d5fa74-6fcc-11ef-bcea-c7b262605968. 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1706681584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.439 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:01 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:38:01.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:01.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1706681584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:01 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1706681584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:01.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:01 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:38:02.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:02 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] up:boot 2024-09-10T23:38:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:02 smithi016 ceph-mon[30855]: fsmap 12 up:standby 2024-09-10T23:38:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:02 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:38:02.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:02 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] up:boot 2024-09-10T23:38:02.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:02 smithi071 ceph-mon[35018]: fsmap 12 up:standby 2024-09-10T23:38:02.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:02 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:38:02.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:02 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] up:boot 2024-09-10T23:38:02.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:02 smithi066 ceph-mon[34761]: fsmap 12 up:standby 2024-09-10T23:38:02.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:02 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:38:03.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:38:03.758 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:04.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:03 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.057 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:38:04.057 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:38:04.057 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.057 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:03 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:38:04.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:04.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:04.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:03 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:38:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 -- 172.21.15.16:0/274395528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c1076a0 msgr2=0x7f177c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 --2- 172.21.15.16:0/274395528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c1076a0 0x7f177c107ae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f176c009900 tx=0x7f176c02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 -- 172.21.15.16:0/274395528 shutdown_connections 2024-09-10T23:38:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 --2- 172.21.15.16:0/274395528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f177c108020 0x7f177c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 --2- 172.21.15.16:0/274395528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c1076a0 0x7f177c107ae0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 --2- 172.21.15.16:0/274395528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f177c101c90 0x7f177c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 -- 172.21.15.16:0/274395528 >> 172.21.15.16:0/274395528 conn(0x7f177c0fd700 msgr2=0x7f177c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 -- 172.21.15.16:0/274395528 shutdown_connections 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 -- 172.21.15.16:0/274395528 wait complete. 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 Processor -- start 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.060+0000 7f1783d68640 1 -- start start 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1783d68640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f177c101c90 0x7f177c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1783d68640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f177c1076a0 0x7f177c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1783d68640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c108020 0x7f177c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1783d68640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f177c112dc0 con 0x7f177c108020 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1783d68640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f177c112c40 con 0x7f177c101c90 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1783d68640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f177c112f40 con 0x7f177c1076a0 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c108020 0x7f177c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c108020 0x7f177c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36272/0 (socket says 172.21.15.16:36272) 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 -- 172.21.15.16:0/1117651580 learned_addr learned my addr 172.21.15.16:0/1117651580 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1781303640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f177c1076a0 0x7f177c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1781b04640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f177c101c90 0x7f177c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 -- 172.21.15.16:0/1117651580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f177c1076a0 msgr2=0x7f177c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f177c1076a0 0x7f177c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 -- 172.21.15.16:0/1117651580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f177c101c90 msgr2=0x7f177c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f177c101c90 0x7f177c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 -- 172.21.15.16:0/1117651580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c19f360 con 0x7f177c108020 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1781b04640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f177c101c90 0x7f177c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1782305640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c108020 0x7f177c19eb90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f177400eb10 tx=0x7f177400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1772ffd640 1 -- 172.21.15.16:0/1117651580 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774004b20 con 0x7f177c108020 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.061+0000 7f1772ffd640 1 -- 172.21.15.16:0/1117651580 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1774004cc0 con 0x7f177c108020 2024-09-10T23:38:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.062+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177c19f650 con 0x7f177c108020 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.062+0000 7f1772ffd640 1 -- 172.21.15.16:0/1117651580 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774010670 con 0x7f177c108020 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.062+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177c1a5ee0 con 0x7f177c108020 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.063+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177c102f40 con 0x7f177c108020 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.064+0000 7f1772ffd640 1 -- 172.21.15.16:0/1117651580 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f1774005020 con 0x7f177c108020 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.065+0000 7f1772ffd640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17680b53b0 0x7f17680b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.065+0000 7f1781b04640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17680b53b0 0x7f17680b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.065+0000 7f1772ffd640 1 -- 172.21.15.16:0/1117651580 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f17740e5e90 con 0x7f177c108020 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.065+0000 7f1781b04640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17680b53b0 0x7f17680b7870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17780058c0 tx=0x7f1778005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.069+0000 7f1772ffd640 1 -- 172.21.15.16:0/1117651580 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f17740ad080 con 0x7f177c108020 2024-09-10T23:38:05.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.302+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f177c102070 con 0x7f177c108020 2024-09-10T23:38:05.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.302+0000 7f1772ffd640 1 -- 172.21.15.16:0/1117651580 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7f177c102070 con 0x7f177c108020 2024-09-10T23:38:05.303 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:05.304 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"btime":"2024-09-10T23:38:01:431979+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24563,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24578,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24589,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24610,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T23:38:05.304 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17680b53b0 msgr2=0x7f17680b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17680b53b0 0x7f17680b7870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17780058c0 tx=0x7f1778005850 comp rx=0 tx=0).stop 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c108020 msgr2=0x7f177c19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c108020 0x7f177c19eb90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f177400eb10 tx=0x7f177400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 shutdown_connections 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f177c108020 0x7f177c19eb90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f177c1076a0 0x7f177c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f17680b53b0 0x7f17680b7870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 --2- 172.21.15.16:0/1117651580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f177c101c90 0x7f177c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 >> 172.21.15.16:0/1117651580 conn(0x7f177c0fd700 msgr2=0x7f177c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:05.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 shutdown_connections 2024-09-10T23:38:05.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:05.305+0000 7f1783d68640 1 -- 172.21.15.16:0/1117651580 wait complete. 2024-09-10T23:38:05.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:05 smithi016 ceph-mon[30855]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:05.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:05.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:05.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:05.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:05 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:05.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:05 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1117651580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:06.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T23:38:06.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:05 smithi071 ceph-mon[35018]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:06.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:05 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:05 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1117651580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:06.293 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:06.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:05 smithi066 ceph-mon[34761]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:06.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:05 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:06.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:05 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1117651580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 -- 172.21.15.16:0/1992559516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80075540 msgr2=0x7f9a80075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 --2- 172.21.15.16:0/1992559516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80075540 0x7f9a80075920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009900 tx=0x7f9a7c02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 -- 172.21.15.16:0/1992559516 shutdown_connections 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 --2- 172.21.15.16:0/1992559516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a80113b20 0x7f9a80115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 --2- 172.21.15.16:0/1992559516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a80075e60 0x7f9a801135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 --2- 172.21.15.16:0/1992559516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80075540 0x7f9a80075920 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 -- 172.21.15.16:0/1992559516 >> 172.21.15.16:0/1992559516 conn(0x7f9a800fe830 msgr2=0x7f9a80100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 -- 172.21.15.16:0/1992559516 shutdown_connections 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.827+0000 7f9a880a5640 1 -- 172.21.15.16:0/1992559516 wait complete. 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 Processor -- start 2024-09-10T23:38:06.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 -- start start 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a80075540 0x7f9a8019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a80075e60 0x7f9a8019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80113b20 0x7f9a801a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a801193a0 con 0x7f9a80113b20 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9a80119220 con 0x7f9a80075540 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.828+0000 7f9a880a5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9a80119520 con 0x7f9a80075e60 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80113b20 0x7f9a801a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80113b20 0x7f9a801a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36294/0 (socket says 172.21.15.16:36294) 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 -- 172.21.15.16:0/3797397320 learned_addr learned my addr 172.21.15.16:0/3797397320 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a85640640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a80075e60 0x7f9a8019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a85e41640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a80075540 0x7f9a8019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 -- 172.21.15.16:0/3797397320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a80075e60 msgr2=0x7f9a8019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a80075e60 0x7f9a8019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:06.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 -- 172.21.15.16:0/3797397320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a80075540 msgr2=0x7f9a8019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a80075540 0x7f9a8019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 -- 172.21.15.16:0/3797397320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a801a5900 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a86642640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80113b20 0x7f9a801a5130 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800ccb0 tx=0x7f9a7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a76ffd640 1 -- 172.21.15.16:0/3797397320 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800f450 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a76ffd640 1 -- 172.21.15.16:0/3797397320 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a7800faa0 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a801a5bf0 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a76ffd640 1 -- 172.21.15.16:0/3797397320 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78018b00 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.829+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a801ac2b0 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.830+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a80075920 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.832+0000 7f9a76ffd640 1 -- 172.21.15.16:0/3797397320 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f9a7800f5f0 con 0x7f9a80113b20 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.833+0000 7f9a76ffd640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9a6c0b5330 0x7f9a6c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.833+0000 7f9a85e41640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9a6c0b5330 0x7f9a6c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:06.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.833+0000 7f9a76ffd640 1 -- 172.21.15.16:0/3797397320 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f9a780e6090 con 0x7f9a80113b20 2024-09-10T23:38:06.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.833+0000 7f9a85e41640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9a6c0b5330 0x7f9a6c0b77f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c031440 tx=0x7f9a7c0095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:06.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:06.835+0000 7f9a76ffd640 1 -- 172.21.15.16:0/3797397320 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a78014030 con 0x7f9a80113b20 2024-09-10T23:38:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.022+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9a801ac650 con 0x7f9a80113b20 2024-09-10T23:38:07.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.023+0000 7f9a76ffd640 1 -- 172.21.15.16:0/3797397320 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f9a780ad3b0 con 0x7f9a80113b20 2024-09-10T23:38:07.024 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:07.024 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-09-10T23:38:07.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:38:07.024 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-09-10T23:38:07.024 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-09-10T23:38:07.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:38:07.025 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-09-10T23:38:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9a6c0b5330 msgr2=0x7f9a6c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9a6c0b5330 0x7f9a6c0b77f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c031440 tx=0x7f9a7c0095f0 comp rx=0 tx=0).stop 2024-09-10T23:38:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80113b20 msgr2=0x7f9a801a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80113b20 0x7f9a801a5130 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800ccb0 tx=0x7f9a7800a620 comp rx=0 tx=0).stop 2024-09-10T23:38:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 shutdown_connections 2024-09-10T23:38:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a80113b20 0x7f9a801a5130 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a80075e60 0x7f9a8019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9a6c0b5330 0x7f9a6c0b77f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 --2- 172.21.15.16:0/3797397320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a80075540 0x7f9a8019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 >> 172.21.15.16:0/3797397320 conn(0x7f9a800fe830 msgr2=0x7f9a800ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 shutdown_connections 2024-09-10T23:38:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:07.026+0000 7f9a880a5640 1 -- 172.21.15.16:0/3797397320 wait complete. 2024-09-10T23:38:07.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:07 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:07 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:07 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:38:07.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:07 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:38:07.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:07 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:07 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3797397320' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:38:07.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:07 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:07 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:07 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:38:07.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:07 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:38:07.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:07 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:07 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3797397320' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:38:07.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:07 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:07 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:07 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:38:07.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:07 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:38:07.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:07 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:38:07.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:07 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3797397320' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:38:07.786 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:38:07.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:38:08.050 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:08.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:08 smithi016 ceph-mon[30855]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:08.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:08 smithi071 ceph-mon[35018]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:08.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:08 smithi066 ceph-mon[34761]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 -- 172.21.15.16:0/2535654226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910108020 msgr2=0x7f091010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 --2- 172.21.15.16:0/2535654226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910108020 0x7f091010e820 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0908009ca0 tx=0x7f090802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 -- 172.21.15.16:0/2535654226 shutdown_connections 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 --2- 172.21.15.16:0/2535654226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910108020 0x7f091010e820 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 --2- 172.21.15.16:0/2535654226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09101076a0 0x7f0910107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 --2- 172.21.15.16:0/2535654226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0910101c90 0x7f0910102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 -- 172.21.15.16:0/2535654226 >> 172.21.15.16:0/2535654226 conn(0x7f09100fd700 msgr2=0x7f09100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:08.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 -- 172.21.15.16:0/2535654226 shutdown_connections 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.597+0000 7f091630f640 1 -- 172.21.15.16:0/2535654226 wait complete. 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 Processor -- start 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 -- start start 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910101c90 0x7f091010f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09101076a0 0x7f091010f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0910108020 0x7f091010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0910112dc0 con 0x7f0910101c90 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0910112c40 con 0x7f0910108020 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f091630f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0910112f40 con 0x7f09101076a0 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f090ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910101c90 0x7f091010f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f090ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910101c90 0x7f091010f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36318/0 (socket says 172.21.15.16:36318) 2024-09-10T23:38:08.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f090ffff640 1 -- 172.21.15.16:0/1789826891 learned_addr learned my addr 172.21.15.16:0/1789826891 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f090f7fe640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09101076a0 0x7f091010f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f09148ac640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0910108020 0x7f091010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f090ffff640 1 -- 172.21.15.16:0/1789826891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09101076a0 msgr2=0x7f091010f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f090ffff640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09101076a0 0x7f091010f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.598+0000 7f090ffff640 1 -- 172.21.15.16:0/1789826891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0910108020 msgr2=0x7f091010fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f090ffff640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0910108020 0x7f091010fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f090ffff640 1 -- 172.21.15.16:0/1789826891 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09101a7630 con 0x7f0910101c90 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f090ffff640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910101c90 0x7f091010f330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f090000c970 tx=0x7f090000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f090d7fa640 1 -- 172.21.15.16:0/1789826891 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900007bb0 con 0x7f0910101c90 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09101a7920 con 0x7f0910101c90 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f090d7fa640 1 -- 172.21.15.16:0/1789826891 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0900007d50 con 0x7f0910101c90 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f090d7fa640 1 -- 172.21.15.16:0/1789826891 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090000f450 con 0x7f0910101c90 2024-09-10T23:38:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.599+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09101a7e10 con 0x7f0910101c90 2024-09-10T23:38:08.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.600+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0910102070 con 0x7f0910101c90 2024-09-10T23:38:08.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.601+0000 7f090d7fa640 1 -- 172.21.15.16:0/1789826891 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f0900004f00 con 0x7f0910101c90 2024-09-10T23:38:08.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.602+0000 7f090d7fa640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f08f80b5330 0x7f08f80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:08.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.602+0000 7f090f7fe640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f08f80b5330 0x7f08f80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:08.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.602+0000 7f090d7fa640 1 -- 172.21.15.16:0/1789826891 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f09000e5860 con 0x7f0910101c90 2024-09-10T23:38:08.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.602+0000 7f090f7fe640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f08f80b5330 0x7f08f80b77f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0910110e20 tx=0x7f090400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:08.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.605+0000 7f090d7fa640 1 -- 172.21.15.16:0/1789826891 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0900014030 con 0x7f0910101c90 2024-09-10T23:38:08.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:08.792+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f091002e5c0 con 0x7f0910101c90 2024-09-10T23:38:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.191+0000 7f090d7fa640 1 -- 172.21.15.16:0/1789826891 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f09000ac4a0 con 0x7f0910101c90 2024-09-10T23:38:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-09-10T23:38:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f08f80b5330 msgr2=0x7f08f80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f08f80b5330 0x7f08f80b77f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0910110e20 tx=0x7f090400b390 comp rx=0 tx=0).stop 2024-09-10T23:38:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910101c90 msgr2=0x7f091010f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910101c90 0x7f091010f330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f090000c970 tx=0x7f090000ce30 comp rx=0 tx=0).stop 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 shutdown_connections 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f08f80b5330 0x7f08f80b77f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0910108020 0x7f091010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09101076a0 0x7f091010f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 --2- 172.21.15.16:0/1789826891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0910101c90 0x7f091010f330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.194+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 >> 172.21.15.16:0/1789826891 conn(0x7f09100fd700 msgr2=0x7f09100fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.195+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 shutdown_connections 2024-09-10T23:38:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:09.195+0000 7f091630f640 1 -- 172.21.15.16:0/1789826891 wait complete. 2024-09-10T23:38:09.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1789826891' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:38:09.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1789826891' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:38:09.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1789826891' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:38:09.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:38:10.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:10 smithi016 ceph-mon[30855]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:10.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:10 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1789826891' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:38:10.207 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:10 smithi016 ceph-mon[30855]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:38:10.212 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:10.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:10 smithi071 ceph-mon[35018]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:10.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:10 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1789826891' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:38:10.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:10 smithi071 ceph-mon[35018]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:38:10.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:10 smithi066 ceph-mon[34761]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:10.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:10 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1789826891' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:38:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:10 smithi066 ceph-mon[34761]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 -- 172.21.15.16:0/3739624047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4104600 msgr2=0x7fc6f410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/3739624047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4104600 0x7fc6f410caf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009900 tx=0x7fc6e802a410 comp rx=0 tx=0).stop 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 -- 172.21.15.16:0/3739624047 shutdown_connections 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/3739624047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f410d140 0x7fc6f410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/3739624047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4104600 0x7fc6f410caf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/3739624047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6f4103ce0 0x7fc6f41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 -- 172.21.15.16:0/3739624047 >> 172.21.15.16:0/3739624047 conn(0x7fc6f40fd700 msgr2=0x7fc6f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 -- 172.21.15.16:0/3739624047 shutdown_connections 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.826+0000 7fc6f99a2640 1 -- 172.21.15.16:0/3739624047 wait complete. 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 Processor -- start 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 -- start start 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4103ce0 0x7fc6f41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f4104600 0x7fc6f4199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6f410d140 0x7fc6f419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4112db0 con 0x7fc6f4103ce0 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4112c30 con 0x7fc6f410d140 2024-09-10T23:38:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.827+0000 7fc6f99a2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4112f30 con 0x7fc6f4104600 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4103ce0 0x7fc6f41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4103ce0 0x7fc6f41992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36344/0 (socket says 172.21.15.16:36344) 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 -- 172.21.15.16:0/2980915936 learned_addr learned my addr 172.21.15.16:0/2980915936 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f37fe640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6f410d140 0x7fc6f419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f27fc640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f4104600 0x7fc6f4199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 -- 172.21.15.16:0/2980915936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f4104600 msgr2=0x7fc6f4199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f4104600 0x7fc6f4199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 -- 172.21.15.16:0/2980915936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6f410d140 msgr2=0x7fc6f419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6f410d140 0x7fc6f419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 -- 172.21.15.16:0/2980915936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f419f370 con 0x7fc6f4103ce0 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f2ffd640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4103ce0 0x7fc6f41992c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400e9f0 tx=0x7fc6e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f89a0640 1 -- 172.21.15.16:0/2980915936 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400cd80 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f89a0640 1 -- 172.21.15.16:0/2980915936 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e40108e0 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f419f660 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.828+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f41a5ef0 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.829+0000 7fc6f89a0640 1 -- 172.21.15.16:0/2980915936 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4018980 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.830+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f41040c0 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.831+0000 7fc6f89a0640 1 -- 172.21.15.16:0/2980915936 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc6e4010430 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.832+0000 7fc6f89a0640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6dc0b53b0 0x7fc6dc0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.832+0000 7fc6f27fc640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6dc0b53b0 0x7fc6dc0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.832+0000 7fc6f89a0640 1 -- 172.21.15.16:0/2980915936 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7fc6e40e5cc0 con 0x7fc6f4103ce0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.832+0000 7fc6f27fc640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6dc0b53b0 0x7fc6dc0b7870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000c00 tx=0x7fc6e8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:10.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:10.836+0000 7fc6f89a0640 1 -- 172.21.15.16:0/2980915936 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc6e40ac790 con 0x7fc6f4103ce0 2024-09-10T23:38:11.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.023+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc6f4108120 con 0x7fc6f4103ce0 2024-09-10T23:38:11.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.195+0000 7fc6f89a0640 1 -- 172.21.15.16:0/2980915936 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7fc6e40b11c0 con 0x7fc6f4103ce0 2024-09-10T23:38:11.196 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-09-10T23:38:11.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6dc0b53b0 msgr2=0x7fc6dc0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6dc0b53b0 0x7fc6dc0b7870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000c00 tx=0x7fc6e8031400 comp rx=0 tx=0).stop 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4103ce0 msgr2=0x7fc6f41992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4103ce0 0x7fc6f41992c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400e9f0 tx=0x7fc6e400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 shutdown_connections 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6dc0b53b0 0x7fc6dc0b7870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6f410d140 0x7fc6f419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f4104600 0x7fc6f4199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 --2- 172.21.15.16:0/2980915936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6f4103ce0 0x7fc6f41992c0 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400e9f0 tx=0x7fc6e400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:38:11.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.199+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 >> 172.21.15.16:0/2980915936 conn(0x7fc6f40fd700 msgr2=0x7fc6f40fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:11.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.200+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 shutdown_connections 2024-09-10T23:38:11.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:11.200+0000 7fc6f99a2640 1 -- 172.21.15.16:0/2980915936 wait complete. 2024-09-10T23:38:11.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:11 smithi016 ceph-mon[30855]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:38:11.488 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:11 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2980915936' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:38:11.488 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:11 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2980915936' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:38:11.488 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:11 smithi016 ceph-mon[30855]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:38:11.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:11 smithi071 ceph-mon[35018]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:38:11.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:11 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2980915936' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:38:11.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:11 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2980915936' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:38:11.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:11 smithi071 ceph-mon[35018]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:38:11.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:11 smithi066 ceph-mon[34761]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:38:11.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:11 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2980915936' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:38:11.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:11 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2980915936' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:38:11.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:11 smithi066 ceph-mon[34761]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:38:11.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:38:12.220 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:12 smithi016 ceph-mon[30855]: pgmap v254: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:12.220 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:12 smithi016 ceph-mon[30855]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:38:12.229 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:12.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:12 smithi016 ceph-mon[30855]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:38:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:12 smithi071 ceph-mon[35018]: pgmap v254: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:12.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:12 smithi071 ceph-mon[35018]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:38:12.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:12 smithi071 ceph-mon[35018]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:38:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:12 smithi066 ceph-mon[34761]: pgmap v254: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:12 smithi066 ceph-mon[34761]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:38:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:12 smithi066 ceph-mon[34761]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 -- 172.21.15.16:0/2735679984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 msgr2=0x7fe3a41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 --2- 172.21.15.16:0/2735679984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a41020b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe394009900 tx=0x7fe39402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 -- 172.21.15.16:0/2735679984 shutdown_connections 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 --2- 172.21.15.16:0/2735679984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3a4108060 0x7fe3a410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 --2- 172.21.15.16:0/2735679984 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a41076e0 0x7fe3a4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 --2- 172.21.15.16:0/2735679984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a41020b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 -- 172.21.15.16:0/2735679984 >> 172.21.15.16:0/2735679984 conn(0x7fe3a40fd700 msgr2=0x7fe3a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 -- 172.21.15.16:0/2735679984 shutdown_connections 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.753+0000 7fe3aa751640 1 -- 172.21.15.16:0/2735679984 wait complete. 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 Processor -- start 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 -- start start 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a41076e0 0x7fe3a4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3a4108060 0x7fe3a419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4111d20 con 0x7fe3a4101cd0 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4111ba0 con 0x7fe3a4108060 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3aa751640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4111ea0 con 0x7fe3a41076e0 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.754+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36376/0 (socket says 172.21.15.16:36376) 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 -- 172.21.15.16:0/3148226880 learned_addr learned my addr 172.21.15.16:0/3148226880 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a37fe640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a41076e0 0x7fe3a4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a8cee640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3a4108060 0x7fe3a419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 -- 172.21.15.16:0/3148226880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a41076e0 msgr2=0x7fe3a4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a41076e0 0x7fe3a4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 -- 172.21.15.16:0/3148226880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3a4108060 msgr2=0x7fe3a419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3a4108060 0x7fe3a419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 -- 172.21.15.16:0/3148226880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a419f3b0 con 0x7fe3a4101cd0 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a8cee640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3a4108060 0x7fe3a419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a3fff640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a4199300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe394006010 tx=0x7fe3940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a17fa640 1 -- 172.21.15.16:0/3148226880 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39403f030 con 0x7fe3a4101cd0 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a17fa640 1 -- 172.21.15.16:0/3148226880 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe394003800 con 0x7fe3a4101cd0 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a419f640 con 0x7fe3a4101cd0 2024-09-10T23:38:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3a17fa640 1 -- 172.21.15.16:0/3148226880 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394035070 con 0x7fe3a4101cd0 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.755+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a41a5d60 con 0x7fe3a4101cd0 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.756+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a41020b0 con 0x7fe3a4101cd0 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.758+0000 7fe3a17fa640 1 -- 172.21.15.16:0/3148226880 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fe394003cb0 con 0x7fe3a4101cd0 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.758+0000 7fe3a17fa640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe38c0b53b0 0x7fe38c0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.759+0000 7fe3a37fe640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe38c0b53b0 0x7fe38c0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.759+0000 7fe3a17fa640 1 -- 172.21.15.16:0/3148226880 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7fe394106610 con 0x7fe3a4101cd0 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.759+0000 7fe3a37fe640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe38c0b53b0 0x7fe38c0b7870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4107390 tx=0x7fe398009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.762+0000 7fe3a17fa640 1 -- 172.21.15.16:0/3148226880 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe3940cd5b0 con 0x7fe3a4101cd0 2024-09-10T23:38:12.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:12.986+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe3a419a430 con 0x7fe3a4101cd0 2024-09-10T23:38:13.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.229+0000 7fe3a17fa640 1 -- 172.21.15.16:0/3148226880 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fe3a419a430 con 0x7fe3a4101cd0 2024-09-10T23:38:13.230 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T23:38:13.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.231+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe38c0b53b0 msgr2=0x7fe38c0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.231+0000 7fe3aa751640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe38c0b53b0 0x7fe38c0b7870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4107390 tx=0x7fe398009110 comp rx=0 tx=0).stop 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.231+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 msgr2=0x7fe3a4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.231+0000 7fe3aa751640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a4199300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe394006010 tx=0x7fe3940042f0 comp rx=0 tx=0).stop 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 shutdown_connections 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe38c0b53b0 0x7fe38c0b7870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3a4108060 0x7fe3a419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a41076e0 0x7fe3a4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 --2- 172.21.15.16:0/3148226880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3a4101cd0 0x7fe3a4199300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 >> 172.21.15.16:0/3148226880 conn(0x7fe3a40fd700 msgr2=0x7fe3a406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 shutdown_connections 2024-09-10T23:38:13.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:13.232+0000 7fe3aa751640 1 -- 172.21.15.16:0/3148226880 wait complete. 2024-09-10T23:38:13.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:13 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3148226880' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:38:13.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:13 smithi016 ceph-mon[30855]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T23:38:13.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:13 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3148226880' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:38:13.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:13 smithi071 ceph-mon[35018]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T23:38:13.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:13 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3148226880' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:38:13.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:13 smithi066 ceph-mon[34761]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T23:38:14.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:38:14.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:14 smithi016 ceph-mon[30855]: pgmap v257: 97 pgs: 29 creating+peering, 34 unknown, 34 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:14.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:14 smithi016 ceph-mon[30855]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:38:14.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:14 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3148226880' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:38:14.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:14 smithi016 ceph-mon[30855]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T23:38:14.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:14 smithi016 ceph-mon[30855]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T23:38:14.318 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:14.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:14 smithi071 ceph-mon[35018]: pgmap v257: 97 pgs: 29 creating+peering, 34 unknown, 34 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:14.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:14 smithi071 ceph-mon[35018]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:38:14.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:14 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3148226880' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:38:14.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:14 smithi071 ceph-mon[35018]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T23:38:14.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:14 smithi071 ceph-mon[35018]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T23:38:14.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:14 smithi066 ceph-mon[34761]: pgmap v257: 97 pgs: 29 creating+peering, 34 unknown, 34 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:14 smithi066 ceph-mon[34761]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:38:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:14 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3148226880' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:38:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:14 smithi066 ceph-mon[34761]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T23:38:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:14 smithi066 ceph-mon[34761]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T23:38:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 -- 172.21.15.16:0/1948292571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 msgr2=0x7f2b701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1948292571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b701020b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009900 tx=0x7f2b6c02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 -- 172.21.15.16:0/1948292571 shutdown_connections 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1948292571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b70108060 0x7f2b7010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1948292571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b701076e0 0x7f2b70107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1948292571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b701020b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 -- 172.21.15.16:0/1948292571 >> 172.21.15.16:0/1948292571 conn(0x7f2b700fd700 msgr2=0x7f2b700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 -- 172.21.15.16:0/1948292571 shutdown_connections 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.815+0000 7f2b77a56640 1 -- 172.21.15.16:0/1948292571 wait complete. 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 Processor -- start 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 -- start start 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b70197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b701076e0 0x7f2b70198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b70108060 0x7f2b70198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70111d20 con 0x7f2b70101cd0 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70111ba0 con 0x7f2b70108060 2024-09-10T23:38:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b77a56640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70111ea0 con 0x7f2b701076e0 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b757f2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b70197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b757f2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b70197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39136/0 (socket says 172.21.15.16:39136) 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b757f2640 1 -- 172.21.15.16:0/1232287714 learned_addr learned my addr 172.21.15.16:0/1232287714 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b75ff3640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b70108060 0x7f2b70198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.816+0000 7f2b74ff1640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b701076e0 0x7f2b70198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b757f2640 1 -- 172.21.15.16:0/1232287714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b701076e0 msgr2=0x7f2b70198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b757f2640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b701076e0 0x7f2b70198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b757f2640 1 -- 172.21.15.16:0/1232287714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b70108060 msgr2=0x7f2b70198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b757f2640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b70108060 0x7f2b70198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b757f2640 1 -- 172.21.15.16:0/1232287714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b701a76c0 con 0x7f2b70101cd0 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b75ff3640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b70108060 0x7f2b70198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b757f2640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b70197ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c005940 tx=0x7f2b6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b667fc640 1 -- 172.21.15.16:0/1232287714 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c03f030 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b667fc640 1 -- 172.21.15.16:0/1232287714 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b6c003cb0 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b701a7950 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b667fc640 1 -- 172.21.15.16:0/1232287714 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c035070 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.817+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b701a7e30 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.818+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b701020b0 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.820+0000 7f2b667fc640 1 -- 172.21.15.16:0/1232287714 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f2b6c03bbf0 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.820+0000 7f2b667fc640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2b5c0b5330 0x7f2b5c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.821+0000 7f2b667fc640 1 -- 172.21.15.16:0/1232287714 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f2b6c106a70 con 0x7f2b70101cd0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.821+0000 7f2b74ff1640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2b5c0b5330 0x7f2b5c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.821+0000 7f2b74ff1640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2b5c0b5330 0x7f2b5c0b77f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b60005fd0 tx=0x7f2b60005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:14.824+0000 7f2b667fc640 1 -- 172.21.15.16:0/1232287714 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2b6c0cd950 con 0x7f2b70101cd0 2024-09-10T23:38:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.013+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b7002e5c0 con 0x7f2b70101cd0 2024-09-10T23:38:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.014+0000 7f2b667fc640 1 -- 172.21.15.16:0/1232287714 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22511 (secure 0 0 0) 0x7f2b6c0cd250 con 0x7f2b70101cd0 2024-09-10T23:38:15.016 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:15.017 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:12.987918+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.016+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2b5c0b5330 msgr2=0x7f2b5c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.016+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2b5c0b5330 0x7f2b5c0b77f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b60005fd0 tx=0x7f2b60005850 comp rx=0 tx=0).stop 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 msgr2=0x7f2b70197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b70197ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c005940 tx=0x7f2b6c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 shutdown_connections 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2b5c0b5330 0x7f2b5c0b77f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b70108060 0x7f2b70198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b701076e0 0x7f2b70198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 --2- 172.21.15.16:0/1232287714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b70101cd0 0x7f2b70197ee0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 >> 172.21.15.16:0/1232287714 conn(0x7f2b700fd700 msgr2=0x7f2b700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 shutdown_connections 2024-09-10T23:38:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:15.017+0000 7f2b77a56640 1 -- 172.21.15.16:0/1232287714 wait complete. 2024-09-10T23:38:15.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:15 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] up:active 2024-09-10T23:38:15.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:15 smithi016 ceph-mon[30855]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:15.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:15 smithi016 ceph-mon[30855]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:15.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:15 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1232287714' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:15.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:15 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] up:active 2024-09-10T23:38:15.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:15 smithi071 ceph-mon[35018]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:15.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:15 smithi071 ceph-mon[35018]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:15.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:15 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1232287714' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:15.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:15 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] up:active 2024-09-10T23:38:15.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:15 smithi066 ceph-mon[34761]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:15.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:15 smithi066 ceph-mon[34761]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:15.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:15 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1232287714' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:15.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:38:16.010 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:16.441 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:16 smithi016 ceph-mon[30855]: pgmap v259: 97 pgs: 29 creating+peering, 20 unknown, 48 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:16.442 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:16 smithi016 ceph-mon[30855]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:38:16.442 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:16 smithi016 ceph-mon[30855]: Cluster is now healthy 2024-09-10T23:38:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:16 smithi071 ceph-mon[35018]: pgmap v259: 97 pgs: 29 creating+peering, 20 unknown, 48 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:16.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:16 smithi071 ceph-mon[35018]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:38:16.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:16 smithi071 ceph-mon[35018]: Cluster is now healthy 2024-09-10T23:38:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 -- 172.21.15.16:0/3385573723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1564108020 msgr2=0x7f156410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 --2- 172.21.15.16:0/3385573723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1564108020 0x7f156410e820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f155c009ca0 tx=0x7f155c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 -- 172.21.15.16:0/3385573723 shutdown_connections 2024-09-10T23:38:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 --2- 172.21.15.16:0/3385573723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1564108020 0x7f156410e820 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 --2- 172.21.15.16:0/3385573723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15641076a0 0x7f1564107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 --2- 172.21.15.16:0/3385573723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1564101c90 0x7f1564102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 -- 172.21.15.16:0/3385573723 >> 172.21.15.16:0/3385573723 conn(0x7f15640fd700 msgr2=0x7f15640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 -- 172.21.15.16:0/3385573723 shutdown_connections 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 -- 172.21.15.16:0/3385573723 wait complete. 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.523+0000 7f1569c38640 1 Processor -- start 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1569c38640 1 -- start start 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1569c38640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1564101c90 0x7f156419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1569c38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15641076a0 0x7f156419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1569c38640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1564108020 0x7f156419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1569c38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1564111ce0 con 0x7f15641076a0 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1569c38640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1564111b60 con 0x7f1564101c90 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1569c38640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1564111e60 con 0x7f1564108020 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15641076a0 0x7f156419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15641076a0 0x7f156419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39156/0 (socket says 172.21.15.16:39156) 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 -- 172.21.15.16:0/1001659553 learned_addr learned my addr 172.21.15.16:0/1001659553 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f15637fe640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1564101c90 0x7f156419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1563fff640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1564108020 0x7f156419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 -- 172.21.15.16:0/1001659553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1564108020 msgr2=0x7f156419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1564108020 0x7f156419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 -- 172.21.15.16:0/1001659553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1564101c90 msgr2=0x7f156419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1564101c90 0x7f156419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 -- 172.21.15.16:0/1001659553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15641a5440 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1562ffd640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15641076a0 0x7f156419a5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f154c00e9f0 tx=0x7f154c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.524+0000 7f1560ff9640 1 -- 172.21.15.16:0/1001659553 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c00cd80 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.525+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15641a5730 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.525+0000 7f1560ff9640 1 -- 172.21.15.16:0/1001659553 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f154c0108e0 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.525+0000 7f1560ff9640 1 -- 172.21.15.16:0/1001659553 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c018980 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.525+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15641a5cc0 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.526+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1564102070 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.527+0000 7f1560ff9640 1 -- 172.21.15.16:0/1001659553 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f154c010430 con 0x7f15641076a0 2024-09-10T23:38:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.528+0000 7f1560ff9640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f15500b5330 0x7f15500b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.528+0000 7f15637fe640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f15500b5330 0x7f15500b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.528+0000 7f1560ff9640 1 -- 172.21.15.16:0/1001659553 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f154c0e6470 con 0x7f15641076a0 2024-09-10T23:38:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.528+0000 7f15637fe640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f15500b5330 0x7f15500b77f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1554009bd0 tx=0x7f1554005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.531+0000 7f1560ff9640 1 -- 172.21.15.16:0/1001659553 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f154c0acca0 con 0x7f15641076a0 2024-09-10T23:38:16.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:16 smithi066 ceph-mon[34761]: pgmap v259: 97 pgs: 29 creating+peering, 20 unknown, 48 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:38:16.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:16 smithi066 ceph-mon[34761]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:38:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:16 smithi066 ceph-mon[34761]: Cluster is now healthy 2024-09-10T23:38:16.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.719+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f156402e5c0 con 0x7f15641076a0 2024-09-10T23:38:16.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.721+0000 7f1560ff9640 1 -- 172.21.15.16:0/1001659553 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22511 (secure 0 0 0) 0x7f154c0b16d0 con 0x7f15641076a0 2024-09-10T23:38:16.722 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:16.722 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:12.987918+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f15500b5330 msgr2=0x7f15500b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f15500b5330 0x7f15500b77f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1554009bd0 tx=0x7f1554005f90 comp rx=0 tx=0).stop 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15641076a0 msgr2=0x7f156419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15641076a0 0x7f156419a5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f154c00e9f0 tx=0x7f154c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 shutdown_connections 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1564108020 0x7f156419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15641076a0 0x7f156419a5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f15500b5330 0x7f15500b77f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 --2- 172.21.15.16:0/1001659553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1564101c90 0x7f156419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 >> 172.21.15.16:0/1001659553 conn(0x7f15640fd700 msgr2=0x7f15640ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:16.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 shutdown_connections 2024-09-10T23:38:16.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:16.723+0000 7f1569c38640 1 -- 172.21.15.16:0/1001659553 wait complete. 2024-09-10T23:38:17.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:17 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1001659553' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:17.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:17 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1001659553' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:17.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:38:17.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:17 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1001659553' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:18.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 -- 172.21.15.16:0/1372454505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c101c90 msgr2=0x7f5f4c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:18.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 --2- 172.21.15.16:0/1372454505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c101c90 0x7f5f4c102070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009900 tx=0x7f5f4802a410 comp rx=0 tx=0).stop 2024-09-10T23:38:18.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 -- 172.21.15.16:0/1372454505 shutdown_connections 2024-09-10T23:38:18.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 --2- 172.21.15.16:0/1372454505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4c108020 0x7f5f4c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:18.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 --2- 172.21.15.16:0/1372454505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f4c1076a0 0x7f5f4c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:18.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 --2- 172.21.15.16:0/1372454505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c101c90 0x7f5f4c102070 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:18.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 -- 172.21.15.16:0/1372454505 >> 172.21.15.16:0/1372454505 conn(0x7f5f4c0fd700 msgr2=0x7f5f4c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 -- 172.21.15.16:0/1372454505 shutdown_connections 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 -- 172.21.15.16:0/1372454505 wait complete. 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.279+0000 7f5f54377640 1 Processor -- start 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f54377640 1 -- start start 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f54377640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4c101c90 0x7f5f4c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f54377640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f4c1076a0 0x7f5f4c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f54377640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c108020 0x7f5f4c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f54377640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c111d20 con 0x7f5f4c108020 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f54377640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c111ba0 con 0x7f5f4c1076a0 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f54377640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c111ea0 con 0x7f5f4c101c90 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c108020 0x7f5f4c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c108020 0x7f5f4c19ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39186/0 (socket says 172.21.15.16:39186) 2024-09-10T23:38:18.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 -- 172.21.15.16:0/4160404251 learned_addr learned my addr 172.21.15.16:0/4160404251 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52113640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4c101c90 0x7f5f4c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f51912640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f4c1076a0 0x7f5f4c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 -- 172.21.15.16:0/4160404251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4c101c90 msgr2=0x7f5f4c19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4c101c90 0x7f5f4c19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 -- 172.21.15.16:0/4160404251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f4c1076a0 msgr2=0x7f5f4c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f4c1076a0 0x7f5f4c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 -- 172.21.15.16:0/4160404251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c1a55d0 con 0x7f5f4c108020 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52113640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4c101c90 0x7f5f4c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f52914640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c108020 0x7f5f4c19ac90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b970 tx=0x7f5f4400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.280+0000 7f5f437fe640 1 -- 172.21.15.16:0/4160404251 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44019070 con 0x7f5f4c108020 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.281+0000 7f5f437fe640 1 -- 172.21.15.16:0/4160404251 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f44014440 con 0x7f5f4c108020 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.281+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4c1a58c0 con 0x7f5f4c108020 2024-09-10T23:38:18.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.281+0000 7f5f437fe640 1 -- 172.21.15.16:0/4160404251 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f440075d0 con 0x7f5f4c108020 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.281+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4c1a5e30 con 0x7f5f4c108020 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.281+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4c1020f0 con 0x7f5f4c108020 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.283+0000 7f5f437fe640 1 -- 172.21.15.16:0/4160404251 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f5f4400cb40 con 0x7f5f4c108020 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.284+0000 7f5f437fe640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5f380b5330 0x7f5f380b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.284+0000 7f5f52113640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5f380b5330 0x7f5f380b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.284+0000 7f5f437fe640 1 -- 172.21.15.16:0/4160404251 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f5f440e58c0 con 0x7f5f4c108020 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.284+0000 7f5f52113640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5f380b5330 0x7f5f380b77f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f48031440 tx=0x7f5f480095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:18.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.287+0000 7f5f437fe640 1 -- 172.21.15.16:0/4160404251 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5f440ac7a0 con 0x7f5f4c108020 2024-09-10T23:38:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:18 smithi016 ceph-mon[30855]: pgmap v260: 97 pgs: 25 creating+peering, 72 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-10T23:38:18.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:18.510+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5f4c02e5c0 con 0x7f5f4c108020 2024-09-10T23:38:18.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:18 smithi071 ceph-mon[35018]: pgmap v260: 97 pgs: 25 creating+peering, 72 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-10T23:38:18.519 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:38:18 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: 2024-09-10T23:38:18.245+0000 7f1f23209640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:38:18.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:18 smithi066 ceph-mon[34761]: pgmap v260: 97 pgs: 25 creating+peering, 72 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-10T23:38:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.244+0000 7f5f437fe640 1 -- 172.21.15.16:0/4160404251 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f5f440ac0a0 con 0x7f5f4c108020 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5f380b5330 msgr2=0x7f5f380b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5f380b5330 0x7f5f380b77f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f48031440 tx=0x7f5f480095f0 comp rx=0 tx=0).stop 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c108020 msgr2=0x7f5f4c19ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c108020 0x7f5f4c19ac90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b970 tx=0x7f5f4400be30 comp rx=0 tx=0).stop 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 shutdown_connections 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c108020 0x7f5f4c19ac90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5f380b5330 0x7f5f380b77f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f4c1076a0 0x7f5f4c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 --2- 172.21.15.16:0/4160404251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f4c101c90 0x7f5f4c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 >> 172.21.15.16:0/4160404251 conn(0x7f5f4c0fd700 msgr2=0x7f5f4c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 shutdown_connections 2024-09-10T23:38:19.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:19.247+0000 7f5f54377640 1 -- 172.21.15.16:0/4160404251 wait complete. 2024-09-10T23:38:19.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:19 smithi071 ceph-mon[35018]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T23:38:19.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:19 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/4160404251' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:38:19.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:19 smithi066 ceph-mon[34761]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T23:38:19.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:19 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/4160404251' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:38:19.631 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:19 smithi016 ceph-mon[30855]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T23:38:19.631 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:19 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4160404251' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:38:19.982 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-10T23:38:19.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T23:38:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:20.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:20 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/4160404251' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:38:20.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:20 smithi071 ceph-mon[35018]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:20.548 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:20 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4160404251' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:38:20.549 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:20 smithi016 ceph-mon[30855]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:20.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:20 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/4160404251' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:38:20.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:20 smithi066 ceph-mon[34761]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:20.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 -- 172.21.15.16:0/1776909730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c1087d0 msgr2=0x7fac1c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:20.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 --2- 172.21.15.16:0/1776909730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c1087d0 0x7fac1c108c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac04009900 tx=0x7fac0402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 -- 172.21.15.16:0/1776909730 shutdown_connections 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 --2- 172.21.15.16:0/1776909730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac1c109150 0x7fac1c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 --2- 172.21.15.16:0/1776909730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c1087d0 0x7fac1c108c10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 --2- 172.21.15.16:0/1776909730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c102dc0 0x7fac1c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 -- 172.21.15.16:0/1776909730 >> 172.21.15.16:0/1776909730 conn(0x7fac1c0fe830 msgr2=0x7fac1c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 -- 172.21.15.16:0/1776909730 shutdown_connections 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.794+0000 7fac21afa640 1 -- 172.21.15.16:0/1776909730 wait complete. 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.795+0000 7fac21afa640 1 Processor -- start 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.795+0000 7fac21afa640 1 -- start start 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c102dc0 0x7fac1c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac1c1087d0 0x7fac1c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c109150 0x7fac1c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:20.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c112dd0 con 0x7fac1c102dc0 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c112c50 con 0x7fac1c1087d0 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c112f50 con 0x7fac1c109150 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c102dc0 0x7fac1c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c102dc0 0x7fac1c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39192/0 (socket says 172.21.15.16:39192) 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 -- 172.21.15.16:0/3825363164 learned_addr learned my addr 172.21.15.16:0/3825363164 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1affd640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac1c1087d0 0x7fac1c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1bfff640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c109150 0x7fac1c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 -- 172.21.15.16:0/3825363164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c109150 msgr2=0x7fac1c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c109150 0x7fac1c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 -- 172.21.15.16:0/3825363164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac1c1087d0 msgr2=0x7fac1c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac1c1087d0 0x7fac1c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 -- 172.21.15.16:0/3825363164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c1a7700 con 0x7fac1c102dc0 2024-09-10T23:38:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1bfff640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c109150 0x7fac1c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac1b7fe640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c102dc0 0x7fac1c0754a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c970 tx=0x7fac0c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac18ff9640 1 -- 172.21.15.16:0/3825363164 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c007bb0 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac18ff9640 1 -- 172.21.15.16:0/3825363164 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac0c007d50 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c1a79f0 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac18ff9640 1 -- 172.21.15.16:0/3825363164 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00f450 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.796+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c1a7eb0 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.798+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1c1031a0 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.799+0000 7fac18ff9640 1 -- 172.21.15.16:0/3825363164 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fac0c004f20 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.800+0000 7fac18ff9640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fac080b5330 0x7fac080b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.800+0000 7fac1affd640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fac080b5330 0x7fac080b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.800+0000 7fac18ff9640 1 -- 172.21.15.16:0/3825363164 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fac0c0e5a70 con 0x7fac1c102dc0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.800+0000 7fac1affd640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fac080b5330 0x7fac080b77f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac04031440 tx=0x7fac040095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:20.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:20.804+0000 7fac18ff9640 1 -- 172.21.15.16:0/3825363164 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fac0c014030 con 0x7fac1c102dc0 2024-09-10T23:38:21.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.028+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fac1c02e5c0 con 0x7fac1c102dc0 2024-09-10T23:38:21.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.250+0000 7fac18ff9640 1 -- 172.21.15.16:0/3825363164 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fac0c0ac8f0 con 0x7fac1c102dc0 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fac080b5330 msgr2=0x7fac080b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fac080b5330 0x7fac080b77f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fac04031440 tx=0x7fac040095f0 comp rx=0 tx=0).stop 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c102dc0 msgr2=0x7fac1c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c102dc0 0x7fac1c0754a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c970 tx=0x7fac0c00ce30 comp rx=0 tx=0).stop 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 shutdown_connections 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c109150 0x7fac1c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fac080b5330 0x7fac080b77f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac1c1087d0 0x7fac1c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 --2- 172.21.15.16:0/3825363164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac1c102dc0 0x7fac1c0754a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.253+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 >> 172.21.15.16:0/3825363164 conn(0x7fac1c0fe830 msgr2=0x7fac1c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.254+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 shutdown_connections 2024-09-10T23:38:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:21.254+0000 7fac21afa640 1 -- 172.21.15.16:0/3825363164 wait complete. 2024-09-10T23:38:21.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:21 smithi071 ceph-mon[35018]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T23:38:21.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:21 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3825363164' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:38:21.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:21 smithi066 ceph-mon[34761]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T23:38:21.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:21 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3825363164' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:38:21.649 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:21 smithi016 ceph-mon[30855]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T23:38:21.649 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:21 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3825363164' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:38:22.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T23:38:22.371 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:22 smithi016 ceph-mon[30855]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:38:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:22 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3825363164' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:38:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:22 smithi016 ceph-mon[30855]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:38:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:22 smithi016 ceph-mon[30855]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:22 smithi016 ceph-mon[30855]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T23:38:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:22 smithi016 ceph-mon[30855]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T23:38:22.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:22 smithi071 ceph-mon[35018]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:38:22.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:22 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3825363164' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:38:22.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:22 smithi071 ceph-mon[35018]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:38:22.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:22 smithi071 ceph-mon[35018]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:22.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:22 smithi071 ceph-mon[35018]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T23:38:22.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:22 smithi071 ceph-mon[35018]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T23:38:22.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:22 smithi066 ceph-mon[34761]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:38:22.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:22 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3825363164' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:38:22.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:22 smithi066 ceph-mon[34761]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:38:22.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:22 smithi066 ceph-mon[34761]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T23:38:22.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:22 smithi066 ceph-mon[34761]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T23:38:22.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:22 smithi066 ceph-mon[34761]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T23:38:22.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.837+0000 7f09a8ba9640 1 -- 172.21.15.16:0/2314485376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 msgr2=0x7f09a410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:22.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.837+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/2314485376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a410e820 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f099c009900 tx=0x7f099c02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:22.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 -- 172.21.15.16:0/2314485376 shutdown_connections 2024-09-10T23:38:22.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/2314485376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a410e820 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:22.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/2314485376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09a41076a0 0x7f09a4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:22.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/2314485376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a4101c90 0x7f09a4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 -- 172.21.15.16:0/2314485376 >> 172.21.15.16:0/2314485376 conn(0x7f09a40fd700 msgr2=0x7f09a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 -- 172.21.15.16:0/2314485376 shutdown_connections 2024-09-10T23:38:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 -- 172.21.15.16:0/2314485376 wait complete. 2024-09-10T23:38:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 Processor -- start 2024-09-10T23:38:22.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.838+0000 7f09a8ba9640 1 -- start start 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a8ba9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a4101c90 0x7f09a4199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a8ba9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09a41076a0 0x7f09a4199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a8ba9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a8ba9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4112e00 con 0x7f09a4108020 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a8ba9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4112c80 con 0x7f09a4101c90 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a8ba9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4112f80 con 0x7f09a41076a0 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:22.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a419eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39206/0 (socket says 172.21.15.16:39206) 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 -- 172.21.15.16:0/4158632326 learned_addr learned my addr 172.21.15.16:0/4158632326 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a1d9b640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09a41076a0 0x7f09a4199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a259c640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a4101c90 0x7f09a4199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 -- 172.21.15.16:0/4158632326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09a41076a0 msgr2=0x7f09a4199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09a41076a0 0x7f09a4199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 -- 172.21.15.16:0/4158632326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a4101c90 msgr2=0x7f09a4199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a4101c90 0x7f09a4199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 -- 172.21.15.16:0/4158632326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a419f2e0 con 0x7f09a4108020 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09a2d9d640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a419eb10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f099c004770 tx=0x7f099c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.839+0000 7f09937fe640 1 -- 172.21.15.16:0/4158632326 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c03f030 con 0x7f09a4108020 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.840+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a419f570 con 0x7f09a4108020 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.840+0000 7f09937fe640 1 -- 172.21.15.16:0/4158632326 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f099c003aa0 con 0x7f09a4108020 2024-09-10T23:38:22.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.840+0000 7f09937fe640 1 -- 172.21.15.16:0/4158632326 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c035070 con 0x7f09a4108020 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.840+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a41a5c90 con 0x7f09a4108020 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.841+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a4102070 con 0x7f09a4108020 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.842+0000 7f09937fe640 1 -- 172.21.15.16:0/4158632326 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f099c0035f0 con 0x7f09a4108020 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.843+0000 7f09937fe640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f098c0b5330 0x7f098c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.843+0000 7f09a259c640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f098c0b5330 0x7f098c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.843+0000 7f09937fe640 1 -- 172.21.15.16:0/4158632326 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f099c1068b0 con 0x7f09a4108020 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.843+0000 7f09a259c640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f098c0b5330 0x7f098c0b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f099400bbe0 tx=0x7f099400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:22.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:22.846+0000 7f09937fe640 1 -- 172.21.15.16:0/4158632326 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f099c0cd0e0 con 0x7f09a4108020 2024-09-10T23:38:23.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.069+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f09a419a360 con 0x7f09a4108020 2024-09-10T23:38:23.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.268+0000 7f09937fe640 1 -- 172.21.15.16:0/4158632326 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f09a419a360 con 0x7f09a4108020 2024-09-10T23:38:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f098c0b5330 msgr2=0x7f098c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f098c0b5330 0x7f098c0b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f099400bbe0 tx=0x7f099400b390 comp rx=0 tx=0).stop 2024-09-10T23:38:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 msgr2=0x7f09a419eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:23.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a419eb10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f099c004770 tx=0x7f099c004270 comp rx=0 tx=0).stop 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 shutdown_connections 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a4108020 0x7f09a419eb10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09a41076a0 0x7f09a4199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f098c0b5330 0x7f098c0b77f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 --2- 172.21.15.16:0/4158632326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a4101c90 0x7f09a4199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.270+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 >> 172.21.15.16:0/4158632326 conn(0x7f09a40fd700 msgr2=0x7f09a40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.271+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 shutdown_connections 2024-09-10T23:38:23.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:23.271+0000 7f09a8ba9640 1 -- 172.21.15.16:0/4158632326 wait complete. 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] up:active 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: Cluster is now healthy 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: pgmap v263: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-10T23:38:23.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:23 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4158632326' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:38:23.519 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: 2024-09-10T23:38:23.245+0000 7f1f23209640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] up:active 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: Cluster is now healthy 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: pgmap v263: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-10T23:38:23.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:23 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/4158632326' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:38:23.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] up:active 2024-09-10T23:38:23.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: Cluster is now healthy 2024-09-10T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: pgmap v263: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-10T23:38:23.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:23 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/4158632326' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:38:23.956 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T23:38:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:24.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:24 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/4158632326' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:38:24.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:24 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] up:active 2024-09-10T23:38:24.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:24 smithi066 ceph-mon[34761]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T23:38:24.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:24 smithi066 ceph-mon[34761]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:38:24.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:24 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4158632326' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:38:24.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:24 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] up:active 2024-09-10T23:38:24.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:24 smithi016 ceph-mon[30855]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T23:38:24.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:24 smithi016 ceph-mon[30855]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:38:24.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:24 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/4158632326' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:38:24.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:24 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] up:active 2024-09-10T23:38:24.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:24 smithi071 ceph-mon[35018]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T23:38:24.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:24 smithi071 ceph-mon[35018]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:38:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.723+0000 7f39fa966640 1 -- 172.21.15.16:0/3062786923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f4103ce0 msgr2=0x7f39f41040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.723+0000 7f39fa966640 1 --2- 172.21.15.16:0/3062786923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f4103ce0 0x7f39f41040c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009900 tx=0x7f39e402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.723+0000 7f39fa966640 1 -- 172.21.15.16:0/3062786923 shutdown_connections 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.723+0000 7f39fa966640 1 --2- 172.21.15.16:0/3062786923 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f410d140 0x7f39f410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.723+0000 7f39fa966640 1 --2- 172.21.15.16:0/3062786923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4104600 0x7f39f410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.723+0000 7f39fa966640 1 --2- 172.21.15.16:0/3062786923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f4103ce0 0x7f39f41040c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.723+0000 7f39fa966640 1 -- 172.21.15.16:0/3062786923 >> 172.21.15.16:0/3062786923 conn(0x7f39f40fd700 msgr2=0x7f39f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.724+0000 7f39fa966640 1 -- 172.21.15.16:0/3062786923 shutdown_connections 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.724+0000 7f39fa966640 1 -- 172.21.15.16:0/3062786923 wait complete. 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.724+0000 7f39fa966640 1 Processor -- start 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.724+0000 7f39fa966640 1 -- start start 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f4103ce0 0x7f39f41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4104600 0x7f39f41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f410d140 0x7f39f419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39f4112db0 con 0x7f39f410d140 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39f4112c30 con 0x7f39f4104600 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39f4112f30 con 0x7f39f4103ce0 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f410d140 0x7f39f419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f410d140 0x7f39f419eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45390/0 (socket says 172.21.15.16:45390) 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 -- 172.21.15.16:0/1907800080 learned_addr learned my addr 172.21.15.16:0/1907800080 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f3fff640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f4103ce0 0x7f39f41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39ebfff640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4104600 0x7f39f41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 -- 172.21.15.16:0/1907800080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f4103ce0 msgr2=0x7f39f41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f4103ce0 0x7f39f41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 -- 172.21.15.16:0/1907800080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4104600 msgr2=0x7f39f41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4104600 0x7f39f41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 -- 172.21.15.16:0/1907800080 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f419f350 con 0x7f39f410d140 2024-09-10T23:38:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f8f03640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f410d140 0x7f39f419eb80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00eb10 tx=0x7f39ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f1ffb640 1 -- 172.21.15.16:0/1907800080 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec004b20 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f1ffb640 1 -- 172.21.15.16:0/1907800080 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39ec004cc0 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f419f640 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39f1ffb640 1 -- 172.21.15.16:0/1907800080 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec010670 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.725+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f41a5d00 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.726+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f41040c0 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.728+0000 7f39f1ffb640 1 -- 172.21.15.16:0/1907800080 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f39ec005000 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.728+0000 7f39f1ffb640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f39e00b5330 0x7f39e00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.729+0000 7f39f3fff640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f39e00b5330 0x7f39e00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.729+0000 7f39f1ffb640 1 -- 172.21.15.16:0/1907800080 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f39ec0e6360 con 0x7f39f410d140 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.729+0000 7f39f3fff640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f39e00b5330 0x7f39e00b77f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39e4031440 tx=0x7f39e4005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.731+0000 7f39f1ffb640 1 -- 172.21.15.16:0/1907800080 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f39ec056220 con 0x7f39f410d140 2024-09-10T23:38:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:24.956+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f39f402e5c0 con 0x7f39f410d140 2024-09-10T23:38:25.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.273+0000 7f39f1ffb640 1 -- 172.21.15.16:0/1907800080 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f39ec0ad240 con 0x7f39f410d140 2024-09-10T23:38:25.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f39e00b5330 msgr2=0x7f39e00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:25.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f39e00b5330 0x7f39e00b77f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39e4031440 tx=0x7f39e4005b50 comp rx=0 tx=0).stop 2024-09-10T23:38:25.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f410d140 msgr2=0x7f39f419eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:25.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f410d140 0x7f39f419eb80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00eb10 tx=0x7f39ec00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:38:25.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 shutdown_connections 2024-09-10T23:38:25.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39f410d140 0x7f39f419eb80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f39e00b5330 0x7f39e00b77f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f4104600 0x7f39f41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 --2- 172.21.15.16:0/1907800080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f4103ce0 0x7f39f41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 >> 172.21.15.16:0/1907800080 conn(0x7f39f40fd700 msgr2=0x7f39f40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 shutdown_connections 2024-09-10T23:38:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:25.276+0000 7f39fa966640 1 -- 172.21.15.16:0/1907800080 wait complete. 2024-09-10T23:38:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:25 smithi066 ceph-mon[34761]: pgmap v264: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2024-09-10T23:38:25.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:25 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1907800080' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:38:25.710 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:25 smithi016 ceph-mon[30855]: pgmap v264: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2024-09-10T23:38:25.710 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:25 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1907800080' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:38:25.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:25 smithi071 ceph-mon[35018]: pgmap v264: 97 pgs: 97 active+clean; 580 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2024-09-10T23:38:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:25 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1907800080' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:38:26.056 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T23:38:26.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T23:38:26.323 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:26.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:26 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1907800080' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:38:26.569 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:26 smithi066 ceph-mon[34761]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:38:26.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:26 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1907800080' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:38:26.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:26 smithi016 ceph-mon[30855]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:38:26.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:26 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1907800080' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:38:26.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:26 smithi071 ceph-mon[35018]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:38:26.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 -- 172.21.15.16:0/2136488867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 msgr2=0x7f836c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 --2- 172.21.15.16:0/2136488867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c1031a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8368009900 tx=0x7f836802a410 comp rx=0 tx=0).stop 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 -- 172.21.15.16:0/2136488867 shutdown_connections 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 --2- 172.21.15.16:0/2136488867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f836c109150 0x7f836c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 --2- 172.21.15.16:0/2136488867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c1087d0 0x7f836c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 --2- 172.21.15.16:0/2136488867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c1031a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 -- 172.21.15.16:0/2136488867 >> 172.21.15.16:0/2136488867 conn(0x7f836c0fe830 msgr2=0x7f836c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 -- 172.21.15.16:0/2136488867 shutdown_connections 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.807+0000 7f837377f640 1 -- 172.21.15.16:0/2136488867 wait complete. 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 Processor -- start 2024-09-10T23:38:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 -- start start 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f836c1087d0 0x7f836c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c109150 0x7f836c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f836c112e10 con 0x7f836c102dc0 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f836c112c90 con 0x7f836c1087d0 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837377f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f836c112f90 con 0x7f836c109150 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45406/0 (socket says 172.21.15.16:45406) 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 -- 172.21.15.16:0/2442036770 learned_addr learned my addr 172.21.15.16:0/2442036770 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f8371d1c640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c109150 0x7f836c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f8370d1a640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f836c1087d0 0x7f836c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 -- 172.21.15.16:0/2442036770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c109150 msgr2=0x7f836c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c109150 0x7f836c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 -- 172.21.15.16:0/2442036770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f836c1087d0 msgr2=0x7f836c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f836c1087d0 0x7f836c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f837151b640 1 -- 172.21.15.16:0/2442036770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c1a76a0 con 0x7f836c102dc0 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f8371d1c640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c109150 0x7f836c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.808+0000 7f8370d1a640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f836c1087d0 0x7f836c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.809+0000 7f837151b640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c0754a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8368006010 tx=0x7f83680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.809+0000 7f83627fc640 1 -- 172.21.15.16:0/2442036770 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836803f030 con 0x7f836c102dc0 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.809+0000 7f83627fc640 1 -- 172.21.15.16:0/2442036770 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8368003800 con 0x7f836c102dc0 2024-09-10T23:38:26.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.809+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c1a7930 con 0x7f836c102dc0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.809+0000 7f83627fc640 1 -- 172.21.15.16:0/2442036770 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368035070 con 0x7f836c102dc0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.809+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c1a7e60 con 0x7f836c102dc0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.810+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836c1031a0 con 0x7f836c102dc0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.811+0000 7f83627fc640 1 -- 172.21.15.16:0/2442036770 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f8368031b10 con 0x7f836c102dc0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.812+0000 7f83627fc640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f83580b53b0 0x7f83580b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.812+0000 7f8370d1a640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f83580b53b0 0x7f83580b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.812+0000 7f83627fc640 1 -- 172.21.15.16:0/2442036770 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f8368106230 con 0x7f836c102dc0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.812+0000 7f8370d1a640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f83580b53b0 0x7f83580b7870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f836c076f90 tx=0x7f835c005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:26.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:26.816+0000 7f83627fc640 1 -- 172.21.15.16:0/2442036770 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f83680cd110 con 0x7f836c102dc0 2024-09-10T23:38:27.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.028+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f836c1007c0 con 0x7f83580b53b0 2024-09-10T23:38:27.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.056+0000 7f83627fc640 1 -- 172.21.15.16:0/2442036770 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f836c1007c0 con 0x7f83580b53b0 2024-09-10T23:38:27.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f83580b53b0 msgr2=0x7f83580b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:27.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f83580b53b0 0x7f83580b7870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f836c076f90 tx=0x7f835c005d30 comp rx=0 tx=0).stop 2024-09-10T23:38:27.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 msgr2=0x7f836c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c0754a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8368006010 tx=0x7f83680042f0 comp rx=0 tx=0).stop 2024-09-10T23:38:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 shutdown_connections 2024-09-10T23:38:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c109150 0x7f836c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f83580b53b0 0x7f83580b7870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f836c1087d0 0x7f836c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 --2- 172.21.15.16:0/2442036770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f836c102dc0 0x7f836c0754a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 >> 172.21.15.16:0/2442036770 conn(0x7f836c0fe830 msgr2=0x7f836c1000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 shutdown_connections 2024-09-10T23:38:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:27.058+0000 7f837377f640 1 -- 172.21.15.16:0/2442036770 wait complete. 2024-09-10T23:38:27.282 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:38:27 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:38:27.033+0000 7f9e9c71d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:38:27.282 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:38:27 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:38:27.033+0000 7f9e9c71d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:38:27.282 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:38:27 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:38:27.033+0000 7f9e9c71d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:38:27.282 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:38:27 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:38:27.033+0000 7f9e9c71d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:38:27.283 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:38:27 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:38:27.033+0000 7f9e9c71d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:38:27.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:27 smithi016 ceph-mon[30855]: pgmap v265: 97 pgs: 97 active+clean; 582 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-10T23:38:27.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:27 smithi016 ceph-mon[30855]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:27 smithi066 ceph-mon[34761]: pgmap v265: 97 pgs: 97 active+clean; 582 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-10T23:38:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:27 smithi066 ceph-mon[34761]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:27 smithi071 ceph-mon[35018]: pgmap v265: 97 pgs: 97 active+clean; 582 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-10T23:38:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:27 smithi071 ceph-mon[35018]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:27.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T23:38:28.145 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/1580031470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38103b30 msgr2=0x7fdf38103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/1580031470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38103b30 0x7fdf38103f10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009900 tx=0x7fdf2802a410 comp rx=0 tx=0).stop 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/1580031470 shutdown_connections 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/1580031470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf3810d0e0 0x7fdf3810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/1580031470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf38104530 0x7fdf3810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/1580031470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38103b30 0x7fdf38103f10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/1580031470 >> 172.21.15.16:0/1580031470 conn(0x7fdf380fd700 msgr2=0x7fdf380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/1580031470 shutdown_connections 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.719+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/1580031470 wait complete. 2024-09-10T23:38:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 Processor -- start 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 -- start start 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf38103b30 0x7fdf381992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38104530 0x7fdf38199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf3810d0e0 0x7fdf3819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdf38112d60 con 0x7fdf38104530 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdf38112be0 con 0x7fdf3810d0e0 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3cd8e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf38112ee0 con 0x7fdf38103b30 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38104530 0x7fdf38199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38104530 0x7fdf38199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45434/0 (socket says 172.21.15.16:45434) 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 -- 172.21.15.16:0/932029480 learned_addr learned my addr 172.21.15.16:0/932029480 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3659c640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf38103b30 0x7fdf381992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 -- 172.21.15.16:0/932029480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf38103b30 msgr2=0x7fdf381992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:28.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf38103b30 0x7fdf381992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 -- 172.21.15.16:0/932029480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf3810d0e0 msgr2=0x7fdf3819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf36d9d640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf3810d0e0 0x7fdf3819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf3810d0e0 0x7fdf3819ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 -- 172.21.15.16:0/932029480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3819f380 con 0x7fdf38104530 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf3659c640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf38103b30 0x7fdf381992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.720+0000 7fdf35d9b640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38104530 0x7fdf38199810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000d770 tx=0x7fdf2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.721+0000 7fdf2f7fe640 1 -- 172.21.15.16:0/932029480 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20017070 con 0x7fdf38104530 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.721+0000 7fdf2f7fe640 1 -- 172.21.15.16:0/932029480 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf200054d0 con 0x7fdf38104530 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.721+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3819f670 con 0x7fdf38104530 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.721+0000 7fdf2f7fe640 1 -- 172.21.15.16:0/932029480 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20004c30 con 0x7fdf38104530 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.721+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf381a5d30 con 0x7fdf38104530 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.722+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf38103f10 con 0x7fdf38104530 2024-09-10T23:38:28.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.724+0000 7fdf2f7fe640 1 -- 172.21.15.16:0/932029480 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fdf20004dd0 con 0x7fdf38104530 2024-09-10T23:38:28.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.725+0000 7fdf2f7fe640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf240b53b0 0x7fdf240b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:28.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.725+0000 7fdf3659c640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf240b53b0 0x7fdf240b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:28.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.725+0000 7fdf2f7fe640 1 -- 172.21.15.16:0/932029480 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fdf200e5b80 con 0x7fdf38104530 2024-09-10T23:38:28.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.726+0000 7fdf3659c640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf240b53b0 0x7fdf240b7870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf28031440 tx=0x7fdf28005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:28.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.728+0000 7fdf2f7fe640 1 -- 172.21.15.16:0/932029480 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf200aca80 con 0x7fdf38104530 2024-09-10T23:38:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.941+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdf38063590 con 0x7fdf240b53b0 2024-09-10T23:38:28.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.967+0000 7fdf2f7fe640 1 -- 172.21.15.16:0/932029480 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdf38063590 con 0x7fdf240b53b0 2024-09-10T23:38:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf240b53b0 msgr2=0x7fdf240b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf240b53b0 0x7fdf240b7870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf28031440 tx=0x7fdf28005a20 comp rx=0 tx=0).stop 2024-09-10T23:38:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38104530 msgr2=0x7fdf38199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38104530 0x7fdf38199810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000d770 tx=0x7fdf2000dc30 comp rx=0 tx=0).stop 2024-09-10T23:38:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 shutdown_connections 2024-09-10T23:38:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf240b53b0 0x7fdf240b7870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf3810d0e0 0x7fdf3819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf38104530 0x7fdf38199810 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 --2- 172.21.15.16:0/932029480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf38103b30 0x7fdf381992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 >> 172.21.15.16:0/932029480 conn(0x7fdf380fd700 msgr2=0x7fdf380fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 shutdown_connections 2024-09-10T23:38:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:28.969+0000 7fdf3cd8e640 1 -- 172.21.15.16:0/932029480 wait complete. 2024-09-10T23:38:29.606 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:29 smithi016 ceph-mon[30855]: pgmap v266: 97 pgs: 97 active+clean; 588 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-09-10T23:38:29.606 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:29 smithi016 ceph-mon[30855]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:29.634 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T23:38:29.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:29 smithi071 ceph-mon[35018]: pgmap v266: 97 pgs: 97 active+clean; 588 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-09-10T23:38:29.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:29 smithi071 ceph-mon[35018]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:29.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:29 smithi066 ceph-mon[34761]: pgmap v266: 97 pgs: 97 active+clean; 588 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-09-10T23:38:29.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:29 smithi066 ceph-mon[34761]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:30.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 -- 172.21.15.16:0/1550307263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 msgr2=0x7f1d64107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:30.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/1550307263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64107ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009900 tx=0x7f1d4c02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:30.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 -- 172.21.15.16:0/1550307263 shutdown_connections 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/1550307263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64108020 0x7f1d6410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/1550307263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64107ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/1550307263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d64101c90 0x7f1d64102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 -- 172.21.15.16:0/1550307263 >> 172.21.15.16:0/1550307263 conn(0x7f1d640fd700 msgr2=0x7f1d640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 -- 172.21.15.16:0/1550307263 shutdown_connections 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.395+0000 7f1d68bbb640 1 -- 172.21.15.16:0/1550307263 wait complete. 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 Processor -- start 2024-09-10T23:38:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 -- start start 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d64101c90 0x7f1d64199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64108020 0x7f1d6419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64111ca0 con 0x7f1d641076a0 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64111b20 con 0x7f1d64101c90 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d68bbb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64111e20 con 0x7f1d64108020 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45444/0 (socket says 172.21.15.16:45444) 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d5bfff640 1 -- 172.21.15.16:0/3636976487 learned_addr learned my addr 172.21.15.16:0/3636976487 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d6259c640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d64101c90 0x7f1d64199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.396+0000 7f1d62d9d640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64108020 0x7f1d6419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5bfff640 1 -- 172.21.15.16:0/3636976487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64108020 msgr2=0x7f1d6419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5bfff640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64108020 0x7f1d6419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5bfff640 1 -- 172.21.15.16:0/3636976487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d64101c90 msgr2=0x7f1d64199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5bfff640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d64101c90 0x7f1d64199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5bfff640 1 -- 172.21.15.16:0/3636976487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6419f3f0 con 0x7f1d641076a0 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5bfff640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64199880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c005940 tx=0x7f1d4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5b7fe640 1 -- 172.21.15.16:0/3636976487 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c03f030 con 0x7f1d641076a0 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6419f680 con 0x7f1d641076a0 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5b7fe640 1 -- 172.21.15.16:0/3636976487 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d4c003aa0 con 0x7f1d641076a0 2024-09-10T23:38:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d5b7fe640 1 -- 172.21.15.16:0/3636976487 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c035070 con 0x7f1d641076a0 2024-09-10T23:38:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.397+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d641a5da0 con 0x7f1d641076a0 2024-09-10T23:38:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.398+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d64102070 con 0x7f1d641076a0 2024-09-10T23:38:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.399+0000 7f1d5b7fe640 1 -- 172.21.15.16:0/3636976487 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f1d4c03bcc0 con 0x7f1d641076a0 2024-09-10T23:38:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.400+0000 7f1d5b7fe640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d500b53c0 0x7f1d500b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.400+0000 7f1d6259c640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d500b53c0 0x7f1d500b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.400+0000 7f1d5b7fe640 1 -- 172.21.15.16:0/3636976487 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f1d4c1069c0 con 0x7f1d641076a0 2024-09-10T23:38:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.401+0000 7f1d6259c640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d500b53c0 0x7f1d500b7880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d54005d00 tx=0x7f1d5400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.403+0000 7f1d5b7fe640 1 -- 172.21.15.16:0/3636976487 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1d4c0cd090 con 0x7f1d641076a0 2024-09-10T23:38:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.616+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1d64104460 con 0x7f1d500b53c0 2024-09-10T23:38:30.619 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:30 smithi016 ceph-mon[30855]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-10T23:38:30.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.622+0000 7f1d5b7fe640 1 -- 172.21.15.16:0/3636976487 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1d64104460 con 0x7f1d500b53c0 2024-09-10T23:38:30.624 INFO:teuthology.orchestra.run.smithi016.stdout:/volumes/qa/sv_0/fe74c019-095b-4a96-afed-0b9b0d7d87cc 2024-09-10T23:38:30.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d500b53c0 msgr2=0x7f1d500b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:30.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d500b53c0 0x7f1d500b7880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d54005d00 tx=0x7f1d5400b410 comp rx=0 tx=0).stop 2024-09-10T23:38:30.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 msgr2=0x7f1d64199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64199880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c005940 tx=0x7f1d4c004270 comp rx=0 tx=0).stop 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 shutdown_connections 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64108020 0x7f1d6419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d641076a0 0x7f1d64199880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d500b53c0 0x7f1d500b7880 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 --2- 172.21.15.16:0/3636976487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d64101c90 0x7f1d64199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 >> 172.21.15.16:0/3636976487 conn(0x7f1d640fd700 msgr2=0x7f1d6406ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 shutdown_connections 2024-09-10T23:38:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:30.625+0000 7f1d68bbb640 1 -- 172.21.15.16:0/3636976487 wait complete. 2024-09-10T23:38:30.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:30 smithi071 ceph-mon[35018]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-10T23:38:30.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:30 smithi066 ceph-mon[34761]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-10T23:38:31.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T23:38:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:31 smithi071 ceph-mon[35018]: pgmap v267: 97 pgs: 97 active+clean; 588 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-10T23:38:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:31 smithi071 ceph-mon[35018]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:31.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:31 smithi066 ceph-mon[34761]: pgmap v267: 97 pgs: 97 active+clean; 588 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-10T23:38:31.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:31 smithi066 ceph-mon[34761]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:31.920 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:31 smithi016 ceph-mon[30855]: pgmap v267: 97 pgs: 97 active+clean; 588 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-10T23:38:31.920 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:31 smithi016 ceph-mon[30855]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:32.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 -- 172.21.15.16:0/368526309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 msgr2=0x7f407010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:32.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 --2- 172.21.15.16:0/368526309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f407010caf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4060009900 tx=0x7f406002a410 comp rx=0 tx=0).stop 2024-09-10T23:38:32.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 -- 172.21.15.16:0/368526309 shutdown_connections 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 --2- 172.21.15.16:0/368526309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f407010d140 0x7f407010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 --2- 172.21.15.16:0/368526309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f407010caf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 --2- 172.21.15.16:0/368526309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4070103ce0 0x7f40701040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 -- 172.21.15.16:0/368526309 >> 172.21.15.16:0/368526309 conn(0x7f40700fd700 msgr2=0x7f40700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 -- 172.21.15.16:0/368526309 shutdown_connections 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.314+0000 7f4078691640 1 -- 172.21.15.16:0/368526309 wait complete. 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 Processor -- start 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 -- start start 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4070103ce0 0x7f40701992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f4070199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f407010d140 0x7f407019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4070112e00 con 0x7f4070104600 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4070112c80 con 0x7f407010d140 2024-09-10T23:38:32.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4078691640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4070112f80 con 0x7f4070103ce0 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4075c2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f4070199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4075c2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f4070199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45458/0 (socket says 172.21.15.16:45458) 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.315+0000 7f4075c2c640 1 -- 172.21.15.16:0/3589013754 learned_addr learned my addr 172.21.15.16:0/3589013754 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4076c2e640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f407010d140 0x7f407019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f407642d640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4070103ce0 0x7f40701992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4075c2c640 1 -- 172.21.15.16:0/3589013754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4070103ce0 msgr2=0x7f40701992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4075c2c640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4070103ce0 0x7f40701992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4075c2c640 1 -- 172.21.15.16:0/3589013754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f407010d140 msgr2=0x7f407019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4075c2c640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f407010d140 0x7f407019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4075c2c640 1 -- 172.21.15.16:0/3589013754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407019f3a0 con 0x7f4070104600 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f407642d640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4070103ce0 0x7f40701992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4075c2c640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f4070199830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4060005ab0 tx=0x7f4060003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f40677fe640 1 -- 172.21.15.16:0/3589013754 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406003f070 con 0x7f4070104600 2024-09-10T23:38:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f40677fe640 1 -- 172.21.15.16:0/3589013754 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4060031b50 con 0x7f4070104600 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f40677fe640 1 -- 172.21.15.16:0/3589013754 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060035030 con 0x7f4070104600 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407019f630 con 0x7f4070104600 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.316+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40701a5d50 con 0x7f4070104600 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.317+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40701040c0 con 0x7f4070104600 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.319+0000 7f40677fe640 1 -- 172.21.15.16:0/3589013754 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f40600316a0 con 0x7f4070104600 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.319+0000 7f40677fe640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f405c0b53c0 0x7f405c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.319+0000 7f40677fe640 1 -- 172.21.15.16:0/3589013754 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f4060106f40 con 0x7f4070104600 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.319+0000 7f407642d640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f405c0b53c0 0x7f405c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.320+0000 7f407642d640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f405c0b53c0 0x7f405c0b7880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f406c005d00 tx=0x7f406c005ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.322+0000 7f40677fe640 1 -- 172.21.15.16:0/3589013754 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f40600cdcc0 con 0x7f4070104600 2024-09-10T23:38:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.535+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f40700ffa20 con 0x7f405c0b53c0 2024-09-10T23:38:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.560+0000 7f40677fe640 1 -- 172.21.15.16:0/3589013754 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f40700ffa20 con 0x7f405c0b53c0 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f405c0b53c0 msgr2=0x7f405c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f405c0b53c0 0x7f405c0b7880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f406c005d00 tx=0x7f406c005ed0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 msgr2=0x7f4070199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f4070199830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4060005ab0 tx=0x7f4060003b90 comp rx=0 tx=0).stop 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 shutdown_connections 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f405c0b53c0 0x7f405c0b7880 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f407010d140 0x7f407019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4070104600 0x7f4070199830 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 --2- 172.21.15.16:0/3589013754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4070103ce0 0x7f40701992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:32.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 >> 172.21.15.16:0/3589013754 conn(0x7f40700fd700 msgr2=0x7f40700fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:32.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 shutdown_connections 2024-09-10T23:38:32.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:32.562+0000 7f4078691640 1 -- 172.21.15.16:0/3589013754 wait complete. 2024-09-10T23:38:33.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T23:38:33.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:33 smithi016 ceph-mon[30855]: pgmap v268: 97 pgs: 97 active+clean; 589 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-10T23:38:33.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:33 smithi016 ceph-mon[30855]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:33.740 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:33 smithi071 ceph-mon[35018]: pgmap v268: 97 pgs: 97 active+clean; 589 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-10T23:38:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:33 smithi071 ceph-mon[35018]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:33 smithi066 ceph-mon[34761]: pgmap v268: 97 pgs: 97 active+clean; 589 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-10T23:38:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:33 smithi066 ceph-mon[34761]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 -- 172.21.15.16:0/2939058808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 msgr2=0x7fda5c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 --2- 172.21.15.16:0/2939058808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c10e820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fda54009ca0 tx=0x7fda5402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 -- 172.21.15.16:0/2939058808 shutdown_connections 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 --2- 172.21.15.16:0/2939058808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c10e820 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 --2- 172.21.15.16:0/2939058808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda5c1076a0 0x7fda5c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 --2- 172.21.15.16:0/2939058808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5c101c90 0x7fda5c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 -- 172.21.15.16:0/2939058808 >> 172.21.15.16:0/2939058808 conn(0x7fda5c0fd700 msgr2=0x7fda5c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 -- 172.21.15.16:0/2939058808 shutdown_connections 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.279+0000 7fda62352640 1 -- 172.21.15.16:0/2939058808 wait complete. 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.280+0000 7fda62352640 1 Processor -- start 2024-09-10T23:38:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.280+0000 7fda62352640 1 -- start start 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda62352640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda5c101c90 0x7fda5c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda62352640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5c1076a0 0x7fda5c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda62352640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda62352640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c111ca0 con 0x7fda5c108020 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda62352640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c111b20 con 0x7fda5c1076a0 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda62352640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c111e20 con 0x7fda5c101c90 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50744/0 (socket says 172.21.15.16:50744) 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda5bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda5c101c90 0x7fda5c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 -- 172.21.15.16:0/2223415164 learned_addr learned my addr 172.21.15.16:0/2223415164 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda53fff640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5c1076a0 0x7fda5c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 -- 172.21.15.16:0/2223415164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda5c101c90 msgr2=0x7fda5c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda5c101c90 0x7fda5c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 -- 172.21.15.16:0/2223415164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5c1076a0 msgr2=0x7fda5c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5c1076a0 0x7fda5c19a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 -- 172.21.15.16:0/2223415164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c1a53d0 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda608ef640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c19aa90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda54005cc0 tx=0x7fda5402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda59ffb640 1 -- 172.21.15.16:0/2223415164 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54003bf0 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5c1a5660 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda59ffb640 1 -- 172.21.15.16:0/2223415164 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda54003d90 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.281+0000 7fda59ffb640 1 -- 172.21.15.16:0/2223415164 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5402fb20 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.282+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5c1a5ba0 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.283+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5c102070 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.284+0000 7fda59ffb640 1 -- 172.21.15.16:0/2223415164 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fda54004580 con 0x7fda5c108020 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.285+0000 7fda59ffb640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fda480b53c0 0x7fda480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:34.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.285+0000 7fda5bfff640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fda480b53c0 0x7fda480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:34.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.285+0000 7fda59ffb640 1 -- 172.21.15.16:0/2223415164 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fda54107170 con 0x7fda5c108020 2024-09-10T23:38:34.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.285+0000 7fda5bfff640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fda480b53c0 0x7fda480b7880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00abe0 tx=0x7fda4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:34.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.289+0000 7fda59ffb640 1 -- 172.21.15.16:0/2223415164 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fda540cdef0 con 0x7fda5c108020 2024-09-10T23:38:34.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.506+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fda5c063590 con 0x7fda480b53c0 2024-09-10T23:38:34.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.511+0000 7fda59ffb640 1 -- 172.21.15.16:0/2223415164 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fda5c063590 con 0x7fda480b53c0 2024-09-10T23:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout:/volumes/qa/sv_1/e192eee7-9903-461b-9e09-b059130a5d5c 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fda480b53c0 msgr2=0x7fda480b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fda480b53c0 0x7fda480b7880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00abe0 tx=0x7fda4c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 msgr2=0x7fda5c19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c19aa90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda54005cc0 tx=0x7fda5402f380 comp rx=0 tx=0).stop 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 shutdown_connections 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda5c108020 0x7fda5c19aa90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fda480b53c0 0x7fda480b7880 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5c1076a0 0x7fda5c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 --2- 172.21.15.16:0/2223415164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda5c101c90 0x7fda5c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 >> 172.21.15.16:0/2223415164 conn(0x7fda5c0fd700 msgr2=0x7fda5c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:34.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 shutdown_connections 2024-09-10T23:38:34.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:34.513+0000 7fda62352640 1 -- 172.21.15.16:0/2223415164 wait complete. 2024-09-10T23:38:35.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:38:35.456 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:35.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:35 smithi016 ceph-mon[30855]: pgmap v269: 97 pgs: 97 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-10T23:38:35.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:35 smithi016 ceph-mon[30855]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:35.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:35 smithi071 ceph-mon[35018]: pgmap v269: 97 pgs: 97 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-10T23:38:35.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:35 smithi071 ceph-mon[35018]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:35.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:35 smithi066 ceph-mon[34761]: pgmap v269: 97 pgs: 97 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-10T23:38:35.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:35 smithi066 ceph-mon[34761]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:38:35.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 -- 172.21.15.16:0/3495138237 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d010d100 msgr2=0x7f45d010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:35.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 --2- 172.21.15.16:0/3495138237 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d010d100 0x7f45d010f560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009900 tx=0x7f45c802a410 comp rx=0 tx=0).stop 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 -- 172.21.15.16:0/3495138237 shutdown_connections 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 --2- 172.21.15.16:0/3495138237 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d010d100 0x7f45d010f560 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 --2- 172.21.15.16:0/3495138237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45d01045c0 0x7f45d010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 --2- 172.21.15.16:0/3495138237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d0103ca0 0x7f45d0104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 -- 172.21.15.16:0/3495138237 >> 172.21.15.16:0/3495138237 conn(0x7f45d00fd700 msgr2=0x7f45d00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 -- 172.21.15.16:0/3495138237 shutdown_connections 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 -- 172.21.15.16:0/3495138237 wait complete. 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 Processor -- start 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.982+0000 7f45d7410640 1 -- start start 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d7410640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d0103ca0 0x7f45d0101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d7410640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d01045c0 0x7f45d0101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:35.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d7410640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45d010d100 0x7f45d01023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d7410640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112d70 con 0x7f45d01045c0 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d7410640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112bf0 con 0x7f45d010d100 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d7410640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112ef0 con 0x7f45d0103ca0 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d01045c0 0x7f45d0101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d01045c0 0x7f45d0101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50756/0 (socket says 172.21.15.16:50756) 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 -- 172.21.15.16:0/2948295033 learned_addr learned my addr 172.21.15.16:0/2948295033 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d51ac640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d0103ca0 0x7f45d0101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d59ad640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45d010d100 0x7f45d01023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 -- 172.21.15.16:0/2948295033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d0103ca0 msgr2=0x7f45d0101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d0103ca0 0x7f45d0101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 -- 172.21.15.16:0/2948295033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45d010d100 msgr2=0x7f45d01023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45d010d100 0x7f45d01023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 -- 172.21.15.16:0/2948295033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d01a7680 con 0x7f45d01045c0 2024-09-10T23:38:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d59ad640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45d010d100 0x7f45d01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45d49ab640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d01045c0 0x7f45d0101e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f45c400ccb0 tx=0x7f45c400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.983+0000 7f45ce7fc640 1 -- 172.21.15.16:0/2948295033 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4003990 con 0x7f45d01045c0 2024-09-10T23:38:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.984+0000 7f45ce7fc640 1 -- 172.21.15.16:0/2948295033 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45c4004020 con 0x7f45d01045c0 2024-09-10T23:38:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.984+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d01a7970 con 0x7f45d01045c0 2024-09-10T23:38:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.984+0000 7f45ce7fc640 1 -- 172.21.15.16:0/2948295033 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c400f6b0 con 0x7f45d01045c0 2024-09-10T23:38:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.984+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d01a7f00 con 0x7f45d01045c0 2024-09-10T23:38:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.985+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d0104080 con 0x7f45d01045c0 2024-09-10T23:38:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.986+0000 7f45ce7fc640 1 -- 172.21.15.16:0/2948295033 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f45c4003b30 con 0x7f45d01045c0 2024-09-10T23:38:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.987+0000 7f45ce7fc640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f45b80b5440 0x7f45b80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.987+0000 7f45d51ac640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f45b80b5440 0x7f45b80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.987+0000 7f45ce7fc640 1 -- 172.21.15.16:0/2948295033 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f45c40e5d10 con 0x7f45d01045c0 2024-09-10T23:38:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.987+0000 7f45d51ac640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f45b80b5440 0x7f45b80b7900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45c0005fd0 tx=0x7f45c000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:35.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:35.991+0000 7f45ce7fc640 1 -- 172.21.15.16:0/2948295033 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f45c40eb020 con 0x7f45d01045c0 2024-09-10T23:38:36.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.214+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45d01a8350 con 0x7f45d01045c0 2024-09-10T23:38:36.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.215+0000 7f45ce7fc640 1 -- 172.21.15.16:0/2948295033 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11897 (secure 0 0 0) 0x7f45c4014030 con 0x7f45d01045c0 2024-09-10T23:38:36.216 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:36.216 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"btime":"2024-09-10T23:38:25:271297+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:38:24.958870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24595,24608,24610]},"id":1}]} 2024-09-10T23:38:36.216 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f45b80b5440 msgr2=0x7f45b80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f45b80b5440 0x7f45b80b7900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45c0005fd0 tx=0x7f45c000b390 comp rx=0 tx=0).stop 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d01045c0 msgr2=0x7f45d0101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d01045c0 0x7f45d0101e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f45c400ccb0 tx=0x7f45c400a620 comp rx=0 tx=0).stop 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 shutdown_connections 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f45b80b5440 0x7f45b80b7900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45d010d100 0x7f45d01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45d01045c0 0x7f45d0101e90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 --2- 172.21.15.16:0/2948295033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45d0103ca0 0x7f45d0101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:36.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 >> 172.21.15.16:0/2948295033 conn(0x7f45d00fd700 msgr2=0x7f45d010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:36.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 shutdown_connections 2024-09-10T23:38:36.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:36.218+0000 7f45d7410640 1 -- 172.21.15.16:0/2948295033 wait complete. 2024-09-10T23:38:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:36 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2948295033' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:36.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:36 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2948295033' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:36.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:36 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2948295033' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:38:37.075 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:38:37.341 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:37.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:37 smithi016 ceph-mon[30855]: pgmap v270: 97 pgs: 97 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2024-09-10T23:38:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:37 smithi071 ceph-mon[35018]: pgmap v270: 97 pgs: 97 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2024-09-10T23:38:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:37 smithi066 ceph-mon[34761]: pgmap v270: 97 pgs: 97 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.823+0000 7f6c79a8f640 1 -- 172.21.15.16:0/3565480540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c74103b70 msgr2=0x7f6c74103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.823+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/3565480540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c74103b70 0x7f6c74103f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009900 tx=0x7f6c6402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 -- 172.21.15.16:0/3565480540 shutdown_connections 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/3565480540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7410d120 0x7f6c7410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/3565480540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c74104570 0x7f6c7410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/3565480540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c74103b70 0x7f6c74103f50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 -- 172.21.15.16:0/3565480540 >> 172.21.15.16:0/3565480540 conn(0x7f6c740fd720 msgr2=0x7f6c740ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 -- 172.21.15.16:0/3565480540 shutdown_connections 2024-09-10T23:38:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 -- 172.21.15.16:0/3565480540 wait complete. 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.824+0000 7f6c79a8f640 1 Processor -- start 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c79a8f640 1 -- start start 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c79a8f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74103b70 0x7f6c741019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c79a8f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c74104570 0x7f6c74101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c79a8f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c7410d120 0x7f6c74102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c79a8f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c74112da0 con 0x7f6c7410d120 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c79a8f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c74112c20 con 0x7f6c74103b70 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c79a8f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c74112f20 con 0x7f6c74104570 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c7410d120 0x7f6c74102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c7410d120 0x7f6c74102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50776/0 (socket says 172.21.15.16:50776) 2024-09-10T23:38:37.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 -- 172.21.15.16:0/1035537467 learned_addr learned my addr 172.21.15.16:0/1035537467 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:37.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c72ffd640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c74104570 0x7f6c74101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:37.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c737fe640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74103b70 0x7f6c741019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:37.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 -- 172.21.15.16:0/1035537467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c74104570 msgr2=0x7f6c74101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:37.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c74104570 0x7f6c74101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:37.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 -- 172.21.15.16:0/1035537467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74103b70 msgr2=0x7f6c741019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:37.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74103b70 0x7f6c741019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:37.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c73fff640 1 -- 172.21.15.16:0/1035537467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c741a76a0 con 0x7f6c7410d120 2024-09-10T23:38:37.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.825+0000 7f6c737fe640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74103b70 0x7f6c741019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:37.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.826+0000 7f6c73fff640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c7410d120 0x7f6c74102470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00eaa0 tx=0x7f6c6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:37.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.826+0000 7f6c70ff9640 1 -- 172.21.15.16:0/1035537467 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00cdb0 con 0x7f6c7410d120 2024-09-10T23:38:37.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.826+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c741a7990 con 0x7f6c7410d120 2024-09-10T23:38:37.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.826+0000 7f6c70ff9640 1 -- 172.21.15.16:0/1035537467 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c6c005020 con 0x7f6c7410d120 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.826+0000 7f6c70ff9640 1 -- 172.21.15.16:0/1035537467 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0116d0 con 0x7f6c7410d120 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.826+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c741a7ed0 con 0x7f6c7410d120 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.827+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c74103f50 con 0x7f6c7410d120 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.828+0000 7f6c70ff9640 1 -- 172.21.15.16:0/1035537467 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f6c6c00f040 con 0x7f6c7410d120 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.829+0000 7f6c70ff9640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c5c0b53c0 0x7f6c5c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.829+0000 7f6c737fe640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c5c0b53c0 0x7f6c5c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.829+0000 7f6c70ff9640 1 -- 172.21.15.16:0/1035537467 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f6c6c0e6050 con 0x7f6c7410d120 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.830+0000 7f6c737fe640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c5c0b53c0 0x7f6c5c0b7880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c64031440 tx=0x7f6c64005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:37.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:37.832+0000 7f6c70ff9640 1 -- 172.21.15.16:0/1035537467 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6c6c016030 con 0x7f6c7410d120 2024-09-10T23:38:38.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.021+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c74102cf0 con 0x7f6c7410d120 2024-09-10T23:38:38.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.022+0000 7f6c70ff9640 1 -- 172.21.15.16:0/1035537467 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22511 (secure 0 0 0) 0x7f6c6c0acd70 con 0x7f6c7410d120 2024-09-10T23:38:38.023 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:38.023 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":75,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:12.987918+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:38:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c5c0b53c0 msgr2=0x7f6c5c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c5c0b53c0 0x7f6c5c0b7880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c64031440 tx=0x7f6c64005a20 comp rx=0 tx=0).stop 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c7410d120 msgr2=0x7f6c74102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c7410d120 0x7f6c74102470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00eaa0 tx=0x7f6c6c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 shutdown_connections 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c7410d120 0x7f6c74102470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c74104570 0x7f6c74101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.024+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c5c0b53c0 0x7f6c5c0b7880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.025+0000 7f6c79a8f640 1 --2- 172.21.15.16:0/1035537467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c74103b70 0x7f6c741019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.025+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 >> 172.21.15.16:0/1035537467 conn(0x7f6c740fd720 msgr2=0x7f6c740fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.025+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 shutdown_connections 2024-09-10T23:38:38.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:38.025+0000 7f6c79a8f640 1 -- 172.21.15.16:0/1035537467 wait complete. 2024-09-10T23:38:38.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:38 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1035537467' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:38.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:38 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1035537467' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:38.780 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:38:38.780 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:38:38.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:38 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1035537467' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:39.039 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:39.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 -- 172.21.15.16:0/2645442401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec108020 msgr2=0x7f76ec10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 --2- 172.21.15.16:0/2645442401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec108020 0x7f76ec10e820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009ca0 tx=0x7f76e402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 -- 172.21.15.16:0/2645442401 shutdown_connections 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 --2- 172.21.15.16:0/2645442401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec108020 0x7f76ec10e820 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 --2- 172.21.15.16:0/2645442401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76ec1076a0 0x7f76ec107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 --2- 172.21.15.16:0/2645442401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76ec101c90 0x7f76ec102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 -- 172.21.15.16:0/2645442401 >> 172.21.15.16:0/2645442401 conn(0x7f76ec0fd700 msgr2=0x7f76ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 -- 172.21.15.16:0/2645442401 shutdown_connections 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 -- 172.21.15.16:0/2645442401 wait complete. 2024-09-10T23:38:39.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.545+0000 7f76f29ea640 1 Processor -- start 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f29ea640 1 -- start start 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f29ea640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76ec101c90 0x7f76ec19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f29ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec1076a0 0x7f76ec19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f29ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76ec108020 0x7f76ec1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f29ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec112e00 con 0x7f76ec1076a0 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f29ea640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec112c80 con 0x7f76ec108020 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f29ea640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec112f80 con 0x7f76ec101c90 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec1076a0 0x7f76ec19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec1076a0 0x7f76ec19b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50802/0 (socket says 172.21.15.16:50802) 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 -- 172.21.15.16:0/429398106 learned_addr learned my addr 172.21.15.16:0/429398106 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76ebfff640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76ec101c90 0x7f76ec19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76f0f87640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76ec108020 0x7f76ec1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:39.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 -- 172.21.15.16:0/429398106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76ec101c90 msgr2=0x7f76ec19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76ec101c90 0x7f76ec19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 -- 172.21.15.16:0/429398106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76ec108020 msgr2=0x7f76ec1a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76ec108020 0x7f76ec1a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 -- 172.21.15.16:0/429398106 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec1a1460 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.546+0000 7f76e3fff640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec1076a0 0x7f76ec19b8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c920 tx=0x7f76d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.547+0000 7f76e9ffb640 1 -- 172.21.15.16:0/429398106 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4007c70 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.547+0000 7f76e9ffb640 1 -- 172.21.15.16:0/429398106 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76d4007e10 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.547+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec1a1750 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.547+0000 7f76e9ffb640 1 -- 172.21.15.16:0/429398106 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4018820 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.547+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec1a7e10 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.548+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec102070 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.549+0000 7f76e9ffb640 1 -- 172.21.15.16:0/429398106 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f76d400f450 con 0x7f76ec1076a0 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.550+0000 7f76e9ffb640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f76d80b53c0 0x7f76d80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.550+0000 7f76ebfff640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f76d80b53c0 0x7f76d80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:39.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.550+0000 7f76e9ffb640 1 -- 172.21.15.16:0/429398106 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f76d40e5ed0 con 0x7f76ec1076a0 2024-09-10T23:38:39.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.550+0000 7f76ebfff640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f76d80b53c0 0x7f76d80b7880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00bbe0 tx=0x7f76dc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:39.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.554+0000 7f76e9ffb640 1 -- 172.21.15.16:0/429398106 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76d4014030 con 0x7f76ec1076a0 2024-09-10T23:38:39.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:39 smithi016 ceph-mon[30855]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-10T23:38:39.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.736+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76ec104c60 con 0x7f76d80b53c0 2024-09-10T23:38:39.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.740+0000 7f76e9ffb640 1 -- 172.21.15.16:0/429398106 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258857 (secure 0 0 0) 0x7f76ec104c60 con 0x7f76d80b53c0 2024-09-10T23:38:39.744 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:39.745 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f76d80b53c0 msgr2=0x7f76d80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f76d80b53c0 0x7f76d80b7880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00bbe0 tx=0x7f76dc00b390 comp rx=0 tx=0).stop 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec1076a0 msgr2=0x7f76ec19b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec1076a0 0x7f76ec19b8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c920 tx=0x7f76d400cde0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 shutdown_connections 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f76d80b53c0 0x7f76d80b7880 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76ec108020 0x7f76ec1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76ec1076a0 0x7f76ec19b8f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 --2- 172.21.15.16:0/429398106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76ec101c90 0x7f76ec19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.744+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 >> 172.21.15.16:0/429398106 conn(0x7f76ec0fd700 msgr2=0x7f76ec100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.745+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 shutdown_connections 2024-09-10T23:38:39.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:39.745+0000 7f76f29ea640 1 -- 172.21.15.16:0/429398106 wait complete. 2024-09-10T23:38:39.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:39 smithi071 ceph-mon[35018]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-10T23:38:39.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:39 smithi066 ceph-mon[34761]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-09-10T23:38:40.493 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-09-10T23:38:38.425064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649946,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":193,"num_read_kb":177,"num_write":279,"num_write_kb":2253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380044,"kb_used_data":9996,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561780,"statfs":{"total":1151940427776,"available":1151551262720,"internally_reserved":0,"allocated":10235904,"data_stored":6722944,"data_compressed":109095,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54468,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":51,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002861"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.223025+0000","last_change":"2024-09-10T23:38:12.217637+0000","last_active":"2024-09-10T23:38:13.223025+0000","last_peered":"2024-09-10T23:38:13.223025+0000","last_clean":"2024-09-10T23:38:13.223025+0000","last_became_active":"2024-09-10T23:38:12.217260+0000","last_became_peered":"2024-09-10T23:38:12.217260+0000","last_unstale":"2024-09-10T23:38:13.223025+0000","last_undegraded":"2024-09-10T23:38:13.223025+0000","last_fullsized":"2024-09-10T23:38:13.223025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.774575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242849+0000","last_change":"2024-09-10T23:38:12.217114+0000","last_active":"2024-09-10T23:38:13.242849+0000","last_peered":"2024-09-10T23:38:13.242849+0000","last_clean":"2024-09-10T23:38:13.242849+0000","last_became_active":"2024-09-10T23:38:12.216836+0000","last_became_peered":"2024-09-10T23:38:12.216836+0000","last_unstale":"2024-09-10T23:38:13.242849+0000","last_undegraded":"2024-09-10T23:38:13.242849+0000","last_fullsized":"2024-09-10T23:38:13.242849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:55.023668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242573+0000","last_change":"2024-09-10T23:38:12.219046+0000","last_active":"2024-09-10T23:38:13.242573+0000","last_peered":"2024-09-10T23:38:13.242573+0000","last_clean":"2024-09-10T23:38:13.242573+0000","last_became_active":"2024-09-10T23:38:12.218348+0000","last_became_peered":"2024-09-10T23:38:12.218348+0000","last_unstale":"2024-09-10T23:38:13.242573+0000","last_undegraded":"2024-09-10T23:38:13.242573+0000","last_fullsized":"2024-09-10T23:38:13.242573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:07.419364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238882+0000","last_change":"2024-09-10T23:38:12.219211+0000","last_active":"2024-09-10T23:38:13.238882+0000","last_peered":"2024-09-10T23:38:13.238882+0000","last_clean":"2024-09-10T23:38:13.238882+0000","last_became_active":"2024-09-10T23:38:12.213452+0000","last_became_peered":"2024-09-10T23:38:12.213452+0000","last_unstale":"2024-09-10T23:38:13.238882+0000","last_undegraded":"2024-09-10T23:38:13.238882+0000","last_fullsized":"2024-09-10T23:38:13.238882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:59.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238677+0000","last_change":"2024-09-10T23:38:12.213636+0000","last_active":"2024-09-10T23:38:13.238677+0000","last_peered":"2024-09-10T23:38:13.238677+0000","last_clean":"2024-09-10T23:38:13.238677+0000","last_became_active":"2024-09-10T23:38:12.213309+0000","last_became_peered":"2024-09-10T23:38:12.213309+0000","last_unstale":"2024-09-10T23:38:13.238677+0000","last_undegraded":"2024-09-10T23:38:13.238677+0000","last_fullsized":"2024-09-10T23:38:13.238677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:34.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.224619+0000","last_change":"2024-09-10T23:38:12.215995+0000","last_active":"2024-09-10T23:38:13.224619+0000","last_peered":"2024-09-10T23:38:13.224619+0000","last_clean":"2024-09-10T23:38:13.224619+0000","last_became_active":"2024-09-10T23:38:12.215601+0000","last_became_peered":"2024-09-10T23:38:12.215601+0000","last_unstale":"2024-09-10T23:38:13.224619+0000","last_undegraded":"2024-09-10T23:38:13.224619+0000","last_fullsized":"2024-09-10T23:38:13.224619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:24.770551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239927+0000","last_change":"2024-09-10T23:38:12.226337+0000","last_active":"2024-09-10T23:38:13.239927+0000","last_peered":"2024-09-10T23:38:13.239927+0000","last_clean":"2024-09-10T23:38:13.239927+0000","last_became_active":"2024-09-10T23:38:12.225953+0000","last_became_peered":"2024-09-10T23:38:12.225953+0000","last_unstale":"2024-09-10T23:38:13.239927+0000","last_undegraded":"2024-09-10T23:38:13.239927+0000","last_fullsized":"2024-09-10T23:38:13.239927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:27.044867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238995+0000","last_change":"2024-09-10T23:38:12.219682+0000","last_active":"2024-09-10T23:38:13.238995+0000","last_peered":"2024-09-10T23:38:13.238995+0000","last_clean":"2024-09-10T23:38:13.238995+0000","last_became_active":"2024-09-10T23:38:12.218596+0000","last_became_peered":"2024-09-10T23:38:12.218596+0000","last_unstale":"2024-09-10T23:38:13.238995+0000","last_undegraded":"2024-09-10T23:38:13.238995+0000","last_fullsized":"2024-09-10T23:38:13.238995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:33.011117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.227500+0000","last_change":"2024-09-10T23:38:12.223114+0000","last_active":"2024-09-10T23:38:13.227500+0000","last_peered":"2024-09-10T23:38:13.227500+0000","last_clean":"2024-09-10T23:38:13.227500+0000","last_became_active":"2024-09-10T23:38:12.222748+0000","last_became_peered":"2024-09-10T23:38:12.222748+0000","last_unstale":"2024-09-10T23:38:13.227500+0000","last_undegraded":"2024-09-10T23:38:13.227500+0000","last_fullsized":"2024-09-10T23:38:13.227500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:38.384821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.224876+0000","last_change":"2024-09-10T23:38:12.225061+0000","last_active":"2024-09-10T23:38:13.224876+0000","last_peered":"2024-09-10T23:38:13.224876+0000","last_clean":"2024-09-10T23:38:13.224876+0000","last_became_active":"2024-09-10T23:38:12.224730+0000","last_became_peered":"2024-09-10T23:38:12.224730+0000","last_unstale":"2024-09-10T23:38:13.224876+0000","last_undegraded":"2024-09-10T23:38:13.224876+0000","last_fullsized":"2024-09-10T23:38:13.224876+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:40.343294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240048+0000","last_change":"2024-09-10T23:38:12.219920+0000","last_active":"2024-09-10T23:38:13.240048+0000","last_peered":"2024-09-10T23:38:13.240048+0000","last_clean":"2024-09-10T23:38:13.240048+0000","last_became_active":"2024-09-10T23:38:12.219517+0000","last_became_peered":"2024-09-10T23:38:12.219517+0000","last_unstale":"2024-09-10T23:38:13.240048+0000","last_undegraded":"2024-09-10T23:38:13.240048+0000","last_fullsized":"2024-09-10T23:38:13.240048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:58.686977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239159+0000","last_change":"2024-09-10T23:38:12.219740+0000","last_active":"2024-09-10T23:38:13.239159+0000","last_peered":"2024-09-10T23:38:13.239159+0000","last_clean":"2024-09-10T23:38:13.239159+0000","last_became_active":"2024-09-10T23:38:12.215497+0000","last_became_peered":"2024-09-10T23:38:12.215497+0000","last_unstale":"2024-09-10T23:38:13.239159+0000","last_undegraded":"2024-09-10T23:38:13.239159+0000","last_fullsized":"2024-09-10T23:38:13.239159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:06.503836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239250+0000","last_change":"2024-09-10T23:38:12.217066+0000","last_active":"2024-09-10T23:38:13.239250+0000","last_peered":"2024-09-10T23:38:13.239250+0000","last_clean":"2024-09-10T23:38:13.239250+0000","last_became_active":"2024-09-10T23:38:12.216758+0000","last_became_peered":"2024-09-10T23:38:12.216758+0000","last_unstale":"2024-09-10T23:38:13.239250+0000","last_undegraded":"2024-09-10T23:38:13.239250+0000","last_fullsized":"2024-09-10T23:38:13.239250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:53.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242376+0000","last_change":"2024-09-10T23:38:12.216584+0000","last_active":"2024-09-10T23:38:13.242376+0000","last_peered":"2024-09-10T23:38:13.242376+0000","last_clean":"2024-09-10T23:38:13.242376+0000","last_became_active":"2024-09-10T23:38:12.216296+0000","last_became_peered":"2024-09-10T23:38:12.216296+0000","last_unstale":"2024-09-10T23:38:13.242376+0000","last_undegraded":"2024-09-10T23:38:13.242376+0000","last_fullsized":"2024-09-10T23:38:13.242376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:11.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242387+0000","last_change":"2024-09-10T23:38:12.211923+0000","last_active":"2024-09-10T23:38:13.242387+0000","last_peered":"2024-09-10T23:38:13.242387+0000","last_clean":"2024-09-10T23:38:13.242387+0000","last_became_active":"2024-09-10T23:38:12.211608+0000","last_became_peered":"2024-09-10T23:38:12.211608+0000","last_unstale":"2024-09-10T23:38:13.242387+0000","last_undegraded":"2024-09-10T23:38:13.242387+0000","last_fullsized":"2024-09-10T23:38:13.242387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:14.112411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.226766+0000","last_change":"2024-09-10T23:38:12.229957+0000","last_active":"2024-09-10T23:38:13.226766+0000","last_peered":"2024-09-10T23:38:13.226766+0000","last_clean":"2024-09-10T23:38:13.226766+0000","last_became_active":"2024-09-10T23:38:12.229297+0000","last_became_peered":"2024-09-10T23:38:12.229297+0000","last_unstale":"2024-09-10T23:38:13.226766+0000","last_undegraded":"2024-09-10T23:38:13.226766+0000","last_fullsized":"2024-09-10T23:38:13.226766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:54.119455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.223076+0000","last_change":"2024-09-10T23:38:12.218345+0000","last_active":"2024-09-10T23:38:13.223076+0000","last_peered":"2024-09-10T23:38:13.223076+0000","last_clean":"2024-09-10T23:38:13.223076+0000","last_became_active":"2024-09-10T23:38:12.218060+0000","last_became_peered":"2024-09-10T23:38:12.218060+0000","last_unstale":"2024-09-10T23:38:13.223076+0000","last_undegraded":"2024-09-10T23:38:13.223076+0000","last_fullsized":"2024-09-10T23:38:13.223076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.912757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.237575+0000","last_change":"2024-09-10T23:38:12.215025+0000","last_active":"2024-09-10T23:38:13.237575+0000","last_peered":"2024-09-10T23:38:13.237575+0000","last_clean":"2024-09-10T23:38:13.237575+0000","last_became_active":"2024-09-10T23:38:12.214709+0000","last_became_peered":"2024-09-10T23:38:12.214709+0000","last_unstale":"2024-09-10T23:38:13.237575+0000","last_undegraded":"2024-09-10T23:38:13.237575+0000","last_fullsized":"2024-09-10T23:38:13.237575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:00.925426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.244367+0000","last_change":"2024-09-10T23:38:12.215536+0000","last_active":"2024-09-10T23:38:13.244367+0000","last_peered":"2024-09-10T23:38:13.244367+0000","last_clean":"2024-09-10T23:38:13.244367+0000","last_became_active":"2024-09-10T23:38:12.214991+0000","last_became_peered":"2024-09-10T23:38:12.214991+0000","last_unstale":"2024-09-10T23:38:13.244367+0000","last_undegraded":"2024-09-10T23:38:13.244367+0000","last_fullsized":"2024-09-10T23:38:13.244367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.059276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222624+0000","last_change":"2024-09-10T23:38:12.224919+0000","last_active":"2024-09-10T23:38:13.222624+0000","last_peered":"2024-09-10T23:38:13.222624+0000","last_clean":"2024-09-10T23:38:13.222624+0000","last_became_active":"2024-09-10T23:38:12.224559+0000","last_became_peered":"2024-09-10T23:38:12.224559+0000","last_unstale":"2024-09-10T23:38:13.222624+0000","last_undegraded":"2024-09-10T23:38:13.222624+0000","last_fullsized":"2024-09-10T23:38:13.222624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:23.373211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239295+0000","last_change":"2024-09-10T23:38:12.216995+0000","last_active":"2024-09-10T23:38:13.239295+0000","last_peered":"2024-09-10T23:38:13.239295+0000","last_clean":"2024-09-10T23:38:13.239295+0000","last_became_active":"2024-09-10T23:38:12.216681+0000","last_became_peered":"2024-09-10T23:38:12.216681+0000","last_unstale":"2024-09-10T23:38:13.239295+0000","last_undegraded":"2024-09-10T23:38:13.239295+0000","last_fullsized":"2024-09-10T23:38:13.239295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:37.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.226983+0000","last_change":"2024-09-10T23:38:12.221618+0000","last_active":"2024-09-10T23:38:13.226983+0000","last_peered":"2024-09-10T23:38:13.226983+0000","last_clean":"2024-09-10T23:38:13.226983+0000","last_became_active":"2024-09-10T23:38:12.219352+0000","last_became_peered":"2024-09-10T23:38:12.219352+0000","last_unstale":"2024-09-10T23:38:13.226983+0000","last_undegraded":"2024-09-10T23:38:13.226983+0000","last_fullsized":"2024-09-10T23:38:13.226983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:48.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239728+0000","last_change":"2024-09-10T23:38:12.221530+0000","last_active":"2024-09-10T23:38:13.239728+0000","last_peered":"2024-09-10T23:38:13.239728+0000","last_clean":"2024-09-10T23:38:13.239728+0000","last_became_active":"2024-09-10T23:38:12.221024+0000","last_became_peered":"2024-09-10T23:38:12.221024+0000","last_unstale":"2024-09-10T23:38:13.239728+0000","last_undegraded":"2024-09-10T23:38:13.239728+0000","last_fullsized":"2024-09-10T23:38:13.239728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238357+0000","last_change":"2024-09-10T23:38:12.219990+0000","last_active":"2024-09-10T23:38:13.238357+0000","last_peered":"2024-09-10T23:38:13.238357+0000","last_clean":"2024-09-10T23:38:13.238357+0000","last_became_active":"2024-09-10T23:38:12.219560+0000","last_became_peered":"2024-09-10T23:38:12.219560+0000","last_unstale":"2024-09-10T23:38:13.238357+0000","last_undegraded":"2024-09-10T23:38:13.238357+0000","last_fullsized":"2024-09-10T23:38:13.238357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:28.112467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239301+0000","last_change":"2024-09-10T23:38:12.225753+0000","last_active":"2024-09-10T23:38:13.239301+0000","last_peered":"2024-09-10T23:38:13.239301+0000","last_clean":"2024-09-10T23:38:13.239301+0000","last_became_active":"2024-09-10T23:38:12.225450+0000","last_became_peered":"2024-09-10T23:38:12.225450+0000","last_unstale":"2024-09-10T23:38:13.239301+0000","last_undegraded":"2024-09-10T23:38:13.239301+0000","last_fullsized":"2024-09-10T23:38:13.239301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:23.478611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.246635+0000","last_change":"2024-09-10T23:38:12.216917+0000","last_active":"2024-09-10T23:38:13.246635+0000","last_peered":"2024-09-10T23:38:13.246635+0000","last_clean":"2024-09-10T23:38:13.246635+0000","last_became_active":"2024-09-10T23:38:12.216528+0000","last_became_peered":"2024-09-10T23:38:12.216528+0000","last_unstale":"2024-09-10T23:38:13.246635+0000","last_undegraded":"2024-09-10T23:38:13.246635+0000","last_fullsized":"2024-09-10T23:38:13.246635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:03.902221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222882+0000","last_change":"2024-09-10T23:38:12.219372+0000","last_active":"2024-09-10T23:38:13.222882+0000","last_peered":"2024-09-10T23:38:13.222882+0000","last_clean":"2024-09-10T23:38:13.222882+0000","last_became_active":"2024-09-10T23:38:12.219072+0000","last_became_peered":"2024-09-10T23:38:12.219072+0000","last_unstale":"2024-09-10T23:38:13.222882+0000","last_undegraded":"2024-09-10T23:38:13.222882+0000","last_fullsized":"2024-09-10T23:38:13.222882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:07.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239401+0000","last_change":"2024-09-10T23:38:12.224716+0000","last_active":"2024-09-10T23:38:13.239401+0000","last_peered":"2024-09-10T23:38:13.239401+0000","last_clean":"2024-09-10T23:38:13.239401+0000","last_became_active":"2024-09-10T23:38:12.224393+0000","last_became_peered":"2024-09-10T23:38:12.224393+0000","last_unstale":"2024-09-10T23:38:13.239401+0000","last_undegraded":"2024-09-10T23:38:13.239401+0000","last_fullsized":"2024-09-10T23:38:13.239401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.995098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242710+0000","last_change":"2024-09-10T23:38:12.213762+0000","last_active":"2024-09-10T23:38:13.242710+0000","last_peered":"2024-09-10T23:38:13.242710+0000","last_clean":"2024-09-10T23:38:13.242710+0000","last_became_active":"2024-09-10T23:38:12.213440+0000","last_became_peered":"2024-09-10T23:38:12.213440+0000","last_unstale":"2024-09-10T23:38:13.242710+0000","last_undegraded":"2024-09-10T23:38:13.242710+0000","last_fullsized":"2024-09-10T23:38:13.242710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:39.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240351+0000","last_change":"2024-09-10T23:38:12.214278+0000","last_active":"2024-09-10T23:38:13.240351+0000","last_peered":"2024-09-10T23:38:13.240351+0000","last_clean":"2024-09-10T23:38:13.240351+0000","last_became_active":"2024-09-10T23:38:12.212079+0000","last_became_peered":"2024-09-10T23:38:12.212079+0000","last_unstale":"2024-09-10T23:38:13.240351+0000","last_undegraded":"2024-09-10T23:38:13.240351+0000","last_fullsized":"2024-09-10T23:38:13.240351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:42.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241446+0000","last_change":"2024-09-10T23:38:12.214703+0000","last_active":"2024-09-10T23:38:13.241446+0000","last_peered":"2024-09-10T23:38:13.241446+0000","last_clean":"2024-09-10T23:38:13.241446+0000","last_became_active":"2024-09-10T23:38:12.214353+0000","last_became_peered":"2024-09-10T23:38:12.214353+0000","last_unstale":"2024-09-10T23:38:13.241446+0000","last_undegraded":"2024-09-10T23:38:13.241446+0000","last_fullsized":"2024-09-10T23:38:13.241446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.004904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222602+0000","last_change":"2024-09-10T23:38:12.223462+0000","last_active":"2024-09-10T23:38:13.222602+0000","last_peered":"2024-09-10T23:38:13.222602+0000","last_clean":"2024-09-10T23:38:13.222602+0000","last_became_active":"2024-09-10T23:38:12.223159+0000","last_became_peered":"2024-09-10T23:38:12.223159+0000","last_unstale":"2024-09-10T23:38:13.222602+0000","last_undegraded":"2024-09-10T23:38:13.222602+0000","last_fullsized":"2024-09-10T23:38:13.222602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.587560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238724+0000","last_change":"2024-09-10T23:38:12.213290+0000","last_active":"2024-09-10T23:38:13.238724+0000","last_peered":"2024-09-10T23:38:13.238724+0000","last_clean":"2024-09-10T23:38:13.238724+0000","last_became_active":"2024-09-10T23:38:12.212999+0000","last_became_peered":"2024-09-10T23:38:12.212999+0000","last_unstale":"2024-09-10T23:38:13.238724+0000","last_undegraded":"2024-09-10T23:38:13.238724+0000","last_fullsized":"2024-09-10T23:38:13.238724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:54.448436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:35.303088+0000","last_change":"2024-09-10T23:38:10.210483+0000","last_active":"2024-09-10T23:38:35.303088+0000","last_peered":"2024-09-10T23:38:35.303088+0000","last_clean":"2024-09-10T23:38:35.303088+0000","last_became_active":"2024-09-10T23:38:10.210108+0000","last_became_peered":"2024-09-10T23:38:10.210108+0000","last_unstale":"2024-09-10T23:38:35.303088+0000","last_undegraded":"2024-09-10T23:38:35.303088+0000","last_fullsized":"2024-09-10T23:38:35.303088+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:33.370496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239662+0000","last_change":"2024-09-10T23:38:12.224527+0000","last_active":"2024-09-10T23:38:13.239662+0000","last_peered":"2024-09-10T23:38:13.239662+0000","last_clean":"2024-09-10T23:38:13.239662+0000","last_became_active":"2024-09-10T23:38:12.224175+0000","last_became_peered":"2024-09-10T23:38:12.224175+0000","last_unstale":"2024-09-10T23:38:13.239662+0000","last_undegraded":"2024-09-10T23:38:13.239662+0000","last_fullsized":"2024-09-10T23:38:13.239662+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:59.992163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273595+0000","last_change":"2024-09-10T23:38:10.210875+0000","last_active":"2024-09-10T23:38:22.273595+0000","last_peered":"2024-09-10T23:38:22.273595+0000","last_clean":"2024-09-10T23:38:22.273595+0000","last_became_active":"2024-09-10T23:38:10.209254+0000","last_became_peered":"2024-09-10T23:38:10.209254+0000","last_unstale":"2024-09-10T23:38:22.273595+0000","last_undegraded":"2024-09-10T23:38:22.273595+0000","last_fullsized":"2024-09-10T23:38:22.273595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:21.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.272894+0000","last_change":"2024-09-10T23:38:10.213483+0000","last_active":"2024-09-10T23:38:22.272894+0000","last_peered":"2024-09-10T23:38:22.272894+0000","last_clean":"2024-09-10T23:38:22.272894+0000","last_became_active":"2024-09-10T23:38:10.213109+0000","last_became_peered":"2024-09-10T23:38:10.213109+0000","last_unstale":"2024-09-10T23:38:22.272894+0000","last_undegraded":"2024-09-10T23:38:22.272894+0000","last_fullsized":"2024-09-10T23:38:22.272894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:03.563548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239115+0000","last_change":"2024-09-10T23:38:12.217136+0000","last_active":"2024-09-10T23:38:13.239115+0000","last_peered":"2024-09-10T23:38:13.239115+0000","last_clean":"2024-09-10T23:38:13.239115+0000","last_became_active":"2024-09-10T23:38:12.216813+0000","last_became_peered":"2024-09-10T23:38:12.216813+0000","last_unstale":"2024-09-10T23:38:13.239115+0000","last_undegraded":"2024-09-10T23:38:13.239115+0000","last_fullsized":"2024-09-10T23:38:13.239115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:26.184575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238732+0000","last_change":"2024-09-10T23:38:10.209109+0000","last_active":"2024-09-10T23:38:13.238732+0000","last_peered":"2024-09-10T23:38:13.238732+0000","last_clean":"2024-09-10T23:38:13.238732+0000","last_became_active":"2024-09-10T23:38:10.208450+0000","last_became_peered":"2024-09-10T23:38:10.208450+0000","last_unstale":"2024-09-10T23:38:13.238732+0000","last_undegraded":"2024-09-10T23:38:13.238732+0000","last_fullsized":"2024-09-10T23:38:13.238732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:29.453119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.237205+0000","last_change":"2024-09-10T23:38:12.213755+0000","last_active":"2024-09-10T23:38:13.237205+0000","last_peered":"2024-09-10T23:38:13.237205+0000","last_clean":"2024-09-10T23:38:13.237205+0000","last_became_active":"2024-09-10T23:38:12.213454+0000","last_became_peered":"2024-09-10T23:38:12.213454+0000","last_unstale":"2024-09-10T23:38:13.237205+0000","last_undegraded":"2024-09-10T23:38:13.237205+0000","last_fullsized":"2024-09-10T23:38:13.237205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.958053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:36.303908+0000","last_change":"2024-09-10T23:38:10.209908+0000","last_active":"2024-09-10T23:38:36.303908+0000","last_peered":"2024-09-10T23:38:36.303908+0000","last_clean":"2024-09-10T23:38:36.303908+0000","last_became_active":"2024-09-10T23:38:10.208867+0000","last_became_peered":"2024-09-10T23:38:10.208867+0000","last_unstale":"2024-09-10T23:38:36.303908+0000","last_undegraded":"2024-09-10T23:38:36.303908+0000","last_fullsized":"2024-09-10T23:38:36.303908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:09.239123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.227464+0000","last_change":"2024-09-10T23:38:12.224353+0000","last_active":"2024-09-10T23:38:13.227464+0000","last_peered":"2024-09-10T23:38:13.227464+0000","last_clean":"2024-09-10T23:38:13.227464+0000","last_became_active":"2024-09-10T23:38:12.223997+0000","last_became_peered":"2024-09-10T23:38:12.223997+0000","last_unstale":"2024-09-10T23:38:13.227464+0000","last_undegraded":"2024-09-10T23:38:13.227464+0000","last_fullsized":"2024-09-10T23:38:13.227464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:53.092794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.267853+0000","last_change":"2024-09-10T23:38:10.207978+0000","last_active":"2024-09-10T23:38:21.267853+0000","last_peered":"2024-09-10T23:38:21.267853+0000","last_clean":"2024-09-10T23:38:21.267853+0000","last_became_active":"2024-09-10T23:38:10.207566+0000","last_became_peered":"2024-09-10T23:38:10.207566+0000","last_unstale":"2024-09-10T23:38:21.267853+0000","last_undegraded":"2024-09-10T23:38:21.267853+0000","last_fullsized":"2024-09-10T23:38:21.267853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:00.715005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242997+0000","last_change":"2024-09-10T23:38:12.215531+0000","last_active":"2024-09-10T23:38:13.242997+0000","last_peered":"2024-09-10T23:38:13.242997+0000","last_clean":"2024-09-10T23:38:13.242997+0000","last_became_active":"2024-09-10T23:38:12.214672+0000","last_became_peered":"2024-09-10T23:38:12.214672+0000","last_unstale":"2024-09-10T23:38:13.242997+0000","last_undegraded":"2024-09-10T23:38:13.242997+0000","last_fullsized":"2024-09-10T23:38:13.242997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:27.815325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.269341+0000","last_change":"2024-09-10T23:38:10.257254+0000","last_active":"2024-09-10T23:38:21.269341+0000","last_peered":"2024-09-10T23:38:21.269341+0000","last_clean":"2024-09-10T23:38:21.269341+0000","last_became_active":"2024-09-10T23:38:10.256791+0000","last_became_peered":"2024-09-10T23:38:10.256791+0000","last_unstale":"2024-09-10T23:38:21.269341+0000","last_undegraded":"2024-09-10T23:38:21.269341+0000","last_fullsized":"2024-09-10T23:38:21.269341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:35.931873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.227157+0000","last_change":"2024-09-10T23:38:12.229295+0000","last_active":"2024-09-10T23:38:13.227157+0000","last_peered":"2024-09-10T23:38:13.227157+0000","last_clean":"2024-09-10T23:38:13.227157+0000","last_became_active":"2024-09-10T23:38:12.228846+0000","last_became_peered":"2024-09-10T23:38:12.228846+0000","last_unstale":"2024-09-10T23:38:13.227157+0000","last_undegraded":"2024-09-10T23:38:13.227157+0000","last_fullsized":"2024-09-10T23:38:13.227157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:15.383624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'25","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:37.428178+0000","last_change":"2024-09-10T23:38:10.203362+0000","last_active":"2024-09-10T23:38:37.428178+0000","last_peered":"2024-09-10T23:38:37.428178+0000","last_clean":"2024-09-10T23:38:37.428178+0000","last_became_active":"2024-09-10T23:38:10.202961+0000","last_became_peered":"2024-09-10T23:38:10.202961+0000","last_unstale":"2024-09-10T23:38:37.428178+0000","last_undegraded":"2024-09-10T23:38:37.428178+0000","last_fullsized":"2024-09-10T23:38:37.428178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:33.580368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54952,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":58,"num_write":26,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239504+0000","last_change":"2024-09-10T23:38:12.219094+0000","last_active":"2024-09-10T23:38:13.239504+0000","last_peered":"2024-09-10T23:38:13.239504+0000","last_clean":"2024-09-10T23:38:13.239504+0000","last_became_active":"2024-09-10T23:38:12.218778+0000","last_became_peered":"2024-09-10T23:38:12.218778+0000","last_unstale":"2024-09-10T23:38:13.239504+0000","last_undegraded":"2024-09-10T23:38:13.239504+0000","last_fullsized":"2024-09-10T23:38:13.239504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:59.019756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.274055+0000","last_change":"2024-09-10T23:38:10.204204+0000","last_active":"2024-09-10T23:38:22.274055+0000","last_peered":"2024-09-10T23:38:22.274055+0000","last_clean":"2024-09-10T23:38:22.274055+0000","last_became_active":"2024-09-10T23:38:10.203662+0000","last_became_peered":"2024-09-10T23:38:10.203662+0000","last_unstale":"2024-09-10T23:38:22.274055+0000","last_undegraded":"2024-09-10T23:38:22.274055+0000","last_fullsized":"2024-09-10T23:38:22.274055+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:44.243961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238438+0000","last_change":"2024-09-10T23:38:12.214337+0000","last_active":"2024-09-10T23:38:13.238438+0000","last_peered":"2024-09-10T23:38:13.238438+0000","last_clean":"2024-09-10T23:38:13.238438+0000","last_became_active":"2024-09-10T23:38:12.214024+0000","last_became_peered":"2024-09-10T23:38:12.214024+0000","last_unstale":"2024-09-10T23:38:13.238438+0000","last_undegraded":"2024-09-10T23:38:13.238438+0000","last_fullsized":"2024-09-10T23:38:13.238438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:19.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.267793+0000","last_change":"2024-09-10T23:38:10.208001+0000","last_active":"2024-09-10T23:38:21.267793+0000","last_peered":"2024-09-10T23:38:21.267793+0000","last_clean":"2024-09-10T23:38:21.267793+0000","last_became_active":"2024-09-10T23:38:10.207656+0000","last_became_peered":"2024-09-10T23:38:10.207656+0000","last_unstale":"2024-09-10T23:38:21.267793+0000","last_undegraded":"2024-09-10T23:38:21.267793+0000","last_fullsized":"2024-09-10T23:38:21.267793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:44.679795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241296+0000","last_change":"2024-09-10T23:38:12.227780+0000","last_active":"2024-09-10T23:38:13.241296+0000","last_peered":"2024-09-10T23:38:13.241296+0000","last_clean":"2024-09-10T23:38:13.241296+0000","last_became_active":"2024-09-10T23:38:12.227404+0000","last_became_peered":"2024-09-10T23:38:12.227404+0000","last_unstale":"2024-09-10T23:38:13.241296+0000","last_undegraded":"2024-09-10T23:38:13.241296+0000","last_fullsized":"2024-09-10T23:38:13.241296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:58.453685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:34.301461+0000","last_change":"2024-09-10T23:38:10.214786+0000","last_active":"2024-09-10T23:38:34.301461+0000","last_peered":"2024-09-10T23:38:34.301461+0000","last_clean":"2024-09-10T23:38:34.301461+0000","last_became_active":"2024-09-10T23:38:10.214124+0000","last_became_peered":"2024-09-10T23:38:10.214124+0000","last_unstale":"2024-09-10T23:38:34.301461+0000","last_undegraded":"2024-09-10T23:38:34.301461+0000","last_fullsized":"2024-09-10T23:38:34.301461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:00.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240869+0000","last_change":"2024-09-10T23:38:12.220507+0000","last_active":"2024-09-10T23:38:13.240869+0000","last_peered":"2024-09-10T23:38:13.240869+0000","last_clean":"2024-09-10T23:38:13.240869+0000","last_became_active":"2024-09-10T23:38:12.220178+0000","last_became_peered":"2024-09-10T23:38:12.220178+0000","last_unstale":"2024-09-10T23:38:13.240869+0000","last_undegraded":"2024-09-10T23:38:13.240869+0000","last_fullsized":"2024-09-10T23:38:13.240869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:57.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273877+0000","last_change":"2024-09-10T23:38:10.256166+0000","last_active":"2024-09-10T23:38:22.273877+0000","last_peered":"2024-09-10T23:38:22.273877+0000","last_clean":"2024-09-10T23:38:22.273877+0000","last_became_active":"2024-09-10T23:38:10.255792+0000","last_became_peered":"2024-09-10T23:38:10.255792+0000","last_unstale":"2024-09-10T23:38:22.273877+0000","last_undegraded":"2024-09-10T23:38:22.273877+0000","last_fullsized":"2024-09-10T23:38:22.273877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:44.621339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239311+0000","last_change":"2024-09-10T23:38:12.225151+0000","last_active":"2024-09-10T23:38:13.239311+0000","last_peered":"2024-09-10T23:38:13.239311+0000","last_clean":"2024-09-10T23:38:13.239311+0000","last_became_active":"2024-09-10T23:38:12.224748+0000","last_became_peered":"2024-09-10T23:38:12.224748+0000","last_unstale":"2024-09-10T23:38:13.239311+0000","last_undegraded":"2024-09-10T23:38:13.239311+0000","last_fullsized":"2024-09-10T23:38:13.239311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:23.280155+0000","last_change":"2024-09-10T23:38:10.212774+0000","last_active":"2024-09-10T23:38:23.280155+0000","last_peered":"2024-09-10T23:38:23.280155+0000","last_clean":"2024-09-10T23:38:23.280155+0000","last_became_active":"2024-09-10T23:38:10.212380+0000","last_became_peered":"2024-09-10T23:38:10.212380+0000","last_unstale":"2024-09-10T23:38:23.280155+0000","last_undegraded":"2024-09-10T23:38:23.280155+0000","last_fullsized":"2024-09-10T23:38:23.280155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.702192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222761+0000","last_change":"2024-09-10T23:38:12.225417+0000","last_active":"2024-09-10T23:38:13.222761+0000","last_peered":"2024-09-10T23:38:13.222761+0000","last_clean":"2024-09-10T23:38:13.222761+0000","last_became_active":"2024-09-10T23:38:12.225129+0000","last_became_peered":"2024-09-10T23:38:12.225129+0000","last_unstale":"2024-09-10T23:38:13.222761+0000","last_undegraded":"2024-09-10T23:38:13.222761+0000","last_fullsized":"2024-09-10T23:38:13.222761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:42.935776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.248562+0000","last_change":"2024-09-10T23:38:10.204942+0000","last_active":"2024-09-10T23:38:13.248562+0000","last_peered":"2024-09-10T23:38:13.248562+0000","last_clean":"2024-09-10T23:38:13.248562+0000","last_became_active":"2024-09-10T23:38:10.204568+0000","last_became_peered":"2024-09-10T23:38:10.204568+0000","last_unstale":"2024-09-10T23:38:13.248562+0000","last_undegraded":"2024-09-10T23:38:13.248562+0000","last_fullsized":"2024-09-10T23:38:13.248562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:00.608617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241669+0000","last_change":"2024-09-10T23:38:12.217411+0000","last_active":"2024-09-10T23:38:13.241669+0000","last_peered":"2024-09-10T23:38:13.241669+0000","last_clean":"2024-09-10T23:38:13.241669+0000","last_became_active":"2024-09-10T23:38:12.216998+0000","last_became_peered":"2024-09-10T23:38:12.216998+0000","last_unstale":"2024-09-10T23:38:13.241669+0000","last_undegraded":"2024-09-10T23:38:13.241669+0000","last_fullsized":"2024-09-10T23:38:13.241669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:12.852239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.245595+0000","last_change":"2024-09-10T23:38:10.209596+0000","last_active":"2024-09-10T23:38:13.245595+0000","last_peered":"2024-09-10T23:38:13.245595+0000","last_clean":"2024-09-10T23:38:13.245595+0000","last_became_active":"2024-09-10T23:38:10.209348+0000","last_became_peered":"2024-09-10T23:38:10.209348+0000","last_unstale":"2024-09-10T23:38:13.245595+0000","last_undegraded":"2024-09-10T23:38:13.245595+0000","last_fullsized":"2024-09-10T23:38:13.245595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:30.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241258+0000","last_change":"2024-09-10T23:38:12.224071+0000","last_active":"2024-09-10T23:38:13.241258+0000","last_peered":"2024-09-10T23:38:13.241258+0000","last_clean":"2024-09-10T23:38:13.241258+0000","last_became_active":"2024-09-10T23:38:12.223773+0000","last_became_peered":"2024-09-10T23:38:12.223773+0000","last_unstale":"2024-09-10T23:38:13.241258+0000","last_undegraded":"2024-09-10T23:38:13.241258+0000","last_fullsized":"2024-09-10T23:38:13.241258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:43.412524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273355+0000","last_change":"2024-09-10T23:38:10.300065+0000","last_active":"2024-09-10T23:38:22.273355+0000","last_peered":"2024-09-10T23:38:22.273355+0000","last_clean":"2024-09-10T23:38:22.273355+0000","last_became_active":"2024-09-10T23:38:10.299624+0000","last_became_peered":"2024-09-10T23:38:10.299624+0000","last_unstale":"2024-09-10T23:38:22.273355+0000","last_undegraded":"2024-09-10T23:38:22.273355+0000","last_fullsized":"2024-09-10T23:38:22.273355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:02.516651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240076+0000","last_change":"2024-09-10T23:38:12.222280+0000","last_active":"2024-09-10T23:38:13.240076+0000","last_peered":"2024-09-10T23:38:13.240076+0000","last_clean":"2024-09-10T23:38:13.240076+0000","last_became_active":"2024-09-10T23:38:12.221644+0000","last_became_peered":"2024-09-10T23:38:12.221644+0000","last_unstale":"2024-09-10T23:38:13.240076+0000","last_undegraded":"2024-09-10T23:38:13.240076+0000","last_fullsized":"2024-09-10T23:38:13.240076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.823629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241049+0000","last_change":"2024-09-10T23:36:58.824948+0000","last_active":"2024-09-10T23:38:13.241049+0000","last_peered":"2024-09-10T23:38:13.241049+0000","last_clean":"2024-09-10T23:38:13.241049+0000","last_became_active":"2024-09-10T23:36:58.819334+0000","last_became_peered":"2024-09-10T23:36:58.819334+0000","last_unstale":"2024-09-10T23:38:13.241049+0000","last_undegraded":"2024-09-10T23:38:13.241049+0000","last_fullsized":"2024-09-10T23:38:13.241049+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_clean_scrub_stamp":"2024-09-10T23:33:36.806080+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:52.996301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:23.283371+0000","last_change":"2024-09-10T23:38:10.215224+0000","last_active":"2024-09-10T23:38:23.283371+0000","last_peered":"2024-09-10T23:38:23.283371+0000","last_clean":"2024-09-10T23:38:23.283371+0000","last_became_active":"2024-09-10T23:38:10.214795+0000","last_became_peered":"2024-09-10T23:38:10.214795+0000","last_unstale":"2024-09-10T23:38:23.283371+0000","last_undegraded":"2024-09-10T23:38:23.283371+0000","last_fullsized":"2024-09-10T23:38:23.283371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:26.599793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240011+0000","last_change":"2024-09-10T23:38:12.220247+0000","last_active":"2024-09-10T23:38:13.240011+0000","last_peered":"2024-09-10T23:38:13.240011+0000","last_clean":"2024-09-10T23:38:13.240011+0000","last_became_active":"2024-09-10T23:38:12.219968+0000","last_became_peered":"2024-09-10T23:38:12.219968+0000","last_unstale":"2024-09-10T23:38:13.240011+0000","last_undegraded":"2024-09-10T23:38:13.240011+0000","last_fullsized":"2024-09-10T23:38:13.240011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:32.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273687+0000","last_change":"2024-09-10T23:38:10.212748+0000","last_active":"2024-09-10T23:38:22.273687+0000","last_peered":"2024-09-10T23:38:22.273687+0000","last_clean":"2024-09-10T23:38:22.273687+0000","last_became_active":"2024-09-10T23:38:10.212427+0000","last_became_peered":"2024-09-10T23:38:10.212427+0000","last_unstale":"2024-09-10T23:38:22.273687+0000","last_undegraded":"2024-09-10T23:38:22.273687+0000","last_fullsized":"2024-09-10T23:38:22.273687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:23.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238090+0000","last_change":"2024-09-10T23:38:12.225178+0000","last_active":"2024-09-10T23:38:13.238090+0000","last_peered":"2024-09-10T23:38:13.238090+0000","last_clean":"2024-09-10T23:38:13.238090+0000","last_became_active":"2024-09-10T23:38:12.224860+0000","last_became_peered":"2024-09-10T23:38:12.224860+0000","last_unstale":"2024-09-10T23:38:13.238090+0000","last_undegraded":"2024-09-10T23:38:13.238090+0000","last_fullsized":"2024-09-10T23:38:13.238090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:10.986009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:36.303614+0000","last_change":"2024-09-10T23:38:10.254625+0000","last_active":"2024-09-10T23:38:36.303614+0000","last_peered":"2024-09-10T23:38:36.303614+0000","last_clean":"2024-09-10T23:38:36.303614+0000","last_became_active":"2024-09-10T23:38:10.254259+0000","last_became_peered":"2024-09-10T23:38:10.254259+0000","last_unstale":"2024-09-10T23:38:36.303614+0000","last_undegraded":"2024-09-10T23:38:36.303614+0000","last_fullsized":"2024-09-10T23:38:36.303614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:46.371999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238405+0000","last_change":"2024-09-10T23:38:12.217168+0000","last_active":"2024-09-10T23:38:13.238405+0000","last_peered":"2024-09-10T23:38:13.238405+0000","last_clean":"2024-09-10T23:38:13.238405+0000","last_became_active":"2024-09-10T23:38:12.216814+0000","last_became_peered":"2024-09-10T23:38:12.216814+0000","last_unstale":"2024-09-10T23:38:13.238405+0000","last_undegraded":"2024-09-10T23:38:13.238405+0000","last_fullsized":"2024-09-10T23:38:13.238405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:41.494690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241000+0000","last_change":"2024-09-10T23:38:10.207456+0000","last_active":"2024-09-10T23:38:13.241000+0000","last_peered":"2024-09-10T23:38:13.241000+0000","last_clean":"2024-09-10T23:38:13.241000+0000","last_became_active":"2024-09-10T23:38:10.207079+0000","last_became_peered":"2024-09-10T23:38:10.207079+0000","last_unstale":"2024-09-10T23:38:13.241000+0000","last_undegraded":"2024-09-10T23:38:13.241000+0000","last_fullsized":"2024-09-10T23:38:13.241000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:14.631231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.224901+0000","last_change":"2024-09-10T23:38:12.218306+0000","last_active":"2024-09-10T23:38:13.224901+0000","last_peered":"2024-09-10T23:38:13.224901+0000","last_clean":"2024-09-10T23:38:13.224901+0000","last_became_active":"2024-09-10T23:38:12.217981+0000","last_became_peered":"2024-09-10T23:38:12.217981+0000","last_unstale":"2024-09-10T23:38:13.224901+0000","last_undegraded":"2024-09-10T23:38:13.224901+0000","last_fullsized":"2024-09-10T23:38:13.224901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:31.745904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.237369+0000","last_change":"2024-09-10T23:38:10.256617+0000","last_active":"2024-09-10T23:38:13.237369+0000","last_peered":"2024-09-10T23:38:13.237369+0000","last_clean":"2024-09-10T23:38:13.237369+0000","last_became_active":"2024-09-10T23:38:10.256314+0000","last_became_peered":"2024-09-10T23:38:10.256314+0000","last_unstale":"2024-09-10T23:38:13.237369+0000","last_undegraded":"2024-09-10T23:38:13.237369+0000","last_fullsized":"2024-09-10T23:38:13.237369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:52.361023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.225010+0000","last_change":"2024-09-10T23:38:12.214507+0000","last_active":"2024-09-10T23:38:13.225010+0000","last_peered":"2024-09-10T23:38:13.225010+0000","last_clean":"2024-09-10T23:38:13.225010+0000","last_became_active":"2024-09-10T23:38:12.214160+0000","last_became_peered":"2024-09-10T23:38:12.214160+0000","last_unstale":"2024-09-10T23:38:13.225010+0000","last_undegraded":"2024-09-10T23:38:13.225010+0000","last_fullsized":"2024-09-10T23:38:13.225010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:04.623624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.266795+0000","last_change":"2024-09-10T23:38:10.256941+0000","last_active":"2024-09-10T23:38:21.266795+0000","last_peered":"2024-09-10T23:38:21.266795+0000","last_clean":"2024-09-10T23:38:21.266795+0000","last_became_active":"2024-09-10T23:38:10.256553+0000","last_became_peered":"2024-09-10T23:38:10.256553+0000","last_unstale":"2024-09-10T23:38:21.266795+0000","last_undegraded":"2024-09-10T23:38:21.266795+0000","last_fullsized":"2024-09-10T23:38:21.266795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:30.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239470+0000","last_change":"2024-09-10T23:38:12.221246+0000","last_active":"2024-09-10T23:38:13.239470+0000","last_peered":"2024-09-10T23:38:13.239470+0000","last_clean":"2024-09-10T23:38:13.239470+0000","last_became_active":"2024-09-10T23:38:12.220912+0000","last_became_peered":"2024-09-10T23:38:12.220912+0000","last_unstale":"2024-09-10T23:38:13.239470+0000","last_undegraded":"2024-09-10T23:38:13.239470+0000","last_fullsized":"2024-09-10T23:38:13.239470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:33.918289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:34.239120+0000","last_change":"2024-09-10T23:38:10.210151+0000","last_active":"2024-09-10T23:38:34.239120+0000","last_peered":"2024-09-10T23:38:34.239120+0000","last_clean":"2024-09-10T23:38:34.239120+0000","last_became_active":"2024-09-10T23:38:10.209832+0000","last_became_peered":"2024-09-10T23:38:10.209832+0000","last_unstale":"2024-09-10T23:38:34.239120+0000","last_undegraded":"2024-09-10T23:38:34.239120+0000","last_fullsized":"2024-09-10T23:38:34.239120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:52.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239547+0000","last_change":"2024-09-10T23:38:12.218256+0000","last_active":"2024-09-10T23:38:13.239547+0000","last_peered":"2024-09-10T23:38:13.239547+0000","last_clean":"2024-09-10T23:38:13.239547+0000","last_became_active":"2024-09-10T23:38:12.217853+0000","last_became_peered":"2024-09-10T23:38:12.217853+0000","last_unstale":"2024-09-10T23:38:13.239547+0000","last_undegraded":"2024-09-10T23:38:13.239547+0000","last_fullsized":"2024-09-10T23:38:13.239547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.268004+0000","last_change":"2024-09-10T23:38:10.300017+0000","last_active":"2024-09-10T23:38:21.268004+0000","last_peered":"2024-09-10T23:38:21.268004+0000","last_clean":"2024-09-10T23:38:21.268004+0000","last_became_active":"2024-09-10T23:38:10.299733+0000","last_became_peered":"2024-09-10T23:38:10.299733+0000","last_unstale":"2024-09-10T23:38:21.268004+0000","last_undegraded":"2024-09-10T23:38:21.268004+0000","last_fullsized":"2024-09-10T23:38:21.268004+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.193043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242860+0000","last_change":"2024-09-10T23:38:12.212818+0000","last_active":"2024-09-10T23:38:13.242860+0000","last_peered":"2024-09-10T23:38:13.242860+0000","last_clean":"2024-09-10T23:38:13.242860+0000","last_became_active":"2024-09-10T23:38:12.212502+0000","last_became_peered":"2024-09-10T23:38:12.212502+0000","last_unstale":"2024-09-10T23:38:13.242860+0000","last_undegraded":"2024-09-10T23:38:13.242860+0000","last_fullsized":"2024-09-10T23:38:13.242860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:26.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.268434+0000","last_change":"2024-09-10T23:38:10.256366+0000","last_active":"2024-09-10T23:38:21.268434+0000","last_peered":"2024-09-10T23:38:21.268434+0000","last_clean":"2024-09-10T23:38:21.268434+0000","last_became_active":"2024-09-10T23:38:10.256056+0000","last_became_peered":"2024-09-10T23:38:10.256056+0000","last_unstale":"2024-09-10T23:38:21.268434+0000","last_undegraded":"2024-09-10T23:38:21.268434+0000","last_fullsized":"2024-09-10T23:38:21.268434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:00.612373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238247+0000","last_change":"2024-09-10T23:38:12.224629+0000","last_active":"2024-09-10T23:38:13.238247+0000","last_peered":"2024-09-10T23:38:13.238247+0000","last_clean":"2024-09-10T23:38:13.238247+0000","last_became_active":"2024-09-10T23:38:12.224018+0000","last_became_peered":"2024-09-10T23:38:12.224018+0000","last_unstale":"2024-09-10T23:38:13.238247+0000","last_undegraded":"2024-09-10T23:38:13.238247+0000","last_fullsized":"2024-09-10T23:38:13.238247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:44.067489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.267508+0000","last_change":"2024-09-10T23:38:10.203395+0000","last_active":"2024-09-10T23:38:21.267508+0000","last_peered":"2024-09-10T23:38:21.267508+0000","last_clean":"2024-09-10T23:38:21.267508+0000","last_became_active":"2024-09-10T23:38:10.203067+0000","last_became_peered":"2024-09-10T23:38:10.203067+0000","last_unstale":"2024-09-10T23:38:21.267508+0000","last_undegraded":"2024-09-10T23:38:21.267508+0000","last_fullsized":"2024-09-10T23:38:21.267508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.398322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222751+0000","last_change":"2024-09-10T23:38:12.223207+0000","last_active":"2024-09-10T23:38:13.222751+0000","last_peered":"2024-09-10T23:38:13.222751+0000","last_clean":"2024-09-10T23:38:13.222751+0000","last_became_active":"2024-09-10T23:38:12.222841+0000","last_became_peered":"2024-09-10T23:38:12.222841+0000","last_unstale":"2024-09-10T23:38:13.222751+0000","last_undegraded":"2024-09-10T23:38:13.222751+0000","last_fullsized":"2024-09-10T23:38:13.222751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:26.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240573+0000","last_change":"2024-09-10T23:38:10.210479+0000","last_active":"2024-09-10T23:38:13.240573+0000","last_peered":"2024-09-10T23:38:13.240573+0000","last_clean":"2024-09-10T23:38:13.240573+0000","last_became_active":"2024-09-10T23:38:10.210124+0000","last_became_peered":"2024-09-10T23:38:10.210124+0000","last_unstale":"2024-09-10T23:38:13.240573+0000","last_undegraded":"2024-09-10T23:38:13.240573+0000","last_fullsized":"2024-09-10T23:38:13.240573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:39.017091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239375+0000","last_change":"2024-09-10T23:38:12.214748+0000","last_active":"2024-09-10T23:38:13.239375+0000","last_peered":"2024-09-10T23:38:13.239375+0000","last_clean":"2024-09-10T23:38:13.239375+0000","last_became_active":"2024-09-10T23:38:12.214431+0000","last_became_peered":"2024-09-10T23:38:12.214431+0000","last_unstale":"2024-09-10T23:38:13.239375+0000","last_undegraded":"2024-09-10T23:38:13.239375+0000","last_fullsized":"2024-09-10T23:38:13.239375+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:02.092876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.268172+0000","last_change":"2024-09-10T23:38:10.214134+0000","last_active":"2024-09-10T23:38:21.268172+0000","last_peered":"2024-09-10T23:38:21.268172+0000","last_clean":"2024-09-10T23:38:21.268172+0000","last_became_active":"2024-09-10T23:38:10.213690+0000","last_became_peered":"2024-09-10T23:38:10.213690+0000","last_unstale":"2024-09-10T23:38:21.268172+0000","last_undegraded":"2024-09-10T23:38:21.268172+0000","last_fullsized":"2024-09-10T23:38:21.268172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:19.369755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240540+0000","last_change":"2024-09-10T23:38:12.218254+0000","last_active":"2024-09-10T23:38:13.240540+0000","last_peered":"2024-09-10T23:38:13.240540+0000","last_clean":"2024-09-10T23:38:13.240540+0000","last_became_active":"2024-09-10T23:38:12.217937+0000","last_became_peered":"2024-09-10T23:38:12.217937+0000","last_unstale":"2024-09-10T23:38:13.240540+0000","last_undegraded":"2024-09-10T23:38:13.240540+0000","last_fullsized":"2024-09-10T23:38:13.240540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:57.080088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240022+0000","last_change":"2024-09-10T23:38:12.224539+0000","last_active":"2024-09-10T23:38:13.240022+0000","last_peered":"2024-09-10T23:38:13.240022+0000","last_clean":"2024-09-10T23:38:13.240022+0000","last_became_active":"2024-09-10T23:38:12.224224+0000","last_became_peered":"2024-09-10T23:38:12.224224+0000","last_unstale":"2024-09-10T23:38:13.240022+0000","last_undegraded":"2024-09-10T23:38:13.240022+0000","last_fullsized":"2024-09-10T23:38:13.240022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:56.618105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.248025+0000","last_change":"2024-09-10T23:38:10.215022+0000","last_active":"2024-09-10T23:38:13.248025+0000","last_peered":"2024-09-10T23:38:13.248025+0000","last_clean":"2024-09-10T23:38:13.248025+0000","last_became_active":"2024-09-10T23:38:10.214678+0000","last_became_peered":"2024-09-10T23:38:10.214678+0000","last_unstale":"2024-09-10T23:38:13.248025+0000","last_undegraded":"2024-09-10T23:38:13.248025+0000","last_fullsized":"2024-09-10T23:38:13.248025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:20.592052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.226893+0000","last_change":"2024-09-10T23:38:12.230449+0000","last_active":"2024-09-10T23:38:13.226893+0000","last_peered":"2024-09-10T23:38:13.226893+0000","last_clean":"2024-09-10T23:38:13.226893+0000","last_became_active":"2024-09-10T23:38:12.228939+0000","last_became_peered":"2024-09-10T23:38:12.228939+0000","last_unstale":"2024-09-10T23:38:13.226893+0000","last_undegraded":"2024-09-10T23:38:13.226893+0000","last_fullsized":"2024-09-10T23:38:13.226893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:45.495207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.272350+0000","last_change":"2024-09-10T23:38:10.209586+0000","last_active":"2024-09-10T23:38:22.272350+0000","last_peered":"2024-09-10T23:38:22.272350+0000","last_clean":"2024-09-10T23:38:22.272350+0000","last_became_active":"2024-09-10T23:38:10.209211+0000","last_became_peered":"2024-09-10T23:38:10.209211+0000","last_unstale":"2024-09-10T23:38:22.272350+0000","last_undegraded":"2024-09-10T23:38:22.272350+0000","last_fullsized":"2024-09-10T23:38:22.272350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:29.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242973+0000","last_change":"2024-09-10T23:38:12.219795+0000","last_active":"2024-09-10T23:38:13.242973+0000","last_peered":"2024-09-10T23:38:13.242973+0000","last_clean":"2024-09-10T23:38:13.242973+0000","last_became_active":"2024-09-10T23:38:12.219318+0000","last_became_peered":"2024-09-10T23:38:12.219318+0000","last_unstale":"2024-09-10T23:38:13.242973+0000","last_undegraded":"2024-09-10T23:38:13.242973+0000","last_fullsized":"2024-09-10T23:38:13.242973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:12.732264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.244074+0000","last_change":"2024-09-10T23:38:10.255508+0000","last_active":"2024-09-10T23:38:13.244074+0000","last_peered":"2024-09-10T23:38:13.244074+0000","last_clean":"2024-09-10T23:38:13.244074+0000","last_became_active":"2024-09-10T23:38:10.255202+0000","last_became_peered":"2024-09-10T23:38:10.255202+0000","last_unstale":"2024-09-10T23:38:13.244074+0000","last_undegraded":"2024-09-10T23:38:13.244074+0000","last_fullsized":"2024-09-10T23:38:13.244074+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:09.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239844+0000","last_change":"2024-09-10T23:38:12.222345+0000","last_active":"2024-09-10T23:38:13.239844+0000","last_peered":"2024-09-10T23:38:13.239844+0000","last_clean":"2024-09-10T23:38:13.239844+0000","last_became_active":"2024-09-10T23:38:12.220593+0000","last_became_peered":"2024-09-10T23:38:12.220593+0000","last_unstale":"2024-09-10T23:38:13.239844+0000","last_undegraded":"2024-09-10T23:38:13.239844+0000","last_fullsized":"2024-09-10T23:38:13.239844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:00.909046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.274314+0000","last_change":"2024-09-10T23:38:10.210071+0000","last_active":"2024-09-10T23:38:22.274314+0000","last_peered":"2024-09-10T23:38:22.274314+0000","last_clean":"2024-09-10T23:38:22.274314+0000","last_became_active":"2024-09-10T23:38:10.209778+0000","last_became_peered":"2024-09-10T23:38:10.209778+0000","last_unstale":"2024-09-10T23:38:22.274314+0000","last_undegraded":"2024-09-10T23:38:22.274314+0000","last_fullsized":"2024-09-10T23:38:22.274314+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:14.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59344,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":112,"num_read_kb":108,"num_write":154,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286063,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":400466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1047290,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103196,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":400702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":400622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":992943,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":400091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":992236,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":400919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":400402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":443826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":860160,"data_stored":442085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":401362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":42201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":43942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:38:40.497 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:38:40.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:40 smithi016 ceph-mon[30855]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:38:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:40.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:40 smithi066 ceph-mon[34761]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:38:41.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:40 smithi071 ceph-mon[35018]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:38:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 -- 172.21.15.16:0/303778664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a28101cd0 msgr2=0x7f1a281020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/303778664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a28101cd0 0x7f1a281020b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009900 tx=0x7f1a1802a410 comp rx=0 tx=0).stop 2024-09-10T23:38:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 -- 172.21.15.16:0/303778664 shutdown_connections 2024-09-10T23:38:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/303778664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a28108060 0x7f1a2810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/303778664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a281076e0 0x7f1a28107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/303778664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a28101cd0 0x7f1a281020b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 -- 172.21.15.16:0/303778664 >> 172.21.15.16:0/303778664 conn(0x7f1a280fd700 msgr2=0x7f1a280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 -- 172.21.15.16:0/303778664 shutdown_connections 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.234+0000 7f1a2cc96640 1 -- 172.21.15.16:0/303778664 wait complete. 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 Processor -- start 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 -- start start 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a28101cd0 0x7f1a28199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a281076e0 0x7f1a281997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a28108060 0x7f1a2819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28112e70 con 0x7f1a281076e0 2024-09-10T23:38:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28112cf0 con 0x7f1a28101cd0 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2cc96640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28112ff0 con 0x7f1a28108060 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a281076e0 0x7f1a281997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a281076e0 0x7f1a281997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50822/0 (socket says 172.21.15.16:50822) 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a25d9b640 1 -- 172.21.15.16:0/1571192508 learned_addr learned my addr 172.21.15.16:0/1571192508 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a2659c640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a28101cd0 0x7f1a28199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a26d9d640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a28108060 0x7f1a2819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a25d9b640 1 -- 172.21.15.16:0/1571192508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a28108060 msgr2=0x7f1a2819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a25d9b640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a28108060 0x7f1a2819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.235+0000 7f1a25d9b640 1 -- 172.21.15.16:0/1571192508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a28101cd0 msgr2=0x7f1a28199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a25d9b640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a28101cd0 0x7f1a28199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a25d9b640 1 -- 172.21.15.16:0/1571192508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2819f330 con 0x7f1a281076e0 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a2659c640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a28101cd0 0x7f1a28199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a25d9b640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a281076e0 0x7f1a281997c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00d950 tx=0x7f1a1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a177fe640 1 -- 172.21.15.16:0/1571192508 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c017070 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2819f620 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a177fe640 1 -- 172.21.15.16:0/1571192508 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a1c009c30 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a177fe640 1 -- 172.21.15.16:0/1571192508 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00f620 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.236+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a281a5eb0 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.237+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a28102f80 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.239+0000 7f1a177fe640 1 -- 172.21.15.16:0/1571192508 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f1a1c010460 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.240+0000 7f1a177fe640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a100b53c0 0x7f1a100b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.240+0000 7f1a2659c640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a100b53c0 0x7f1a100b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.240+0000 7f1a177fe640 1 -- 172.21.15.16:0/1571192508 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f1a1c0e5a90 con 0x7f1a281076e0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.241+0000 7f1a2659c640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a100b53c0 0x7f1a100b7880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a18000c00 tx=0x7f1a18005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.243+0000 7f1a177fe640 1 -- 172.21.15.16:0/1571192508 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1a1c0ac810 con 0x7f1a281076e0 2024-09-10T23:38:41.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.424+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a28063590 con 0x7f1a100b53c0 2024-09-10T23:38:41.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.429+0000 7f1a177fe640 1 -- 172.21.15.16:0/1571192508 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258852 (secure 0 0 0) 0x7f1a28063590 con 0x7f1a100b53c0 2024-09-10T23:38:41.431 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:41.432 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-10T23:38:41.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.432+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a100b53c0 msgr2=0x7f1a100b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:41.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.432+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a100b53c0 0x7f1a100b7880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a18000c00 tx=0x7f1a18005a20 comp rx=0 tx=0).stop 2024-09-10T23:38:41.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.432+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a281076e0 msgr2=0x7f1a281997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:41.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.432+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a281076e0 0x7f1a281997c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00d950 tx=0x7f1a1c00de10 comp rx=0 tx=0).stop 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 shutdown_connections 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a28108060 0x7f1a2819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a281076e0 0x7f1a281997c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a100b53c0 0x7f1a100b7880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 --2- 172.21.15.16:0/1571192508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a28101cd0 0x7f1a28199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 >> 172.21.15.16:0/1571192508 conn(0x7f1a280fd700 msgr2=0x7f1a280ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 shutdown_connections 2024-09-10T23:38:41.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:41.433+0000 7f1a2cc96640 1 -- 172.21.15.16:0/1571192508 wait complete. 2024-09-10T23:38:41.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:41 smithi016 ceph-mon[30855]: pgmap v272: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T23:38:41.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:41 smithi066 ceph-mon[34761]: pgmap v272: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T23:38:42.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:41 smithi071 ceph-mon[35018]: pgmap v272: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T23:38:42.267 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-10T23:38:40.425805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649946,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":193,"num_read_kb":177,"num_write":279,"num_write_kb":2253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380044,"kb_used_data":9996,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561780,"statfs":{"total":1151940427776,"available":1151551262720,"internally_reserved":0,"allocated":10235904,"data_stored":6722944,"data_compressed":109095,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47756,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":66,"num_write":28,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003201"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.223025+0000","last_change":"2024-09-10T23:38:12.217637+0000","last_active":"2024-09-10T23:38:13.223025+0000","last_peered":"2024-09-10T23:38:13.223025+0000","last_clean":"2024-09-10T23:38:13.223025+0000","last_became_active":"2024-09-10T23:38:12.217260+0000","last_became_peered":"2024-09-10T23:38:12.217260+0000","last_unstale":"2024-09-10T23:38:13.223025+0000","last_undegraded":"2024-09-10T23:38:13.223025+0000","last_fullsized":"2024-09-10T23:38:13.223025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.774575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242849+0000","last_change":"2024-09-10T23:38:12.217114+0000","last_active":"2024-09-10T23:38:13.242849+0000","last_peered":"2024-09-10T23:38:13.242849+0000","last_clean":"2024-09-10T23:38:13.242849+0000","last_became_active":"2024-09-10T23:38:12.216836+0000","last_became_peered":"2024-09-10T23:38:12.216836+0000","last_unstale":"2024-09-10T23:38:13.242849+0000","last_undegraded":"2024-09-10T23:38:13.242849+0000","last_fullsized":"2024-09-10T23:38:13.242849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:55.023668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242573+0000","last_change":"2024-09-10T23:38:12.219046+0000","last_active":"2024-09-10T23:38:13.242573+0000","last_peered":"2024-09-10T23:38:13.242573+0000","last_clean":"2024-09-10T23:38:13.242573+0000","last_became_active":"2024-09-10T23:38:12.218348+0000","last_became_peered":"2024-09-10T23:38:12.218348+0000","last_unstale":"2024-09-10T23:38:13.242573+0000","last_undegraded":"2024-09-10T23:38:13.242573+0000","last_fullsized":"2024-09-10T23:38:13.242573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:07.419364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238882+0000","last_change":"2024-09-10T23:38:12.219211+0000","last_active":"2024-09-10T23:38:13.238882+0000","last_peered":"2024-09-10T23:38:13.238882+0000","last_clean":"2024-09-10T23:38:13.238882+0000","last_became_active":"2024-09-10T23:38:12.213452+0000","last_became_peered":"2024-09-10T23:38:12.213452+0000","last_unstale":"2024-09-10T23:38:13.238882+0000","last_undegraded":"2024-09-10T23:38:13.238882+0000","last_fullsized":"2024-09-10T23:38:13.238882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:59.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238677+0000","last_change":"2024-09-10T23:38:12.213636+0000","last_active":"2024-09-10T23:38:13.238677+0000","last_peered":"2024-09-10T23:38:13.238677+0000","last_clean":"2024-09-10T23:38:13.238677+0000","last_became_active":"2024-09-10T23:38:12.213309+0000","last_became_peered":"2024-09-10T23:38:12.213309+0000","last_unstale":"2024-09-10T23:38:13.238677+0000","last_undegraded":"2024-09-10T23:38:13.238677+0000","last_fullsized":"2024-09-10T23:38:13.238677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:34.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.224619+0000","last_change":"2024-09-10T23:38:12.215995+0000","last_active":"2024-09-10T23:38:13.224619+0000","last_peered":"2024-09-10T23:38:13.224619+0000","last_clean":"2024-09-10T23:38:13.224619+0000","last_became_active":"2024-09-10T23:38:12.215601+0000","last_became_peered":"2024-09-10T23:38:12.215601+0000","last_unstale":"2024-09-10T23:38:13.224619+0000","last_undegraded":"2024-09-10T23:38:13.224619+0000","last_fullsized":"2024-09-10T23:38:13.224619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:24.770551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239927+0000","last_change":"2024-09-10T23:38:12.226337+0000","last_active":"2024-09-10T23:38:13.239927+0000","last_peered":"2024-09-10T23:38:13.239927+0000","last_clean":"2024-09-10T23:38:13.239927+0000","last_became_active":"2024-09-10T23:38:12.225953+0000","last_became_peered":"2024-09-10T23:38:12.225953+0000","last_unstale":"2024-09-10T23:38:13.239927+0000","last_undegraded":"2024-09-10T23:38:13.239927+0000","last_fullsized":"2024-09-10T23:38:13.239927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:27.044867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238995+0000","last_change":"2024-09-10T23:38:12.219682+0000","last_active":"2024-09-10T23:38:13.238995+0000","last_peered":"2024-09-10T23:38:13.238995+0000","last_clean":"2024-09-10T23:38:13.238995+0000","last_became_active":"2024-09-10T23:38:12.218596+0000","last_became_peered":"2024-09-10T23:38:12.218596+0000","last_unstale":"2024-09-10T23:38:13.238995+0000","last_undegraded":"2024-09-10T23:38:13.238995+0000","last_fullsized":"2024-09-10T23:38:13.238995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:33.011117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.227500+0000","last_change":"2024-09-10T23:38:12.223114+0000","last_active":"2024-09-10T23:38:13.227500+0000","last_peered":"2024-09-10T23:38:13.227500+0000","last_clean":"2024-09-10T23:38:13.227500+0000","last_became_active":"2024-09-10T23:38:12.222748+0000","last_became_peered":"2024-09-10T23:38:12.222748+0000","last_unstale":"2024-09-10T23:38:13.227500+0000","last_undegraded":"2024-09-10T23:38:13.227500+0000","last_fullsized":"2024-09-10T23:38:13.227500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:38.384821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.224876+0000","last_change":"2024-09-10T23:38:12.225061+0000","last_active":"2024-09-10T23:38:13.224876+0000","last_peered":"2024-09-10T23:38:13.224876+0000","last_clean":"2024-09-10T23:38:13.224876+0000","last_became_active":"2024-09-10T23:38:12.224730+0000","last_became_peered":"2024-09-10T23:38:12.224730+0000","last_unstale":"2024-09-10T23:38:13.224876+0000","last_undegraded":"2024-09-10T23:38:13.224876+0000","last_fullsized":"2024-09-10T23:38:13.224876+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:40.343294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240048+0000","last_change":"2024-09-10T23:38:12.219920+0000","last_active":"2024-09-10T23:38:13.240048+0000","last_peered":"2024-09-10T23:38:13.240048+0000","last_clean":"2024-09-10T23:38:13.240048+0000","last_became_active":"2024-09-10T23:38:12.219517+0000","last_became_peered":"2024-09-10T23:38:12.219517+0000","last_unstale":"2024-09-10T23:38:13.240048+0000","last_undegraded":"2024-09-10T23:38:13.240048+0000","last_fullsized":"2024-09-10T23:38:13.240048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:58.686977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239159+0000","last_change":"2024-09-10T23:38:12.219740+0000","last_active":"2024-09-10T23:38:13.239159+0000","last_peered":"2024-09-10T23:38:13.239159+0000","last_clean":"2024-09-10T23:38:13.239159+0000","last_became_active":"2024-09-10T23:38:12.215497+0000","last_became_peered":"2024-09-10T23:38:12.215497+0000","last_unstale":"2024-09-10T23:38:13.239159+0000","last_undegraded":"2024-09-10T23:38:13.239159+0000","last_fullsized":"2024-09-10T23:38:13.239159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:06.503836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239250+0000","last_change":"2024-09-10T23:38:12.217066+0000","last_active":"2024-09-10T23:38:13.239250+0000","last_peered":"2024-09-10T23:38:13.239250+0000","last_clean":"2024-09-10T23:38:13.239250+0000","last_became_active":"2024-09-10T23:38:12.216758+0000","last_became_peered":"2024-09-10T23:38:12.216758+0000","last_unstale":"2024-09-10T23:38:13.239250+0000","last_undegraded":"2024-09-10T23:38:13.239250+0000","last_fullsized":"2024-09-10T23:38:13.239250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:53.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242376+0000","last_change":"2024-09-10T23:38:12.216584+0000","last_active":"2024-09-10T23:38:13.242376+0000","last_peered":"2024-09-10T23:38:13.242376+0000","last_clean":"2024-09-10T23:38:13.242376+0000","last_became_active":"2024-09-10T23:38:12.216296+0000","last_became_peered":"2024-09-10T23:38:12.216296+0000","last_unstale":"2024-09-10T23:38:13.242376+0000","last_undegraded":"2024-09-10T23:38:13.242376+0000","last_fullsized":"2024-09-10T23:38:13.242376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:11.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242387+0000","last_change":"2024-09-10T23:38:12.211923+0000","last_active":"2024-09-10T23:38:13.242387+0000","last_peered":"2024-09-10T23:38:13.242387+0000","last_clean":"2024-09-10T23:38:13.242387+0000","last_became_active":"2024-09-10T23:38:12.211608+0000","last_became_peered":"2024-09-10T23:38:12.211608+0000","last_unstale":"2024-09-10T23:38:13.242387+0000","last_undegraded":"2024-09-10T23:38:13.242387+0000","last_fullsized":"2024-09-10T23:38:13.242387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:14.112411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.226766+0000","last_change":"2024-09-10T23:38:12.229957+0000","last_active":"2024-09-10T23:38:13.226766+0000","last_peered":"2024-09-10T23:38:13.226766+0000","last_clean":"2024-09-10T23:38:13.226766+0000","last_became_active":"2024-09-10T23:38:12.229297+0000","last_became_peered":"2024-09-10T23:38:12.229297+0000","last_unstale":"2024-09-10T23:38:13.226766+0000","last_undegraded":"2024-09-10T23:38:13.226766+0000","last_fullsized":"2024-09-10T23:38:13.226766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:54.119455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.223076+0000","last_change":"2024-09-10T23:38:12.218345+0000","last_active":"2024-09-10T23:38:13.223076+0000","last_peered":"2024-09-10T23:38:13.223076+0000","last_clean":"2024-09-10T23:38:13.223076+0000","last_became_active":"2024-09-10T23:38:12.218060+0000","last_became_peered":"2024-09-10T23:38:12.218060+0000","last_unstale":"2024-09-10T23:38:13.223076+0000","last_undegraded":"2024-09-10T23:38:13.223076+0000","last_fullsized":"2024-09-10T23:38:13.223076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.912757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.237575+0000","last_change":"2024-09-10T23:38:12.215025+0000","last_active":"2024-09-10T23:38:13.237575+0000","last_peered":"2024-09-10T23:38:13.237575+0000","last_clean":"2024-09-10T23:38:13.237575+0000","last_became_active":"2024-09-10T23:38:12.214709+0000","last_became_peered":"2024-09-10T23:38:12.214709+0000","last_unstale":"2024-09-10T23:38:13.237575+0000","last_undegraded":"2024-09-10T23:38:13.237575+0000","last_fullsized":"2024-09-10T23:38:13.237575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:00.925426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.244367+0000","last_change":"2024-09-10T23:38:12.215536+0000","last_active":"2024-09-10T23:38:13.244367+0000","last_peered":"2024-09-10T23:38:13.244367+0000","last_clean":"2024-09-10T23:38:13.244367+0000","last_became_active":"2024-09-10T23:38:12.214991+0000","last_became_peered":"2024-09-10T23:38:12.214991+0000","last_unstale":"2024-09-10T23:38:13.244367+0000","last_undegraded":"2024-09-10T23:38:13.244367+0000","last_fullsized":"2024-09-10T23:38:13.244367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.059276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222624+0000","last_change":"2024-09-10T23:38:12.224919+0000","last_active":"2024-09-10T23:38:13.222624+0000","last_peered":"2024-09-10T23:38:13.222624+0000","last_clean":"2024-09-10T23:38:13.222624+0000","last_became_active":"2024-09-10T23:38:12.224559+0000","last_became_peered":"2024-09-10T23:38:12.224559+0000","last_unstale":"2024-09-10T23:38:13.222624+0000","last_undegraded":"2024-09-10T23:38:13.222624+0000","last_fullsized":"2024-09-10T23:38:13.222624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:23.373211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239295+0000","last_change":"2024-09-10T23:38:12.216995+0000","last_active":"2024-09-10T23:38:13.239295+0000","last_peered":"2024-09-10T23:38:13.239295+0000","last_clean":"2024-09-10T23:38:13.239295+0000","last_became_active":"2024-09-10T23:38:12.216681+0000","last_became_peered":"2024-09-10T23:38:12.216681+0000","last_unstale":"2024-09-10T23:38:13.239295+0000","last_undegraded":"2024-09-10T23:38:13.239295+0000","last_fullsized":"2024-09-10T23:38:13.239295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:37.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.226983+0000","last_change":"2024-09-10T23:38:12.221618+0000","last_active":"2024-09-10T23:38:13.226983+0000","last_peered":"2024-09-10T23:38:13.226983+0000","last_clean":"2024-09-10T23:38:13.226983+0000","last_became_active":"2024-09-10T23:38:12.219352+0000","last_became_peered":"2024-09-10T23:38:12.219352+0000","last_unstale":"2024-09-10T23:38:13.226983+0000","last_undegraded":"2024-09-10T23:38:13.226983+0000","last_fullsized":"2024-09-10T23:38:13.226983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:48.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239728+0000","last_change":"2024-09-10T23:38:12.221530+0000","last_active":"2024-09-10T23:38:13.239728+0000","last_peered":"2024-09-10T23:38:13.239728+0000","last_clean":"2024-09-10T23:38:13.239728+0000","last_became_active":"2024-09-10T23:38:12.221024+0000","last_became_peered":"2024-09-10T23:38:12.221024+0000","last_unstale":"2024-09-10T23:38:13.239728+0000","last_undegraded":"2024-09-10T23:38:13.239728+0000","last_fullsized":"2024-09-10T23:38:13.239728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238357+0000","last_change":"2024-09-10T23:38:12.219990+0000","last_active":"2024-09-10T23:38:13.238357+0000","last_peered":"2024-09-10T23:38:13.238357+0000","last_clean":"2024-09-10T23:38:13.238357+0000","last_became_active":"2024-09-10T23:38:12.219560+0000","last_became_peered":"2024-09-10T23:38:12.219560+0000","last_unstale":"2024-09-10T23:38:13.238357+0000","last_undegraded":"2024-09-10T23:38:13.238357+0000","last_fullsized":"2024-09-10T23:38:13.238357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:28.112467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239301+0000","last_change":"2024-09-10T23:38:12.225753+0000","last_active":"2024-09-10T23:38:13.239301+0000","last_peered":"2024-09-10T23:38:13.239301+0000","last_clean":"2024-09-10T23:38:13.239301+0000","last_became_active":"2024-09-10T23:38:12.225450+0000","last_became_peered":"2024-09-10T23:38:12.225450+0000","last_unstale":"2024-09-10T23:38:13.239301+0000","last_undegraded":"2024-09-10T23:38:13.239301+0000","last_fullsized":"2024-09-10T23:38:13.239301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:23.478611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.246635+0000","last_change":"2024-09-10T23:38:12.216917+0000","last_active":"2024-09-10T23:38:13.246635+0000","last_peered":"2024-09-10T23:38:13.246635+0000","last_clean":"2024-09-10T23:38:13.246635+0000","last_became_active":"2024-09-10T23:38:12.216528+0000","last_became_peered":"2024-09-10T23:38:12.216528+0000","last_unstale":"2024-09-10T23:38:13.246635+0000","last_undegraded":"2024-09-10T23:38:13.246635+0000","last_fullsized":"2024-09-10T23:38:13.246635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:03.902221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222882+0000","last_change":"2024-09-10T23:38:12.219372+0000","last_active":"2024-09-10T23:38:13.222882+0000","last_peered":"2024-09-10T23:38:13.222882+0000","last_clean":"2024-09-10T23:38:13.222882+0000","last_became_active":"2024-09-10T23:38:12.219072+0000","last_became_peered":"2024-09-10T23:38:12.219072+0000","last_unstale":"2024-09-10T23:38:13.222882+0000","last_undegraded":"2024-09-10T23:38:13.222882+0000","last_fullsized":"2024-09-10T23:38:13.222882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:07.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239401+0000","last_change":"2024-09-10T23:38:12.224716+0000","last_active":"2024-09-10T23:38:13.239401+0000","last_peered":"2024-09-10T23:38:13.239401+0000","last_clean":"2024-09-10T23:38:13.239401+0000","last_became_active":"2024-09-10T23:38:12.224393+0000","last_became_peered":"2024-09-10T23:38:12.224393+0000","last_unstale":"2024-09-10T23:38:13.239401+0000","last_undegraded":"2024-09-10T23:38:13.239401+0000","last_fullsized":"2024-09-10T23:38:13.239401+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.995098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242710+0000","last_change":"2024-09-10T23:38:12.213762+0000","last_active":"2024-09-10T23:38:13.242710+0000","last_peered":"2024-09-10T23:38:13.242710+0000","last_clean":"2024-09-10T23:38:13.242710+0000","last_became_active":"2024-09-10T23:38:12.213440+0000","last_became_peered":"2024-09-10T23:38:12.213440+0000","last_unstale":"2024-09-10T23:38:13.242710+0000","last_undegraded":"2024-09-10T23:38:13.242710+0000","last_fullsized":"2024-09-10T23:38:13.242710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:39.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240351+0000","last_change":"2024-09-10T23:38:12.214278+0000","last_active":"2024-09-10T23:38:13.240351+0000","last_peered":"2024-09-10T23:38:13.240351+0000","last_clean":"2024-09-10T23:38:13.240351+0000","last_became_active":"2024-09-10T23:38:12.212079+0000","last_became_peered":"2024-09-10T23:38:12.212079+0000","last_unstale":"2024-09-10T23:38:13.240351+0000","last_undegraded":"2024-09-10T23:38:13.240351+0000","last_fullsized":"2024-09-10T23:38:13.240351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:42.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241446+0000","last_change":"2024-09-10T23:38:12.214703+0000","last_active":"2024-09-10T23:38:13.241446+0000","last_peered":"2024-09-10T23:38:13.241446+0000","last_clean":"2024-09-10T23:38:13.241446+0000","last_became_active":"2024-09-10T23:38:12.214353+0000","last_became_peered":"2024-09-10T23:38:12.214353+0000","last_unstale":"2024-09-10T23:38:13.241446+0000","last_undegraded":"2024-09-10T23:38:13.241446+0000","last_fullsized":"2024-09-10T23:38:13.241446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.004904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222602+0000","last_change":"2024-09-10T23:38:12.223462+0000","last_active":"2024-09-10T23:38:13.222602+0000","last_peered":"2024-09-10T23:38:13.222602+0000","last_clean":"2024-09-10T23:38:13.222602+0000","last_became_active":"2024-09-10T23:38:12.223159+0000","last_became_peered":"2024-09-10T23:38:12.223159+0000","last_unstale":"2024-09-10T23:38:13.222602+0000","last_undegraded":"2024-09-10T23:38:13.222602+0000","last_fullsized":"2024-09-10T23:38:13.222602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.587560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238724+0000","last_change":"2024-09-10T23:38:12.213290+0000","last_active":"2024-09-10T23:38:13.238724+0000","last_peered":"2024-09-10T23:38:13.238724+0000","last_clean":"2024-09-10T23:38:13.238724+0000","last_became_active":"2024-09-10T23:38:12.212999+0000","last_became_peered":"2024-09-10T23:38:12.212999+0000","last_unstale":"2024-09-10T23:38:13.238724+0000","last_undegraded":"2024-09-10T23:38:13.238724+0000","last_fullsized":"2024-09-10T23:38:13.238724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:54.448436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:35.303088+0000","last_change":"2024-09-10T23:38:10.210483+0000","last_active":"2024-09-10T23:38:35.303088+0000","last_peered":"2024-09-10T23:38:35.303088+0000","last_clean":"2024-09-10T23:38:35.303088+0000","last_became_active":"2024-09-10T23:38:10.210108+0000","last_became_peered":"2024-09-10T23:38:10.210108+0000","last_unstale":"2024-09-10T23:38:35.303088+0000","last_undegraded":"2024-09-10T23:38:35.303088+0000","last_fullsized":"2024-09-10T23:38:35.303088+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:33.370496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239662+0000","last_change":"2024-09-10T23:38:12.224527+0000","last_active":"2024-09-10T23:38:13.239662+0000","last_peered":"2024-09-10T23:38:13.239662+0000","last_clean":"2024-09-10T23:38:13.239662+0000","last_became_active":"2024-09-10T23:38:12.224175+0000","last_became_peered":"2024-09-10T23:38:12.224175+0000","last_unstale":"2024-09-10T23:38:13.239662+0000","last_undegraded":"2024-09-10T23:38:13.239662+0000","last_fullsized":"2024-09-10T23:38:13.239662+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:59.992163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273595+0000","last_change":"2024-09-10T23:38:10.210875+0000","last_active":"2024-09-10T23:38:22.273595+0000","last_peered":"2024-09-10T23:38:22.273595+0000","last_clean":"2024-09-10T23:38:22.273595+0000","last_became_active":"2024-09-10T23:38:10.209254+0000","last_became_peered":"2024-09-10T23:38:10.209254+0000","last_unstale":"2024-09-10T23:38:22.273595+0000","last_undegraded":"2024-09-10T23:38:22.273595+0000","last_fullsized":"2024-09-10T23:38:22.273595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:21.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.272894+0000","last_change":"2024-09-10T23:38:10.213483+0000","last_active":"2024-09-10T23:38:22.272894+0000","last_peered":"2024-09-10T23:38:22.272894+0000","last_clean":"2024-09-10T23:38:22.272894+0000","last_became_active":"2024-09-10T23:38:10.213109+0000","last_became_peered":"2024-09-10T23:38:10.213109+0000","last_unstale":"2024-09-10T23:38:22.272894+0000","last_undegraded":"2024-09-10T23:38:22.272894+0000","last_fullsized":"2024-09-10T23:38:22.272894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:03.563548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239115+0000","last_change":"2024-09-10T23:38:12.217136+0000","last_active":"2024-09-10T23:38:13.239115+0000","last_peered":"2024-09-10T23:38:13.239115+0000","last_clean":"2024-09-10T23:38:13.239115+0000","last_became_active":"2024-09-10T23:38:12.216813+0000","last_became_peered":"2024-09-10T23:38:12.216813+0000","last_unstale":"2024-09-10T23:38:13.239115+0000","last_undegraded":"2024-09-10T23:38:13.239115+0000","last_fullsized":"2024-09-10T23:38:13.239115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:26.184575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238732+0000","last_change":"2024-09-10T23:38:10.209109+0000","last_active":"2024-09-10T23:38:13.238732+0000","last_peered":"2024-09-10T23:38:13.238732+0000","last_clean":"2024-09-10T23:38:13.238732+0000","last_became_active":"2024-09-10T23:38:10.208450+0000","last_became_peered":"2024-09-10T23:38:10.208450+0000","last_unstale":"2024-09-10T23:38:13.238732+0000","last_undegraded":"2024-09-10T23:38:13.238732+0000","last_fullsized":"2024-09-10T23:38:13.238732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:29.453119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.237205+0000","last_change":"2024-09-10T23:38:12.213755+0000","last_active":"2024-09-10T23:38:13.237205+0000","last_peered":"2024-09-10T23:38:13.237205+0000","last_clean":"2024-09-10T23:38:13.237205+0000","last_became_active":"2024-09-10T23:38:12.213454+0000","last_became_peered":"2024-09-10T23:38:12.213454+0000","last_unstale":"2024-09-10T23:38:13.237205+0000","last_undegraded":"2024-09-10T23:38:13.237205+0000","last_fullsized":"2024-09-10T23:38:13.237205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.958053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:36.303908+0000","last_change":"2024-09-10T23:38:10.209908+0000","last_active":"2024-09-10T23:38:36.303908+0000","last_peered":"2024-09-10T23:38:36.303908+0000","last_clean":"2024-09-10T23:38:36.303908+0000","last_became_active":"2024-09-10T23:38:10.208867+0000","last_became_peered":"2024-09-10T23:38:10.208867+0000","last_unstale":"2024-09-10T23:38:36.303908+0000","last_undegraded":"2024-09-10T23:38:36.303908+0000","last_fullsized":"2024-09-10T23:38:36.303908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:09.239123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.227464+0000","last_change":"2024-09-10T23:38:12.224353+0000","last_active":"2024-09-10T23:38:13.227464+0000","last_peered":"2024-09-10T23:38:13.227464+0000","last_clean":"2024-09-10T23:38:13.227464+0000","last_became_active":"2024-09-10T23:38:12.223997+0000","last_became_peered":"2024-09-10T23:38:12.223997+0000","last_unstale":"2024-09-10T23:38:13.227464+0000","last_undegraded":"2024-09-10T23:38:13.227464+0000","last_fullsized":"2024-09-10T23:38:13.227464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:53.092794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.267853+0000","last_change":"2024-09-10T23:38:10.207978+0000","last_active":"2024-09-10T23:38:21.267853+0000","last_peered":"2024-09-10T23:38:21.267853+0000","last_clean":"2024-09-10T23:38:21.267853+0000","last_became_active":"2024-09-10T23:38:10.207566+0000","last_became_peered":"2024-09-10T23:38:10.207566+0000","last_unstale":"2024-09-10T23:38:21.267853+0000","last_undegraded":"2024-09-10T23:38:21.267853+0000","last_fullsized":"2024-09-10T23:38:21.267853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:00.715005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242997+0000","last_change":"2024-09-10T23:38:12.215531+0000","last_active":"2024-09-10T23:38:13.242997+0000","last_peered":"2024-09-10T23:38:13.242997+0000","last_clean":"2024-09-10T23:38:13.242997+0000","last_became_active":"2024-09-10T23:38:12.214672+0000","last_became_peered":"2024-09-10T23:38:12.214672+0000","last_unstale":"2024-09-10T23:38:13.242997+0000","last_undegraded":"2024-09-10T23:38:13.242997+0000","last_fullsized":"2024-09-10T23:38:13.242997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:27.815325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.269341+0000","last_change":"2024-09-10T23:38:10.257254+0000","last_active":"2024-09-10T23:38:21.269341+0000","last_peered":"2024-09-10T23:38:21.269341+0000","last_clean":"2024-09-10T23:38:21.269341+0000","last_became_active":"2024-09-10T23:38:10.256791+0000","last_became_peered":"2024-09-10T23:38:10.256791+0000","last_unstale":"2024-09-10T23:38:21.269341+0000","last_undegraded":"2024-09-10T23:38:21.269341+0000","last_fullsized":"2024-09-10T23:38:21.269341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:35.931873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.227157+0000","last_change":"2024-09-10T23:38:12.229295+0000","last_active":"2024-09-10T23:38:13.227157+0000","last_peered":"2024-09-10T23:38:13.227157+0000","last_clean":"2024-09-10T23:38:13.227157+0000","last_became_active":"2024-09-10T23:38:12.228846+0000","last_became_peered":"2024-09-10T23:38:12.228846+0000","last_unstale":"2024-09-10T23:38:13.227157+0000","last_undegraded":"2024-09-10T23:38:13.227157+0000","last_fullsized":"2024-09-10T23:38:13.227157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:15.383624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'25","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:37.428178+0000","last_change":"2024-09-10T23:38:10.203362+0000","last_active":"2024-09-10T23:38:37.428178+0000","last_peered":"2024-09-10T23:38:37.428178+0000","last_clean":"2024-09-10T23:38:37.428178+0000","last_became_active":"2024-09-10T23:38:10.202961+0000","last_became_peered":"2024-09-10T23:38:10.202961+0000","last_unstale":"2024-09-10T23:38:37.428178+0000","last_undegraded":"2024-09-10T23:38:37.428178+0000","last_fullsized":"2024-09-10T23:38:37.428178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:33.580368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54952,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":58,"num_write":26,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239504+0000","last_change":"2024-09-10T23:38:12.219094+0000","last_active":"2024-09-10T23:38:13.239504+0000","last_peered":"2024-09-10T23:38:13.239504+0000","last_clean":"2024-09-10T23:38:13.239504+0000","last_became_active":"2024-09-10T23:38:12.218778+0000","last_became_peered":"2024-09-10T23:38:12.218778+0000","last_unstale":"2024-09-10T23:38:13.239504+0000","last_undegraded":"2024-09-10T23:38:13.239504+0000","last_fullsized":"2024-09-10T23:38:13.239504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:59.019756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.274055+0000","last_change":"2024-09-10T23:38:10.204204+0000","last_active":"2024-09-10T23:38:22.274055+0000","last_peered":"2024-09-10T23:38:22.274055+0000","last_clean":"2024-09-10T23:38:22.274055+0000","last_became_active":"2024-09-10T23:38:10.203662+0000","last_became_peered":"2024-09-10T23:38:10.203662+0000","last_unstale":"2024-09-10T23:38:22.274055+0000","last_undegraded":"2024-09-10T23:38:22.274055+0000","last_fullsized":"2024-09-10T23:38:22.274055+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:44.243961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238438+0000","last_change":"2024-09-10T23:38:12.214337+0000","last_active":"2024-09-10T23:38:13.238438+0000","last_peered":"2024-09-10T23:38:13.238438+0000","last_clean":"2024-09-10T23:38:13.238438+0000","last_became_active":"2024-09-10T23:38:12.214024+0000","last_became_peered":"2024-09-10T23:38:12.214024+0000","last_unstale":"2024-09-10T23:38:13.238438+0000","last_undegraded":"2024-09-10T23:38:13.238438+0000","last_fullsized":"2024-09-10T23:38:13.238438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:19.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.267793+0000","last_change":"2024-09-10T23:38:10.208001+0000","last_active":"2024-09-10T23:38:21.267793+0000","last_peered":"2024-09-10T23:38:21.267793+0000","last_clean":"2024-09-10T23:38:21.267793+0000","last_became_active":"2024-09-10T23:38:10.207656+0000","last_became_peered":"2024-09-10T23:38:10.207656+0000","last_unstale":"2024-09-10T23:38:21.267793+0000","last_undegraded":"2024-09-10T23:38:21.267793+0000","last_fullsized":"2024-09-10T23:38:21.267793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:44.679795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241296+0000","last_change":"2024-09-10T23:38:12.227780+0000","last_active":"2024-09-10T23:38:13.241296+0000","last_peered":"2024-09-10T23:38:13.241296+0000","last_clean":"2024-09-10T23:38:13.241296+0000","last_became_active":"2024-09-10T23:38:12.227404+0000","last_became_peered":"2024-09-10T23:38:12.227404+0000","last_unstale":"2024-09-10T23:38:13.241296+0000","last_undegraded":"2024-09-10T23:38:13.241296+0000","last_fullsized":"2024-09-10T23:38:13.241296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:58.453685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:34.301461+0000","last_change":"2024-09-10T23:38:10.214786+0000","last_active":"2024-09-10T23:38:34.301461+0000","last_peered":"2024-09-10T23:38:34.301461+0000","last_clean":"2024-09-10T23:38:34.301461+0000","last_became_active":"2024-09-10T23:38:10.214124+0000","last_became_peered":"2024-09-10T23:38:10.214124+0000","last_unstale":"2024-09-10T23:38:34.301461+0000","last_undegraded":"2024-09-10T23:38:34.301461+0000","last_fullsized":"2024-09-10T23:38:34.301461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:00.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240869+0000","last_change":"2024-09-10T23:38:12.220507+0000","last_active":"2024-09-10T23:38:13.240869+0000","last_peered":"2024-09-10T23:38:13.240869+0000","last_clean":"2024-09-10T23:38:13.240869+0000","last_became_active":"2024-09-10T23:38:12.220178+0000","last_became_peered":"2024-09-10T23:38:12.220178+0000","last_unstale":"2024-09-10T23:38:13.240869+0000","last_undegraded":"2024-09-10T23:38:13.240869+0000","last_fullsized":"2024-09-10T23:38:13.240869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:57.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273877+0000","last_change":"2024-09-10T23:38:10.256166+0000","last_active":"2024-09-10T23:38:22.273877+0000","last_peered":"2024-09-10T23:38:22.273877+0000","last_clean":"2024-09-10T23:38:22.273877+0000","last_became_active":"2024-09-10T23:38:10.255792+0000","last_became_peered":"2024-09-10T23:38:10.255792+0000","last_unstale":"2024-09-10T23:38:22.273877+0000","last_undegraded":"2024-09-10T23:38:22.273877+0000","last_fullsized":"2024-09-10T23:38:22.273877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:44.621339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239311+0000","last_change":"2024-09-10T23:38:12.225151+0000","last_active":"2024-09-10T23:38:13.239311+0000","last_peered":"2024-09-10T23:38:13.239311+0000","last_clean":"2024-09-10T23:38:13.239311+0000","last_became_active":"2024-09-10T23:38:12.224748+0000","last_became_peered":"2024-09-10T23:38:12.224748+0000","last_unstale":"2024-09-10T23:38:13.239311+0000","last_undegraded":"2024-09-10T23:38:13.239311+0000","last_fullsized":"2024-09-10T23:38:13.239311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:23.280155+0000","last_change":"2024-09-10T23:38:10.212774+0000","last_active":"2024-09-10T23:38:23.280155+0000","last_peered":"2024-09-10T23:38:23.280155+0000","last_clean":"2024-09-10T23:38:23.280155+0000","last_became_active":"2024-09-10T23:38:10.212380+0000","last_became_peered":"2024-09-10T23:38:10.212380+0000","last_unstale":"2024-09-10T23:38:23.280155+0000","last_undegraded":"2024-09-10T23:38:23.280155+0000","last_fullsized":"2024-09-10T23:38:23.280155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:23.702192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222761+0000","last_change":"2024-09-10T23:38:12.225417+0000","last_active":"2024-09-10T23:38:13.222761+0000","last_peered":"2024-09-10T23:38:13.222761+0000","last_clean":"2024-09-10T23:38:13.222761+0000","last_became_active":"2024-09-10T23:38:12.225129+0000","last_became_peered":"2024-09-10T23:38:12.225129+0000","last_unstale":"2024-09-10T23:38:13.222761+0000","last_undegraded":"2024-09-10T23:38:13.222761+0000","last_fullsized":"2024-09-10T23:38:13.222761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:42.935776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.248562+0000","last_change":"2024-09-10T23:38:10.204942+0000","last_active":"2024-09-10T23:38:13.248562+0000","last_peered":"2024-09-10T23:38:13.248562+0000","last_clean":"2024-09-10T23:38:13.248562+0000","last_became_active":"2024-09-10T23:38:10.204568+0000","last_became_peered":"2024-09-10T23:38:10.204568+0000","last_unstale":"2024-09-10T23:38:13.248562+0000","last_undegraded":"2024-09-10T23:38:13.248562+0000","last_fullsized":"2024-09-10T23:38:13.248562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:00.608617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241669+0000","last_change":"2024-09-10T23:38:12.217411+0000","last_active":"2024-09-10T23:38:13.241669+0000","last_peered":"2024-09-10T23:38:13.241669+0000","last_clean":"2024-09-10T23:38:13.241669+0000","last_became_active":"2024-09-10T23:38:12.216998+0000","last_became_peered":"2024-09-10T23:38:12.216998+0000","last_unstale":"2024-09-10T23:38:13.241669+0000","last_undegraded":"2024-09-10T23:38:13.241669+0000","last_fullsized":"2024-09-10T23:38:13.241669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:12.852239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.245595+0000","last_change":"2024-09-10T23:38:10.209596+0000","last_active":"2024-09-10T23:38:13.245595+0000","last_peered":"2024-09-10T23:38:13.245595+0000","last_clean":"2024-09-10T23:38:13.245595+0000","last_became_active":"2024-09-10T23:38:10.209348+0000","last_became_peered":"2024-09-10T23:38:10.209348+0000","last_unstale":"2024-09-10T23:38:13.245595+0000","last_undegraded":"2024-09-10T23:38:13.245595+0000","last_fullsized":"2024-09-10T23:38:13.245595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:30.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241258+0000","last_change":"2024-09-10T23:38:12.224071+0000","last_active":"2024-09-10T23:38:13.241258+0000","last_peered":"2024-09-10T23:38:13.241258+0000","last_clean":"2024-09-10T23:38:13.241258+0000","last_became_active":"2024-09-10T23:38:12.223773+0000","last_became_peered":"2024-09-10T23:38:12.223773+0000","last_unstale":"2024-09-10T23:38:13.241258+0000","last_undegraded":"2024-09-10T23:38:13.241258+0000","last_fullsized":"2024-09-10T23:38:13.241258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:43.412524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273355+0000","last_change":"2024-09-10T23:38:10.300065+0000","last_active":"2024-09-10T23:38:22.273355+0000","last_peered":"2024-09-10T23:38:22.273355+0000","last_clean":"2024-09-10T23:38:22.273355+0000","last_became_active":"2024-09-10T23:38:10.299624+0000","last_became_peered":"2024-09-10T23:38:10.299624+0000","last_unstale":"2024-09-10T23:38:22.273355+0000","last_undegraded":"2024-09-10T23:38:22.273355+0000","last_fullsized":"2024-09-10T23:38:22.273355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:02.516651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240076+0000","last_change":"2024-09-10T23:38:12.222280+0000","last_active":"2024-09-10T23:38:13.240076+0000","last_peered":"2024-09-10T23:38:13.240076+0000","last_clean":"2024-09-10T23:38:13.240076+0000","last_became_active":"2024-09-10T23:38:12.221644+0000","last_became_peered":"2024-09-10T23:38:12.221644+0000","last_unstale":"2024-09-10T23:38:13.240076+0000","last_undegraded":"2024-09-10T23:38:13.240076+0000","last_fullsized":"2024-09-10T23:38:13.240076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.823629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241049+0000","last_change":"2024-09-10T23:36:58.824948+0000","last_active":"2024-09-10T23:38:13.241049+0000","last_peered":"2024-09-10T23:38:13.241049+0000","last_clean":"2024-09-10T23:38:13.241049+0000","last_became_active":"2024-09-10T23:36:58.819334+0000","last_became_peered":"2024-09-10T23:36:58.819334+0000","last_unstale":"2024-09-10T23:38:13.241049+0000","last_undegraded":"2024-09-10T23:38:13.241049+0000","last_fullsized":"2024-09-10T23:38:13.241049+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_clean_scrub_stamp":"2024-09-10T23:33:36.806080+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:52.996301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:23.283371+0000","last_change":"2024-09-10T23:38:10.215224+0000","last_active":"2024-09-10T23:38:23.283371+0000","last_peered":"2024-09-10T23:38:23.283371+0000","last_clean":"2024-09-10T23:38:23.283371+0000","last_became_active":"2024-09-10T23:38:10.214795+0000","last_became_peered":"2024-09-10T23:38:10.214795+0000","last_unstale":"2024-09-10T23:38:23.283371+0000","last_undegraded":"2024-09-10T23:38:23.283371+0000","last_fullsized":"2024-09-10T23:38:23.283371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:26.599793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240011+0000","last_change":"2024-09-10T23:38:12.220247+0000","last_active":"2024-09-10T23:38:13.240011+0000","last_peered":"2024-09-10T23:38:13.240011+0000","last_clean":"2024-09-10T23:38:13.240011+0000","last_became_active":"2024-09-10T23:38:12.219968+0000","last_became_peered":"2024-09-10T23:38:12.219968+0000","last_unstale":"2024-09-10T23:38:13.240011+0000","last_undegraded":"2024-09-10T23:38:13.240011+0000","last_fullsized":"2024-09-10T23:38:13.240011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:32.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.273687+0000","last_change":"2024-09-10T23:38:10.212748+0000","last_active":"2024-09-10T23:38:22.273687+0000","last_peered":"2024-09-10T23:38:22.273687+0000","last_clean":"2024-09-10T23:38:22.273687+0000","last_became_active":"2024-09-10T23:38:10.212427+0000","last_became_peered":"2024-09-10T23:38:10.212427+0000","last_unstale":"2024-09-10T23:38:22.273687+0000","last_undegraded":"2024-09-10T23:38:22.273687+0000","last_fullsized":"2024-09-10T23:38:22.273687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:23.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238090+0000","last_change":"2024-09-10T23:38:12.225178+0000","last_active":"2024-09-10T23:38:13.238090+0000","last_peered":"2024-09-10T23:38:13.238090+0000","last_clean":"2024-09-10T23:38:13.238090+0000","last_became_active":"2024-09-10T23:38:12.224860+0000","last_became_peered":"2024-09-10T23:38:12.224860+0000","last_unstale":"2024-09-10T23:38:13.238090+0000","last_undegraded":"2024-09-10T23:38:13.238090+0000","last_fullsized":"2024-09-10T23:38:13.238090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:10.986009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:36.303614+0000","last_change":"2024-09-10T23:38:10.254625+0000","last_active":"2024-09-10T23:38:36.303614+0000","last_peered":"2024-09-10T23:38:36.303614+0000","last_clean":"2024-09-10T23:38:36.303614+0000","last_became_active":"2024-09-10T23:38:10.254259+0000","last_became_peered":"2024-09-10T23:38:10.254259+0000","last_unstale":"2024-09-10T23:38:36.303614+0000","last_undegraded":"2024-09-10T23:38:36.303614+0000","last_fullsized":"2024-09-10T23:38:36.303614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:46.371999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238405+0000","last_change":"2024-09-10T23:38:12.217168+0000","last_active":"2024-09-10T23:38:13.238405+0000","last_peered":"2024-09-10T23:38:13.238405+0000","last_clean":"2024-09-10T23:38:13.238405+0000","last_became_active":"2024-09-10T23:38:12.216814+0000","last_became_peered":"2024-09-10T23:38:12.216814+0000","last_unstale":"2024-09-10T23:38:13.238405+0000","last_undegraded":"2024-09-10T23:38:13.238405+0000","last_fullsized":"2024-09-10T23:38:13.238405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:41.494690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.241000+0000","last_change":"2024-09-10T23:38:10.207456+0000","last_active":"2024-09-10T23:38:13.241000+0000","last_peered":"2024-09-10T23:38:13.241000+0000","last_clean":"2024-09-10T23:38:13.241000+0000","last_became_active":"2024-09-10T23:38:10.207079+0000","last_became_peered":"2024-09-10T23:38:10.207079+0000","last_unstale":"2024-09-10T23:38:13.241000+0000","last_undegraded":"2024-09-10T23:38:13.241000+0000","last_fullsized":"2024-09-10T23:38:13.241000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:14.631231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.224901+0000","last_change":"2024-09-10T23:38:12.218306+0000","last_active":"2024-09-10T23:38:13.224901+0000","last_peered":"2024-09-10T23:38:13.224901+0000","last_clean":"2024-09-10T23:38:13.224901+0000","last_became_active":"2024-09-10T23:38:12.217981+0000","last_became_peered":"2024-09-10T23:38:12.217981+0000","last_unstale":"2024-09-10T23:38:13.224901+0000","last_undegraded":"2024-09-10T23:38:13.224901+0000","last_fullsized":"2024-09-10T23:38:13.224901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:31.745904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.237369+0000","last_change":"2024-09-10T23:38:10.256617+0000","last_active":"2024-09-10T23:38:13.237369+0000","last_peered":"2024-09-10T23:38:13.237369+0000","last_clean":"2024-09-10T23:38:13.237369+0000","last_became_active":"2024-09-10T23:38:10.256314+0000","last_became_peered":"2024-09-10T23:38:10.256314+0000","last_unstale":"2024-09-10T23:38:13.237369+0000","last_undegraded":"2024-09-10T23:38:13.237369+0000","last_fullsized":"2024-09-10T23:38:13.237369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:52.361023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.225010+0000","last_change":"2024-09-10T23:38:12.214507+0000","last_active":"2024-09-10T23:38:13.225010+0000","last_peered":"2024-09-10T23:38:13.225010+0000","last_clean":"2024-09-10T23:38:13.225010+0000","last_became_active":"2024-09-10T23:38:12.214160+0000","last_became_peered":"2024-09-10T23:38:12.214160+0000","last_unstale":"2024-09-10T23:38:13.225010+0000","last_undegraded":"2024-09-10T23:38:13.225010+0000","last_fullsized":"2024-09-10T23:38:13.225010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:04.623624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.266795+0000","last_change":"2024-09-10T23:38:10.256941+0000","last_active":"2024-09-10T23:38:21.266795+0000","last_peered":"2024-09-10T23:38:21.266795+0000","last_clean":"2024-09-10T23:38:21.266795+0000","last_became_active":"2024-09-10T23:38:10.256553+0000","last_became_peered":"2024-09-10T23:38:10.256553+0000","last_unstale":"2024-09-10T23:38:21.266795+0000","last_undegraded":"2024-09-10T23:38:21.266795+0000","last_fullsized":"2024-09-10T23:38:21.266795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:30.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239470+0000","last_change":"2024-09-10T23:38:12.221246+0000","last_active":"2024-09-10T23:38:13.239470+0000","last_peered":"2024-09-10T23:38:13.239470+0000","last_clean":"2024-09-10T23:38:13.239470+0000","last_became_active":"2024-09-10T23:38:12.220912+0000","last_became_peered":"2024-09-10T23:38:12.220912+0000","last_unstale":"2024-09-10T23:38:13.239470+0000","last_undegraded":"2024-09-10T23:38:13.239470+0000","last_fullsized":"2024-09-10T23:38:13.239470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:33.918289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:34.239120+0000","last_change":"2024-09-10T23:38:10.210151+0000","last_active":"2024-09-10T23:38:34.239120+0000","last_peered":"2024-09-10T23:38:34.239120+0000","last_clean":"2024-09-10T23:38:34.239120+0000","last_became_active":"2024-09-10T23:38:10.209832+0000","last_became_peered":"2024-09-10T23:38:10.209832+0000","last_unstale":"2024-09-10T23:38:34.239120+0000","last_undegraded":"2024-09-10T23:38:34.239120+0000","last_fullsized":"2024-09-10T23:38:34.239120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:52.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239547+0000","last_change":"2024-09-10T23:38:12.218256+0000","last_active":"2024-09-10T23:38:13.239547+0000","last_peered":"2024-09-10T23:38:13.239547+0000","last_clean":"2024-09-10T23:38:13.239547+0000","last_became_active":"2024-09-10T23:38:12.217853+0000","last_became_peered":"2024-09-10T23:38:12.217853+0000","last_unstale":"2024-09-10T23:38:13.239547+0000","last_undegraded":"2024-09-10T23:38:13.239547+0000","last_fullsized":"2024-09-10T23:38:13.239547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.268004+0000","last_change":"2024-09-10T23:38:10.300017+0000","last_active":"2024-09-10T23:38:21.268004+0000","last_peered":"2024-09-10T23:38:21.268004+0000","last_clean":"2024-09-10T23:38:21.268004+0000","last_became_active":"2024-09-10T23:38:10.299733+0000","last_became_peered":"2024-09-10T23:38:10.299733+0000","last_unstale":"2024-09-10T23:38:21.268004+0000","last_undegraded":"2024-09-10T23:38:21.268004+0000","last_fullsized":"2024-09-10T23:38:21.268004+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.193043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242860+0000","last_change":"2024-09-10T23:38:12.212818+0000","last_active":"2024-09-10T23:38:13.242860+0000","last_peered":"2024-09-10T23:38:13.242860+0000","last_clean":"2024-09-10T23:38:13.242860+0000","last_became_active":"2024-09-10T23:38:12.212502+0000","last_became_peered":"2024-09-10T23:38:12.212502+0000","last_unstale":"2024-09-10T23:38:13.242860+0000","last_undegraded":"2024-09-10T23:38:13.242860+0000","last_fullsized":"2024-09-10T23:38:13.242860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:26.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.268434+0000","last_change":"2024-09-10T23:38:10.256366+0000","last_active":"2024-09-10T23:38:21.268434+0000","last_peered":"2024-09-10T23:38:21.268434+0000","last_clean":"2024-09-10T23:38:21.268434+0000","last_became_active":"2024-09-10T23:38:10.256056+0000","last_became_peered":"2024-09-10T23:38:10.256056+0000","last_unstale":"2024-09-10T23:38:21.268434+0000","last_undegraded":"2024-09-10T23:38:21.268434+0000","last_fullsized":"2024-09-10T23:38:21.268434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:00.612373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.238247+0000","last_change":"2024-09-10T23:38:12.224629+0000","last_active":"2024-09-10T23:38:13.238247+0000","last_peered":"2024-09-10T23:38:13.238247+0000","last_clean":"2024-09-10T23:38:13.238247+0000","last_became_active":"2024-09-10T23:38:12.224018+0000","last_became_peered":"2024-09-10T23:38:12.224018+0000","last_unstale":"2024-09-10T23:38:13.238247+0000","last_undegraded":"2024-09-10T23:38:13.238247+0000","last_fullsized":"2024-09-10T23:38:13.238247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:44.067489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.267508+0000","last_change":"2024-09-10T23:38:10.203395+0000","last_active":"2024-09-10T23:38:21.267508+0000","last_peered":"2024-09-10T23:38:21.267508+0000","last_clean":"2024-09-10T23:38:21.267508+0000","last_became_active":"2024-09-10T23:38:10.203067+0000","last_became_peered":"2024-09-10T23:38:10.203067+0000","last_unstale":"2024-09-10T23:38:21.267508+0000","last_undegraded":"2024-09-10T23:38:21.267508+0000","last_fullsized":"2024-09-10T23:38:21.267508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.398322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.222751+0000","last_change":"2024-09-10T23:38:12.223207+0000","last_active":"2024-09-10T23:38:13.222751+0000","last_peered":"2024-09-10T23:38:13.222751+0000","last_clean":"2024-09-10T23:38:13.222751+0000","last_became_active":"2024-09-10T23:38:12.222841+0000","last_became_peered":"2024-09-10T23:38:12.222841+0000","last_unstale":"2024-09-10T23:38:13.222751+0000","last_undegraded":"2024-09-10T23:38:13.222751+0000","last_fullsized":"2024-09-10T23:38:13.222751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:26.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240573+0000","last_change":"2024-09-10T23:38:10.210479+0000","last_active":"2024-09-10T23:38:13.240573+0000","last_peered":"2024-09-10T23:38:13.240573+0000","last_clean":"2024-09-10T23:38:13.240573+0000","last_became_active":"2024-09-10T23:38:10.210124+0000","last_became_peered":"2024-09-10T23:38:10.210124+0000","last_unstale":"2024-09-10T23:38:13.240573+0000","last_undegraded":"2024-09-10T23:38:13.240573+0000","last_fullsized":"2024-09-10T23:38:13.240573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:39.017091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239375+0000","last_change":"2024-09-10T23:38:12.214748+0000","last_active":"2024-09-10T23:38:13.239375+0000","last_peered":"2024-09-10T23:38:13.239375+0000","last_clean":"2024-09-10T23:38:13.239375+0000","last_became_active":"2024-09-10T23:38:12.214431+0000","last_became_peered":"2024-09-10T23:38:12.214431+0000","last_unstale":"2024-09-10T23:38:13.239375+0000","last_undegraded":"2024-09-10T23:38:13.239375+0000","last_fullsized":"2024-09-10T23:38:13.239375+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:02.092876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:21.268172+0000","last_change":"2024-09-10T23:38:10.214134+0000","last_active":"2024-09-10T23:38:21.268172+0000","last_peered":"2024-09-10T23:38:21.268172+0000","last_clean":"2024-09-10T23:38:21.268172+0000","last_became_active":"2024-09-10T23:38:10.213690+0000","last_became_peered":"2024-09-10T23:38:10.213690+0000","last_unstale":"2024-09-10T23:38:21.268172+0000","last_undegraded":"2024-09-10T23:38:21.268172+0000","last_fullsized":"2024-09-10T23:38:21.268172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:19.369755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240540+0000","last_change":"2024-09-10T23:38:12.218254+0000","last_active":"2024-09-10T23:38:13.240540+0000","last_peered":"2024-09-10T23:38:13.240540+0000","last_clean":"2024-09-10T23:38:13.240540+0000","last_became_active":"2024-09-10T23:38:12.217937+0000","last_became_peered":"2024-09-10T23:38:12.217937+0000","last_unstale":"2024-09-10T23:38:13.240540+0000","last_undegraded":"2024-09-10T23:38:13.240540+0000","last_fullsized":"2024-09-10T23:38:13.240540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:57.080088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.240022+0000","last_change":"2024-09-10T23:38:12.224539+0000","last_active":"2024-09-10T23:38:13.240022+0000","last_peered":"2024-09-10T23:38:13.240022+0000","last_clean":"2024-09-10T23:38:13.240022+0000","last_became_active":"2024-09-10T23:38:12.224224+0000","last_became_peered":"2024-09-10T23:38:12.224224+0000","last_unstale":"2024-09-10T23:38:13.240022+0000","last_undegraded":"2024-09-10T23:38:13.240022+0000","last_fullsized":"2024-09-10T23:38:13.240022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:56.618105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.248025+0000","last_change":"2024-09-10T23:38:10.215022+0000","last_active":"2024-09-10T23:38:13.248025+0000","last_peered":"2024-09-10T23:38:13.248025+0000","last_clean":"2024-09-10T23:38:13.248025+0000","last_became_active":"2024-09-10T23:38:10.214678+0000","last_became_peered":"2024-09-10T23:38:10.214678+0000","last_unstale":"2024-09-10T23:38:13.248025+0000","last_undegraded":"2024-09-10T23:38:13.248025+0000","last_fullsized":"2024-09-10T23:38:13.248025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:20.592052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.226893+0000","last_change":"2024-09-10T23:38:12.230449+0000","last_active":"2024-09-10T23:38:13.226893+0000","last_peered":"2024-09-10T23:38:13.226893+0000","last_clean":"2024-09-10T23:38:13.226893+0000","last_became_active":"2024-09-10T23:38:12.228939+0000","last_became_peered":"2024-09-10T23:38:12.228939+0000","last_unstale":"2024-09-10T23:38:13.226893+0000","last_undegraded":"2024-09-10T23:38:13.226893+0000","last_fullsized":"2024-09-10T23:38:13.226893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:45.495207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.272350+0000","last_change":"2024-09-10T23:38:10.209586+0000","last_active":"2024-09-10T23:38:22.272350+0000","last_peered":"2024-09-10T23:38:22.272350+0000","last_clean":"2024-09-10T23:38:22.272350+0000","last_became_active":"2024-09-10T23:38:10.209211+0000","last_became_peered":"2024-09-10T23:38:10.209211+0000","last_unstale":"2024-09-10T23:38:22.272350+0000","last_undegraded":"2024-09-10T23:38:22.272350+0000","last_fullsized":"2024-09-10T23:38:22.272350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:29.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.242973+0000","last_change":"2024-09-10T23:38:12.219795+0000","last_active":"2024-09-10T23:38:13.242973+0000","last_peered":"2024-09-10T23:38:13.242973+0000","last_clean":"2024-09-10T23:38:13.242973+0000","last_became_active":"2024-09-10T23:38:12.219318+0000","last_became_peered":"2024-09-10T23:38:12.219318+0000","last_unstale":"2024-09-10T23:38:13.242973+0000","last_undegraded":"2024-09-10T23:38:13.242973+0000","last_fullsized":"2024-09-10T23:38:13.242973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:12.732264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.244074+0000","last_change":"2024-09-10T23:38:10.255508+0000","last_active":"2024-09-10T23:38:13.244074+0000","last_peered":"2024-09-10T23:38:13.244074+0000","last_clean":"2024-09-10T23:38:13.244074+0000","last_became_active":"2024-09-10T23:38:10.255202+0000","last_became_peered":"2024-09-10T23:38:10.255202+0000","last_unstale":"2024-09-10T23:38:13.244074+0000","last_undegraded":"2024-09-10T23:38:13.244074+0000","last_fullsized":"2024-09-10T23:38:13.244074+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:09.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:13.239844+0000","last_change":"2024-09-10T23:38:12.222345+0000","last_active":"2024-09-10T23:38:13.239844+0000","last_peered":"2024-09-10T23:38:13.239844+0000","last_clean":"2024-09-10T23:38:13.239844+0000","last_became_active":"2024-09-10T23:38:12.220593+0000","last_became_peered":"2024-09-10T23:38:12.220593+0000","last_unstale":"2024-09-10T23:38:13.239844+0000","last_undegraded":"2024-09-10T23:38:13.239844+0000","last_fullsized":"2024-09-10T23:38:13.239844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:00.909046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T23:38:22.274314+0000","last_change":"2024-09-10T23:38:10.210071+0000","last_active":"2024-09-10T23:38:22.274314+0000","last_peered":"2024-09-10T23:38:22.274314+0000","last_clean":"2024-09-10T23:38:22.274314+0000","last_became_active":"2024-09-10T23:38:10.209778+0000","last_became_peered":"2024-09-10T23:38:10.209778+0000","last_unstale":"2024-09-10T23:38:22.274314+0000","last_undegraded":"2024-09-10T23:38:22.274314+0000","last_fullsized":"2024-09-10T23:38:22.274314+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:14.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59344,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":112,"num_read_kb":108,"num_write":154,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286063,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":400466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1047290,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103196,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":400702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":400622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":992943,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":400091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":992236,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":400919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":400402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":443826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":860160,"data_stored":442085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":401362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":42201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":43942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:38:42.271 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:38:42.272 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T23:38:42.272 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T23:38:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:42.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:38:42.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-10T23:38:42.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:38:42.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-10T23:38:42.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-09-10T23:38:42.796 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-10T23:38:42.796 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-10T23:38:42.796 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2024-09-10T23:38:42.796 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:42 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-09-10T23:38:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:38:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-10T23:38:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:38:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-10T23:38:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-09-10T23:38:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-10T23:38:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-10T23:38:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2024-09-10T23:38:42.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:42 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-09-10T23:38:43.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2024-09-10T23:38:43.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:42 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-09-10T23:38:43.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 -- 172.21.15.16:0/965160707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0102dc0 msgr2=0x7f89f01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:43.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 --2- 172.21.15.16:0/965160707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0102dc0 0x7f89f01031a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009900 tx=0x7f89ec02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:43.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 -- 172.21.15.16:0/965160707 shutdown_connections 2024-09-10T23:38:43.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 --2- 172.21.15.16:0/965160707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89f0109150 0x7f89f010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 --2- 172.21.15.16:0/965160707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89f01087d0 0x7f89f0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 --2- 172.21.15.16:0/965160707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0102dc0 0x7f89f01031a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 -- 172.21.15.16:0/965160707 >> 172.21.15.16:0/965160707 conn(0x7f89f00fe830 msgr2=0x7f89f0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 -- 172.21.15.16:0/965160707 shutdown_connections 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.038+0000 7f89f7d74640 1 -- 172.21.15.16:0/965160707 wait complete. 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 Processor -- start 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 -- start start 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89f0102dc0 0x7f89f01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89f01087d0 0x7f89f01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0109150 0x7f89f019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0112dd0 con 0x7f89f0109150 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0112c50 con 0x7f89f0102dc0 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f7d74640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0112f50 con 0x7f89f01087d0 2024-09-10T23:38:43.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0109150 0x7f89f019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0109150 0x7f89f019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50828/0 (socket says 172.21.15.16:50828) 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 -- 172.21.15.16:0/3138830017 learned_addr learned my addr 172.21.15.16:0/3138830017 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f530f640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89f01087d0 0x7f89f01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f5b10640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89f0102dc0 0x7f89f01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 -- 172.21.15.16:0/3138830017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89f01087d0 msgr2=0x7f89f01997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89f01087d0 0x7f89f01997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 -- 172.21.15.16:0/3138830017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89f0102dc0 msgr2=0x7f89f01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89f0102dc0 0x7f89f01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.039+0000 7f89f6311640 1 -- 172.21.15.16:0/3138830017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f019f350 con 0x7f89f0109150 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.040+0000 7f89f6311640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0109150 0x7f89f019eb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009fd0 tx=0x7f89e800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.040+0000 7f89e6ffd640 1 -- 172.21.15.16:0/3138830017 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8017070 con 0x7f89f0109150 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.040+0000 7f89e6ffd640 1 -- 172.21.15.16:0/3138830017 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e8003e20 con 0x7f89f0109150 2024-09-10T23:38:43.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.040+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f019f640 con 0x7f89f0109150 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.040+0000 7f89e6ffd640 1 -- 172.21.15.16:0/3138830017 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8010460 con 0x7f89f0109150 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.040+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f01a5d00 con 0x7f89f0109150 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.041+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f01031a0 con 0x7f89f0109150 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.042+0000 7f89e6ffd640 1 -- 172.21.15.16:0/3138830017 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f89e8003970 con 0x7f89f0109150 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.043+0000 7f89e6ffd640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f89dc0b5440 0x7f89dc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.043+0000 7f89f5b10640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f89dc0b5440 0x7f89dc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.043+0000 7f89e6ffd640 1 -- 172.21.15.16:0/3138830017 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8426+0+0 (secure 0 0 0) 0x7f89e80e5a70 con 0x7f89f0109150 2024-09-10T23:38:43.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.044+0000 7f89f5b10640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f89dc0b5440 0x7f89dc0b7900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89ec031440 tx=0x7f89ec005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:43.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.047+0000 7f89e6ffd640 1 -- 172.21.15.16:0/3138830017 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f89e80ac0c0 con 0x7f89f0109150 2024-09-10T23:38:43.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.310+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f89f002e700 con 0x7f89f0109150 2024-09-10T23:38:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.313+0000 7f89e6ffd640 1 -- 172.21.15.16:0/3138830017 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f89e80b0af0 con 0x7f89f0109150 2024-09-10T23:38:43.313 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-09-10T23:38:43.313 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCD2OBmReeSEhAAdjkFwXbM3am6CgYiTIsZWg== 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f89dc0b5440 msgr2=0x7f89dc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f89dc0b5440 0x7f89dc0b7900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f89ec031440 tx=0x7f89ec005b50 comp rx=0 tx=0).stop 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0109150 msgr2=0x7f89f019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0109150 0x7f89f019eb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009fd0 tx=0x7f89e800b260 comp rx=0 tx=0).stop 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 shutdown_connections 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f0109150 0x7f89f019eb80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89f01087d0 0x7f89f01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f89dc0b5440 0x7f89dc0b7900 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 --2- 172.21.15.16:0/3138830017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89f0102dc0 0x7f89f01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 >> 172.21.15.16:0/3138830017 conn(0x7f89f00fe830 msgr2=0x7f89f0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 shutdown_connections 2024-09-10T23:38:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:43.315+0000 7f89f7d74640 1 -- 172.21.15.16:0/3138830017 wait complete. 2024-09-10T23:38:43.693 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: pgmap v273: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-10T23:38:43.693 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-10T23:38:43.693 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3138830017' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:38:43.694 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:43 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3138830017' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: pgmap v273: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:38:43.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3138830017' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:38:43.803 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:43 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3138830017' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:38:44.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: pgmap v273: 97 pgs: 97 active+clean; 635 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-10T23:38:44.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-10T23:38:44.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3138830017' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:38:44.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:43 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3138830017' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:38:44.083 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:38:44.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T23:38:44.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T23:38:44.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T23:38:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:44.691 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:44 smithi016 ceph-mon[30855]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:38:44.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:44 smithi066 ceph-mon[34761]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 -- 172.21.15.16:0/199048485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c102dc0 msgr2=0x7f7b3c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 --2- 172.21.15.16:0/199048485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c102dc0 0x7f7b3c1031a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009900 tx=0x7f7b2c02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 -- 172.21.15.16:0/199048485 shutdown_connections 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 --2- 172.21.15.16:0/199048485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b3c109150 0x7f7b3c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 --2- 172.21.15.16:0/199048485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b3c1087d0 0x7f7b3c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 --2- 172.21.15.16:0/199048485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c102dc0 0x7f7b3c1031a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 -- 172.21.15.16:0/199048485 >> 172.21.15.16:0/199048485 conn(0x7f7b3c0fe830 msgr2=0x7f7b3c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 -- 172.21.15.16:0/199048485 shutdown_connections 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.941+0000 7f7b408a2640 1 -- 172.21.15.16:0/199048485 wait complete. 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.942+0000 7f7b408a2640 1 Processor -- start 2024-09-10T23:38:44.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.942+0000 7f7b408a2640 1 -- start start 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b408a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b3c102dc0 0x7f7b3c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b408a2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b3c1087d0 0x7f7b3c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b408a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c109150 0x7f7b3c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b408a2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c112e60 con 0x7f7b3c109150 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b408a2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c112ce0 con 0x7f7b3c102dc0 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b408a2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c112fe0 con 0x7f7b3c1087d0 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c109150 0x7f7b3c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b3c102dc0 0x7f7b3c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c109150 0x7f7b3c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46564/0 (socket says 172.21.15.16:46564) 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b39d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b3c1087d0 0x7f7b3c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 -- 172.21.15.16:0/2722846448 learned_addr learned my addr 172.21.15.16:0/2722846448 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 -- 172.21.15.16:0/2722846448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b3c1087d0 msgr2=0x7f7b3c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:44.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b3c1087d0 0x7f7b3c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 -- 172.21.15.16:0/2722846448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b3c102dc0 msgr2=0x7f7b3c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b3c102dc0 0x7f7b3c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 -- 172.21.15.16:0/2722846448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3c1a76f0 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b3ad9d640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c109150 0x7f7b3c075f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400eaa0 tx=0x7f7b3400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/2722846448 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400cdb0 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/2722846448 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b34005020 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/2722846448 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b340116d0 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.943+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3c1a79e0 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.944+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3c1a7f20 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.944+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3c1031a0 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.946+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/2722846448 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f7b3400f040 con 0x7f7b3c109150 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.946+0000 7f7b2b7fe640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b240b5440 0x7f7b240b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.947+0000 7f7b3a59c640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b240b5440 0x7f7b240b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:44.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.947+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/2722846448 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f7b340e5c40 con 0x7f7b3c109150 2024-09-10T23:38:44.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.947+0000 7f7b3a59c640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b240b5440 0x7f7b240b7900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c005ab0 tx=0x7f7b2c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:44.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:44.951+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/2722846448 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7b340ec080 con 0x7f7b3c109150 2024-09-10T23:38:45.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:44 smithi071 ceph-mon[35018]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:38:45.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.137+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f7b3c1a8360 con 0x7f7b3c109150 2024-09-10T23:38:45.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.138+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/2722846448 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v56) ==== 86+0+133 (secure 0 0 0) 0x7f7b34016030 con 0x7f7b3c109150 2024-09-10T23:38:45.139 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:45.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b240b5440 msgr2=0x7f7b240b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:45.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b240b5440 0x7f7b240b7900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c005ab0 tx=0x7f7b2c005a20 comp rx=0 tx=0).stop 2024-09-10T23:38:45.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c109150 msgr2=0x7f7b3c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:45.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c109150 0x7f7b3c075f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400eaa0 tx=0x7f7b3400ef60 comp rx=0 tx=0).stop 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 shutdown_connections 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b3c109150 0x7f7b3c075f20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b3c1087d0 0x7f7b3c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b240b5440 0x7f7b240b7900 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 --2- 172.21.15.16:0/2722846448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b3c102dc0 0x7f7b3c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 >> 172.21.15.16:0/2722846448 conn(0x7f7b3c0fe830 msgr2=0x7f7b3c1000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 shutdown_connections 2024-09-10T23:38:45.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:45.140+0000 7f7b408a2640 1 -- 172.21.15.16:0/2722846448 wait complete. 2024-09-10T23:38:45.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:45 smithi066 ceph-mon[34761]: pgmap v276: 97 pgs: 97 active+clean; 640 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-10T23:38:45.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:45 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2722846448' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:38:45.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:45 smithi016 ceph-mon[30855]: pgmap v276: 97 pgs: 97 active+clean; 640 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-10T23:38:45.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:45 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2722846448' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:38:45.971 INFO:teuthology.orchestra.run.smithi016.stdout:[{"version":56,"timestamp":"2024-09-10T23:38:01.221152+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T23:38:45.971 INFO:tasks.ceph_manager:config epoch is 56 2024-09-10T23:38:45.971 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T23:38:45.971 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T23:38:45.972 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T23:38:46.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:45 smithi071 ceph-mon[35018]: pgmap v276: 97 pgs: 97 active+clean; 640 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-10T23:38:46.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:45 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2722846448' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:38:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.779+0000 7f807a716640 1 -- 172.21.15.16:0/3731916120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074101cd0 msgr2=0x7f80741020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.779+0000 7f807a716640 1 --2- 172.21.15.16:0/3731916120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074101cd0 0x7f80741020b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8064009900 tx=0x7f806402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 -- 172.21.15.16:0/3731916120 shutdown_connections 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 --2- 172.21.15.16:0/3731916120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8074108060 0x7f807410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 --2- 172.21.15.16:0/3731916120 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80741076e0 0x7f8074107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 --2- 172.21.15.16:0/3731916120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074101cd0 0x7f80741020b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 -- 172.21.15.16:0/3731916120 >> 172.21.15.16:0/3731916120 conn(0x7f80740fd700 msgr2=0x7f80740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 -- 172.21.15.16:0/3731916120 shutdown_connections 2024-09-10T23:38:46.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 -- 172.21.15.16:0/3731916120 wait complete. 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 Processor -- start 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.780+0000 7f807a716640 1 -- start start 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f807a716640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8074101cd0 0x7f80741981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f807a716640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80741076e0 0x7f8074198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f807a716640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074108060 0x7f807419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f807a716640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8074111d70 con 0x7f8074108060 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f807a716640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8074111bf0 con 0x7f8074101cd0 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f807a716640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8074111ef0 con 0x7f80741076e0 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074108060 0x7f807419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074108060 0x7f807419dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46584/0 (socket says 172.21.15.16:46584) 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 -- 172.21.15.16:0/360247112 learned_addr learned my addr 172.21.15.16:0/360247112 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8073fff640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8074101cd0 0x7f80741981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f806bfff640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80741076e0 0x7f8074198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:46.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 -- 172.21.15.16:0/360247112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80741076e0 msgr2=0x7f8074198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80741076e0 0x7f8074198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 -- 172.21.15.16:0/360247112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8074101cd0 msgr2=0x7f80741981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8074101cd0 0x7f80741981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 -- 172.21.15.16:0/360247112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807419e290 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.781+0000 7f8078cb3640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074108060 0x7f807419dac0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f806c00cce0 tx=0x7f806c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.782+0000 7f8071ffb640 1 -- 172.21.15.16:0/360247112 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c00f450 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.782+0000 7f8071ffb640 1 -- 172.21.15.16:0/360247112 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f806c00faa0 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.782+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807419e580 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.782+0000 7f8071ffb640 1 -- 172.21.15.16:0/360247112 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c018b70 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.782+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807406b490 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.783+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80741020b0 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.784+0000 7f8071ffb640 1 -- 172.21.15.16:0/360247112 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f806c00f5f0 con 0x7f8074108060 2024-09-10T23:38:46.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.785+0000 7f8071ffb640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80600b53c0 0x7f80600b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:46.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.785+0000 7f8073fff640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80600b53c0 0x7f80600b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:46.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.785+0000 7f8071ffb640 1 -- 172.21.15.16:0/360247112 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f806c0e6640 con 0x7f8074108060 2024-09-10T23:38:46.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.785+0000 7f8073fff640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80600b53c0 0x7f80600b7880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8064005ab0 tx=0x7f8064005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:46.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:46.788+0000 7f8071ffb640 1 -- 172.21.15.16:0/360247112 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f806c014030 con 0x7f8074108060 2024-09-10T23:38:47.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.022+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f807406bf70 con 0x7f8074108060 2024-09-10T23:38:47.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.027+0000 7f8071ffb640 1 -- 172.21.15.16:0/360247112 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+294232 (secure 0 0 0) 0x7f806c0ad370 con 0x7f8074108060 2024-09-10T23:38:47.031 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:47.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80600b53c0 msgr2=0x7f80600b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:47.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80600b53c0 0x7f80600b7880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8064005ab0 tx=0x7f8064005a20 comp rx=0 tx=0).stop 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074108060 msgr2=0x7f807419dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074108060 0x7f807419dac0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f806c00cce0 tx=0x7f806c00a620 comp rx=0 tx=0).stop 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 shutdown_connections 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8074108060 0x7f807419dac0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80741076e0 0x7f8074198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80600b53c0 0x7f80600b7880 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 --2- 172.21.15.16:0/360247112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8074101cd0 0x7f80741981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.030+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 >> 172.21.15.16:0/360247112 conn(0x7f80740fd700 msgr2=0x7f80740ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.031+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 shutdown_connections 2024-09-10T23:38:47.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:47.031+0000 7f807a716640 1 -- 172.21.15.16:0/360247112 wait complete. 2024-09-10T23:38:47.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:47 smithi016 ceph-mon[30855]: pgmap v277: 97 pgs: 97 active+clean; 640 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T23:38:47.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:47 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/360247112' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:38:47.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:47 smithi066 ceph-mon[34761]: pgmap v277: 97 pgs: 97 active+clean; 640 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T23:38:47.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:47 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/360247112' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"flags":0,"active_gid":14220,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3253461284},{"type":"v1","addr":"172.21.15.16:6801","nonce":3253461284}]},"active_addr":"172.21.15.16:6801/3253461284","active_change":"2024-09-10T23:31:42.335824+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24149,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.16:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1958865271}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":2802449427}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1298509223}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":3689396158}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1863312969}]}]} 2024-09-10T23:38:47.831 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T23:38:47.831 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T23:38:47.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:38:48.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:47 smithi071 ceph-mon[35018]: pgmap v277: 97 pgs: 97 active+clean; 640 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T23:38:48.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:47 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/360247112' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:38:48.089 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:48.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 -- 172.21.15.16:0/2786306466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8109150 msgr2=0x7f74f810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:48.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 --2- 172.21.15.16:0/2786306466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8109150 0x7f74f810f950 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009900 tx=0x7f74f002a410 comp rx=0 tx=0).stop 2024-09-10T23:38:48.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 -- 172.21.15.16:0/2786306466 shutdown_connections 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 --2- 172.21.15.16:0/2786306466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8109150 0x7f74f810f950 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 --2- 172.21.15.16:0/2786306466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74f81087d0 0x7f74f8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 --2- 172.21.15.16:0/2786306466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74f8102dc0 0x7f74f81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 -- 172.21.15.16:0/2786306466 >> 172.21.15.16:0/2786306466 conn(0x7f74f80fe830 msgr2=0x7f74f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 -- 172.21.15.16:0/2786306466 shutdown_connections 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.608+0000 7f74fcbce640 1 -- 172.21.15.16:0/2786306466 wait complete. 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 Processor -- start 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 -- start start 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8102dc0 0x7f74f8199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74f81087d0 0x7f74f8199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74f8109150 0x7f74f819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8112dd0 con 0x7f74f8102dc0 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8112c50 con 0x7f74f81087d0 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74fcbce640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8112f50 con 0x7f74f8109150 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8102dc0 0x7f74f8199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8102dc0 0x7f74f8199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46594/0 (socket says 172.21.15.16:46594) 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 -- 172.21.15.16:0/1881587589 learned_addr learned my addr 172.21.15.16:0/1881587589 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f6d9d640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74f8109150 0x7f74f819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f5d9b640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74f81087d0 0x7f74f8199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 -- 172.21.15.16:0/1881587589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74f8109150 msgr2=0x7f74f819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74f8109150 0x7f74f819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 -- 172.21.15.16:0/1881587589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74f81087d0 msgr2=0x7f74f8199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74f81087d0 0x7f74f8199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.609+0000 7f74f659c640 1 -- 172.21.15.16:0/1881587589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f819f2b0 con 0x7f74f8102dc0 2024-09-10T23:38:48.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.610+0000 7f74f659c640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8102dc0 0x7f74f8199200 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c920 tx=0x7f74e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.610+0000 7f74e77fe640 1 -- 172.21.15.16:0/1881587589 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8007c70 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.610+0000 7f74e77fe640 1 -- 172.21.15.16:0/1881587589 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e8007e10 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.610+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f819f5a0 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.610+0000 7f74e77fe640 1 -- 172.21.15.16:0/1881587589 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8018820 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.610+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f81a5e30 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.611+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f81031a0 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.612+0000 7f74e77fe640 1 -- 172.21.15.16:0/1881587589 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f74e800f450 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.613+0000 7f74e77fe640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74e00b5440 0x7f74e00b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.613+0000 7f74f5d9b640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74e00b5440 0x7f74e00b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.613+0000 7f74e77fe640 1 -- 172.21.15.16:0/1881587589 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f74e80e61c0 con 0x7f74f8102dc0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.614+0000 7f74f5d9b640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74e00b5440 0x7f74e00b7900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74f8105230 tx=0x7f74ec009870 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:48.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.616+0000 7f74e77fe640 1 -- 172.21.15.16:0/1881587589 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f74e8014030 con 0x7f74f8102dc0 2024-09-10T23:38:48.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.803+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74f819a330 con 0x7f74f8102dc0 2024-09-10T23:38:48.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.804+0000 7f74e77fe640 1 -- 172.21.15.16:0/1881587589 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22944 (secure 0 0 0) 0x7f74f819a330 con 0x7f74f8102dc0 2024-09-10T23:38:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:48.805 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":77,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:43.527822+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:38:48.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74e00b5440 msgr2=0x7f74e00b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:48.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74e00b5440 0x7f74e00b7900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74f8105230 tx=0x7f74ec009870 comp rx=0 tx=0).stop 2024-09-10T23:38:48.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8102dc0 msgr2=0x7f74f8199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:48.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8102dc0 0x7f74f8199200 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f74e800c920 tx=0x7f74e800cde0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 shutdown_connections 2024-09-10T23:38:48.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74f8109150 0x7f74f819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74e00b5440 0x7f74e00b7900 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74f81087d0 0x7f74f8199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 --2- 172.21.15.16:0/1881587589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f8102dc0 0x7f74f8199200 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:48.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 >> 172.21.15.16:0/1881587589 conn(0x7f74f80fe830 msgr2=0x7f74f8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:48.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 shutdown_connections 2024-09-10T23:38:48.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:48.807+0000 7f74fcbce640 1 -- 172.21.15.16:0/1881587589 wait complete. 2024-09-10T23:38:49.469 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T23:38:49.469 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:38:49.729 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:49.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:49 smithi016 ceph-mon[30855]: pgmap v278: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1023 B/s wr, 8 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:49.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:49 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1881587589' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:49.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:49 smithi066 ceph-mon[34761]: pgmap v278: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1023 B/s wr, 8 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:49.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:49 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1881587589' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:50.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:49 smithi071 ceph-mon[35018]: pgmap v278: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1023 B/s wr, 8 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:50.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:49 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1881587589' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.205+0000 7ff4474dc640 1 -- 172.21.15.16:0/609145960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 msgr2=0x7ff44010ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.205+0000 7ff4474dc640 1 --2- 172.21.15.16:0/609145960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44010ef40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff430009900 tx=0x7ff43002a410 comp rx=0 tx=0).stop 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.205+0000 7ff4474dc640 1 -- 172.21.15.16:0/609145960 shutdown_connections 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 --2- 172.21.15.16:0/609145960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff44010f480 0x7ff440111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 --2- 172.21.15.16:0/609145960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44010ef40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 --2- 172.21.15.16:0/609145960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4401018d0 0x7ff440101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 -- 172.21.15.16:0/609145960 >> 172.21.15.16:0/609145960 conn(0x7ff4400fd700 msgr2=0x7ff4400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 -- 172.21.15.16:0/609145960 shutdown_connections 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 -- 172.21.15.16:0/609145960 wait complete. 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 Processor -- start 2024-09-10T23:38:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 -- start start 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4401018d0 0x7ff44019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.206+0000 7ff4474dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff44010f480 0x7ff4401a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4474dc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff440114fe0 con 0x7ff4401021f0 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4474dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff440114e60 con 0x7ff44010f480 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4474dc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff440115160 con 0x7ff4401018d0 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44019ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46608/0 (socket says 172.21.15.16:46608) 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 -- 172.21.15.16:0/2629484766 learned_addr learned my addr 172.21.15.16:0/2629484766 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff445278640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4401018d0 0x7ff44019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff445a79640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff44010f480 0x7ff4401a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 -- 172.21.15.16:0/2629484766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4401018d0 msgr2=0x7ff44019b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:50.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4401018d0 0x7ff44019b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 -- 172.21.15.16:0/2629484766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff44010f480 msgr2=0x7ff4401a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff44010f480 0x7ff4401a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 -- 172.21.15.16:0/2629484766 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4401a15c0 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff444a77640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44019ba50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff430005ab0 tx=0x7ff430003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4367fc640 1 -- 172.21.15.16:0/2629484766 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43003f070 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4367fc640 1 -- 172.21.15.16:0/2629484766 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff430031b60 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4401a1850 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4367fc640 1 -- 172.21.15.16:0/2629484766 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430035030 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.207+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4401a7f70 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.209+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff440101cb0 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.210+0000 7ff4367fc640 1 -- 172.21.15.16:0/2629484766 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ff43004c060 con 0x7ff4401021f0 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.211+0000 7ff4367fc640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff42c0b53c0 0x7ff42c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:50.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.211+0000 7ff445278640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff42c0b53c0 0x7ff42c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:50.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.211+0000 7ff4367fc640 1 -- 172.21.15.16:0/2629484766 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff4301061d0 con 0x7ff4401021f0 2024-09-10T23:38:50.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.211+0000 7ff445278640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff42c0b53c0 0x7ff42c0b7880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009bd0 tx=0x7ff43c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:50.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.215+0000 7ff4367fc640 1 -- 172.21.15.16:0/2629484766 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff4300cc820 con 0x7ff4401021f0 2024-09-10T23:38:50.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.404+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4401a8170 con 0x7ff4401021f0 2024-09-10T23:38:50.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.406+0000 7ff4367fc640 1 -- 172.21.15.16:0/2629484766 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22944 (secure 0 0 0) 0x7ff4300d1250 con 0x7ff4401021f0 2024-09-10T23:38:50.407 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:38:50.407 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":77,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:43.527822+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:38:50.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff42c0b53c0 msgr2=0x7ff42c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:50.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff42c0b53c0 0x7ff42c0b7880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009bd0 tx=0x7ff43c005f90 comp rx=0 tx=0).stop 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 msgr2=0x7ff44019ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44019ba50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff430005ab0 tx=0x7ff430003c10 comp rx=0 tx=0).stop 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 shutdown_connections 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff42c0b53c0 0x7ff42c0b7880 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff44010f480 0x7ff4401a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4401021f0 0x7ff44019ba50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 --2- 172.21.15.16:0/2629484766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4401018d0 0x7ff44019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 >> 172.21.15.16:0/2629484766 conn(0x7ff4400fd700 msgr2=0x7ff440111670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 shutdown_connections 2024-09-10T23:38:50.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:50.408+0000 7ff4474dc640 1 -- 172.21.15.16:0/2629484766 wait complete. 2024-09-10T23:38:50.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:50 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2629484766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:51.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:50 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2629484766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:51.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:50 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2629484766' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:38:51.162 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T23:38:51.162 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T23:38:51.162 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T23:38:51.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T23:38:51.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T23:38:51.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T23:38:51.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T23:38:51.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T23:38:51.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T23:38:51.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T23:38:51.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T23:38:51.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T23:38:51.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:51 smithi016 ceph-mon[30855]: pgmap v279: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 895 B/s wr, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:52.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:51 smithi071 ceph-mon[35018]: pgmap v279: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 895 B/s wr, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:52.020 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.021 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.021 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.022 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.022 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.028 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.031 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.035 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.035 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.049 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:52.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:51 smithi066 ceph-mon[34761]: pgmap v279: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 895 B/s wr, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:52.055 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 -- 172.21.15.16:0/2874570509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9581045c0 msgr2=0x7ff95810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 --2- 172.21.15.16:0/2874570509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9581045c0 0x7ff95810cab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009900 tx=0x7ff94c02a410 comp rx=0 tx=0).stop 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 -- 172.21.15.16:0/2874570509 shutdown_connections 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 --2- 172.21.15.16:0/2874570509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff95810d100 0x7ff95810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 --2- 172.21.15.16:0/2874570509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9581045c0 0x7ff95810cab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 --2- 172.21.15.16:0/2874570509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff958103ca0 0x7ff958104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 -- 172.21.15.16:0/2874570509 >> 172.21.15.16:0/2874570509 conn(0x7ff9580fd700 msgr2=0x7ff9580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 -- 172.21.15.16:0/2874570509 shutdown_connections 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.407+0000 7ff95d248640 1 -- 172.21.15.16:0/2874570509 wait complete. 2024-09-10T23:38:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 Processor -- start 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 -- start start 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff958103ca0 0x7ff958101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9581045c0 0x7ff958101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff95810d100 0x7ff9581023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff958112d70 con 0x7ff95810d100 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff958112bf0 con 0x7ff9581045c0 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95d248640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff958112ef0 con 0x7ff958103ca0 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff956d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff958103ca0 0x7ff958101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff95810d100 0x7ff9581023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff95659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9581045c0 0x7ff958101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff956d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff958103ca0 0x7ff958101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:39700/0 (socket says 172.21.15.16:39700) 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.408+0000 7ff956d9d640 1 -- 172.21.15.16:0/721658469 learned_addr learned my addr 172.21.15.16:0/721658469 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff956d9d640 1 -- 172.21.15.16:0/721658469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9581045c0 msgr2=0x7ff958101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff956d9d640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9581045c0 0x7ff958101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff956d9d640 1 -- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff95810d100 msgr2=0x7ff9581023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff956d9d640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff95810d100 0x7ff9581023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff956d9d640 1 -- 172.21.15.16:0/721658469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9581a7740 con 0x7ff958103ca0 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff95659c640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9581045c0 0x7ff958101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff95759e640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff95810d100 0x7ff9581023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff956d9d640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff958103ca0 0x7ff958101950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c970 tx=0x7ff94800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948007bb0 con 0x7ff958103ca0 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9581a7a30 con 0x7ff958103ca0 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff948007d50 con 0x7ff958103ca0 2024-09-10T23:38:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94800f450 con 0x7ff958103ca0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.409+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9581a7ef0 con 0x7ff958103ca0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.410+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9580638a0 con 0x7ff958103ca0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.413+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ff948004f00 con 0x7ff958103ca0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff93ffff640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff9400b53c0 0x7ff9400b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff95659c640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff9400b53c0 0x7ff9400b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff9480e5f70 con 0x7ff958103ca0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff93ffff640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] conn(0x7ff9400bf0e0 0x7ff9400c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 --> [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9400c1c50 con 0x7ff9400bf0e0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7ff9480e6320 con 0x7ff958103ca0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff95759e640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] conn(0x7ff9400bf0e0 0x7ff9400c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff95659c640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff9400b53c0 0x7ff9400b7880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff94c000c00 tx=0x7ff94c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.414+0000 7ff95759e640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] conn(0x7ff9400bf0e0 0x7ff9400c1580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.415+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== osd.0 v2:172.21.15.16:6802/709153273 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9400c1c50 con 0x7ff9400bf0e0 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.429+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 --> [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff958063d20 con 0x7ff9400bf0e0 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.429+0000 7ff93ffff640 1 -- 172.21.15.16:0/721658469 <== osd.0 v2:172.21.15.16:6802/709153273 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff958063d20 con 0x7ff9400bf0e0 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] conn(0x7ff9400bf0e0 msgr2=0x7ff9400c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] conn(0x7ff9400bf0e0 0x7ff9400c1580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff9400b53c0 msgr2=0x7ff9400b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff9400b53c0 0x7ff9400b7880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff94c000c00 tx=0x7ff94c031400 comp rx=0 tx=0).stop 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff958103ca0 msgr2=0x7ff958101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 --2- 172.21.15.16:0/721658469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff958103ca0 0x7ff958101950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c970 tx=0x7ff94800ce30 comp rx=0 tx=0).stop 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95759e640 1 -- 172.21.15.16:0/721658469 reap_dead start 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 shutdown_connections 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 >> 172.21.15.16:0/721658469 conn(0x7ff9580fd700 msgr2=0x7ff9580fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 shutdown_connections 2024-09-10T23:38:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.430+0000 7ff95d248640 1 -- 172.21.15.16:0/721658469 wait complete. 2024-09-10T23:38:53.821 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:53 smithi071 ceph-mon[35018]: pgmap v280: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 724 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:53.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:53 smithi066 ceph-mon[34761]: pgmap v280: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 724 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:53.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2308669560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d8108020 msgr2=0x7fb2d810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 --2- 172.21.15.16:0/2308669560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d8108020 0x7fb2d810e820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009ca0 tx=0x7fb2d002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2308669560 shutdown_connections 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 --2- 172.21.15.16:0/2308669560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d8108020 0x7fb2d810e820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 --2- 172.21.15.16:0/2308669560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d81076a0 0x7fb2d8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 --2- 172.21.15.16:0/2308669560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2d8101c90 0x7fb2d8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2308669560 >> 172.21.15.16:0/2308669560 conn(0x7fb2d80fd700 msgr2=0x7fb2d80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2308669560 shutdown_connections 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.286+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2308669560 wait complete. 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.287+0000 7fb2ddd77640 1 Processor -- start 2024-09-10T23:38:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.287+0000 7fb2ddd77640 1 -- start start 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2ddd77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2d8101c90 0x7fb2d8104580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2ddd77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d81076a0 0x7fb2d8104ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2ddd77640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d8108020 0x7fb2d8105000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2ddd77640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8111ca0 con 0x7fb2d81076a0 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2ddd77640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8111b20 con 0x7fb2d8101c90 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2ddd77640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8111e20 con 0x7fb2d8108020 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d8108020 0x7fb2d8105000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d81076a0 0x7fb2d8104ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d8108020 0x7fb2d8105000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:39688/0 (socket says 172.21.15.16:39688) 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d7fff640 1 -- 172.21.15.16:0/2988407675 learned_addr learned my addr 172.21.15.16:0/2988407675 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d77fe640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2d8101c90 0x7fb2d8104580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d6ffd640 1 -- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d8108020 msgr2=0x7fb2d8105000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d6ffd640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d8108020 0x7fb2d8105000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d6ffd640 1 -- 172.21.15.16:0/2988407675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2d8101c90 msgr2=0x7fb2d8104580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d6ffd640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2d8101c90 0x7fb2d8104580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d6ffd640 1 -- 172.21.15.16:0/2988407675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d81a7640 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.288+0000 7fb2d7fff640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2d8108020 0x7fb2d8105000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.289+0000 7fb2d6ffd640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d81076a0 0x7fb2d8104ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c970 tx=0x7fb2cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.289+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc007bb0 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.289+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d81a7930 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.289+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2cc007d50 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.289+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc004df0 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.289+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d81a7e70 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.290+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2d80fe190 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.291+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb2cc005000 con 0x7fb2d81076a0 2024-09-10T23:38:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.292+0000 7fb2d4ff9640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2c00b53c0 0x7fb2c00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.292+0000 7fb2d77fe640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2c00b53c0 0x7fb2c00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.292+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb2cc0e5e70 con 0x7fb2d81076a0 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.292+0000 7fb2d4ff9640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] conn(0x7fb2c00bf0d0 0x7fb2c00c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.292+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 --> [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2c00c1c40 con 0x7fb2c00bf0d0 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.292+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fb2cc0e6220 con 0x7fb2d81076a0 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.293+0000 7fb2d77fe640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2c00b53c0 0x7fb2c00b7880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8005d00 tx=0x7fb2c800b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.293+0000 7fb2d7fff640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] conn(0x7fb2c00bf0d0 0x7fb2c00c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.293+0000 7fb2d7fff640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] conn(0x7fb2c00bf0d0 0x7fb2c00c1570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:53.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.294+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== osd.8 v2:172.21.15.71:6816/2889878704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2c00c1c40 con 0x7fb2c00bf0d0 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.321+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 --> [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2d8102f40 con 0x7fb2c00bf0d0 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.321+0000 7fb2d4ff9640 1 -- 172.21.15.16:0/2988407675 <== osd.8 v2:172.21.15.71:6816/2889878704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb2d8102f40 con 0x7fb2c00bf0d0 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] conn(0x7fb2c00bf0d0 msgr2=0x7fb2c00c1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] conn(0x7fb2c00bf0d0 0x7fb2c00c1570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2c00b53c0 msgr2=0x7fb2c00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2c00b53c0 0x7fb2c00b7880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8005d00 tx=0x7fb2c800b410 comp rx=0 tx=0).stop 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d81076a0 msgr2=0x7fb2d8104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 --2- 172.21.15.16:0/2988407675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d81076a0 0x7fb2d8104ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c970 tx=0x7fb2cc00ce30 comp rx=0 tx=0).stop 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2d7fff640 1 -- 172.21.15.16:0/2988407675 reap_dead start 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 shutdown_connections 2024-09-10T23:38:53.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 >> 172.21.15.16:0/2988407675 conn(0x7fb2d80fd700 msgr2=0x7fb2d8106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:53.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 shutdown_connections 2024-09-10T23:38:53.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.322+0000 7fb2ddd77640 1 -- 172.21.15.16:0/2988407675 wait complete. 2024-09-10T23:38:53.937 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:53 smithi016 ceph-mon[30855]: pgmap v280: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 724 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:54.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 -- 172.21.15.16:0/2170855210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 msgr2=0x7fa2c81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:54.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 --2- 172.21.15.16:0/2170855210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 0x7fa2c81031c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009900 tx=0x7fa2c402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 -- 172.21.15.16:0/2170855210 shutdown_connections 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 --2- 172.21.15.16:0/2170855210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c8109170 0x7fa2c810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 --2- 172.21.15.16:0/2170855210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2c81087f0 0x7fa2c8108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 --2- 172.21.15.16:0/2170855210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 0x7fa2c81031c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 -- 172.21.15.16:0/2170855210 >> 172.21.15.16:0/2170855210 conn(0x7fa2c80fe830 msgr2=0x7fa2c8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 -- 172.21.15.16:0/2170855210 shutdown_connections 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.327+0000 7fa2d0132640 1 -- 172.21.15.16:0/2170855210 wait complete. 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 Processor -- start 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 -- start start 2024-09-10T23:38:54.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 0x7fa2c819b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c81087f0 0x7fa2c819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2c8109170 0x7fa2c81a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c8112e30 con 0x7fa2c8102de0 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c8112cb0 con 0x7fa2c81087f0 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2d0132640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c8112fb0 con 0x7fa2c8109170 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2cdece640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 0x7fa2c819b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2cdece640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 0x7fa2c819b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53470/0 (socket says 172.21.15.16:53470) 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.328+0000 7fa2cdece640 1 -- 172.21.15.16:0/1840789883 learned_addr learned my addr 172.21.15.16:0/1840789883 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2cd6cd640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c81087f0 0x7fa2c819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2ce6cf640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2c8109170 0x7fa2c81a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:54.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2cdece640 1 -- 172.21.15.16:0/1840789883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2c8109170 msgr2=0x7fa2c81a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2cdece640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2c8109170 0x7fa2c81a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2cdece640 1 -- 172.21.15.16:0/1840789883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c81087f0 msgr2=0x7fa2c819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2cdece640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c81087f0 0x7fa2c819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2cdece640 1 -- 172.21.15.16:0/1840789883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c81a15e0 con 0x7fa2c8102de0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2cdece640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 0x7fa2c819b530 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006010 tx=0x7fa2c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c403f030 con 0x7fa2c8102de0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2c4003800 con 0x7fa2c8102de0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c81a1870 con 0x7fa2c8102de0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4035070 con 0x7fa2c8102de0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.329+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c81a7f90 con 0x7fa2c8102de0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.330+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2c80638e0 con 0x7fa2c8102de0 2024-09-10T23:38:54.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.332+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa2c4003cb0 con 0x7fa2c8102de0 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.332+0000 7fa2beffd640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b40b5440 0x7fa2b40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2cd6cd640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b40b5440 0x7fa2b40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa2c4106d60 con 0x7fa2c8102de0 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2beffd640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] conn(0x7fa2b40bf160 0x7fa2b40c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 --> [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2c400b0b0 con 0x7fa2b40bf160 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa2c41071b0 con 0x7fa2c8102de0 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2ce6cf640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] conn(0x7fa2b40bf160 0x7fa2b40c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:54.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2cd6cd640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b40b5440 0x7fa2b40b7900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2c81080e0 tx=0x7fa2b8009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.333+0000 7fa2ce6cf640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] conn(0x7fa2b40bf160 0x7fa2b40c1600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.334+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== osd.6 v2:172.21.15.16:6818/3830581477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2c400b0b0 con 0x7fa2b40bf160 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 --> [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2c8063ce0 con 0x7fa2b40bf160 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2beffd640 1 -- 172.21.15.16:0/1840789883 <== osd.6 v2:172.21.15.16:6818/3830581477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa2c8063ce0 con 0x7fa2b40bf160 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] conn(0x7fa2b40bf160 msgr2=0x7fa2b40c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] conn(0x7fa2b40bf160 0x7fa2b40c1600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b40b5440 msgr2=0x7fa2b40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2b40b5440 0x7fa2b40b7900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2c81080e0 tx=0x7fa2b8009110 comp rx=0 tx=0).stop 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 msgr2=0x7fa2c819b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 --2- 172.21.15.16:0/1840789883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2c8102de0 0x7fa2c819b530 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006010 tx=0x7fa2c40042f0 comp rx=0 tx=0).stop 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2ce6cf640 1 -- 172.21.15.16:0/1840789883 reap_dead start 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 shutdown_connections 2024-09-10T23:38:54.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 >> 172.21.15.16:0/1840789883 conn(0x7fa2c80fe830 msgr2=0x7fa2c8104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:54.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 shutdown_connections 2024-09-10T23:38:54.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:54.348+0000 7fa2d0132640 1 -- 172.21.15.16:0/1840789883 wait complete. 2024-09-10T23:38:55.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 -- 172.21.15.16:0/759174530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc1076a0 msgr2=0x7fe5fc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 --2- 172.21.15.16:0/759174530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc1076a0 0x7fe5fc107ae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009900 tx=0x7fe5e402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 -- 172.21.15.16:0/759174530 shutdown_connections 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 --2- 172.21.15.16:0/759174530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5fc108020 0x7fe5fc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 --2- 172.21.15.16:0/759174530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc1076a0 0x7fe5fc107ae0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 --2- 172.21.15.16:0/759174530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc101c90 0x7fe5fc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 -- 172.21.15.16:0/759174530 >> 172.21.15.16:0/759174530 conn(0x7fe5fc0fd700 msgr2=0x7fe5fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 -- 172.21.15.16:0/759174530 shutdown_connections 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.519+0000 7fe603138640 1 -- 172.21.15.16:0/759174530 wait complete. 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 Processor -- start 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 -- start start 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5fc101c90 0x7fe5fc1981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc1076a0 0x7fe5fc1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:55.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc108020 0x7fe5fc19da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc111ce0 con 0x7fe5fc108020 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc111b60 con 0x7fe5fc101c90 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe603138640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc111e60 con 0x7fe5fc1076a0 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc108020 0x7fe5fc19da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc108020 0x7fe5fc19da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53454/0 (socket says 172.21.15.16:53454) 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 -- 172.21.15.16:0/3312418419 learned_addr learned my addr 172.21.15.16:0/3312418419 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe600ed4640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5fc101c90 0x7fe5fc1981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:55.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe5fbfff640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc1076a0 0x7fe5fc1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 -- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc1076a0 msgr2=0x7fe5fc1986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc1076a0 0x7fe5fc1986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 -- 172.21.15.16:0/3312418419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5fc101c90 msgr2=0x7fe5fc1981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5fc101c90 0x7fe5fc1981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.520+0000 7fe6016d5640 1 -- 172.21.15.16:0/3312418419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5fc19e250 con 0x7fe5fc108020 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe5fbfff640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc1076a0 0x7fe5fc1986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe600ed4640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5fc101c90 0x7fe5fc1981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe6016d5640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc108020 0x7fe5fc19da80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400d750 tx=0x7fe5f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:55.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4017070 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5f40054d0 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5fc19e540 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4004c60 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.521+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5fc06aab0 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.522+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5fc06b000 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.524+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fe5f4004e00 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.524+0000 7fe5f9ffb640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe5e80b53c0 0x7fe5e80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.524+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe5f40e5d30 con 0x7fe5fc108020 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.524+0000 7fe600ed4640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe5e80b53c0 0x7fe5e80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.524+0000 7fe5f9ffb640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] conn(0x7fe5e80bf0e0 0x7fe5e80c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.524+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 --> [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5f4001d30 con 0x7fe5e80bf0e0 2024-09-10T23:38:55.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.525+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fe5f40e6180 con 0x7fe5fc108020 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.525+0000 7fe600ed4640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe5e80b53c0 0x7fe5e80b7880 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec005fd0 tx=0x7fe5ec009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.525+0000 7fe5fbfff640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] conn(0x7fe5e80bf0e0 0x7fe5e80c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.525+0000 7fe5fbfff640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] conn(0x7fe5e80bf0e0 0x7fe5e80c1580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.526+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== osd.11 v2:172.21.15.71:6824/2875208782 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5f4001d30 con 0x7fe5e80bf0e0 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.540+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 --> [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5fc06b480 con 0x7fe5e80bf0e0 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.541+0000 7fe5f9ffb640 1 -- 172.21.15.16:0/3312418419 <== osd.11 v2:172.21.15.71:6824/2875208782 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe5fc06b480 con 0x7fe5e80bf0e0 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.541+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] conn(0x7fe5e80bf0e0 msgr2=0x7fe5e80c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.541+0000 7fe603138640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] conn(0x7fe5e80bf0e0 0x7fe5e80c1580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.541+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe5e80b53c0 msgr2=0x7fe5e80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.541+0000 7fe603138640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe5e80b53c0 0x7fe5e80b7880 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec005fd0 tx=0x7fe5ec009500 comp rx=0 tx=0).stop 2024-09-10T23:38:55.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.542+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc108020 msgr2=0x7fe5fc19da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.542+0000 7fe603138640 1 --2- 172.21.15.16:0/3312418419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5fc108020 0x7fe5fc19da80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400d750 tx=0x7fe5f400dc10 comp rx=0 tx=0).stop 2024-09-10T23:38:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.542+0000 7fe6016d5640 1 -- 172.21.15.16:0/3312418419 reap_dead start 2024-09-10T23:38:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.542+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 shutdown_connections 2024-09-10T23:38:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.542+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 >> 172.21.15.16:0/3312418419 conn(0x7fe5fc0fd700 msgr2=0x7fe5fc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.542+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 shutdown_connections 2024-09-10T23:38:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:53.542+0000 7fe603138640 1 -- 172.21.15.16:0/3312418419 wait complete. 2024-09-10T23:38:55.824 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:55 smithi016 ceph-mon[30855]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:56.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:55 smithi071 ceph-mon[35018]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:56.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:55 smithi066 ceph-mon[34761]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T23:38:56.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.314+0000 7f7834635640 1 -- 172.21.15.16:0/2200649315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c109150 msgr2=0x7f782c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.314+0000 7f7834635640 1 --2- 172.21.15.16:0/2200649315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c109150 0x7f782c10f950 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7824009900 tx=0x7f782402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.314+0000 7f7834635640 1 -- 172.21.15.16:0/2200649315 shutdown_connections 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.314+0000 7f7834635640 1 --2- 172.21.15.16:0/2200649315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c109150 0x7f782c10f950 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.314+0000 7f7834635640 1 --2- 172.21.15.16:0/2200649315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f782c1087d0 0x7f782c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.314+0000 7f7834635640 1 --2- 172.21.15.16:0/2200649315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c102dc0 0x7f782c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.314+0000 7f7834635640 1 -- 172.21.15.16:0/2200649315 >> 172.21.15.16:0/2200649315 conn(0x7f782c0fe830 msgr2=0x7f782c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 -- 172.21.15.16:0/2200649315 shutdown_connections 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 -- 172.21.15.16:0/2200649315 wait complete. 2024-09-10T23:38:56.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 Processor -- start 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 -- start start 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c102dc0 0x7f782c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f782c1087d0 0x7f782c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c109150 0x7f782c19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f782c112e10 con 0x7f782c102dc0 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f782c112c90 con 0x7f782c109150 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f7834635640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f782c112f90 con 0x7f782c1087d0 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f78323d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c102dc0 0x7f782c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f78323d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c102dc0 0x7f782c199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53476/0 (socket says 172.21.15.16:53476) 2024-09-10T23:38:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.315+0000 7f78323d1640 1 -- 172.21.15.16:0/354812057 learned_addr learned my addr 172.21.15.16:0/354812057 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f7832bd2640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c109150 0x7f782c19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f7831bd0640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f782c1087d0 0x7f782c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f78323d1640 1 -- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f782c1087d0 msgr2=0x7f782c1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f78323d1640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f782c1087d0 0x7f782c1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f78323d1640 1 -- 172.21.15.16:0/354812057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c109150 msgr2=0x7f782c19ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f78323d1640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c109150 0x7f782c19ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f78323d1640 1 -- 172.21.15.16:0/354812057 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c19f230 con 0x7f782c102dc0 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f7831bd0640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f782c1087d0 0x7f782c1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f78323d1640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c102dc0 0x7f782c199180 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f781c00cce0 tx=0x7f781c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c004b20 con 0x7f782c102dc0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f781c004cc0 con 0x7f782c102dc0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782c19f520 con 0x7f782c102dc0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c00f6b0 con 0x7f782c102dc0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.316+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782c1a5be0 con 0x7f782c102dc0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.317+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f782c1060e0 con 0x7f782c102dc0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.319+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f781c00f850 con 0x7f782c102dc0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.319+0000 7f782b7fe640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f78140b53c0 0x7f78140b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.320+0000 7f7831bd0640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f78140b53c0 0x7f78140b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.320+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f781c0e62e0 con 0x7f782c102dc0 2024-09-10T23:38:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.320+0000 7f782b7fe640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] conn(0x7f78140bf0e0 0x7f78140c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.320+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 --> [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f781c016ec0 con 0x7f78140bf0e0 2024-09-10T23:38:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.320+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f781c0e6730 con 0x7f782c102dc0 2024-09-10T23:38:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.320+0000 7f7831bd0640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f78140b53c0 0x7f78140b7880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f782c1081d0 tx=0x7f7820005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.320+0000 7f7832bd2640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] conn(0x7f78140bf0e0 0x7f78140c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.321+0000 7f7832bd2640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] conn(0x7f78140bf0e0 0x7f78140c1580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:56.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.321+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== osd.5 v2:172.21.15.71:6808/2984688439 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f781c016ec0 con 0x7f78140bf0e0 2024-09-10T23:38:56.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.335+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 --> [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f782c104070 con 0x7f78140bf0e0 2024-09-10T23:38:56.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f782b7fe640 1 -- 172.21.15.16:0/354812057 <== osd.5 v2:172.21.15.71:6808/2984688439 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f782c104070 con 0x7f78140bf0e0 2024-09-10T23:38:56.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] conn(0x7f78140bf0e0 msgr2=0x7f78140c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] conn(0x7f78140bf0e0 0x7f78140c1580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f78140b53c0 msgr2=0x7f78140b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f78140b53c0 0x7f78140b7880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f782c1081d0 tx=0x7f7820005d90 comp rx=0 tx=0).stop 2024-09-10T23:38:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c102dc0 msgr2=0x7f782c199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 --2- 172.21.15.16:0/354812057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f782c102dc0 0x7f782c199180 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f781c00cce0 tx=0x7f781c00a620 comp rx=0 tx=0).stop 2024-09-10T23:38:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7832bd2640 1 -- 172.21.15.16:0/354812057 reap_dead start 2024-09-10T23:38:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 shutdown_connections 2024-09-10T23:38:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 >> 172.21.15.16:0/354812057 conn(0x7f782c0fe830 msgr2=0x7f782c101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 shutdown_connections 2024-09-10T23:38:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.336+0000 7f7834635640 1 -- 172.21.15.16:0/354812057 wait complete. 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 -- 172.21.15.16:0/2615376040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 msgr2=0x7f7d941020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 --2- 172.21.15.16:0/2615376040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 0x7f7d941020b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009900 tx=0x7f7d8402a410 comp rx=0 tx=0).stop 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 -- 172.21.15.16:0/2615376040 shutdown_connections 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 --2- 172.21.15.16:0/2615376040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d94108060 0x7f7d9410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 --2- 172.21.15.16:0/2615376040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d941076e0 0x7f7d94107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 --2- 172.21.15.16:0/2615376040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 0x7f7d941020b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 -- 172.21.15.16:0/2615376040 >> 172.21.15.16:0/2615376040 conn(0x7f7d940fd700 msgr2=0x7f7d940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 -- 172.21.15.16:0/2615376040 shutdown_connections 2024-09-10T23:38:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.524+0000 7f7d99f52640 1 -- 172.21.15.16:0/2615376040 wait complete. 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 Processor -- start 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 -- start start 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 0x7f7d9419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d941076e0 0x7f7d9419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d94108060 0x7f7d941a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94111d20 con 0x7f7d94101cd0 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94111ba0 con 0x7f7d941076e0 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d99f52640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94111ea0 con 0x7f7d94108060 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 0x7f7d9419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 0x7f7d9419a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53496/0 (socket says 172.21.15.16:53496) 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d937fe640 1 -- 172.21.15.16:0/163494072 learned_addr learned my addr 172.21.15.16:0/163494072 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.525+0000 7f7d92ffd640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d941076e0 0x7f7d9419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d93fff640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d94108060 0x7f7d941a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d937fe640 1 -- 172.21.15.16:0/163494072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d94108060 msgr2=0x7f7d941a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d937fe640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d94108060 0x7f7d941a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d937fe640 1 -- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d941076e0 msgr2=0x7f7d9419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d937fe640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d941076e0 0x7f7d9419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d937fe640 1 -- 172.21.15.16:0/163494072 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d941a5650 con 0x7f7d94101cd0 2024-09-10T23:38:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d937fe640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 0x7f7d9419a090 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005940 tx=0x7f7d840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8403f030 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d84003cb0 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d941a5820 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84035070 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.526+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d941a5cf0 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.527+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d940638e0 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.529+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f7d84003800 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.529+0000 7f7d90ff9640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7d7c0b53c0 0x7f7d7c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.529+0000 7f7d92ffd640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7d7c0b53c0 0x7f7d7c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.529+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f7d84106d20 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.529+0000 7f7d90ff9640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] conn(0x7f7d7c0bf0e0 0x7f7d7c0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.529+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 --> [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d8403dec0 con 0x7f7d7c0bf0e0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.530+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f7d841070d0 con 0x7f7d94101cd0 2024-09-10T23:38:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.530+0000 7f7d92ffd640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7d7c0b53c0 0x7f7d7c0b7880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406c0f0 tx=0x7f7d88009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.530+0000 7f7d93fff640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] conn(0x7f7d7c0bf0e0 0x7f7d7c0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.530+0000 7f7d93fff640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] conn(0x7f7d7c0bf0e0 0x7f7d7c0c1580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.531+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== osd.7 v2:172.21.15.66:6816/3815713704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d8403dec0 con 0x7f7d7c0bf0e0 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.545+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 --> [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7d94063ce0 con 0x7f7d7c0bf0e0 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.545+0000 7f7d90ff9640 1 -- 172.21.15.16:0/163494072 <== osd.7 v2:172.21.15.66:6816/3815713704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7d94063ce0 con 0x7f7d7c0bf0e0 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] conn(0x7f7d7c0bf0e0 msgr2=0x7f7d7c0c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] conn(0x7f7d7c0bf0e0 0x7f7d7c0c1580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7d7c0b53c0 msgr2=0x7f7d7c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7d7c0b53c0 0x7f7d7c0b7880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406c0f0 tx=0x7f7d88009110 comp rx=0 tx=0).stop 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 msgr2=0x7f7d9419a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 --2- 172.21.15.16:0/163494072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d94101cd0 0x7f7d9419a090 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005940 tx=0x7f7d840042f0 comp rx=0 tx=0).stop 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d93fff640 1 -- 172.21.15.16:0/163494072 reap_dead start 2024-09-10T23:38:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 shutdown_connections 2024-09-10T23:38:56.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 >> 172.21.15.16:0/163494072 conn(0x7f7d940fd700 msgr2=0x7f7d940ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:56.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 shutdown_connections 2024-09-10T23:38:56.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:56.546+0000 7f7d99f52640 1 -- 172.21.15.16:0/163494072 wait complete. 2024-09-10T23:38:57.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:57 smithi016 ceph-mon[30855]: pgmap v282: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T23:38:57.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 -- 172.21.15.16:0/2215380317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70101cd0 msgr2=0x7f5a701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 --2- 172.21.15.16:0/2215380317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70101cd0 0x7f5a701020b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009900 tx=0x7f5a6002a410 comp rx=0 tx=0).stop 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 -- 172.21.15.16:0/2215380317 shutdown_connections 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 --2- 172.21.15.16:0/2215380317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a70108060 0x7f5a7010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 --2- 172.21.15.16:0/2215380317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a701076e0 0x7f5a70107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 --2- 172.21.15.16:0/2215380317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70101cd0 0x7f5a701020b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 -- 172.21.15.16:0/2215380317 >> 172.21.15.16:0/2215380317 conn(0x7f5a700fd700 msgr2=0x7f5a700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 -- 172.21.15.16:0/2215380317 shutdown_connections 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 -- 172.21.15.16:0/2215380317 wait complete. 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 Processor -- start 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.759+0000 7f5a75de0640 1 -- start start 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a75de0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a70101cd0 0x7f5a700fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a75de0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a701076e0 0x7f5a700fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a75de0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a70108060 0x7f5a700fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a75de0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70111d70 con 0x7f5a701076e0 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a75de0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70111bf0 con 0x7f5a70101cd0 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a75de0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70111ef0 con 0x7f5a70108060 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a701076e0 0x7f5a700fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a701076e0 0x7f5a700fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53538/0 (socket says 172.21.15.16:53538) 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 -- 172.21.15.16:0/515076613 learned_addr learned my addr 172.21.15.16:0/515076613 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a6f7fe640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a70101cd0 0x7f5a700fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a6ffff640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a70108060 0x7f5a700fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 -- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a70108060 msgr2=0x7f5a700fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a70108060 0x7f5a700fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 -- 172.21.15.16:0/515076613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a70101cd0 msgr2=0x7f5a700fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a70101cd0 0x7f5a700fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 -- 172.21.15.16:0/515076613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a701a76b0 con 0x7f5a701076e0 2024-09-10T23:38:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a6ffff640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a70108060 0x7f5a700fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a67fff640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a701076e0 0x7f5a700fe140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800d950 tx=0x7f5a5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.760+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58017030 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.761+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a58004020 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.761+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a701a79a0 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.761+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a580047a0 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.761+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a701a7ee0 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.761+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a700638e0 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.763+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f5a58009a30 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6d7fa640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a5c0b53c0 0x7f5a5c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6f7fe640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a5c0b53c0 0x7f5a5c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5a580e5f80 con 0x7f5a701076e0 2024-09-10T23:38:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6d7fa640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] conn(0x7f5a5c0bf0e0 0x7f5a5c0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 --> [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a58009090 con 0x7f5a5c0bf0e0 2024-09-10T23:38:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f5a580e63d0 con 0x7f5a701076e0 2024-09-10T23:38:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6f7fe640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a5c0b53c0 0x7f5a5c0b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005ab0 tx=0x7f5a60005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.764+0000 7f5a6ffff640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] conn(0x7f5a5c0bf0e0 0x7f5a5c0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.765+0000 7f5a6ffff640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] conn(0x7f5a5c0bf0e0 0x7f5a5c0c1580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.766+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== osd.2 v2:172.21.15.71:6800/3069059707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a58009090 con 0x7f5a5c0bf0e0 2024-09-10T23:38:57.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.780+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 --> [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a70063d60 con 0x7f5a5c0bf0e0 2024-09-10T23:38:57.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a6d7fa640 1 -- 172.21.15.16:0/515076613 <== osd.2 v2:172.21.15.71:6800/3069059707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5a70063d60 con 0x7f5a5c0bf0e0 2024-09-10T23:38:57.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] conn(0x7f5a5c0bf0e0 msgr2=0x7f5a5c0c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:57.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] conn(0x7f5a5c0bf0e0 0x7f5a5c0c1580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:57.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a5c0b53c0 msgr2=0x7f5a5c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:57.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a5c0b53c0 0x7f5a5c0b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005ab0 tx=0x7f5a60005a20 comp rx=0 tx=0).stop 2024-09-10T23:38:57.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a701076e0 msgr2=0x7f5a700fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:57.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 --2- 172.21.15.16:0/515076613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a701076e0 0x7f5a700fe140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800d950 tx=0x7f5a5800de10 comp rx=0 tx=0).stop 2024-09-10T23:38:57.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a6ffff640 1 -- 172.21.15.16:0/515076613 reap_dead start 2024-09-10T23:38:57.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 shutdown_connections 2024-09-10T23:38:57.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 >> 172.21.15.16:0/515076613 conn(0x7f5a700fd700 msgr2=0x7f5a7006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:57.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 shutdown_connections 2024-09-10T23:38:57.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.781+0000 7f5a75de0640 1 -- 172.21.15.16:0/515076613 wait complete. 2024-09-10T23:38:58.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:57 smithi071 ceph-mon[35018]: pgmap v282: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T23:38:58.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:57 smithi066 ceph-mon[34761]: pgmap v282: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T23:38:58.365 INFO:teuthology.orchestra.run.smithi016.stdout:296352743445 2024-09-10T23:38:58.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.237+0000 7fcec80fd640 1 -- 172.21.15.16:0/1084326468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec01087d0 msgr2=0x7fcec0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.237+0000 7fcec80fd640 1 --2- 172.21.15.16:0/1084326468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec01087d0 0x7fcec0108c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009900 tx=0x7fceb002a410 comp rx=0 tx=0).stop 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.237+0000 7fcec80fd640 1 -- 172.21.15.16:0/1084326468 shutdown_connections 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.237+0000 7fcec80fd640 1 --2- 172.21.15.16:0/1084326468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcec0109150 0x7fcec010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.237+0000 7fcec80fd640 1 --2- 172.21.15.16:0/1084326468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec01087d0 0x7fcec0108c10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.237+0000 7fcec80fd640 1 --2- 172.21.15.16:0/1084326468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec0102dc0 0x7fcec01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.237+0000 7fcec80fd640 1 -- 172.21.15.16:0/1084326468 >> 172.21.15.16:0/1084326468 conn(0x7fcec00fe830 msgr2=0x7fcec0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.238+0000 7fcec80fd640 1 -- 172.21.15.16:0/1084326468 shutdown_connections 2024-09-10T23:38:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.238+0000 7fcec80fd640 1 -- 172.21.15.16:0/1084326468 wait complete. 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.238+0000 7fcec80fd640 1 Processor -- start 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.238+0000 7fcec80fd640 1 -- start start 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec80fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec0102dc0 0x7fcec0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec80fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcec01087d0 0x7fcec01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec80fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec0109150 0x7fcec019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec80fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0112dd0 con 0x7fcec0109150 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec80fd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0112c50 con 0x7fcec0102dc0 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec80fd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0112f50 con 0x7fcec01087d0 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec0109150 0x7fcec019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec0109150 0x7fcec019eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53518/0 (socket says 172.21.15.16:53518) 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 -- 172.21.15.16:0/4189582598 learned_addr learned my addr 172.21.15.16:0/4189582598 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec5698640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcec01087d0 0x7fcec01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec5e99640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec0102dc0 0x7fcec0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 -- 172.21.15.16:0/4189582598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcec01087d0 msgr2=0x7fcec01997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcec01087d0 0x7fcec01997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 -- 172.21.15.16:0/4189582598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec0102dc0 msgr2=0x7fcec0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcec0102dc0 0x7fcec0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 -- 172.21.15.16:0/4189582598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec019f330 con 0x7fcec0109150 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec669a640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec0109150 0x7fcec019eb60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009fd0 tx=0x7fceb800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:58.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8017070 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec019f620 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceb8003e20 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.239+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8010460 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.240+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01a5ce0 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.240+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcec00638e0 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.242+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fceb8003970 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.243+0000 7fceb6ffd640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fceac0b53c0 0x7fceac0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.243+0000 7fcec5e99640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fceac0b53c0 0x7fceac0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.243+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fceb80e5f50 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.243+0000 7fceb6ffd640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] conn(0x7fceac0bf0e0 0x7fceac0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.243+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 --> [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fceb8016ec0 con 0x7fceac0bf0e0 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.243+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fceb80e63a0 con 0x7fcec0109150 2024-09-10T23:38:58.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.243+0000 7fcec5e99640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fceac0b53c0 0x7fceac0b7880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00bbe0 tx=0x7fcebc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.244+0000 7fcec5698640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] conn(0x7fceac0bf0e0 0x7fceac0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.244+0000 7fcec5698640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] conn(0x7fceac0bf0e0 0x7fceac0c1580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.245+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== osd.9 v2:172.21.15.16:6826/2503971838 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fceb8016ec0 con 0x7fceac0bf0e0 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.258+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 --> [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcec0063d90 con 0x7fceac0bf0e0 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fceb6ffd640 1 -- 172.21.15.16:0/4189582598 <== osd.9 v2:172.21.15.16:6826/2503971838 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcec0063d90 con 0x7fceac0bf0e0 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] conn(0x7fceac0bf0e0 msgr2=0x7fceac0c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] conn(0x7fceac0bf0e0 0x7fceac0c1580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fceac0b53c0 msgr2=0x7fceac0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fceac0b53c0 0x7fceac0b7880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00bbe0 tx=0x7fcebc00b390 comp rx=0 tx=0).stop 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec0109150 msgr2=0x7fcec019eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 --2- 172.21.15.16:0/4189582598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcec0109150 0x7fcec019eb60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009fd0 tx=0x7fceb800b260 comp rx=0 tx=0).stop 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec669a640 1 -- 172.21.15.16:0/4189582598 reap_dead start 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 shutdown_connections 2024-09-10T23:38:58.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 >> 172.21.15.16:0/4189582598 conn(0x7fcec00fe830 msgr2=0x7fcec0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:38:58.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 shutdown_connections 2024-09-10T23:38:58.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:57.259+0000 7fcec80fd640 1 -- 172.21.15.16:0/4189582598 wait complete. 2024-09-10T23:38:59.368 INFO:teuthology.orchestra.run.smithi016.stdout:38654705741 2024-09-10T23:38:59.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T23:38:59.725 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:38:59 smithi016 ceph-mon[30855]: pgmap v283: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T23:39:00.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:38:59 smithi071 ceph-mon[35018]: pgmap v283: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T23:39:00.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:38:59 smithi066 ceph-mon[34761]: pgmap v283: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T23:39:00.386 INFO:teuthology.orchestra.run.smithi016.stdout:201863462953 2024-09-10T23:39:00.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T23:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout:180388626478 2024-09-10T23:39:00.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 -- 172.21.15.16:0/1282362223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 msgr2=0x7f4a7c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 --2- 172.21.15.16:0/1282362223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 0x7f4a7c10e860 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009900 tx=0x7f4a7402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 -- 172.21.15.16:0/1282362223 shutdown_connections 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 --2- 172.21.15.16:0/1282362223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 0x7f4a7c10e860 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 --2- 172.21.15.16:0/1282362223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a7c1076e0 0x7f4a7c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 --2- 172.21.15.16:0/1282362223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c101cd0 0x7f4a7c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 -- 172.21.15.16:0/1282362223 >> 172.21.15.16:0/1282362223 conn(0x7f4a7c0fd700 msgr2=0x7f4a7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:01.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 -- 172.21.15.16:0/1282362223 shutdown_connections 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.024+0000 7f4a83b60640 1 -- 172.21.15.16:0/1282362223 wait complete. 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 Processor -- start 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 -- start start 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a7c101cd0 0x7f4a7c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c1076e0 0x7f4a7c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 0x7f4a7c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c111ce0 con 0x7f4a7c108060 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c111b60 con 0x7f4a7c1076e0 2024-09-10T23:39:01.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a83b60640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c111e60 con 0x7f4a7c101cd0 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 0x7f4a7c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 0x7f4a7c19ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53576/0 (socket says 172.21.15.16:53576) 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 -- 172.21.15.16:0/2366912537 learned_addr learned my addr 172.21.15.16:0/2366912537 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a818fc640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a7c101cd0 0x7f4a7c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 -- 172.21.15.16:0/2366912537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a7c101cd0 msgr2=0x7f4a7c1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a7c101cd0 0x7f4a7c1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 -- 172.21.15.16:0/2366912537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c1076e0 msgr2=0x7f4a7c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a810fb640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c1076e0 0x7f4a7c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c1076e0 0x7f4a7c1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:01.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 -- 172.21.15.16:0/2366912537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c19f450 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a810fb640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c1076e0 0x7f4a7c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.025+0000 7f4a820fd640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 0x7f4a7c19ec80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a74004770 tx=0x7f4a74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.026+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7403f030 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.026+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a74003aa0 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.026+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c19f6e0 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.026+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74035070 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.026+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c1a5e00 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.027+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a7c0638e0 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.028+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f4a740035f0 con 0x7f4a7c108060 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a72ffd640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4a680b5440 0x7f4a680b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a818fc640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4a680b5440 0x7f4a680b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:01.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4a74106ff0 con 0x7f4a7c108060 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a72ffd640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] conn(0x7f4a680bf160 0x7f4a680c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 --> [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a74008e50 con 0x7f4a680bf160 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f4a74107400 con 0x7f4a7c108060 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a810fb640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] conn(0x7f4a680bf160 0x7f4a680c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.029+0000 7f4a818fc640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4a680b5440 0x7f4a680b7900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a78005fd0 tx=0x7f4a78009870 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.030+0000 7f4a810fb640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] conn(0x7f4a680bf160 0x7f4a680c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.030+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== osd.3 v2:172.21.15.16:6810/2604369772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a74008e50 con 0x7f4a680bf160 2024-09-10T23:39:01.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.044+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 --> [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a7c063ce0 con 0x7f4a680bf160 2024-09-10T23:39:01.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.044+0000 7f4a72ffd640 1 -- 172.21.15.16:0/2366912537 <== osd.3 v2:172.21.15.16:6810/2604369772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4a7c063ce0 con 0x7f4a680bf160 2024-09-10T23:39:01.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] conn(0x7f4a680bf160 msgr2=0x7f4a680c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] conn(0x7f4a680bf160 0x7f4a680c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4a680b5440 msgr2=0x7f4a680b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4a680b5440 0x7f4a680b7900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a78005fd0 tx=0x7f4a78009870 comp rx=0 tx=0).stop 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 msgr2=0x7f4a7c19ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 --2- 172.21.15.16:0/2366912537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a7c108060 0x7f4a7c19ec80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a74004770 tx=0x7f4a74004270 comp rx=0 tx=0).stop 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a820fd640 1 -- 172.21.15.16:0/2366912537 reap_dead start 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 shutdown_connections 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 >> 172.21.15.16:0/2366912537 conn(0x7f4a7c0fd700 msgr2=0x7f4a7c06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 shutdown_connections 2024-09-10T23:39:01.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:01.045+0000 7f4a83b60640 1 -- 172.21.15.16:0/2366912537 wait complete. 2024-09-10T23:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout:223338299428 2024-09-10T23:39:01.289 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T23:39:01.702 INFO:teuthology.orchestra.run.smithi016.stdout:107374182463 2024-09-10T23:39:01.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T23:39:01.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:01 smithi016 ceph-mon[30855]: pgmap v284: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:02.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:01 smithi071 ceph-mon[35018]: pgmap v284: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:02.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:01 smithi066 ceph-mon[34761]: pgmap v284: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:02.424 INFO:teuthology.orchestra.run.smithi016.stdout:154618822708 2024-09-10T23:39:02.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T23:39:02.977 INFO:teuthology.orchestra.run.smithi016.stdout:249108103201 2024-09-10T23:39:02.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 -- 172.21.15.16:0/2931276900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c109170 msgr2=0x7f1f1c10f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 --2- 172.21.15.16:0/2931276900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c109170 0x7f1f1c10f970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009ca0 tx=0x7f1f1402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 -- 172.21.15.16:0/2931276900 shutdown_connections 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 --2- 172.21.15.16:0/2931276900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c109170 0x7f1f1c10f970 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 --2- 172.21.15.16:0/2931276900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f1c1087f0 0x7f1f1c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 --2- 172.21.15.16:0/2931276900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c102de0 0x7f1f1c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 -- 172.21.15.16:0/2931276900 >> 172.21.15.16:0/2931276900 conn(0x7f1f1c0fe830 msgr2=0x7f1f1c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 -- 172.21.15.16:0/2931276900 shutdown_connections 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.559+0000 7f1f21bd7640 1 -- 172.21.15.16:0/2931276900 wait complete. 2024-09-10T23:39:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.560+0000 7f1f21bd7640 1 Processor -- start 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.560+0000 7f1f21bd7640 1 -- start start 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.560+0000 7f1f21bd7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c102de0 0x7f1f1c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.560+0000 7f1f21bd7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c1087f0 0x7f1f1c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c1087f0 0x7f1f1c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c1087f0 0x7f1f1c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53554/0 (socket says 172.21.15.16:53554) 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f21bd7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f1c109170 0x7f1f1c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c112df0 con 0x7f1f1c1087f0 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 -- 172.21.15.16:0/1805968290 learned_addr learned my addr 172.21.15.16:0/1805968290 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c112c70 con 0x7f1f1c109170 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c112f70 con 0x7f1f1c102de0 2024-09-10T23:39:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1b7fe640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c102de0 0x7f1f1c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 -- 172.21.15.16:0/1805968290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c102de0 msgr2=0x7f1f1c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f1c102de0 0x7f1f1c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 -- 172.21.15.16:0/1805968290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f1c109170 msgr2=0x7f1f1c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f1c109170 0x7f1f1c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c1a7720 con 0x7f1f1c1087f0 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f1affd640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c1087f0 0x7f1f1c0759e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9f0 tx=0x7f1f0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.561+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400cd80 con 0x7f1f1c1087f0 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.562+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f040108e0 con 0x7f1f1c1087f0 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.562+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c1a7a10 con 0x7f1f1c1087f0 2024-09-10T23:39:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.562+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04018980 con 0x7f1f1c1087f0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.562+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1a7f50 con 0x7f1f1c1087f0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.563+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f1c0638e0 con 0x7f1f1c1087f0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.564+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f1f04010430 con 0x7f1f1c1087f0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.565+0000 7f1f18ff9640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b53c0 0x7f1f080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.565+0000 7f1f1b7fe640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b53c0 0x7f1f080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.565+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f1f040e6210 con 0x7f1f1c1087f0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.565+0000 7f1f18ff9640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] conn(0x7f1f080bf0e0 0x7f1f080c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.566+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f04022e50 con 0x7f1f080bf0e0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.566+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f1f040ed050 con 0x7f1f1c1087f0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.566+0000 7f1f1b7fe640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b53c0 0x7f1f080b7880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005d00 tx=0x7f1f0c00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.566+0000 7f1f1bfff640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] conn(0x7f1f080bf0e0 0x7f1f080c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.566+0000 7f1f1bfff640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] conn(0x7f1f080bf0e0 0x7f1f080c1580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.567+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== osd.4 v2:172.21.15.66:6808/2175362919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f04022e50 con 0x7f1f080bf0e0 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.582+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 --> [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f1c063d60 con 0x7f1f080bf0e0 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.582+0000 7f1f18ff9640 1 -- 172.21.15.16:0/1805968290 <== osd.4 v2:172.21.15.66:6808/2175362919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1f1c063d60 con 0x7f1f080bf0e0 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.582+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 >> [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] conn(0x7f1f080bf0e0 msgr2=0x7f1f080c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.582+0000 7f1f21bd7640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] conn(0x7f1f080bf0e0 0x7f1f080c1580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b53c0 msgr2=0x7f1f080b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b53c0 0x7f1f080b7880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005d00 tx=0x7f1f0c00b410 comp rx=0 tx=0).stop 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c1087f0 msgr2=0x7f1f1c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 --2- 172.21.15.16:0/1805968290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f1c1087f0 0x7f1f1c0759e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9f0 tx=0x7f1f0400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f1bfff640 1 -- 172.21.15.16:0/1805968290 reap_dead start 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 shutdown_connections 2024-09-10T23:39:03.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 >> 172.21.15.16:0/1805968290 conn(0x7f1f1c0fe830 msgr2=0x7f1f1c0ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 shutdown_connections 2024-09-10T23:39:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:38:58.583+0000 7f1f21bd7640 1 -- 172.21.15.16:0/1805968290 wait complete. 2024-09-10T23:39:03.733 INFO:teuthology.orchestra.run.smithi016.stdout:133143986234 2024-09-10T23:39:03.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T23:39:03.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:03 smithi016 ceph-mon[30855]: pgmap v285: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:03.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 -- 172.21.15.16:0/430048399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd570108020 msgr2=0x7fd57010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 --2- 172.21.15.16:0/430048399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd570108020 0x7fd57010e820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd568009ca0 tx=0x7fd56802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 -- 172.21.15.16:0/430048399 shutdown_connections 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 --2- 172.21.15.16:0/430048399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd570108020 0x7fd57010e820 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 --2- 172.21.15.16:0/430048399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5701076a0 0x7fd570107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 --2- 172.21.15.16:0/430048399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd570101c90 0x7fd570102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 -- 172.21.15.16:0/430048399 >> 172.21.15.16:0/430048399 conn(0x7fd5700fd700 msgr2=0x7fd5700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 -- 172.21.15.16:0/430048399 shutdown_connections 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 -- 172.21.15.16:0/430048399 wait complete. 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.899+0000 7fd576bbb640 1 Processor -- start 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd576bbb640 1 -- start start 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd576bbb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd570101c90 0x7fd5701972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd576bbb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5701076a0 0x7fd570197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd576bbb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd570108020 0x7fd57019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd576bbb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd570111ca0 con 0x7fd5701076a0 2024-09-10T23:39:03.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd576bbb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd570111b20 con 0x7fd570108020 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd576bbb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd570111e20 con 0x7fd570101c90 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5701076a0 0x7fd570197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5701076a0 0x7fd570197820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32774/0 (socket says 172.21.15.16:32774) 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 -- 172.21.15.16:0/1758869090 learned_addr learned my addr 172.21.15.16:0/1758869090 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd574957640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd570101c90 0x7fd5701972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd575158640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd570108020 0x7fd57019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 -- 172.21.15.16:0/1758869090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd570101c90 msgr2=0x7fd5701972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd570101c90 0x7fd5701972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 -- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd570108020 msgr2=0x7fd57019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd570108020 0x7fd57019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.900+0000 7fd56ffff640 1 -- 172.21.15.16:0/1758869090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57019d0c0 con 0x7fd5701076a0 2024-09-10T23:39:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd574957640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd570101c90 0x7fd5701972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd575158640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd570108020 0x7fd57019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd56ffff640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5701076a0 0x7fd570197820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00c970 tx=0x7fd55c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c007bb0 con 0x7fd5701076a0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57019d3b0 con 0x7fd5701076a0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57019dab0 con 0x7fd5701076a0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd55c007d50 con 0x7fd5701076a0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.901+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c004de0 con 0x7fd5701076a0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.902+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd57006b620 con 0x7fd5701076a0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.905+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fd55c005020 con 0x7fd5701076a0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd56dffb640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5600b5440 0x7fd5600b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd574957640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5600b5440 0x7fd5600b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd55c0e5ae0 con 0x7fd5701076a0 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd56dffb640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] conn(0x7fd5600bf160 0x7fd5600c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 --> [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5600c1cd0 con 0x7fd5600bf160 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd55c0ea2c0 con 0x7fd5701076a0 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd574957640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5600b5440 0x7fd5600b7900 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd56400afb0 tx=0x7fd56400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.906+0000 7fd575158640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] conn(0x7fd5600bf160 0x7fd5600c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.907+0000 7fd575158640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] conn(0x7fd5600bf160 0x7fd5600c1600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.908+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== osd.10 v2:172.21.15.66:6824/168536242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5600c1cd0 con 0x7fd5600bf160 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.922+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 --> [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd570102f40 con 0x7fd5600bf160 2024-09-10T23:39:03.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.922+0000 7fd56dffb640 1 -- 172.21.15.16:0/1758869090 <== osd.10 v2:172.21.15.66:6824/168536242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd570102f40 con 0x7fd5600bf160 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] conn(0x7fd5600bf160 msgr2=0x7fd5600c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] conn(0x7fd5600bf160 0x7fd5600c1600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5600b5440 msgr2=0x7fd5600b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5600b5440 0x7fd5600b7900 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd56400afb0 tx=0x7fd56400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5701076a0 msgr2=0x7fd570197820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 --2- 172.21.15.16:0/1758869090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5701076a0 0x7fd570197820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00c970 tx=0x7fd55c00cd70 comp rx=0 tx=0).stop 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd575158640 1 -- 172.21.15.16:0/1758869090 reap_dead start 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 shutdown_connections 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 >> 172.21.15.16:0/1758869090 conn(0x7fd5700fd700 msgr2=0x7fd570100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:03.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 shutdown_connections 2024-09-10T23:39:03.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:03.923+0000 7fd576bbb640 1 -- 172.21.15.16:0/1758869090 wait complete. 2024-09-10T23:39:04.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:03 smithi071 ceph-mon[35018]: pgmap v285: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:04.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:03 smithi066 ceph-mon[34761]: pgmap v285: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:04.633 INFO:teuthology.orchestra.run.smithi016.stdout:270582939677 2024-09-10T23:39:04.634 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 -- 172.21.15.16:0/129170953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc1087d0 msgr2=0x7fb3fc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 --2- 172.21.15.16:0/129170953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc1087d0 0x7fb3fc108c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009900 tx=0x7fb3f002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 -- 172.21.15.16:0/129170953 shutdown_connections 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 --2- 172.21.15.16:0/129170953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3fc109150 0x7fb3fc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 --2- 172.21.15.16:0/129170953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc1087d0 0x7fb3fc108c10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 --2- 172.21.15.16:0/129170953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3fc102dc0 0x7fb3fc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 -- 172.21.15.16:0/129170953 >> 172.21.15.16:0/129170953 conn(0x7fb3fc0fe830 msgr2=0x7fb3fc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 -- 172.21.15.16:0/129170953 shutdown_connections 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 -- 172.21.15.16:0/129170953 wait complete. 2024-09-10T23:39:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.100+0000 7fb40219b640 1 Processor -- start 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb40219b640 1 -- start start 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb40219b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3fc102dc0 0x7fb3fc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb40219b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3fc1087d0 0x7fb3fc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb40219b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc109150 0x7fb3fc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb40219b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc112e20 con 0x7fb3fc109150 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb40219b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc112ca0 con 0x7fb3fc1087d0 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb40219b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc112fa0 con 0x7fb3fc102dc0 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc109150 0x7fb3fc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc109150 0x7fb3fc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32792/0 (socket says 172.21.15.16:32792) 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 -- 172.21.15.16:0/539705170 learned_addr learned my addr 172.21.15.16:0/539705170 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fb7fe640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3fc102dc0 0x7fb3fc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3faffd640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3fc1087d0 0x7fb3fc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 -- 172.21.15.16:0/539705170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3fc102dc0 msgr2=0x7fb3fc0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3fc102dc0 0x7fb3fc0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 -- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3fc1087d0 msgr2=0x7fb3fc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3fc1087d0 0x7fb3fc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 -- 172.21.15.16:0/539705170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3fc1a76b0 con 0x7fb3fc109150 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.101+0000 7fb3fbfff640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc109150 0x7fb3fc075f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400eaa0 tx=0x7fb3f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.102+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400cdb0 con 0x7fb3fc109150 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.102+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3fc1a79a0 con 0x7fb3fc109150 2024-09-10T23:39:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.102+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3f4005020 con 0x7fb3fc109150 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.102+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40116d0 con 0x7fb3fc109150 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.102+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3fc1a7eb0 con 0x7fb3fc109150 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.102+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3fc0638e0 con 0x7fb3fc109150 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.104+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb3f400f040 con 0x7fb3fc109150 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.105+0000 7fb3f8ff9640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3e40b53c0 0x7fb3e40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.105+0000 7fb3fb7fe640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3e40b53c0 0x7fb3e40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.105+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb3f40e6020 con 0x7fb3fc109150 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.105+0000 7fb3f8ff9640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] conn(0x7fb3e40bf0e0 0x7fb3e40c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.105+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 --> [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3f4014ec0 con 0x7fb3e40bf0e0 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.105+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fb3f40e6470 con 0x7fb3fc109150 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.105+0000 7fb3fb7fe640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3e40b53c0 0x7fb3e40b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0058c0 tx=0x7fb3ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.106+0000 7fb3faffd640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] conn(0x7fb3e40bf0e0 0x7fb3e40c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.106+0000 7fb3faffd640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] conn(0x7fb3e40bf0e0 0x7fb3e40c1580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.107+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== osd.1 v2:172.21.15.66:6800/842526831 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3f4014ec0 con 0x7fb3e40bf0e0 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.120+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 --> [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb3fc063d60 con 0x7fb3e40bf0e0 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.121+0000 7fb3f8ff9640 1 -- 172.21.15.16:0/539705170 <== osd.1 v2:172.21.15.66:6800/842526831 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb3fc063d60 con 0x7fb3e40bf0e0 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.121+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] conn(0x7fb3e40bf0e0 msgr2=0x7fb3e40c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.121+0000 7fb40219b640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] conn(0x7fb3e40bf0e0 0x7fb3e40c1580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3e40b53c0 msgr2=0x7fb3e40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3e40b53c0 0x7fb3e40b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0058c0 tx=0x7fb3ec00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc109150 msgr2=0x7fb3fc075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 --2- 172.21.15.16:0/539705170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3fc109150 0x7fb3fc075f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400eaa0 tx=0x7fb3f400ef60 comp rx=0 tx=0).stop 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb3fbfff640 1 -- 172.21.15.16:0/539705170 reap_dead start 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 shutdown_connections 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 >> 172.21.15.16:0/539705170 conn(0x7fb3fc0fe830 msgr2=0x7fb3fc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 shutdown_connections 2024-09-10T23:39:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:05.122+0000 7fb40219b640 1 -- 172.21.15.16:0/539705170 wait complete. 2024-09-10T23:39:05.821 INFO:teuthology.orchestra.run.smithi016.stdout:60129542218 2024-09-10T23:39:05.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T23:39:05.845 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:05 smithi016 ceph-mon[30855]: pgmap v286: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T23:39:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:05 smithi071 ceph-mon[35018]: pgmap v286: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T23:39:06.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:05 smithi066 ceph-mon[34761]: pgmap v286: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T23:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout:77309411396 2024-09-10T23:39:06.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T23:39:06.528 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:06.531 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:06.534 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:06.535 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:06.535 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:06.541 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:06.884 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:06 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:39:06.885 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:06.955 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:06 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:39:07.008 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:06 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/1951260053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68108020 msgr2=0x7f3f6810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/1951260053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68108020 0x7f3f6810e820 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009ca0 tx=0x7f3f6002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/1951260053 shutdown_connections 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/1951260053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68108020 0x7f3f6810e820 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/1951260053 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f681076a0 0x7f3f68107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/1951260053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f68101c90 0x7f3f68102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/1951260053 >> 172.21.15.16:0/1951260053 conn(0x7f3f680fd700 msgr2=0x7f3f680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/1951260053 shutdown_connections 2024-09-10T23:39:07.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/1951260053 wait complete. 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.184+0000 7f3f6d5c1640 1 Processor -- start 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f6d5c1640 1 -- start start 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f6d5c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101c90 0x7f3f6819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f6d5c1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f681076a0 0x7f3f6819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f6d5c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f68108020 0x7f3f6819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f6d5c1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68111ce0 con 0x7f3f68101c90 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f6d5c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68111b60 con 0x7f3f68108020 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f6d5c1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68111e60 con 0x7f3f681076a0 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101c90 0x7f3f6819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101c90 0x7f3f6819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32804/0 (socket says 172.21.15.16:32804) 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 -- 172.21.15.16:0/500180536 learned_addr learned my addr 172.21.15.16:0/500180536 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f667fc640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f681076a0 0x7f3f6819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:07.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f677fe640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f68108020 0x7f3f6819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 -- 172.21.15.16:0/500180536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f681076a0 msgr2=0x7f3f6819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f681076a0 0x7f3f6819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 -- 172.21.15.16:0/500180536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f68108020 msgr2=0x7f3f6819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f68108020 0x7f3f6819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f66ffd640 1 -- 172.21.15.16:0/500180536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f681a5470 con 0x7f3f68101c90 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.185+0000 7f3f677fe640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f68108020 0x7f3f6819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.186+0000 7f3f66ffd640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101c90 0x7f3f6819a070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800b4a0 tx=0x7f3f5800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.186+0000 7f3f4ffff640 1 -- 172.21.15.16:0/500180536 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58014070 con 0x7f3f68101c90 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.186+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f681a5760 con 0x7f3f68101c90 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.186+0000 7f3f4ffff640 1 -- 172.21.15.16:0/500180536 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f58010ac0 con 0x7f3f68101c90 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.186+0000 7f3f4ffff640 1 -- 172.21.15.16:0/500180536 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58017c30 con 0x7f3f68101c90 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.186+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f681a5d20 con 0x7f3f68101c90 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.187+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f68102070 con 0x7f3f68101c90 2024-09-10T23:39:07.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.188+0000 7f3f4ffff640 1 -- 172.21.15.16:0/500180536 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f3f58010610 con 0x7f3f68101c90 2024-09-10T23:39:07.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.189+0000 7f3f4ffff640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3f500b53c0 0x7f3f500b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:07.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.189+0000 7f3f667fc640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3f500b53c0 0x7f3f500b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:07.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.189+0000 7f3f4ffff640 1 -- 172.21.15.16:0/500180536 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f3f580e5810 con 0x7f3f68101c90 2024-09-10T23:39:07.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.189+0000 7f3f667fc640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3f500b53c0 0x7f3f500b7880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3f6806b6d0 tx=0x7f3f5c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:07.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.192+0000 7f3f4ffff640 1 -- 172.21.15.16:0/500180536 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3f580ac4b0 con 0x7f3f68101c90 2024-09-10T23:39:07.216 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:07.216 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:07.217 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:07.220 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:07.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.417+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3f6806aee0 con 0x7f3f68101c90 2024-09-10T23:39:07.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.417+0000 7f3f4ffff640 1 -- 172.21.15.16:0/500180536 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3f580abdb0 con 0x7f3f68101c90 2024-09-10T23:39:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:201863462955 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3f500b53c0 msgr2=0x7f3f500b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3f500b53c0 0x7f3f500b7880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3f6806b6d0 tx=0x7f3f5c00b390 comp rx=0 tx=0).stop 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101c90 msgr2=0x7f3f6819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101c90 0x7f3f6819a070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800b4a0 tx=0x7f3f5800b960 comp rx=0 tx=0).stop 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 shutdown_connections 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3f500b53c0 0x7f3f500b7880 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f68108020 0x7f3f6819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3f681076a0 0x7f3f6819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 --2- 172.21.15.16:0/500180536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101c90 0x7f3f6819a070 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 >> 172.21.15.16:0/500180536 conn(0x7f3f680fd700 msgr2=0x7f3f680ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 shutdown_connections 2024-09-10T23:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:07.419+0000 7f3f6d5c1640 1 -- 172.21.15.16:0/500180536 wait complete. 2024-09-10T23:39:07.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:07 smithi016 ceph-mon[30855]: pgmap v287: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:07.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:07 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/500180536' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:39:08.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:07 smithi071 ceph-mon[35018]: pgmap v287: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:08.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:07 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/500180536' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:39:08.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:07 smithi066 ceph-mon[34761]: pgmap v287: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:08.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:07 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/500180536' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:39:08.252 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462955 for osd.7 2024-09-10T23:39:08.252 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.945+0000 7f9207b8a640 1 -- 172.21.15.16:0/3234915281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9200101830 msgr2=0x7f9200101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.945+0000 7f9207b8a640 1 --2- 172.21.15.16:0/3234915281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9200101830 0x7f9200101c10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009900 tx=0x7f91fc02a480 comp rx=0 tx=0).stop 2024-09-10T23:39:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.945+0000 7f9207b8a640 1 -- 172.21.15.16:0/3234915281 shutdown_connections 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.945+0000 7f9207b8a640 1 --2- 172.21.15.16:0/3234915281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920010f3e0 0x7f92001117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.945+0000 7f9207b8a640 1 --2- 172.21.15.16:0/3234915281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9200102150 0x7f920010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.945+0000 7f9207b8a640 1 --2- 172.21.15.16:0/3234915281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9200101830 0x7f9200101c10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.945+0000 7f9207b8a640 1 -- 172.21.15.16:0/3234915281 >> 172.21.15.16:0/3234915281 conn(0x7f92000fd700 msgr2=0x7f92000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.946+0000 7f9207b8a640 1 -- 172.21.15.16:0/3234915281 shutdown_connections 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.946+0000 7f9207b8a640 1 -- 172.21.15.16:0/3234915281 wait complete. 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.946+0000 7f9207b8a640 1 Processor -- start 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.946+0000 7f9207b8a640 1 -- start start 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.946+0000 7f9207b8a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9200101830 0x7f920019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.946+0000 7f9207b8a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9200102150 0x7f920019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9207b8a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f920010f3e0 0x7f92001a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9207b8a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9200114f40 con 0x7f920010f3e0 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9207b8a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9200114dc0 con 0x7f9200101830 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9207b8a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92001150c0 con 0x7f9200102150 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f920010f3e0 0x7f92001a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f920010f3e0 0x7f92001a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32838/0 (socket says 172.21.15.16:32838) 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 -- 172.21.15.16:0/2327778417 learned_addr learned my addr 172.21.15.16:0/2327778417 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9205125640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9200102150 0x7f920019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9205926640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9200101830 0x7f920019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 -- 172.21.15.16:0/2327778417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9200102150 msgr2=0x7f920019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9200102150 0x7f920019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 -- 172.21.15.16:0/2327778417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9200101830 msgr2=0x7f920019b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9200101830 0x7f920019b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 -- 172.21.15.16:0/2327778417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92001a15a0 con 0x7f920010f3e0 2024-09-10T23:39:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9206127640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f920010f3e0 0x7f92001a0dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f91f800eb10 tx=0x7f91f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f91f6ffd640 1 -- 172.21.15.16:0/2327778417 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8004b20 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92001a1890 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f91f6ffd640 1 -- 172.21.15.16:0/2327778417 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91f8004cc0 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f91f6ffd640 1 -- 172.21.15.16:0/2327778417 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8010670 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.947+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92001a7f50 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.948+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9200101c10 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.950+0000 7f91f6ffd640 1 -- 172.21.15.16:0/2327778417 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f91f8005000 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.951+0000 7f91f6ffd640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91ec0b53c0 0x7f91ec0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.951+0000 7f9205926640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91ec0b53c0 0x7f91ec0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.951+0000 7f91f6ffd640 1 -- 172.21.15.16:0/2327778417 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f91f80e6640 con 0x7f920010f3e0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.951+0000 7f9205926640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91ec0b53c0 0x7f91ec0b7880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91fc031440 tx=0x7f91fc0095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.958+0000 7f91f6ffd640 1 -- 172.21.15.16:0/2327778417 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f91f8056220 con 0x7f920010f3e0 2024-09-10T23:39:09.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:08 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.155+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f92001a8330 con 0x7f920010f3e0 2024-09-10T23:39:09.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.155+0000 7f91f6ffd640 1 -- 172.21.15.16:0/2327778417 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f91f80ad2e0 con 0x7f920010f3e0 2024-09-10T23:39:09.157 INFO:teuthology.orchestra.run.smithi016.stdout:133143986236 2024-09-10T23:39:09.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91ec0b53c0 msgr2=0x7f91ec0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:09.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91ec0b53c0 0x7f91ec0b7880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91fc031440 tx=0x7f91fc0095f0 comp rx=0 tx=0).stop 2024-09-10T23:39:09.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f920010f3e0 msgr2=0x7f92001a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:09.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f920010f3e0 0x7f92001a0dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f91f800eb10 tx=0x7f91f800c2d0 comp rx=0 tx=0).stop 2024-09-10T23:39:09.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 shutdown_connections 2024-09-10T23:39:09.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f920010f3e0 0x7f92001a0dd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:09.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9200102150 0x7f920019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:09.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91ec0b53c0 0x7f91ec0b7880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:09.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 --2- 172.21.15.16:0/2327778417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9200101830 0x7f920019b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:09.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 >> 172.21.15.16:0/2327778417 conn(0x7f92000fd700 msgr2=0x7f92001115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:09.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.157+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 shutdown_connections 2024-09-10T23:39:09.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.158+0000 7f9207b8a640 1 -- 172.21.15.16:0/2327778417 wait complete. 2024-09-10T23:39:09.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:08 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:09.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:08 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:10.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:09 smithi016 ceph-mon[30855]: pgmap v288: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-10T23:39:10.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2017699742' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:39:10.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2327778417' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:39:10.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1128027195' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:39:10.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:09 smithi071 ceph-mon[35018]: pgmap v288: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-10T23:39:10.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2017699742' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:39:10.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2327778417' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:39:10.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1128027195' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:39:10.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 -- 172.21.15.16:0/1728601686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 msgr2=0x7fa06410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 --2- 172.21.15.16:0/1728601686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410e820 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009ca0 tx=0x7fa05c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 -- 172.21.15.16:0/1728601686 shutdown_connections 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 --2- 172.21.15.16:0/1728601686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410e820 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 --2- 172.21.15.16:0/1728601686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0641076a0 0x7fa064107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 --2- 172.21.15.16:0/1728601686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa064101c90 0x7fa064102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 -- 172.21.15.16:0/1728601686 >> 172.21.15.16:0/1728601686 conn(0x7fa0640fd700 msgr2=0x7fa0640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 -- 172.21.15.16:0/1728601686 shutdown_connections 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.268+0000 7fa06ad01640 1 -- 172.21.15.16:0/1728601686 wait complete. 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 Processor -- start 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 -- start start 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa064101c90 0x7fa06410f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0641076a0 0x7fa06410f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:10.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa064112e00 con 0x7fa064108020 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa064112c80 con 0x7fa064101c90 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06ad01640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa064112f80 con 0x7fa0641076a0 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32862/0 (socket says 172.21.15.16:32862) 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 -- 172.21.15.16:0/3356147199 learned_addr learned my addr 172.21.15.16:0/3356147199 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa063fff640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0641076a0 0x7fa06410f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa068a9d640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa064101c90 0x7fa06410f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 -- 172.21.15.16:0/3356147199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0641076a0 msgr2=0x7fa06410f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0641076a0 0x7fa06410f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 -- 172.21.15.16:0/3356147199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa064101c90 msgr2=0x7fa06410f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa064101c90 0x7fa06410f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 -- 172.21.15.16:0/3356147199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0641a7650 con 0x7fa064108020 2024-09-10T23:39:10.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.269+0000 7fa06929e640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410fdb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0098d0 tx=0x7fa05c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.270+0000 7fa061ffb640 1 -- 172.21.15.16:0/3356147199 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c003b70 con 0x7fa064108020 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.270+0000 7fa061ffb640 1 -- 172.21.15.16:0/3356147199 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa05c003d10 con 0x7fa064108020 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.270+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0641a78e0 con 0x7fa064108020 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.270+0000 7fa061ffb640 1 -- 172.21.15.16:0/3356147199 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c02fa20 con 0x7fa064108020 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.270+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0641a7e70 con 0x7fa064108020 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.271+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa064102070 con 0x7fa064108020 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.272+0000 7fa061ffb640 1 -- 172.21.15.16:0/3356147199 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa05c02fc40 con 0x7fa064108020 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.273+0000 7fa061ffb640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0540b5440 0x7fa0540b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.273+0000 7fa068a9d640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0540b5440 0x7fa0540b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:10.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.273+0000 7fa061ffb640 1 -- 172.21.15.16:0/3356147199 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa05c107080 con 0x7fa064108020 2024-09-10T23:39:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.273+0000 7fa068a9d640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0540b5440 0x7fa0540b7900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa05800bbe0 tx=0x7fa05800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.277+0000 7fa061ffb640 1 -- 172.21.15.16:0/3356147199 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa05c0cdd20 con 0x7fa064108020 2024-09-10T23:39:10.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:09 smithi066 ceph-mon[34761]: pgmap v288: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-10T23:39:10.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2017699742' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:39:10.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2327778417' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:39:10.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1128027195' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:39:10.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.465+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa06402e5c0 con 0x7fa064108020 2024-09-10T23:39:10.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.465+0000 7fa061ffb640 1 -- 172.21.15.16:0/3356147199 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa05c0cd620 con 0x7fa064108020 2024-09-10T23:39:10.466 INFO:teuthology.orchestra.run.smithi016.stdout:296352743448 2024-09-10T23:39:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0540b5440 msgr2=0x7fa0540b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0540b5440 0x7fa0540b7900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa05800bbe0 tx=0x7fa05800b390 comp rx=0 tx=0).stop 2024-09-10T23:39:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 msgr2=0x7fa06410fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410fdb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0098d0 tx=0x7fa05c0317b0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 shutdown_connections 2024-09-10T23:39:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa064108020 0x7fa06410fdb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0641076a0 0x7fa06410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0540b5440 0x7fa0540b7900 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 --2- 172.21.15.16:0/3356147199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa064101c90 0x7fa06410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:10.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 >> 172.21.15.16:0/3356147199 conn(0x7fa0640fd700 msgr2=0x7fa0640ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:10.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 shutdown_connections 2024-09-10T23:39:10.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.468+0000 7fa06ad01640 1 -- 172.21.15.16:0/3356147199 wait complete. 2024-09-10T23:39:11.070 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986236 for osd.4 2024-09-10T23:39:11.070 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:11.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:10 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3356147199' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:39:11.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:10 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2399647407' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:39:11.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:10 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3356147199' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:39:11.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:10 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2399647407' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:39:11.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:10 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3356147199' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:39:11.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:10 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2399647407' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:39:11.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.478+0000 7f82959f1640 1 -- 172.21.15.16:0/2249393968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 msgr2=0x7f829010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.478+0000 7f82959f1640 1 --2- 172.21.15.16:0/2249393968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f829010e820 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8288009ca0 tx=0x7f828802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 -- 172.21.15.16:0/2249393968 shutdown_connections 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 --2- 172.21.15.16:0/2249393968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f829010e820 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 --2- 172.21.15.16:0/2249393968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82901076a0 0x7f8290107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 --2- 172.21.15.16:0/2249393968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8290101c90 0x7f8290102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 -- 172.21.15.16:0/2249393968 >> 172.21.15.16:0/2249393968 conn(0x7f82900fd700 msgr2=0x7f82900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 -- 172.21.15.16:0/2249393968 shutdown_connections 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 -- 172.21.15.16:0/2249393968 wait complete. 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 Processor -- start 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.479+0000 7f82959f1640 1 -- start start 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f82959f1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8290101c90 0x7f8290197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f82959f1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82901076a0 0x7f82901983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f82959f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f8290198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f82959f1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8290111ca0 con 0x7f8290108020 2024-09-10T23:39:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f82959f1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8290111b20 con 0x7f82901076a0 2024-09-10T23:39:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f82959f1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8290111e20 con 0x7f8290101c90 2024-09-10T23:39:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f8290198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f8290198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32886/0 (socket says 172.21.15.16:32886) 2024-09-10T23:39:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 -- 172.21.15.16:0/2399647407 learned_addr learned my addr 172.21.15.16:0/2399647407 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828e7fc640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82901076a0 0x7f82901983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.431 INFO:teuthology.orchestra.run.smithi016.stdout:223338299431 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828effd640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8290101c90 0x7f8290197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 -- 172.21.15.16:0/2399647407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8290101c90 msgr2=0x7f8290197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8290101c90 0x7f8290197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 -- 172.21.15.16:0/2399647407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82901076a0 msgr2=0x7f82901983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82901076a0 0x7f82901983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 -- 172.21.15.16:0/2399647407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82901a7660 con 0x7f8290108020 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.480+0000 7f828f7fe640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f8290198900 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f82880098d0 tx=0x7f82880317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.481+0000 7f82949ef640 1 -- 172.21.15.16:0/2399647407 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288003b70 con 0x7f8290108020 2024-09-10T23:39:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.481+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82901a78f0 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.481+0000 7f82949ef640 1 -- 172.21.15.16:0/2399647407 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8288003d10 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.481+0000 7f82949ef640 1 -- 172.21.15.16:0/2399647407 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828802fa20 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.481+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82901a7e80 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.482+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8290102070 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.483+0000 7f82949ef640 1 -- 172.21.15.16:0/2399647407 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f828802fc40 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.484+0000 7f82949ef640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f827c0b53c0 0x7f827c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.484+0000 7f828effd640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f827c0b53c0 0x7f827c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.484+0000 7f82949ef640 1 -- 172.21.15.16:0/2399647407 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f82881070b0 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.485+0000 7f828effd640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f827c0b53c0 0x7f827c0b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8278009bd0 tx=0x7f8278005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.490+0000 7f82949ef640 1 -- 172.21.15.16:0/2399647407 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f82880cddf0 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.676+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f8290109e60 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.676+0000 7f82949ef640 1 -- 172.21.15.16:0/2399647407 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f82880cd6f0 con 0x7f8290108020 2024-09-10T23:39:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f827c0b53c0 msgr2=0x7f827c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f827c0b53c0 0x7f827c0b7880 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8278009bd0 tx=0x7f8278005f90 comp rx=0 tx=0).stop 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 msgr2=0x7f8290198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f8290198900 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f82880098d0 tx=0x7f82880317b0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 shutdown_connections 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8290108020 0x7f8290198900 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f827c0b53c0 0x7f827c0b7880 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82901076a0 0x7f82901983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 --2- 172.21.15.16:0/2399647407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8290101c90 0x7f8290197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.678+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 >> 172.21.15.16:0/2399647407 conn(0x7f82900fd700 msgr2=0x7f82900ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.679+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 shutdown_connections 2024-09-10T23:39:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:10.679+0000 7f82959f1640 1 -- 172.21.15.16:0/2399647407 wait complete. 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 -- 172.21.15.16:0/3924857092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc44103ce0 msgr2=0x7fcc441040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 --2- 172.21.15.16:0/3924857092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc44103ce0 0x7fcc441040c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009900 tx=0x7fcc3402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 -- 172.21.15.16:0/3924857092 shutdown_connections 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 --2- 172.21.15.16:0/3924857092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc4410d140 0x7fcc4410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 --2- 172.21.15.16:0/3924857092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc44104600 0x7fcc4410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 --2- 172.21.15.16:0/3924857092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc44103ce0 0x7fcc441040c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 -- 172.21.15.16:0/3924857092 >> 172.21.15.16:0/3924857092 conn(0x7fcc440fd720 msgr2=0x7fcc440ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 -- 172.21.15.16:0/3924857092 shutdown_connections 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.488+0000 7fcc49807640 1 -- 172.21.15.16:0/3924857092 wait complete. 2024-09-10T23:39:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 Processor -- start 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 -- start start 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc44103ce0 0x7fcc44199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc44104600 0x7fcc44199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc4410d140 0x7fcc4419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc44112db0 con 0x7fcc4410d140 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcc44112c30 con 0x7fcc44104600 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc49807640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc44112f30 con 0x7fcc44103ce0 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc4410d140 0x7fcc4419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc4410d140 0x7fcc4419ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32850/0 (socket says 172.21.15.16:32850) 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc437fe640 1 -- 172.21.15.16:0/1128027195 learned_addr learned my addr 172.21.15.16:0/1128027195 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc427fc640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc44104600 0x7fcc44199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.489+0000 7fcc42ffd640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc44103ce0 0x7fcc44199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc437fe640 1 -- 172.21.15.16:0/1128027195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc44103ce0 msgr2=0x7fcc44199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc437fe640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc44103ce0 0x7fcc44199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc437fe640 1 -- 172.21.15.16:0/1128027195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc44104600 msgr2=0x7fcc44199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc437fe640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc44104600 0x7fcc44199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc437fe640 1 -- 172.21.15.16:0/1128027195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4419f400 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc42ffd640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc44103ce0 0x7fcc44199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc437fe640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc4410d140 0x7fcc4419ec30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00eb10 tx=0x7fcc3c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc48805640 1 -- 172.21.15.16:0/1128027195 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c004b20 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc48805640 1 -- 172.21.15.16:0/1128027195 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc3c004cc0 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4419f6f0 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc48805640 1 -- 172.21.15.16:0/1128027195 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c010670 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.490+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc441a5db0 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.491+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc441040c0 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.493+0000 7fcc48805640 1 -- 172.21.15.16:0/1128027195 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fcc3c005000 con 0x7fcc4410d140 2024-09-10T23:39:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.494+0000 7fcc48805640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcc2c0b5440 0x7fcc2c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.494+0000 7fcc42ffd640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcc2c0b5440 0x7fcc2c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.494+0000 7fcc48805640 1 -- 172.21.15.16:0/1128027195 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fcc3c0e6650 con 0x7fcc4410d140 2024-09-10T23:39:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.495+0000 7fcc42ffd640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcc2c0b5440 0x7fcc2c0b7900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc34031440 tx=0x7fcc34005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:11.743 INFO:teuthology.orchestra.run.smithi016.stdout:38654705744 2024-09-10T23:39:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.497+0000 7fcc48805640 1 -- 172.21.15.16:0/1128027195 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcc3c056220 con 0x7fcc4410d140 2024-09-10T23:39:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.686+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcc4419a480 con 0x7fcc4410d140 2024-09-10T23:39:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.686+0000 7fcc48805640 1 -- 172.21.15.16:0/1128027195 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc3c0ad290 con 0x7fcc4410d140 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcc2c0b5440 msgr2=0x7fcc2c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcc2c0b5440 0x7fcc2c0b7900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc34031440 tx=0x7fcc34005a20 comp rx=0 tx=0).stop 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc4410d140 msgr2=0x7fcc4419ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc4410d140 0x7fcc4419ec30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00eb10 tx=0x7fcc3c00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 shutdown_connections 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc4410d140 0x7fcc4419ec30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcc2c0b5440 0x7fcc2c0b7900 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc44104600 0x7fcc44199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 --2- 172.21.15.16:0/1128027195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc44103ce0 0x7fcc44199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.688+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 >> 172.21.15.16:0/1128027195 conn(0x7fcc440fd720 msgr2=0x7fcc440fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.689+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 shutdown_connections 2024-09-10T23:39:11.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.689+0000 7fcc49807640 1 -- 172.21.15.16:0/1128027195 wait complete. 2024-09-10T23:39:12.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:11 smithi016 ceph-mon[30855]: pgmap v289: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:12.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:11 smithi071 ceph-mon[35018]: pgmap v289: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:12.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:11 smithi066 ceph-mon[34761]: pgmap v289: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:12.372 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705741 got 38654705744 for osd.0 2024-09-10T23:39:12.372 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:13.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:12 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/997420393' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:39:13.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:12 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/997420393' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:39:13.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:12 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/997420393' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:39:13.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 -- 172.21.15.16:0/2737495403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 msgr2=0x7fd30c10f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 --2- 172.21.15.16:0/2737495403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c10f590 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd304009ca0 tx=0x7fd30402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 -- 172.21.15.16:0/2737495403 shutdown_connections 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 --2- 172.21.15.16:0/2737495403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c10f590 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 --2- 172.21.15.16:0/2737495403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd30c104570 0x7fd30c10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 --2- 172.21.15.16:0/2737495403 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30c103b70 0x7fd30c103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 -- 172.21.15.16:0/2737495403 >> 172.21.15.16:0/2737495403 conn(0x7fd30c0fd700 msgr2=0x7fd30c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 -- 172.21.15.16:0/2737495403 shutdown_connections 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.188+0000 7fd31218e640 1 -- 172.21.15.16:0/2737495403 wait complete. 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 Processor -- start 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 -- start start 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30c103b70 0x7fd30c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd30c104570 0x7fd30c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c112da0 con 0x7fd30c10d120 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c112c20 con 0x7fd30c104570 2024-09-10T23:39:13.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd31218e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c112f20 con 0x7fd30c103b70 2024-09-10T23:39:13.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd30bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd30bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32924/0 (socket says 172.21.15.16:32924) 2024-09-10T23:39:13.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd30bfff640 1 -- 172.21.15.16:0/886401415 learned_addr learned my addr 172.21.15.16:0/886401415 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:13.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd30affd640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd30c104570 0x7fd30c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.189+0000 7fd30b7fe640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30c103b70 0x7fd30c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.453 INFO:teuthology.orchestra.run.smithi016.stdout:180388626482 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd30bfff640 1 -- 172.21.15.16:0/886401415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30c103b70 msgr2=0x7fd30c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd30bfff640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30c103b70 0x7fd30c1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd30bfff640 1 -- 172.21.15.16:0/886401415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd30c104570 msgr2=0x7fd30c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd30bfff640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd30c104570 0x7fd30c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd30bfff640 1 -- 172.21.15.16:0/886401415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c19f2a0 con 0x7fd30c10d120 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd30bfff640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c19ead0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd304005cc0 tx=0x7fd30402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd308ff9640 1 -- 172.21.15.16:0/886401415 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304003bf0 con 0x7fd30c10d120 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd308ff9640 1 -- 172.21.15.16:0/886401415 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd304003d90 con 0x7fd30c10d120 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c19f530 con 0x7fd30c10d120 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd308ff9640 1 -- 172.21.15.16:0/886401415 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30402fbc0 con 0x7fd30c10d120 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.190+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c1a5c50 con 0x7fd30c10d120 2024-09-10T23:39:13.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.191+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30c103f50 con 0x7fd30c10d120 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.192+0000 7fd308ff9640 1 -- 172.21.15.16:0/886401415 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fd304004610 con 0x7fd30c10d120 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.193+0000 7fd308ff9640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2f40b5440 0x7fd2f40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.193+0000 7fd30b7fe640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2f40b5440 0x7fd2f40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.193+0000 7fd308ff9640 1 -- 172.21.15.16:0/886401415 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd3041073c0 con 0x7fd30c10d120 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.194+0000 7fd30b7fe640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2f40b5440 0x7fd2f40b7900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc005fd0 tx=0x7fd2fc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.196+0000 7fd308ff9640 1 -- 172.21.15.16:0/886401415 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd3040ce060 con 0x7fd30c10d120 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.385+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd30c19a320 con 0x7fd30c10d120 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.386+0000 7fd308ff9640 1 -- 172.21.15.16:0/886401415 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd3040cd960 con 0x7fd30c10d120 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2f40b5440 msgr2=0x7fd2f40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2f40b5440 0x7fd2f40b7900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc005fd0 tx=0x7fd2fc00b390 comp rx=0 tx=0).stop 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 msgr2=0x7fd30c19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c19ead0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd304005cc0 tx=0x7fd30402f380 comp rx=0 tx=0).stop 2024-09-10T23:39:13.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 shutdown_connections 2024-09-10T23:39:13.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c10d120 0x7fd30c19ead0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2f40b5440 0x7fd2f40b7900 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd30c104570 0x7fd30c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 --2- 172.21.15.16:0/886401415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd30c103b70 0x7fd30c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 >> 172.21.15.16:0/886401415 conn(0x7fd30c0fd700 msgr2=0x7fd30c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:13.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 shutdown_connections 2024-09-10T23:39:13.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.388+0000 7fd31218e640 1 -- 172.21.15.16:0/886401415 wait complete. 2024-09-10T23:39:13.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.877+0000 7f462d945640 1 -- 172.21.15.16:0/1171141608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46281076a0 msgr2=0x7f4628107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.877+0000 7f462d945640 1 --2- 172.21.15.16:0/1171141608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46281076a0 0x7f4628107ae0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f461c009900 tx=0x7f461c02a410 comp rx=0 tx=0).stop 2024-09-10T23:39:13.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 -- 172.21.15.16:0/1171141608 shutdown_connections 2024-09-10T23:39:13.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 --2- 172.21.15.16:0/1171141608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4628108020 0x7f462810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 --2- 172.21.15.16:0/1171141608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46281076a0 0x7f4628107ae0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 --2- 172.21.15.16:0/1171141608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4628101c90 0x7f4628102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 -- 172.21.15.16:0/1171141608 >> 172.21.15.16:0/1171141608 conn(0x7f46280fd700 msgr2=0x7f46280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:13.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 -- 172.21.15.16:0/1171141608 shutdown_connections 2024-09-10T23:39:13.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 -- 172.21.15.16:0/1171141608 wait complete. 2024-09-10T23:39:13.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 Processor -- start 2024-09-10T23:39:13.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.878+0000 7f462d945640 1 -- start start 2024-09-10T23:39:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f462d945640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4628101c90 0x7f46281992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f462d945640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46281076a0 0x7f4628199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f462d945640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4628108020 0x7f462819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f462d945640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4628111ce0 con 0x7f4628101c90 2024-09-10T23:39:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f462d945640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4628111b60 con 0x7f46281076a0 2024-09-10T23:39:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f462d945640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4628111e60 con 0x7f4628108020 2024-09-10T23:39:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4628101c90 0x7f46281992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4628101c90 0x7f46281992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37376/0 (socket says 172.21.15.16:37376) 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 -- 172.21.15.16:0/2777220304 learned_addr learned my addr 172.21.15.16:0/2777220304 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f46267fc640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46281076a0 0x7f4628199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f46277fe640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4628108020 0x7f462819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 -- 172.21.15.16:0/2777220304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4628108020 msgr2=0x7f462819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4628108020 0x7f462819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 -- 172.21.15.16:0/2777220304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46281076a0 msgr2=0x7f4628199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46281076a0 0x7f4628199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 -- 172.21.15.16:0/2777220304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462819f370 con 0x7f4628101c90 2024-09-10T23:39:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f46277fe640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4628108020 0x7f462819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.879+0000 7f4626ffd640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4628101c90 0x7f46281992c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f461800d950 tx=0x7f461800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.880+0000 7f462c943640 1 -- 172.21.15.16:0/2777220304 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4618017070 con 0x7f4628101c90 2024-09-10T23:39:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.880+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462819f660 con 0x7f4628101c90 2024-09-10T23:39:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.880+0000 7f462c943640 1 -- 172.21.15.16:0/2777220304 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4618009c30 con 0x7f4628101c90 2024-09-10T23:39:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.880+0000 7f462c943640 1 -- 172.21.15.16:0/2777220304 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461800f620 con 0x7f4628101c90 2024-09-10T23:39:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.880+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46281a5ef0 con 0x7f4628101c90 2024-09-10T23:39:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.881+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4628102f40 con 0x7f4628101c90 2024-09-10T23:39:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.882+0000 7f462c943640 1 -- 172.21.15.16:0/2777220304 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f4618005030 con 0x7f4628101c90 2024-09-10T23:39:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.883+0000 7f462c943640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f46100b53c0 0x7f46100b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.883+0000 7f46267fc640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f46100b53c0 0x7f46100b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.883+0000 7f462c943640 1 -- 172.21.15.16:0/2777220304 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f46180e5a90 con 0x7f4628101c90 2024-09-10T23:39:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.883+0000 7f46267fc640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f46100b53c0 0x7f46100b7880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f461c031440 tx=0x7f461c005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:13.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:13.886+0000 7f462c943640 1 -- 172.21.15.16:0/2777220304 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f46180ac730 con 0x7f4628101c90 2024-09-10T23:39:14.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 -- 172.21.15.16:0/914297572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 msgr2=0x7f0bd0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 --2- 172.21.15.16:0/914297572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd0108c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009900 tx=0x7f0bb802a410 comp rx=0 tx=0).stop 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 -- 172.21.15.16:0/914297572 shutdown_connections 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 --2- 172.21.15.16:0/914297572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bd0109150 0x7f0bd010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 --2- 172.21.15.16:0/914297572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd0108c10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 --2- 172.21.15.16:0/914297572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd0102dc0 0x7f0bd01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 -- 172.21.15.16:0/914297572 >> 172.21.15.16:0/914297572 conn(0x7f0bd00fe830 msgr2=0x7f0bd0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 -- 172.21.15.16:0/914297572 shutdown_connections 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.836+0000 7f0bd5761640 1 -- 172.21.15.16:0/914297572 wait complete. 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 Processor -- start 2024-09-10T23:39:14.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 -- start start 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bd0102dc0 0x7f0bd00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd0109150 0x7f0bd0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0112dd0 con 0x7f0bd01087d0 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0112c50 con 0x7f0bd0109150 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bd5761640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0112f50 con 0x7f0bd0102dc0 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:14.006 INFO:teuthology.orchestra.run.smithi016.stdout:249108103203 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd00759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32822/0 (socket says 172.21.15.16:32822) 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 -- 172.21.15.16:0/2017699742 learned_addr learned my addr 172.21.15.16:0/2017699742 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bceffd640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bd0102dc0 0x7f0bd00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bcf7fe640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd0109150 0x7f0bd0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 -- 172.21.15.16:0/2017699742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bd0102dc0 msgr2=0x7f0bd00754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bd0102dc0 0x7f0bd00754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 -- 172.21.15.16:0/2017699742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd0109150 msgr2=0x7f0bd0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd0109150 0x7f0bd0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.837+0000 7f0bc7fff640 1 -- 172.21.15.16:0/2017699742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd01a76c0 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.838+0000 7f0bc7fff640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd00759e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8005940 tx=0x7f0bb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.838+0000 7f0bccff9640 1 -- 172.21.15.16:0/2017699742 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb803f030 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.838+0000 7f0bccff9640 1 -- 172.21.15.16:0/2017699742 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bb8003cb0 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.838+0000 7f0bccff9640 1 -- 172.21.15.16:0/2017699742 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8035070 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.838+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd01a7950 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.838+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd01a7e80 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.839+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd01031a0 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.840+0000 7f0bccff9640 1 -- 172.21.15.16:0/2017699742 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f0bb803bbf0 con 0x7f0bd01087d0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.841+0000 7f0bccff9640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0bbc0b5440 0x7f0bbc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.842+0000 7f0bceffd640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0bbc0b5440 0x7f0bbc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:14.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.842+0000 7f0bccff9640 1 -- 172.21.15.16:0/2017699742 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f0bb8106bb0 con 0x7f0bd01087d0 2024-09-10T23:39:14.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.842+0000 7f0bceffd640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0bbc0b5440 0x7f0bbc0b7900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000bbe0 tx=0x7f0bc000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:14.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:08.845+0000 7f0bccff9640 1 -- 172.21.15.16:0/2017699742 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0bb80cd1a0 con 0x7f0bd01087d0 2024-09-10T23:39:14.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.043+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f0bd010a9a0 con 0x7f0bd01087d0 2024-09-10T23:39:14.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.043+0000 7f0bccff9640 1 -- 172.21.15.16:0/2017699742 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0bb80d1bd0 con 0x7f0bd01087d0 2024-09-10T23:39:14.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0bbc0b5440 msgr2=0x7f0bbc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:14.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0bbc0b5440 0x7f0bbc0b7900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000bbe0 tx=0x7f0bc000b390 comp rx=0 tx=0).stop 2024-09-10T23:39:14.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 msgr2=0x7f0bd00759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd00759e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8005940 tx=0x7f0bb80042f0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 shutdown_connections 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0bbc0b5440 0x7f0bbc0b7900 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd0109150 0x7f0bd0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bd01087d0 0x7f0bd00759e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 --2- 172.21.15.16:0/2017699742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bd0102dc0 0x7f0bd00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 >> 172.21.15.16:0/2017699742 conn(0x7f0bd00fe830 msgr2=0x7f0bd0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.045+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 shutdown_connections 2024-09-10T23:39:14.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:09.046+0000 7f0bd5761640 1 -- 172.21.15.16:0/2017699742 wait complete. 2024-09-10T23:39:14.087 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:13 smithi016 ceph-mon[30855]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:39:14.087 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:13 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/886401415' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:39:14.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.095+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4628102070 con 0x7f4628101c90 2024-09-10T23:39:14.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.096+0000 7f462c943640 1 -- 172.21.15.16:0/2777220304 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4628102070 con 0x7f4628101c90 2024-09-10T23:39:14.097 INFO:teuthology.orchestra.run.smithi016.stdout:60129542220 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f46100b53c0 msgr2=0x7f46100b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f46100b53c0 0x7f46100b7880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f461c031440 tx=0x7f461c005b50 comp rx=0 tx=0).stop 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4628101c90 msgr2=0x7f46281992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4628101c90 0x7f46281992c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f461800d950 tx=0x7f461800de10 comp rx=0 tx=0).stop 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 shutdown_connections 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4628108020 0x7f462819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f46100b53c0 0x7f46100b7880 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46281076a0 0x7f4628199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 --2- 172.21.15.16:0/2777220304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4628101c90 0x7f46281992c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:14.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 >> 172.21.15.16:0/2777220304 conn(0x7f46280fd700 msgr2=0x7f462806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:14.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 shutdown_connections 2024-09-10T23:39:14.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:14.098+0000 7f462d945640 1 -- 172.21.15.16:0/2777220304 wait complete. 2024-09-10T23:39:14.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:13 smithi071 ceph-mon[35018]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:39:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:13 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/886401415' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:39:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:13 smithi066 ceph-mon[34761]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:39:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:13 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/886401415' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:39:14.661 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103201 got 249108103203 for osd.9 2024-09-10T23:39:14.661 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.098+0000 7f237719b640 1 -- 172.21.15.16:0/1156863366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23701076e0 msgr2=0x7f2370107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.098+0000 7f237719b640 1 --2- 172.21.15.16:0/1156863366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23701076e0 0x7f2370107b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2364009900 tx=0x7f236402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 -- 172.21.15.16:0/1156863366 shutdown_connections 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 --2- 172.21.15.16:0/1156863366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2370108060 0x7f237010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 --2- 172.21.15.16:0/1156863366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23701076e0 0x7f2370107b20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 --2- 172.21.15.16:0/1156863366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2370101cd0 0x7f23701020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 -- 172.21.15.16:0/1156863366 >> 172.21.15.16:0/1156863366 conn(0x7f23700fd720 msgr2=0x7f23700ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:15.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 -- 172.21.15.16:0/1156863366 shutdown_connections 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 -- 172.21.15.16:0/1156863366 wait complete. 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.099+0000 7f237719b640 1 Processor -- start 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f237719b640 1 -- start start 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f237719b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2370101cd0 0x7f23701992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f237719b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23701076e0 0x7f23701997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f237719b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2370108060 0x7f237019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f237719b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2370112e00 con 0x7f2370101cd0 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f237719b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2370112c80 con 0x7f2370108060 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f237719b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2370112f80 con 0x7f23701076e0 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2370101cd0 0x7f23701992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2370101cd0 0x7f23701992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37394/0 (socket says 172.21.15.16:37394) 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 -- 172.21.15.16:0/1864936466 learned_addr learned my addr 172.21.15.16:0/1864936466 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2375738640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2370108060 0x7f237019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f236ffff640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23701076e0 0x7f23701997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 -- 172.21.15.16:0/1864936466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23701076e0 msgr2=0x7f23701997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23701076e0 0x7f23701997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 -- 172.21.15.16:0/1864936466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2370108060 msgr2=0x7f237019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2370108060 0x7f237019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 -- 172.21.15.16:0/1864936466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237019f360 con 0x7f2370101cd0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.100+0000 7f2374f37640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2370101cd0 0x7f23701992b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f236000d950 tx=0x7f236000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.101+0000 7f236dffb640 1 -- 172.21.15.16:0/1864936466 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360017030 con 0x7f2370101cd0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.101+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237019f650 con 0x7f2370101cd0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.101+0000 7f236dffb640 1 -- 172.21.15.16:0/1864936466 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2360004020 con 0x7f2370101cd0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.101+0000 7f236dffb640 1 -- 172.21.15.16:0/1864936466 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23600047a0 con 0x7f2370101cd0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.101+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23701a5ee0 con 0x7f2370101cd0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.102+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2370102f80 con 0x7f2370101cd0 2024-09-10T23:39:15.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.103+0000 7f236dffb640 1 -- 172.21.15.16:0/1864936466 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f2360009a30 con 0x7f2370101cd0 2024-09-10T23:39:15.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.104+0000 7f236dffb640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23580b53c0 0x7f23580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.104+0000 7f236ffff640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23580b53c0 0x7f23580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.104+0000 7f236dffb640 1 -- 172.21.15.16:0/1864936466 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f23600e5910 con 0x7f2370101cd0 2024-09-10T23:39:15.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.104+0000 7f236ffff640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23580b53c0 0x7f23580b7880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2364031440 tx=0x7f2364005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:15.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.108+0000 7f236dffb640 1 -- 172.21.15.16:0/1864936466 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f23600ac550 con 0x7f2370101cd0 2024-09-10T23:39:15.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:14 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2777220304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:39:15.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:14 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2777220304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:39:15.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:14 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2777220304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:39:15.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.318+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2370109e70 con 0x7f2370101cd0 2024-09-10T23:39:15.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.318+0000 7f236dffb640 1 -- 172.21.15.16:0/1864936466 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f23600abe50 con 0x7f2370101cd0 2024-09-10T23:39:15.319 INFO:teuthology.orchestra.run.smithi016.stdout:154618822712 2024-09-10T23:39:15.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23580b53c0 msgr2=0x7f23580b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23580b53c0 0x7f23580b7880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2364031440 tx=0x7f2364005b50 comp rx=0 tx=0).stop 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2370101cd0 msgr2=0x7f23701992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2370101cd0 0x7f23701992b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f236000d950 tx=0x7f236000de10 comp rx=0 tx=0).stop 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 shutdown_connections 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23580b53c0 0x7f23580b7880 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2370108060 0x7f237019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23701076e0 0x7f23701997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 --2- 172.21.15.16:0/1864936466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2370101cd0 0x7f23701992b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 >> 172.21.15.16:0/1864936466 conn(0x7f23700fd720 msgr2=0x7f23700ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 shutdown_connections 2024-09-10T23:39:15.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.321+0000 7f237719b640 1 -- 172.21.15.16:0/1864936466 wait complete. 2024-09-10T23:39:15.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/1622197406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108020 msgr2=0x7fc3d010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/1622197406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108020 0x7fc3d010e820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009900 tx=0x7fc3b802a410 comp rx=0 tx=0).stop 2024-09-10T23:39:15.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/1622197406 shutdown_connections 2024-09-10T23:39:15.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/1622197406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d0108020 0x7fc3d010e820 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/1622197406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d01076a0 0x7fc3d0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/1622197406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3d0101c90 0x7fc3d0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/1622197406 >> 172.21.15.16:0/1622197406 conn(0x7fc3d00fd700 msgr2=0x7fc3d00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/1622197406 shutdown_connections 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.353+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/1622197406 wait complete. 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.354+0000 7fc3d6cc1640 1 Processor -- start 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.354+0000 7fc3d6cc1640 1 -- start start 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d6cc1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0101c90 0x7fc3d0198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d6cc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d01076a0 0x7fc3d0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d6cc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3d0108020 0x7fc3d019da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d6cc1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0111ca0 con 0x7fc3d01076a0 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d6cc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0111b20 con 0x7fc3d0108020 2024-09-10T23:39:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d6cc1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0111e20 con 0x7fc3d0101c90 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d01076a0 0x7fc3d0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d01076a0 0x7fc3d0198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37416/0 (socket says 172.21.15.16:37416) 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 -- 172.21.15.16:0/719844341 learned_addr learned my addr 172.21.15.16:0/719844341 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d4a5d640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0101c90 0x7fc3d0198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d525e640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3d0108020 0x7fc3d019da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 -- 172.21.15.16:0/719844341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0101c90 msgr2=0x7fc3d0198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0101c90 0x7fc3d0198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 -- 172.21.15.16:0/719844341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3d0108020 msgr2=0x7fc3d019da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3d0108020 0x7fc3d019da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 -- 172.21.15.16:0/719844341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d019e1e0 con 0x7fc3d01076a0 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3d525e640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3d0108020 0x7fc3d019da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cffff640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d01076a0 0x7fc3d0198670 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000cce0 tx=0x7fc3c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cdffb640 1 -- 172.21.15.16:0/719844341 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0004b20 con 0x7fc3d01076a0 2024-09-10T23:39:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cdffb640 1 -- 172.21.15.16:0/719844341 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3c0004cc0 con 0x7fc3d01076a0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.355+0000 7fc3cdffb640 1 -- 172.21.15.16:0/719844341 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000f6b0 con 0x7fc3d01076a0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.356+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d019e4d0 con 0x7fc3d01076a0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.356+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d01a4b90 con 0x7fc3d01076a0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.357+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d0102070 con 0x7fc3d01076a0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.358+0000 7fc3cdffb640 1 -- 172.21.15.16:0/719844341 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fc3c000f850 con 0x7fc3d01076a0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.359+0000 7fc3cdffb640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc3bc0b53c0 0x7fc3bc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.359+0000 7fc3d4a5d640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc3bc0b53c0 0x7fc3bc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.359+0000 7fc3cdffb640 1 -- 172.21.15.16:0/719844341 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc3c00e6350 con 0x7fc3d01076a0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.359+0000 7fc3d4a5d640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc3bc0b53c0 0x7fc3bc0b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800bbe0 tx=0x7fc3c800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.362+0000 7fc3cdffb640 1 -- 172.21.15.16:0/719844341 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc3c0014030 con 0x7fc3d01076a0 2024-09-10T23:39:15.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.559+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc3d0199260 con 0x7fc3d01076a0 2024-09-10T23:39:15.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.560+0000 7fc3cdffb640 1 -- 172.21.15.16:0/719844341 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3c00acf90 con 0x7fc3d01076a0 2024-09-10T23:39:15.561 INFO:teuthology.orchestra.run.smithi016.stdout:107374182465 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc3bc0b53c0 msgr2=0x7fc3bc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc3bc0b53c0 0x7fc3bc0b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800bbe0 tx=0x7fc3c800b390 comp rx=0 tx=0).stop 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d01076a0 msgr2=0x7fc3d0198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d01076a0 0x7fc3d0198670 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000cce0 tx=0x7fc3c000a620 comp rx=0 tx=0).stop 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 shutdown_connections 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc3bc0b53c0 0x7fc3bc0b7880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3d0108020 0x7fc3d019da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d01076a0 0x7fc3d0198670 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 --2- 172.21.15.16:0/719844341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0101c90 0x7fc3d0198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 >> 172.21.15.16:0/719844341 conn(0x7fc3d00fd700 msgr2=0x7fc3d00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:15.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 shutdown_connections 2024-09-10T23:39:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:15.562+0000 7fc3d6cc1640 1 -- 172.21.15.16:0/719844341 wait complete. 2024-09-10T23:39:16.227 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:15 smithi016 ceph-mon[30855]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:16.227 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:15 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1864936466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:39:16.227 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:15 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/719844341' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:39:16.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:15 smithi071 ceph-mon[35018]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:16.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:15 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1864936466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:39:16.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:15 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/719844341' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:39:16.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:15 smithi066 ceph-mon[34761]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:16.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:15 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1864936466' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:39:16.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:15 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/719844341' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:39:16.361 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182463 got 107374182465 for osd.3 2024-09-10T23:39:16.362 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.606+0000 7fa30c698640 1 -- 172.21.15.16:0/1737151618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 msgr2=0x7fa30410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.606+0000 7fa30c698640 1 --2- 172.21.15.16:0/1737151618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30410f950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009ca0 tx=0x7fa2fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 -- 172.21.15.16:0/1737151618 shutdown_connections 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 --2- 172.21.15.16:0/1737151618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30410f950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 --2- 172.21.15.16:0/1737151618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3041087d0 0x7fa304108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 --2- 172.21.15.16:0/1737151618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa304102dc0 0x7fa3041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 -- 172.21.15.16:0/1737151618 >> 172.21.15.16:0/1737151618 conn(0x7fa3040fe830 msgr2=0x7fa304100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 -- 172.21.15.16:0/1737151618 shutdown_connections 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 -- 172.21.15.16:0/1737151618 wait complete. 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 Processor -- start 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.607+0000 7fa30c698640 1 -- start start 2024-09-10T23:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30c698640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa304102dc0 0x7fa304199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30c698640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3041087d0 0x7fa304199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30c698640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30c698640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa304112dd0 con 0x7fa304109150 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30c698640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa304112c50 con 0x7fa304102dc0 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30c698640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa304112f50 con 0x7fa3041087d0 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30419eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32912/0 (socket says 172.21.15.16:32912) 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 -- 172.21.15.16:0/997420393 learned_addr learned my addr 172.21.15.16:0/997420393 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa309c33640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3041087d0 0x7fa304199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30a434640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa304102dc0 0x7fa304199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 -- 172.21.15.16:0/997420393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3041087d0 msgr2=0x7fa304199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3041087d0 0x7fa304199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 -- 172.21.15.16:0/997420393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa304102dc0 msgr2=0x7fa304199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa304102dc0 0x7fa304199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 -- 172.21.15.16:0/997420393 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30419f2d0 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30a434640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa304102dc0 0x7fa304199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.608+0000 7fa30ac35640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30419eb00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0098d0 tx=0x7fa2fc0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.609+0000 7fa2fb7fe640 1 -- 172.21.15.16:0/997420393 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc003b70 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.609+0000 7fa2fb7fe640 1 -- 172.21.15.16:0/997420393 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2fc003d10 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.609+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30419f560 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.609+0000 7fa2fb7fe640 1 -- 172.21.15.16:0/997420393 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc02fa20 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.609+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3041a5c80 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.610+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3041031a0 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.612+0000 7fa2fb7fe640 1 -- 172.21.15.16:0/997420393 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa2fc02fbc0 con 0x7fa304109150 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.613+0000 7fa2fb7fe640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2f00b53c0 0x7fa2f00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.613+0000 7fa30a434640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2f00b53c0 0x7fa2f00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.613+0000 7fa2fb7fe640 1 -- 172.21.15.16:0/997420393 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa2fc107350 con 0x7fa304109150 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.614+0000 7fa30a434640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2f00b53c0 0x7fa2f00b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa300009c20 tx=0x7fa300005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stdout:270582939678 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.617+0000 7fa2fb7fe640 1 -- 172.21.15.16:0/997420393 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa2fc0cdf90 con 0x7fa304109150 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.806+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa30410af30 con 0x7fa304109150 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.807+0000 7fa2fb7fe640 1 -- 172.21.15.16:0/997420393 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa2fc0cd890 con 0x7fa304109150 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2f00b53c0 msgr2=0x7fa2f00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2f00b53c0 0x7fa2f00b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa300009c20 tx=0x7fa300005f90 comp rx=0 tx=0).stop 2024-09-10T23:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 msgr2=0x7fa30419eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30419eb00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0098d0 tx=0x7fa2fc0317b0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 shutdown_connections 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa304109150 0x7fa30419eb00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3041087d0 0x7fa304199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa2f00b53c0 0x7fa2f00b7880 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 --2- 172.21.15.16:0/997420393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa304102dc0 0x7fa304199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 >> 172.21.15.16:0/997420393 conn(0x7fa3040fe830 msgr2=0x7fa3040ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 shutdown_connections 2024-09-10T23:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:12.809+0000 7fa30c698640 1 -- 172.21.15.16:0/997420393 wait complete. 2024-09-10T23:39:17.173 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939677 got 270582939678 for osd.10 2024-09-10T23:39:17.173 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:17.617 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299428 got 223338299431 for osd.8 2024-09-10T23:39:17.617 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:18.137 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743445 got 296352743448 for osd.11 2024-09-10T23:39:18.137 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:18.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:17 smithi016 ceph-mon[30855]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-10T23:39:18.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:17 smithi071 ceph-mon[35018]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-10T23:39:18.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:17 smithi066 ceph-mon[34761]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-10T23:39:18.629 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822708 got 154618822712 for osd.5 2024-09-10T23:39:18.630 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:19.089 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:19.122 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542218 got 60129542220 for osd.1 2024-09-10T23:39:19.123 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:19.566 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626478 got 180388626482 for osd.6 2024-09-10T23:39:19.566 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:20.045 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:19 smithi016 ceph-mon[30855]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-10T23:39:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 -- 172.21.15.16:0/3878533763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 msgr2=0x7fd5dc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/3878533763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc10e820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009ca0 tx=0x7fd5d402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 -- 172.21.15.16:0/3878533763 shutdown_connections 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/3878533763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc10e820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/3878533763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5dc1076a0 0x7fd5dc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/3878533763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc101c90 0x7fd5dc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 -- 172.21.15.16:0/3878533763 >> 172.21.15.16:0/3878533763 conn(0x7fd5dc0fd700 msgr2=0x7fd5dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 -- 172.21.15.16:0/3878533763 shutdown_connections 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.035+0000 7fd5e2d40640 1 -- 172.21.15.16:0/3878533763 wait complete. 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 Processor -- start 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 -- start start 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5dc101c90 0x7fd5dc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc1076a0 0x7fd5dc1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc111d30 con 0x7fd5dc108020 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc111bb0 con 0x7fd5dc101c90 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e2d40640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc111eb0 con 0x7fd5dc1076a0 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc19eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37432/0 (socket says 172.21.15.16:37432) 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 -- 172.21.15.16:0/1269349811 learned_addr learned my addr 172.21.15.16:0/1269349811 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e0adc640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5dc101c90 0x7fd5dc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5dbfff640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc1076a0 0x7fd5dc1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 -- 172.21.15.16:0/1269349811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc1076a0 msgr2=0x7fd5dc1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc1076a0 0x7fd5dc1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 -- 172.21.15.16:0/1269349811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5dc101c90 msgr2=0x7fd5dc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5dc101c90 0x7fd5dc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.036+0000 7fd5e12dd640 1 -- 172.21.15.16:0/1269349811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc19f340 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.037+0000 7fd5e12dd640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc19eb70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4031a20 tx=0x7fd5d4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.037+0000 7fd5d9ffb640 1 -- 172.21.15.16:0/1269349811 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4003c70 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.037+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc19f5d0 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.037+0000 7fd5d9ffb640 1 -- 172.21.15.16:0/1269349811 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5d4003e10 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.037+0000 7fd5d9ffb640 1 -- 172.21.15.16:0/1269349811 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d402fcb0 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.037+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc1a5d70 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.038+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc102070 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.040+0000 7fd5d9ffb640 1 -- 172.21.15.16:0/1269349811 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fd5d4004040 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.041+0000 7fd5d9ffb640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5c80b53c0 0x7fd5c80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.041+0000 7fd5e0adc640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5c80b53c0 0x7fd5c80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.041+0000 7fd5d9ffb640 1 -- 172.21.15.16:0/1269349811 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd5d4107410 con 0x7fd5dc108020 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.041+0000 7fd5e0adc640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5c80b53c0 0x7fd5c80b7880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009990 tx=0x7fd5cc009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.044+0000 7fd5d9ffb640 1 -- 172.21.15.16:0/1269349811 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd5d40ce140 con 0x7fd5dc108020 2024-09-10T23:39:20.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.230+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd5dc1a60a0 con 0x7fd5dc108020 2024-09-10T23:39:20.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.230+0000 7fd5d9ffb640 1 -- 172.21.15.16:0/1269349811 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5d40cda40 con 0x7fd5dc108020 2024-09-10T23:39:20.232 INFO:teuthology.orchestra.run.smithi016.stdout:77309411400 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5c80b53c0 msgr2=0x7fd5c80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5c80b53c0 0x7fd5c80b7880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009990 tx=0x7fd5cc009110 comp rx=0 tx=0).stop 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 msgr2=0x7fd5dc19eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc19eb70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4031a20 tx=0x7fd5d4031a50 comp rx=0 tx=0).stop 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 shutdown_connections 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5dc108020 0x7fd5dc19eb70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc1076a0 0x7fd5dc1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd5c80b53c0 0x7fd5c80b7880 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 --2- 172.21.15.16:0/1269349811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5dc101c90 0x7fd5dc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 >> 172.21.15.16:0/1269349811 conn(0x7fd5dc0fd700 msgr2=0x7fd5dc06ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:20.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 shutdown_connections 2024-09-10T23:39:20.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:20.233+0000 7fd5e2d40640 1 -- 172.21.15.16:0/1269349811 wait complete. 2024-09-10T23:39:20.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:19 smithi071 ceph-mon[35018]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-10T23:39:20.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:19 smithi066 ceph-mon[34761]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-10T23:39:20.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:20 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1269349811' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:39:21.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:20 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1269349811' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:39:21.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:20 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1269349811' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:39:21.474 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411400 for osd.2 2024-09-10T23:39:21.474 DEBUG:teuthology.parallel:result is None 2024-09-10T23:39:21.474 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:39:21.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:39:21.752 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:22.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:21 smithi016 ceph-mon[30855]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:22.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.237+0000 7f36a0ccf640 1 -- 172.21.15.16:0/1475977327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 msgr2=0x7f369c108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.237+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/1475977327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c108c30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3690009900 tx=0x7f369002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.237+0000 7f36a0ccf640 1 -- 172.21.15.16:0/1475977327 shutdown_connections 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/1475977327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f369c109170 0x7f369c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/1475977327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c108c30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/1475977327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f369c102de0 0x7f369c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 -- 172.21.15.16:0/1475977327 >> 172.21.15.16:0/1475977327 conn(0x7f369c0fe830 msgr2=0x7f369c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 -- 172.21.15.16:0/1475977327 shutdown_connections 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 -- 172.21.15.16:0/1475977327 wait complete. 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 Processor -- start 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.238+0000 7f36a0ccf640 1 -- start start 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f36a0ccf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f369c102de0 0x7f369c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:22.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f36a0ccf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f36a0ccf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f369c109170 0x7f369c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f36a0ccf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f369c112dc0 con 0x7f369c1087f0 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f36a0ccf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f369c112c40 con 0x7f369c102de0 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f36a0ccf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f369c112f40 con 0x7f369c109170 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37446/0 (socket says 172.21.15.16:37446) 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 -- 172.21.15.16:0/3121545620 learned_addr learned my addr 172.21.15.16:0/3121545620 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f369a59c640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f369c102de0 0x7f369c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f369ad9d640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f369c109170 0x7f369c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 -- 172.21.15.16:0/3121545620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f369c109170 msgr2=0x7f369c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f369c109170 0x7f369c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 -- 172.21.15.16:0/3121545620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f369c102de0 msgr2=0x7f369c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f369c102de0 0x7f369c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 -- 172.21.15.16:0/3121545620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c1a76a0 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.239+0000 7f3699d9b640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c0759e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3690005940 tx=0x7f36900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.240+0000 7f368b7fe640 1 -- 172.21.15.16:0/3121545620 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369003f030 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.240+0000 7f368b7fe640 1 -- 172.21.15.16:0/3121545620 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3690003cb0 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.240+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c1a7930 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.240+0000 7f368b7fe640 1 -- 172.21.15.16:0/3121545620 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690035070 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.240+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c1a7e60 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.241+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c1031c0 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.243+0000 7f368b7fe640 1 -- 172.21.15.16:0/3121545620 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f369003bbf0 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.244+0000 7f368b7fe640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36840b5440 0x7f36840b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.245+0000 7f369a59c640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36840b5440 0x7f36840b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.245+0000 7f368b7fe640 1 -- 172.21.15.16:0/3121545620 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f3690106be0 con 0x7f369c1087f0 2024-09-10T23:39:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.245+0000 7f369a59c640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36840b5440 0x7f36840b7900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f368c00bbe0 tx=0x7f368c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:22.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.247+0000 7f368b7fe640 1 -- 172.21.15.16:0/3121545620 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f36900cd230 con 0x7f369c1087f0 2024-09-10T23:39:22.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:21 smithi071 ceph-mon[35018]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:22.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:21 smithi066 ceph-mon[34761]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:22.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.463+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f369c063590 con 0x7f36840b5440 2024-09-10T23:39:22.472 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:22.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.471+0000 7f368b7fe640 1 -- 172.21.15.16:0/3121545620 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258955 (secure 0 0 0) 0x7f369c063590 con 0x7f36840b5440 2024-09-10T23:39:22.476 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-10T23:39:22.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36840b5440 msgr2=0x7f36840b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:22.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36840b5440 0x7f36840b7900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f368c00bbe0 tx=0x7f368c00b390 comp rx=0 tx=0).stop 2024-09-10T23:39:22.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 msgr2=0x7f369c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:22.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c0759e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3690005940 tx=0x7f36900042f0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 shutdown_connections 2024-09-10T23:39:22.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f369c109170 0x7f369c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f369c1087f0 0x7f369c0759e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36840b5440 0x7f36840b7900 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 --2- 172.21.15.16:0/3121545620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f369c102de0 0x7f369c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:22.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 >> 172.21.15.16:0/3121545620 conn(0x7f369c0fe830 msgr2=0x7f369c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:22.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.474+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 shutdown_connections 2024-09-10T23:39:22.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:22.475+0000 7f36a0ccf640 1 -- 172.21.15.16:0/3121545620 wait complete. 2024-09-10T23:39:23.155 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-10T23:39:22.436794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655341,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":449,"num_read_kb":320,"num_write":286,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380456,"kb_used_data":10320,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561368,"statfs":{"total":1151940427776,"available":1151550840832,"internally_reserved":0,"allocated":10567680,"data_stored":6974727,"data_compressed":178827,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003401"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.535000+0000","last_change":"2024-09-10T23:38:12.217637+0000","last_active":"2024-09-10T23:38:43.535000+0000","last_peered":"2024-09-10T23:38:43.535000+0000","last_clean":"2024-09-10T23:38:43.535000+0000","last_became_active":"2024-09-10T23:38:12.217260+0000","last_became_peered":"2024-09-10T23:38:12.217260+0000","last_unstale":"2024-09-10T23:38:43.535000+0000","last_undegraded":"2024-09-10T23:38:43.535000+0000","last_fullsized":"2024-09-10T23:38:43.535000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.774575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533626+0000","last_change":"2024-09-10T23:38:12.217114+0000","last_active":"2024-09-10T23:38:43.533626+0000","last_peered":"2024-09-10T23:38:43.533626+0000","last_clean":"2024-09-10T23:38:43.533626+0000","last_became_active":"2024-09-10T23:38:12.216836+0000","last_became_peered":"2024-09-10T23:38:12.216836+0000","last_unstale":"2024-09-10T23:38:43.533626+0000","last_undegraded":"2024-09-10T23:38:43.533626+0000","last_fullsized":"2024-09-10T23:38:43.533626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:55.023668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533086+0000","last_change":"2024-09-10T23:38:12.219046+0000","last_active":"2024-09-10T23:38:43.533086+0000","last_peered":"2024-09-10T23:38:43.533086+0000","last_clean":"2024-09-10T23:38:43.533086+0000","last_became_active":"2024-09-10T23:38:12.218348+0000","last_became_peered":"2024-09-10T23:38:12.218348+0000","last_unstale":"2024-09-10T23:38:43.533086+0000","last_undegraded":"2024-09-10T23:38:43.533086+0000","last_fullsized":"2024-09-10T23:38:43.533086+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:07.419364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536765+0000","last_change":"2024-09-10T23:38:12.219211+0000","last_active":"2024-09-10T23:38:43.536765+0000","last_peered":"2024-09-10T23:38:43.536765+0000","last_clean":"2024-09-10T23:38:43.536765+0000","last_became_active":"2024-09-10T23:38:12.213452+0000","last_became_peered":"2024-09-10T23:38:12.213452+0000","last_unstale":"2024-09-10T23:38:43.536765+0000","last_undegraded":"2024-09-10T23:38:43.536765+0000","last_fullsized":"2024-09-10T23:38:43.536765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:59.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531947+0000","last_change":"2024-09-10T23:38:12.213636+0000","last_active":"2024-09-10T23:38:43.531947+0000","last_peered":"2024-09-10T23:38:43.531947+0000","last_clean":"2024-09-10T23:38:43.531947+0000","last_became_active":"2024-09-10T23:38:12.213309+0000","last_became_peered":"2024-09-10T23:38:12.213309+0000","last_unstale":"2024-09-10T23:38:43.531947+0000","last_undegraded":"2024-09-10T23:38:43.531947+0000","last_fullsized":"2024-09-10T23:38:43.531947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:34.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024439+0000","last_change":"2024-09-10T23:38:12.215995+0000","last_active":"2024-09-10T23:38:44.024439+0000","last_peered":"2024-09-10T23:38:44.024439+0000","last_clean":"2024-09-10T23:38:44.024439+0000","last_became_active":"2024-09-10T23:38:12.215601+0000","last_became_peered":"2024-09-10T23:38:12.215601+0000","last_unstale":"2024-09-10T23:38:44.024439+0000","last_undegraded":"2024-09-10T23:38:44.024439+0000","last_fullsized":"2024-09-10T23:38:44.024439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:24.770551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.090994+0000","last_change":"2024-09-10T23:38:12.226337+0000","last_active":"2024-09-10T23:38:44.090994+0000","last_peered":"2024-09-10T23:38:44.090994+0000","last_clean":"2024-09-10T23:38:44.090994+0000","last_became_active":"2024-09-10T23:38:12.225953+0000","last_became_peered":"2024-09-10T23:38:12.225953+0000","last_unstale":"2024-09-10T23:38:44.090994+0000","last_undegraded":"2024-09-10T23:38:44.090994+0000","last_fullsized":"2024-09-10T23:38:44.090994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:27.044867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965227+0000","last_change":"2024-09-10T23:38:12.219682+0000","last_active":"2024-09-10T23:38:43.965227+0000","last_peered":"2024-09-10T23:38:43.965227+0000","last_clean":"2024-09-10T23:38:43.965227+0000","last_became_active":"2024-09-10T23:38:12.218596+0000","last_became_peered":"2024-09-10T23:38:12.218596+0000","last_unstale":"2024-09-10T23:38:43.965227+0000","last_undegraded":"2024-09-10T23:38:43.965227+0000","last_fullsized":"2024-09-10T23:38:43.965227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:33.011117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532547+0000","last_change":"2024-09-10T23:38:12.223114+0000","last_active":"2024-09-10T23:38:43.532547+0000","last_peered":"2024-09-10T23:38:43.532547+0000","last_clean":"2024-09-10T23:38:43.532547+0000","last_became_active":"2024-09-10T23:38:12.222748+0000","last_became_peered":"2024-09-10T23:38:12.222748+0000","last_unstale":"2024-09-10T23:38:43.532547+0000","last_undegraded":"2024-09-10T23:38:43.532547+0000","last_fullsized":"2024-09-10T23:38:43.532547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:38.384821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024856+0000","last_change":"2024-09-10T23:38:12.225061+0000","last_active":"2024-09-10T23:38:44.024856+0000","last_peered":"2024-09-10T23:38:44.024856+0000","last_clean":"2024-09-10T23:38:44.024856+0000","last_became_active":"2024-09-10T23:38:12.224730+0000","last_became_peered":"2024-09-10T23:38:12.224730+0000","last_unstale":"2024-09-10T23:38:44.024856+0000","last_undegraded":"2024-09-10T23:38:44.024856+0000","last_fullsized":"2024-09-10T23:38:44.024856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:40.343294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091365+0000","last_change":"2024-09-10T23:38:12.219920+0000","last_active":"2024-09-10T23:38:44.091365+0000","last_peered":"2024-09-10T23:38:44.091365+0000","last_clean":"2024-09-10T23:38:44.091365+0000","last_became_active":"2024-09-10T23:38:12.219517+0000","last_became_peered":"2024-09-10T23:38:12.219517+0000","last_unstale":"2024-09-10T23:38:44.091365+0000","last_undegraded":"2024-09-10T23:38:44.091365+0000","last_fullsized":"2024-09-10T23:38:44.091365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:58.686977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536928+0000","last_change":"2024-09-10T23:38:12.219740+0000","last_active":"2024-09-10T23:38:43.536928+0000","last_peered":"2024-09-10T23:38:43.536928+0000","last_clean":"2024-09-10T23:38:43.536928+0000","last_became_active":"2024-09-10T23:38:12.215497+0000","last_became_peered":"2024-09-10T23:38:12.215497+0000","last_unstale":"2024-09-10T23:38:43.536928+0000","last_undegraded":"2024-09-10T23:38:43.536928+0000","last_fullsized":"2024-09-10T23:38:43.536928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:06.503836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530968+0000","last_change":"2024-09-10T23:38:12.217066+0000","last_active":"2024-09-10T23:38:43.530968+0000","last_peered":"2024-09-10T23:38:43.530968+0000","last_clean":"2024-09-10T23:38:43.530968+0000","last_became_active":"2024-09-10T23:38:12.216758+0000","last_became_peered":"2024-09-10T23:38:12.216758+0000","last_unstale":"2024-09-10T23:38:43.530968+0000","last_undegraded":"2024-09-10T23:38:43.530968+0000","last_fullsized":"2024-09-10T23:38:43.530968+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:53.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533299+0000","last_change":"2024-09-10T23:38:12.216584+0000","last_active":"2024-09-10T23:38:43.533299+0000","last_peered":"2024-09-10T23:38:43.533299+0000","last_clean":"2024-09-10T23:38:43.533299+0000","last_became_active":"2024-09-10T23:38:12.216296+0000","last_became_peered":"2024-09-10T23:38:12.216296+0000","last_unstale":"2024-09-10T23:38:43.533299+0000","last_undegraded":"2024-09-10T23:38:43.533299+0000","last_fullsized":"2024-09-10T23:38:43.533299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:11.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.772333+0000","last_change":"2024-09-10T23:38:43.772225+0000","last_active":"2024-09-10T23:38:43.772333+0000","last_peered":"2024-09-10T23:38:43.772333+0000","last_clean":"2024-09-10T23:38:43.772333+0000","last_became_active":"2024-09-10T23:38:43.771855+0000","last_became_peered":"2024-09-10T23:38:43.771855+0000","last_unstale":"2024-09-10T23:38:43.772333+0000","last_undegraded":"2024-09-10T23:38:43.772333+0000","last_fullsized":"2024-09-10T23:38:43.772333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:14.454340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531869+0000","last_change":"2024-09-10T23:38:12.229957+0000","last_active":"2024-09-10T23:38:43.531869+0000","last_peered":"2024-09-10T23:38:43.531869+0000","last_clean":"2024-09-10T23:38:43.531869+0000","last_became_active":"2024-09-10T23:38:12.229297+0000","last_became_peered":"2024-09-10T23:38:12.229297+0000","last_unstale":"2024-09-10T23:38:43.531869+0000","last_undegraded":"2024-09-10T23:38:43.531869+0000","last_fullsized":"2024-09-10T23:38:43.531869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:54.119455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.535230+0000","last_change":"2024-09-10T23:38:12.218345+0000","last_active":"2024-09-10T23:38:43.535230+0000","last_peered":"2024-09-10T23:38:43.535230+0000","last_clean":"2024-09-10T23:38:43.535230+0000","last_became_active":"2024-09-10T23:38:12.218060+0000","last_became_peered":"2024-09-10T23:38:12.218060+0000","last_unstale":"2024-09-10T23:38:43.535230+0000","last_undegraded":"2024-09-10T23:38:43.535230+0000","last_fullsized":"2024-09-10T23:38:43.535230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.912757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534017+0000","last_change":"2024-09-10T23:38:12.215025+0000","last_active":"2024-09-10T23:38:43.534017+0000","last_peered":"2024-09-10T23:38:43.534017+0000","last_clean":"2024-09-10T23:38:43.534017+0000","last_became_active":"2024-09-10T23:38:12.214709+0000","last_became_peered":"2024-09-10T23:38:12.214709+0000","last_unstale":"2024-09-10T23:38:43.534017+0000","last_undegraded":"2024-09-10T23:38:43.534017+0000","last_fullsized":"2024-09-10T23:38:43.534017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:00.925426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770954+0000","last_change":"2024-09-10T23:38:12.215536+0000","last_active":"2024-09-10T23:38:43.770954+0000","last_peered":"2024-09-10T23:38:43.770954+0000","last_clean":"2024-09-10T23:38:43.770954+0000","last_became_active":"2024-09-10T23:38:12.214991+0000","last_became_peered":"2024-09-10T23:38:12.214991+0000","last_unstale":"2024-09-10T23:38:43.770954+0000","last_undegraded":"2024-09-10T23:38:43.770954+0000","last_fullsized":"2024-09-10T23:38:43.770954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.059276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534090+0000","last_change":"2024-09-10T23:38:12.224919+0000","last_active":"2024-09-10T23:38:43.534090+0000","last_peered":"2024-09-10T23:38:43.534090+0000","last_clean":"2024-09-10T23:38:43.534090+0000","last_became_active":"2024-09-10T23:38:12.224559+0000","last_became_peered":"2024-09-10T23:38:12.224559+0000","last_unstale":"2024-09-10T23:38:43.534090+0000","last_undegraded":"2024-09-10T23:38:43.534090+0000","last_fullsized":"2024-09-10T23:38:43.534090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:23.373211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531089+0000","last_change":"2024-09-10T23:38:12.216995+0000","last_active":"2024-09-10T23:38:43.531089+0000","last_peered":"2024-09-10T23:38:43.531089+0000","last_clean":"2024-09-10T23:38:43.531089+0000","last_became_active":"2024-09-10T23:38:12.216681+0000","last_became_peered":"2024-09-10T23:38:12.216681+0000","last_unstale":"2024-09-10T23:38:43.531089+0000","last_undegraded":"2024-09-10T23:38:43.531089+0000","last_fullsized":"2024-09-10T23:38:43.531089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:37.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532257+0000","last_change":"2024-09-10T23:38:12.221618+0000","last_active":"2024-09-10T23:38:43.532257+0000","last_peered":"2024-09-10T23:38:43.532257+0000","last_clean":"2024-09-10T23:38:43.532257+0000","last_became_active":"2024-09-10T23:38:12.219352+0000","last_became_peered":"2024-09-10T23:38:12.219352+0000","last_unstale":"2024-09-10T23:38:43.532257+0000","last_undegraded":"2024-09-10T23:38:43.532257+0000","last_fullsized":"2024-09-10T23:38:43.532257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:48.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965268+0000","last_change":"2024-09-10T23:38:12.221530+0000","last_active":"2024-09-10T23:38:43.965268+0000","last_peered":"2024-09-10T23:38:43.965268+0000","last_clean":"2024-09-10T23:38:43.965268+0000","last_became_active":"2024-09-10T23:38:12.221024+0000","last_became_peered":"2024-09-10T23:38:12.221024+0000","last_unstale":"2024-09-10T23:38:43.965268+0000","last_undegraded":"2024-09-10T23:38:43.965268+0000","last_fullsized":"2024-09-10T23:38:43.965268+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536551+0000","last_change":"2024-09-10T23:38:12.219990+0000","last_active":"2024-09-10T23:38:43.536551+0000","last_peered":"2024-09-10T23:38:43.536551+0000","last_clean":"2024-09-10T23:38:43.536551+0000","last_became_active":"2024-09-10T23:38:12.219560+0000","last_became_peered":"2024-09-10T23:38:12.219560+0000","last_unstale":"2024-09-10T23:38:43.536551+0000","last_undegraded":"2024-09-10T23:38:43.536551+0000","last_fullsized":"2024-09-10T23:38:43.536551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:28.112467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965921+0000","last_change":"2024-09-10T23:38:12.225753+0000","last_active":"2024-09-10T23:38:43.965921+0000","last_peered":"2024-09-10T23:38:43.965921+0000","last_clean":"2024-09-10T23:38:43.965921+0000","last_became_active":"2024-09-10T23:38:12.225450+0000","last_became_peered":"2024-09-10T23:38:12.225450+0000","last_unstale":"2024-09-10T23:38:43.965921+0000","last_undegraded":"2024-09-10T23:38:43.965921+0000","last_fullsized":"2024-09-10T23:38:43.965921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:23.478611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.771150+0000","last_change":"2024-09-10T23:38:12.216917+0000","last_active":"2024-09-10T23:38:43.771150+0000","last_peered":"2024-09-10T23:38:43.771150+0000","last_clean":"2024-09-10T23:38:43.771150+0000","last_became_active":"2024-09-10T23:38:12.216528+0000","last_became_peered":"2024-09-10T23:38:12.216528+0000","last_unstale":"2024-09-10T23:38:43.771150+0000","last_undegraded":"2024-09-10T23:38:43.771150+0000","last_fullsized":"2024-09-10T23:38:43.771150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:03.902221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534170+0000","last_change":"2024-09-10T23:38:12.219372+0000","last_active":"2024-09-10T23:38:43.534170+0000","last_peered":"2024-09-10T23:38:43.534170+0000","last_clean":"2024-09-10T23:38:43.534170+0000","last_became_active":"2024-09-10T23:38:12.219072+0000","last_became_peered":"2024-09-10T23:38:12.219072+0000","last_unstale":"2024-09-10T23:38:43.534170+0000","last_undegraded":"2024-09-10T23:38:43.534170+0000","last_fullsized":"2024-09-10T23:38:43.534170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:07.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531045+0000","last_change":"2024-09-10T23:38:12.224716+0000","last_active":"2024-09-10T23:38:43.531045+0000","last_peered":"2024-09-10T23:38:43.531045+0000","last_clean":"2024-09-10T23:38:43.531045+0000","last_became_active":"2024-09-10T23:38:12.224393+0000","last_became_peered":"2024-09-10T23:38:12.224393+0000","last_unstale":"2024-09-10T23:38:43.531045+0000","last_undegraded":"2024-09-10T23:38:43.531045+0000","last_fullsized":"2024-09-10T23:38:43.531045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.995098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.092585+0000","last_change":"2024-09-10T23:38:44.092446+0000","last_active":"2024-09-10T23:38:44.092585+0000","last_peered":"2024-09-10T23:38:44.092585+0000","last_clean":"2024-09-10T23:38:44.092585+0000","last_became_active":"2024-09-10T23:38:44.092027+0000","last_became_peered":"2024-09-10T23:38:44.092027+0000","last_unstale":"2024-09-10T23:38:44.092585+0000","last_undegraded":"2024-09-10T23:38:44.092585+0000","last_fullsized":"2024-09-10T23:38:44.092585+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.804237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770652+0000","last_change":"2024-09-10T23:38:12.214278+0000","last_active":"2024-09-10T23:38:43.770652+0000","last_peered":"2024-09-10T23:38:43.770652+0000","last_clean":"2024-09-10T23:38:43.770652+0000","last_became_active":"2024-09-10T23:38:12.212079+0000","last_became_peered":"2024-09-10T23:38:12.212079+0000","last_unstale":"2024-09-10T23:38:43.770652+0000","last_undegraded":"2024-09-10T23:38:43.770652+0000","last_fullsized":"2024-09-10T23:38:43.770652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:42.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770801+0000","last_change":"2024-09-10T23:38:12.214703+0000","last_active":"2024-09-10T23:38:43.770801+0000","last_peered":"2024-09-10T23:38:43.770801+0000","last_clean":"2024-09-10T23:38:43.770801+0000","last_became_active":"2024-09-10T23:38:12.214353+0000","last_became_peered":"2024-09-10T23:38:12.214353+0000","last_unstale":"2024-09-10T23:38:43.770801+0000","last_undegraded":"2024-09-10T23:38:43.770801+0000","last_fullsized":"2024-09-10T23:38:43.770801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.004904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533954+0000","last_change":"2024-09-10T23:38:12.223462+0000","last_active":"2024-09-10T23:38:43.533954+0000","last_peered":"2024-09-10T23:38:43.533954+0000","last_clean":"2024-09-10T23:38:43.533954+0000","last_became_active":"2024-09-10T23:38:12.223159+0000","last_became_peered":"2024-09-10T23:38:12.223159+0000","last_unstale":"2024-09-10T23:38:43.533954+0000","last_undegraded":"2024-09-10T23:38:43.533954+0000","last_fullsized":"2024-09-10T23:38:43.533954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.587560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531872+0000","last_change":"2024-09-10T23:38:12.213290+0000","last_active":"2024-09-10T23:38:43.531872+0000","last_peered":"2024-09-10T23:38:43.531872+0000","last_clean":"2024-09-10T23:38:43.531872+0000","last_became_active":"2024-09-10T23:38:12.212999+0000","last_became_peered":"2024-09-10T23:38:12.212999+0000","last_unstale":"2024-09-10T23:38:43.531872+0000","last_undegraded":"2024-09-10T23:38:43.531872+0000","last_fullsized":"2024-09-10T23:38:43.531872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:54.448436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":91,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:20.364666+0000","last_change":"2024-09-10T23:38:10.210483+0000","last_active":"2024-09-10T23:39:20.364666+0000","last_peered":"2024-09-10T23:39:20.364666+0000","last_clean":"2024-09-10T23:39:20.364666+0000","last_became_active":"2024-09-10T23:38:10.210108+0000","last_became_peered":"2024-09-10T23:38:10.210108+0000","last_unstale":"2024-09-10T23:39:20.364666+0000","last_undegraded":"2024-09-10T23:39:20.364666+0000","last_fullsized":"2024-09-10T23:39:20.364666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:33.370496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.967231+0000","last_change":"2024-09-10T23:38:43.966800+0000","last_active":"2024-09-10T23:38:43.967231+0000","last_peered":"2024-09-10T23:38:43.967231+0000","last_clean":"2024-09-10T23:38:43.967231+0000","last_became_active":"2024-09-10T23:38:43.966274+0000","last_became_peered":"2024-09-10T23:38:43.966274+0000","last_unstale":"2024-09-10T23:38:43.967231+0000","last_undegraded":"2024-09-10T23:38:43.967231+0000","last_fullsized":"2024-09-10T23:38:43.967231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:02.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024529+0000","last_change":"2024-09-10T23:38:10.210875+0000","last_active":"2024-09-10T23:38:44.024529+0000","last_peered":"2024-09-10T23:38:44.024529+0000","last_clean":"2024-09-10T23:38:44.024529+0000","last_became_active":"2024-09-10T23:38:10.209254+0000","last_became_peered":"2024-09-10T23:38:10.209254+0000","last_unstale":"2024-09-10T23:38:44.024529+0000","last_undegraded":"2024-09-10T23:38:44.024529+0000","last_fullsized":"2024-09-10T23:38:44.024529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:21.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530747+0000","last_change":"2024-09-10T23:38:10.213483+0000","last_active":"2024-09-10T23:38:43.530747+0000","last_peered":"2024-09-10T23:38:43.530747+0000","last_clean":"2024-09-10T23:38:43.530747+0000","last_became_active":"2024-09-10T23:38:10.213109+0000","last_became_peered":"2024-09-10T23:38:10.213109+0000","last_unstale":"2024-09-10T23:38:43.530747+0000","last_undegraded":"2024-09-10T23:38:43.530747+0000","last_fullsized":"2024-09-10T23:38:43.530747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:03.563548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965299+0000","last_change":"2024-09-10T23:38:12.217136+0000","last_active":"2024-09-10T23:38:43.965299+0000","last_peered":"2024-09-10T23:38:43.965299+0000","last_clean":"2024-09-10T23:38:43.965299+0000","last_became_active":"2024-09-10T23:38:12.216813+0000","last_became_peered":"2024-09-10T23:38:12.216813+0000","last_unstale":"2024-09-10T23:38:43.965299+0000","last_undegraded":"2024-09-10T23:38:43.965299+0000","last_fullsized":"2024-09-10T23:38:43.965299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:26.184575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536951+0000","last_change":"2024-09-10T23:38:10.209109+0000","last_active":"2024-09-10T23:38:43.536951+0000","last_peered":"2024-09-10T23:38:43.536951+0000","last_clean":"2024-09-10T23:38:43.536951+0000","last_became_active":"2024-09-10T23:38:10.208450+0000","last_became_peered":"2024-09-10T23:38:10.208450+0000","last_unstale":"2024-09-10T23:38:43.536951+0000","last_undegraded":"2024-09-10T23:38:43.536951+0000","last_fullsized":"2024-09-10T23:38:43.536951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:29.453119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534085+0000","last_change":"2024-09-10T23:38:12.213755+0000","last_active":"2024-09-10T23:38:43.534085+0000","last_peered":"2024-09-10T23:38:43.534085+0000","last_clean":"2024-09-10T23:38:43.534085+0000","last_became_active":"2024-09-10T23:38:12.213454+0000","last_became_peered":"2024-09-10T23:38:12.213454+0000","last_unstale":"2024-09-10T23:38:43.534085+0000","last_undegraded":"2024-09-10T23:38:43.534085+0000","last_fullsized":"2024-09-10T23:38:43.534085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.958053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:16.358272+0000","last_change":"2024-09-10T23:38:10.209908+0000","last_active":"2024-09-10T23:39:16.358272+0000","last_peered":"2024-09-10T23:39:16.358272+0000","last_clean":"2024-09-10T23:39:16.358272+0000","last_became_active":"2024-09-10T23:38:10.208867+0000","last_became_peered":"2024-09-10T23:38:10.208867+0000","last_unstale":"2024-09-10T23:39:16.358272+0000","last_undegraded":"2024-09-10T23:39:16.358272+0000","last_fullsized":"2024-09-10T23:39:16.358272+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:09.239123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532347+0000","last_change":"2024-09-10T23:38:12.224353+0000","last_active":"2024-09-10T23:38:43.532347+0000","last_peered":"2024-09-10T23:38:43.532347+0000","last_clean":"2024-09-10T23:38:43.532347+0000","last_became_active":"2024-09-10T23:38:12.223997+0000","last_became_peered":"2024-09-10T23:38:12.223997+0000","last_unstale":"2024-09-10T23:38:43.532347+0000","last_undegraded":"2024-09-10T23:38:43.532347+0000","last_fullsized":"2024-09-10T23:38:43.532347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:53.092794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091493+0000","last_change":"2024-09-10T23:38:10.207978+0000","last_active":"2024-09-10T23:38:44.091493+0000","last_peered":"2024-09-10T23:38:44.091493+0000","last_clean":"2024-09-10T23:38:44.091493+0000","last_became_active":"2024-09-10T23:38:10.207566+0000","last_became_peered":"2024-09-10T23:38:10.207566+0000","last_unstale":"2024-09-10T23:38:44.091493+0000","last_undegraded":"2024-09-10T23:38:44.091493+0000","last_fullsized":"2024-09-10T23:38:44.091493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:00.715005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538710+0000","last_change":"2024-09-10T23:38:43.538619+0000","last_active":"2024-09-10T23:38:43.538710+0000","last_peered":"2024-09-10T23:38:43.538710+0000","last_clean":"2024-09-10T23:38:43.538710+0000","last_became_active":"2024-09-10T23:38:43.537752+0000","last_became_peered":"2024-09-10T23:38:43.537752+0000","last_unstale":"2024-09-10T23:38:43.538710+0000","last_undegraded":"2024-09-10T23:38:43.538710+0000","last_fullsized":"2024-09-10T23:38:43.538710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:08.399537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537358+0000","last_change":"2024-09-10T23:38:10.257254+0000","last_active":"2024-09-10T23:38:43.537358+0000","last_peered":"2024-09-10T23:38:43.537358+0000","last_clean":"2024-09-10T23:38:43.537358+0000","last_became_active":"2024-09-10T23:38:10.256791+0000","last_became_peered":"2024-09-10T23:38:10.256791+0000","last_unstale":"2024-09-10T23:38:43.537358+0000","last_undegraded":"2024-09-10T23:38:43.537358+0000","last_fullsized":"2024-09-10T23:38:43.537358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:35.931873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532022+0000","last_change":"2024-09-10T23:38:12.229295+0000","last_active":"2024-09-10T23:38:43.532022+0000","last_peered":"2024-09-10T23:38:43.532022+0000","last_clean":"2024-09-10T23:38:43.532022+0000","last_became_active":"2024-09-10T23:38:12.228846+0000","last_became_peered":"2024-09-10T23:38:12.228846+0000","last_unstale":"2024-09-10T23:38:43.532022+0000","last_undegraded":"2024-09-10T23:38:43.532022+0000","last_fullsized":"2024-09-10T23:38:43.532022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:15.383624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":167,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:17.359814+0000","last_change":"2024-09-10T23:38:10.203362+0000","last_active":"2024-09-10T23:39:17.359814+0000","last_peered":"2024-09-10T23:39:17.359814+0000","last_clean":"2024-09-10T23:39:17.359814+0000","last_became_active":"2024-09-10T23:38:10.202961+0000","last_became_peered":"2024-09-10T23:38:10.202961+0000","last_unstale":"2024-09-10T23:39:17.359814+0000","last_undegraded":"2024-09-10T23:39:17.359814+0000","last_fullsized":"2024-09-10T23:39:17.359814+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:33.580368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":28,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532341+0000","last_change":"2024-09-10T23:38:12.219094+0000","last_active":"2024-09-10T23:38:43.532341+0000","last_peered":"2024-09-10T23:38:43.532341+0000","last_clean":"2024-09-10T23:38:43.532341+0000","last_became_active":"2024-09-10T23:38:12.218778+0000","last_became_peered":"2024-09-10T23:38:12.218778+0000","last_unstale":"2024-09-10T23:38:43.532341+0000","last_undegraded":"2024-09-10T23:38:43.532341+0000","last_fullsized":"2024-09-10T23:38:43.532341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:59.019756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770789+0000","last_change":"2024-09-10T23:38:10.204204+0000","last_active":"2024-09-10T23:38:43.770789+0000","last_peered":"2024-09-10T23:38:43.770789+0000","last_clean":"2024-09-10T23:38:43.770789+0000","last_became_active":"2024-09-10T23:38:10.203662+0000","last_became_peered":"2024-09-10T23:38:10.203662+0000","last_unstale":"2024-09-10T23:38:43.770789+0000","last_undegraded":"2024-09-10T23:38:43.770789+0000","last_fullsized":"2024-09-10T23:38:43.770789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:44.243961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530782+0000","last_change":"2024-09-10T23:38:12.214337+0000","last_active":"2024-09-10T23:38:43.530782+0000","last_peered":"2024-09-10T23:38:43.530782+0000","last_clean":"2024-09-10T23:38:43.530782+0000","last_became_active":"2024-09-10T23:38:12.214024+0000","last_became_peered":"2024-09-10T23:38:12.214024+0000","last_unstale":"2024-09-10T23:38:43.530782+0000","last_undegraded":"2024-09-10T23:38:43.530782+0000","last_fullsized":"2024-09-10T23:38:43.530782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:19.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536668+0000","last_change":"2024-09-10T23:38:10.208001+0000","last_active":"2024-09-10T23:38:43.536668+0000","last_peered":"2024-09-10T23:38:43.536668+0000","last_clean":"2024-09-10T23:38:43.536668+0000","last_became_active":"2024-09-10T23:38:10.207656+0000","last_became_peered":"2024-09-10T23:38:10.207656+0000","last_unstale":"2024-09-10T23:38:43.536668+0000","last_undegraded":"2024-09-10T23:38:43.536668+0000","last_fullsized":"2024-09-10T23:38:43.536668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:44.679795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091260+0000","last_change":"2024-09-10T23:38:12.227780+0000","last_active":"2024-09-10T23:38:44.091260+0000","last_peered":"2024-09-10T23:38:44.091260+0000","last_clean":"2024-09-10T23:38:44.091260+0000","last_became_active":"2024-09-10T23:38:12.227404+0000","last_became_peered":"2024-09-10T23:38:12.227404+0000","last_unstale":"2024-09-10T23:38:44.091260+0000","last_undegraded":"2024-09-10T23:38:44.091260+0000","last_fullsized":"2024-09-10T23:38:44.091260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:58.453685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":88,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:19.363716+0000","last_change":"2024-09-10T23:38:10.214786+0000","last_active":"2024-09-10T23:39:19.363716+0000","last_peered":"2024-09-10T23:39:19.363716+0000","last_clean":"2024-09-10T23:39:19.363716+0000","last_became_active":"2024-09-10T23:38:10.214124+0000","last_became_peered":"2024-09-10T23:38:10.214124+0000","last_unstale":"2024-09-10T23:39:19.363716+0000","last_undegraded":"2024-09-10T23:39:19.363716+0000","last_fullsized":"2024-09-10T23:39:19.363716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:00.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.090875+0000","last_change":"2024-09-10T23:38:12.220507+0000","last_active":"2024-09-10T23:38:44.090875+0000","last_peered":"2024-09-10T23:38:44.090875+0000","last_clean":"2024-09-10T23:38:44.090875+0000","last_became_active":"2024-09-10T23:38:12.220178+0000","last_became_peered":"2024-09-10T23:38:12.220178+0000","last_unstale":"2024-09-10T23:38:44.090875+0000","last_undegraded":"2024-09-10T23:38:44.090875+0000","last_fullsized":"2024-09-10T23:38:44.090875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:57.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531867+0000","last_change":"2024-09-10T23:38:10.256166+0000","last_active":"2024-09-10T23:38:43.531867+0000","last_peered":"2024-09-10T23:38:43.531867+0000","last_clean":"2024-09-10T23:38:43.531867+0000","last_became_active":"2024-09-10T23:38:10.255792+0000","last_became_peered":"2024-09-10T23:38:10.255792+0000","last_unstale":"2024-09-10T23:38:43.531867+0000","last_undegraded":"2024-09-10T23:38:43.531867+0000","last_fullsized":"2024-09-10T23:38:43.531867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:44.621339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537237+0000","last_change":"2024-09-10T23:38:12.225151+0000","last_active":"2024-09-10T23:38:43.537237+0000","last_peered":"2024-09-10T23:38:43.537237+0000","last_clean":"2024-09-10T23:38:43.537237+0000","last_became_active":"2024-09-10T23:38:12.224748+0000","last_became_peered":"2024-09-10T23:38:12.224748+0000","last_unstale":"2024-09-10T23:38:43.537237+0000","last_undegraded":"2024-09-10T23:38:43.537237+0000","last_fullsized":"2024-09-10T23:38:43.537237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.543098+0000","last_change":"2024-09-10T23:38:43.542616+0000","last_active":"2024-09-10T23:38:43.543098+0000","last_peered":"2024-09-10T23:38:43.543098+0000","last_clean":"2024-09-10T23:38:43.543098+0000","last_became_active":"2024-09-10T23:38:43.537936+0000","last_became_peered":"2024-09-10T23:38:43.537936+0000","last_unstale":"2024-09-10T23:38:43.543098+0000","last_undegraded":"2024-09-10T23:38:43.543098+0000","last_fullsized":"2024-09-10T23:38:43.543098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:31.390914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534317+0000","last_change":"2024-09-10T23:38:12.225417+0000","last_active":"2024-09-10T23:38:43.534317+0000","last_peered":"2024-09-10T23:38:43.534317+0000","last_clean":"2024-09-10T23:38:43.534317+0000","last_became_active":"2024-09-10T23:38:12.225129+0000","last_became_peered":"2024-09-10T23:38:12.225129+0000","last_unstale":"2024-09-10T23:38:43.534317+0000","last_undegraded":"2024-09-10T23:38:43.534317+0000","last_fullsized":"2024-09-10T23:38:43.534317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:42.935776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530992+0000","last_change":"2024-09-10T23:38:10.204942+0000","last_active":"2024-09-10T23:38:43.530992+0000","last_peered":"2024-09-10T23:38:43.530992+0000","last_clean":"2024-09-10T23:38:43.530992+0000","last_became_active":"2024-09-10T23:38:10.204568+0000","last_became_peered":"2024-09-10T23:38:10.204568+0000","last_unstale":"2024-09-10T23:38:43.530992+0000","last_undegraded":"2024-09-10T23:38:43.530992+0000","last_fullsized":"2024-09-10T23:38:43.530992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:00.608617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091532+0000","last_change":"2024-09-10T23:38:12.217411+0000","last_active":"2024-09-10T23:38:44.091532+0000","last_peered":"2024-09-10T23:38:44.091532+0000","last_clean":"2024-09-10T23:38:44.091532+0000","last_became_active":"2024-09-10T23:38:12.216998+0000","last_became_peered":"2024-09-10T23:38:12.216998+0000","last_unstale":"2024-09-10T23:38:44.091532+0000","last_undegraded":"2024-09-10T23:38:44.091532+0000","last_fullsized":"2024-09-10T23:38:44.091532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:12.852239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537386+0000","last_change":"2024-09-10T23:38:10.209596+0000","last_active":"2024-09-10T23:38:43.537386+0000","last_peered":"2024-09-10T23:38:43.537386+0000","last_clean":"2024-09-10T23:38:43.537386+0000","last_became_active":"2024-09-10T23:38:10.209348+0000","last_became_peered":"2024-09-10T23:38:10.209348+0000","last_unstale":"2024-09-10T23:38:43.537386+0000","last_undegraded":"2024-09-10T23:38:43.537386+0000","last_fullsized":"2024-09-10T23:38:43.537386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:30.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091318+0000","last_change":"2024-09-10T23:38:12.224071+0000","last_active":"2024-09-10T23:38:44.091318+0000","last_peered":"2024-09-10T23:38:44.091318+0000","last_clean":"2024-09-10T23:38:44.091318+0000","last_became_active":"2024-09-10T23:38:12.223773+0000","last_became_peered":"2024-09-10T23:38:12.223773+0000","last_unstale":"2024-09-10T23:38:44.091318+0000","last_undegraded":"2024-09-10T23:38:44.091318+0000","last_fullsized":"2024-09-10T23:38:44.091318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:43.412524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.771165+0000","last_change":"2024-09-10T23:38:10.300065+0000","last_active":"2024-09-10T23:38:43.771165+0000","last_peered":"2024-09-10T23:38:43.771165+0000","last_clean":"2024-09-10T23:38:43.771165+0000","last_became_active":"2024-09-10T23:38:10.299624+0000","last_became_peered":"2024-09-10T23:38:10.299624+0000","last_unstale":"2024-09-10T23:38:43.771165+0000","last_undegraded":"2024-09-10T23:38:43.771165+0000","last_fullsized":"2024-09-10T23:38:43.771165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:02.516651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091462+0000","last_change":"2024-09-10T23:38:12.222280+0000","last_active":"2024-09-10T23:38:44.091462+0000","last_peered":"2024-09-10T23:38:44.091462+0000","last_clean":"2024-09-10T23:38:44.091462+0000","last_became_active":"2024-09-10T23:38:12.221644+0000","last_became_peered":"2024-09-10T23:38:12.221644+0000","last_unstale":"2024-09-10T23:38:44.091462+0000","last_undegraded":"2024-09-10T23:38:44.091462+0000","last_fullsized":"2024-09-10T23:38:44.091462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.823629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":96,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091140+0000","last_change":"2024-09-10T23:36:58.824948+0000","last_active":"2024-09-10T23:38:44.091140+0000","last_peered":"2024-09-10T23:38:44.091140+0000","last_clean":"2024-09-10T23:38:44.091140+0000","last_became_active":"2024-09-10T23:36:58.819334+0000","last_became_peered":"2024-09-10T23:36:58.819334+0000","last_unstale":"2024-09-10T23:38:44.091140+0000","last_undegraded":"2024-09-10T23:38:44.091140+0000","last_fullsized":"2024-09-10T23:38:44.091140+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_clean_scrub_stamp":"2024-09-10T23:33:36.806080+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:52.996301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536800+0000","last_change":"2024-09-10T23:38:10.215224+0000","last_active":"2024-09-10T23:38:43.536800+0000","last_peered":"2024-09-10T23:38:43.536800+0000","last_clean":"2024-09-10T23:38:43.536800+0000","last_became_active":"2024-09-10T23:38:10.214795+0000","last_became_peered":"2024-09-10T23:38:10.214795+0000","last_unstale":"2024-09-10T23:38:43.536800+0000","last_undegraded":"2024-09-10T23:38:43.536800+0000","last_fullsized":"2024-09-10T23:38:43.536800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:26.599793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.539066+0000","last_change":"2024-09-10T23:38:43.538480+0000","last_active":"2024-09-10T23:38:43.539066+0000","last_peered":"2024-09-10T23:38:43.539066+0000","last_clean":"2024-09-10T23:38:43.539066+0000","last_became_active":"2024-09-10T23:38:43.538091+0000","last_became_peered":"2024-09-10T23:38:43.538091+0000","last_unstale":"2024-09-10T23:38:43.539066+0000","last_undegraded":"2024-09-10T23:38:43.539066+0000","last_fullsized":"2024-09-10T23:38:43.539066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:40.890114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091042+0000","last_change":"2024-09-10T23:38:10.212748+0000","last_active":"2024-09-10T23:38:44.091042+0000","last_peered":"2024-09-10T23:38:44.091042+0000","last_clean":"2024-09-10T23:38:44.091042+0000","last_became_active":"2024-09-10T23:38:10.212427+0000","last_became_peered":"2024-09-10T23:38:10.212427+0000","last_unstale":"2024-09-10T23:38:44.091042+0000","last_undegraded":"2024-09-10T23:38:44.091042+0000","last_fullsized":"2024-09-10T23:38:44.091042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:23.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530729+0000","last_change":"2024-09-10T23:38:12.225178+0000","last_active":"2024-09-10T23:38:43.530729+0000","last_peered":"2024-09-10T23:38:43.530729+0000","last_clean":"2024-09-10T23:38:43.530729+0000","last_became_active":"2024-09-10T23:38:12.224860+0000","last_became_peered":"2024-09-10T23:38:12.224860+0000","last_unstale":"2024-09-10T23:38:43.530729+0000","last_undegraded":"2024-09-10T23:38:43.530729+0000","last_fullsized":"2024-09-10T23:38:43.530729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:10.986009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":87,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:21.365870+0000","last_change":"2024-09-10T23:38:10.254625+0000","last_active":"2024-09-10T23:39:21.365870+0000","last_peered":"2024-09-10T23:39:21.365870+0000","last_clean":"2024-09-10T23:39:21.365870+0000","last_became_active":"2024-09-10T23:38:10.254259+0000","last_became_peered":"2024-09-10T23:38:10.254259+0000","last_unstale":"2024-09-10T23:39:21.365870+0000","last_undegraded":"2024-09-10T23:39:21.365870+0000","last_fullsized":"2024-09-10T23:39:21.365870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:46.371999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536676+0000","last_change":"2024-09-10T23:38:12.217168+0000","last_active":"2024-09-10T23:38:43.536676+0000","last_peered":"2024-09-10T23:38:43.536676+0000","last_clean":"2024-09-10T23:38:43.536676+0000","last_became_active":"2024-09-10T23:38:12.216814+0000","last_became_peered":"2024-09-10T23:38:12.216814+0000","last_unstale":"2024-09-10T23:38:43.536676+0000","last_undegraded":"2024-09-10T23:38:43.536676+0000","last_fullsized":"2024-09-10T23:38:43.536676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:41.494690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091293+0000","last_change":"2024-09-10T23:38:10.207456+0000","last_active":"2024-09-10T23:38:44.091293+0000","last_peered":"2024-09-10T23:38:44.091293+0000","last_clean":"2024-09-10T23:38:44.091293+0000","last_became_active":"2024-09-10T23:38:10.207079+0000","last_became_peered":"2024-09-10T23:38:10.207079+0000","last_unstale":"2024-09-10T23:38:44.091293+0000","last_undegraded":"2024-09-10T23:38:44.091293+0000","last_fullsized":"2024-09-10T23:38:44.091293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:14.631231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024598+0000","last_change":"2024-09-10T23:38:12.218306+0000","last_active":"2024-09-10T23:38:44.024598+0000","last_peered":"2024-09-10T23:38:44.024598+0000","last_clean":"2024-09-10T23:38:44.024598+0000","last_became_active":"2024-09-10T23:38:12.217981+0000","last_became_peered":"2024-09-10T23:38:12.217981+0000","last_unstale":"2024-09-10T23:38:44.024598+0000","last_undegraded":"2024-09-10T23:38:44.024598+0000","last_fullsized":"2024-09-10T23:38:44.024598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:31.745904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538159+0000","last_change":"2024-09-10T23:38:43.538061+0000","last_active":"2024-09-10T23:38:43.538159+0000","last_peered":"2024-09-10T23:38:43.538159+0000","last_clean":"2024-09-10T23:38:43.538159+0000","last_became_active":"2024-09-10T23:38:43.537582+0000","last_became_peered":"2024-09-10T23:38:43.537582+0000","last_unstale":"2024-09-10T23:38:43.538159+0000","last_undegraded":"2024-09-10T23:38:43.538159+0000","last_fullsized":"2024-09-10T23:38:43.538159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:15.083698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024718+0000","last_change":"2024-09-10T23:38:12.214507+0000","last_active":"2024-09-10T23:38:44.024718+0000","last_peered":"2024-09-10T23:38:44.024718+0000","last_clean":"2024-09-10T23:38:44.024718+0000","last_became_active":"2024-09-10T23:38:12.214160+0000","last_became_peered":"2024-09-10T23:38:12.214160+0000","last_unstale":"2024-09-10T23:38:44.024718+0000","last_undegraded":"2024-09-10T23:38:44.024718+0000","last_fullsized":"2024-09-10T23:38:44.024718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:04.623624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532455+0000","last_change":"2024-09-10T23:38:10.256941+0000","last_active":"2024-09-10T23:38:43.532455+0000","last_peered":"2024-09-10T23:38:43.532455+0000","last_clean":"2024-09-10T23:38:43.532455+0000","last_became_active":"2024-09-10T23:38:10.256553+0000","last_became_peered":"2024-09-10T23:38:10.256553+0000","last_unstale":"2024-09-10T23:38:43.532455+0000","last_undegraded":"2024-09-10T23:38:43.532455+0000","last_fullsized":"2024-09-10T23:38:43.532455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:30.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531145+0000","last_change":"2024-09-10T23:38:12.221246+0000","last_active":"2024-09-10T23:38:43.531145+0000","last_peered":"2024-09-10T23:38:43.531145+0000","last_clean":"2024-09-10T23:38:43.531145+0000","last_became_active":"2024-09-10T23:38:12.220912+0000","last_became_peered":"2024-09-10T23:38:12.220912+0000","last_unstale":"2024-09-10T23:38:43.531145+0000","last_undegraded":"2024-09-10T23:38:43.531145+0000","last_fullsized":"2024-09-10T23:38:43.531145+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:33.918289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534169+0000","last_change":"2024-09-10T23:38:10.210151+0000","last_active":"2024-09-10T23:38:43.534169+0000","last_peered":"2024-09-10T23:38:43.534169+0000","last_clean":"2024-09-10T23:38:43.534169+0000","last_became_active":"2024-09-10T23:38:10.209832+0000","last_became_peered":"2024-09-10T23:38:10.209832+0000","last_unstale":"2024-09-10T23:38:43.534169+0000","last_undegraded":"2024-09-10T23:38:43.534169+0000","last_fullsized":"2024-09-10T23:38:43.534169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:52.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965986+0000","last_change":"2024-09-10T23:38:12.218256+0000","last_active":"2024-09-10T23:38:43.965986+0000","last_peered":"2024-09-10T23:38:43.965986+0000","last_clean":"2024-09-10T23:38:43.965986+0000","last_became_active":"2024-09-10T23:38:12.217853+0000","last_became_peered":"2024-09-10T23:38:12.217853+0000","last_unstale":"2024-09-10T23:38:43.965986+0000","last_undegraded":"2024-09-10T23:38:43.965986+0000","last_fullsized":"2024-09-10T23:38:43.965986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537082+0000","last_change":"2024-09-10T23:38:10.300017+0000","last_active":"2024-09-10T23:38:43.537082+0000","last_peered":"2024-09-10T23:38:43.537082+0000","last_clean":"2024-09-10T23:38:43.537082+0000","last_became_active":"2024-09-10T23:38:10.299733+0000","last_became_peered":"2024-09-10T23:38:10.299733+0000","last_unstale":"2024-09-10T23:38:43.537082+0000","last_undegraded":"2024-09-10T23:38:43.537082+0000","last_fullsized":"2024-09-10T23:38:43.537082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.193043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533724+0000","last_change":"2024-09-10T23:38:12.212818+0000","last_active":"2024-09-10T23:38:43.533724+0000","last_peered":"2024-09-10T23:38:43.533724+0000","last_clean":"2024-09-10T23:38:43.533724+0000","last_became_active":"2024-09-10T23:38:12.212502+0000","last_became_peered":"2024-09-10T23:38:12.212502+0000","last_unstale":"2024-09-10T23:38:43.533724+0000","last_undegraded":"2024-09-10T23:38:43.533724+0000","last_fullsized":"2024-09-10T23:38:43.533724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:26.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531972+0000","last_change":"2024-09-10T23:38:10.256366+0000","last_active":"2024-09-10T23:38:43.531972+0000","last_peered":"2024-09-10T23:38:43.531972+0000","last_clean":"2024-09-10T23:38:43.531972+0000","last_became_active":"2024-09-10T23:38:10.256056+0000","last_became_peered":"2024-09-10T23:38:10.256056+0000","last_unstale":"2024-09-10T23:38:43.531972+0000","last_undegraded":"2024-09-10T23:38:43.531972+0000","last_fullsized":"2024-09-10T23:38:43.531972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:00.612373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531864+0000","last_change":"2024-09-10T23:38:12.224629+0000","last_active":"2024-09-10T23:38:43.531864+0000","last_peered":"2024-09-10T23:38:43.531864+0000","last_clean":"2024-09-10T23:38:43.531864+0000","last_became_active":"2024-09-10T23:38:12.224018+0000","last_became_peered":"2024-09-10T23:38:12.224018+0000","last_unstale":"2024-09-10T23:38:43.531864+0000","last_undegraded":"2024-09-10T23:38:43.531864+0000","last_fullsized":"2024-09-10T23:38:43.531864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:44.067489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965400+0000","last_change":"2024-09-10T23:38:10.203395+0000","last_active":"2024-09-10T23:38:43.965400+0000","last_peered":"2024-09-10T23:38:43.965400+0000","last_clean":"2024-09-10T23:38:43.965400+0000","last_became_active":"2024-09-10T23:38:10.203067+0000","last_became_peered":"2024-09-10T23:38:10.203067+0000","last_unstale":"2024-09-10T23:38:43.965400+0000","last_undegraded":"2024-09-10T23:38:43.965400+0000","last_fullsized":"2024-09-10T23:38:43.965400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.398322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534004+0000","last_change":"2024-09-10T23:38:12.223207+0000","last_active":"2024-09-10T23:38:43.534004+0000","last_peered":"2024-09-10T23:38:43.534004+0000","last_clean":"2024-09-10T23:38:43.534004+0000","last_became_active":"2024-09-10T23:38:12.222841+0000","last_became_peered":"2024-09-10T23:38:12.222841+0000","last_unstale":"2024-09-10T23:38:43.534004+0000","last_undegraded":"2024-09-10T23:38:43.534004+0000","last_fullsized":"2024-09-10T23:38:43.534004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:26.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770702+0000","last_change":"2024-09-10T23:38:10.210479+0000","last_active":"2024-09-10T23:38:43.770702+0000","last_peered":"2024-09-10T23:38:43.770702+0000","last_clean":"2024-09-10T23:38:43.770702+0000","last_became_active":"2024-09-10T23:38:10.210124+0000","last_became_peered":"2024-09-10T23:38:10.210124+0000","last_unstale":"2024-09-10T23:38:43.770702+0000","last_undegraded":"2024-09-10T23:38:43.770702+0000","last_fullsized":"2024-09-10T23:38:43.770702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:39.017091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965576+0000","last_change":"2024-09-10T23:38:12.214748+0000","last_active":"2024-09-10T23:38:43.965576+0000","last_peered":"2024-09-10T23:38:43.965576+0000","last_clean":"2024-09-10T23:38:43.965576+0000","last_became_active":"2024-09-10T23:38:12.214431+0000","last_became_peered":"2024-09-10T23:38:12.214431+0000","last_unstale":"2024-09-10T23:38:43.965576+0000","last_undegraded":"2024-09-10T23:38:43.965576+0000","last_fullsized":"2024-09-10T23:38:43.965576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:02.092876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532097+0000","last_change":"2024-09-10T23:38:10.214134+0000","last_active":"2024-09-10T23:38:43.532097+0000","last_peered":"2024-09-10T23:38:43.532097+0000","last_clean":"2024-09-10T23:38:43.532097+0000","last_became_active":"2024-09-10T23:38:10.213690+0000","last_became_peered":"2024-09-10T23:38:10.213690+0000","last_unstale":"2024-09-10T23:38:43.532097+0000","last_undegraded":"2024-09-10T23:38:43.532097+0000","last_fullsized":"2024-09-10T23:38:43.532097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:19.369755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091140+0000","last_change":"2024-09-10T23:38:12.218254+0000","last_active":"2024-09-10T23:38:44.091140+0000","last_peered":"2024-09-10T23:38:44.091140+0000","last_clean":"2024-09-10T23:38:44.091140+0000","last_became_active":"2024-09-10T23:38:12.217937+0000","last_became_peered":"2024-09-10T23:38:12.217937+0000","last_unstale":"2024-09-10T23:38:44.091140+0000","last_undegraded":"2024-09-10T23:38:44.091140+0000","last_fullsized":"2024-09-10T23:38:44.091140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:57.080088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538290+0000","last_change":"2024-09-10T23:38:43.537716+0000","last_active":"2024-09-10T23:38:43.538290+0000","last_peered":"2024-09-10T23:38:43.538290+0000","last_clean":"2024-09-10T23:38:43.538290+0000","last_became_active":"2024-09-10T23:38:43.537357+0000","last_became_peered":"2024-09-10T23:38:43.537357+0000","last_unstale":"2024-09-10T23:38:43.538290+0000","last_undegraded":"2024-09-10T23:38:43.538290+0000","last_fullsized":"2024-09-10T23:38:43.538290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:59.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532282+0000","last_change":"2024-09-10T23:38:10.215022+0000","last_active":"2024-09-10T23:38:43.532282+0000","last_peered":"2024-09-10T23:38:43.532282+0000","last_clean":"2024-09-10T23:38:43.532282+0000","last_became_active":"2024-09-10T23:38:10.214678+0000","last_became_peered":"2024-09-10T23:38:10.214678+0000","last_unstale":"2024-09-10T23:38:43.532282+0000","last_undegraded":"2024-09-10T23:38:43.532282+0000","last_fullsized":"2024-09-10T23:38:43.532282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:20.592052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531960+0000","last_change":"2024-09-10T23:38:12.230449+0000","last_active":"2024-09-10T23:38:43.531960+0000","last_peered":"2024-09-10T23:38:43.531960+0000","last_clean":"2024-09-10T23:38:43.531960+0000","last_became_active":"2024-09-10T23:38:12.228939+0000","last_became_peered":"2024-09-10T23:38:12.228939+0000","last_unstale":"2024-09-10T23:38:43.531960+0000","last_undegraded":"2024-09-10T23:38:43.531960+0000","last_fullsized":"2024-09-10T23:38:43.531960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:45.495207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532292+0000","last_change":"2024-09-10T23:38:10.209586+0000","last_active":"2024-09-10T23:38:43.532292+0000","last_peered":"2024-09-10T23:38:43.532292+0000","last_clean":"2024-09-10T23:38:43.532292+0000","last_became_active":"2024-09-10T23:38:10.209211+0000","last_became_peered":"2024-09-10T23:38:10.209211+0000","last_unstale":"2024-09-10T23:38:43.532292+0000","last_undegraded":"2024-09-10T23:38:43.532292+0000","last_fullsized":"2024-09-10T23:38:43.532292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:29.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533776+0000","last_change":"2024-09-10T23:38:12.219795+0000","last_active":"2024-09-10T23:38:43.533776+0000","last_peered":"2024-09-10T23:38:43.533776+0000","last_clean":"2024-09-10T23:38:43.533776+0000","last_became_active":"2024-09-10T23:38:12.219318+0000","last_became_peered":"2024-09-10T23:38:12.219318+0000","last_unstale":"2024-09-10T23:38:43.533776+0000","last_undegraded":"2024-09-10T23:38:43.533776+0000","last_fullsized":"2024-09-10T23:38:43.533776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:12.732264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965952+0000","last_change":"2024-09-10T23:38:10.255508+0000","last_active":"2024-09-10T23:38:43.965952+0000","last_peered":"2024-09-10T23:38:43.965952+0000","last_clean":"2024-09-10T23:38:43.965952+0000","last_became_active":"2024-09-10T23:38:10.255202+0000","last_became_peered":"2024-09-10T23:38:10.255202+0000","last_unstale":"2024-09-10T23:38:43.965952+0000","last_undegraded":"2024-09-10T23:38:43.965952+0000","last_fullsized":"2024-09-10T23:38:43.965952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:09.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965838+0000","last_change":"2024-09-10T23:38:12.222345+0000","last_active":"2024-09-10T23:38:43.965838+0000","last_peered":"2024-09-10T23:38:43.965838+0000","last_clean":"2024-09-10T23:38:43.965838+0000","last_became_active":"2024-09-10T23:38:12.220593+0000","last_became_peered":"2024-09-10T23:38:12.220593+0000","last_unstale":"2024-09-10T23:38:43.965838+0000","last_undegraded":"2024-09-10T23:38:43.965838+0000","last_fullsized":"2024-09-10T23:38:43.965838+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:00.909046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534353+0000","last_change":"2024-09-10T23:38:10.210071+0000","last_active":"2024-09-10T23:38:43.534353+0000","last_peered":"2024-09-10T23:38:43.534353+0000","last_clean":"2024-09-10T23:38:43.534353+0000","last_became_active":"2024-09-10T23:38:10.209778+0000","last_became_peered":"2024-09-10T23:38:10.209778+0000","last_unstale":"2024-09-10T23:38:43.534353+0000","last_undegraded":"2024-09-10T23:38:43.534353+0000","last_fullsized":"2024-09-10T23:38:43.534353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:14.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64739,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":368,"num_read_kb":251,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":194217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286063,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":417996,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":987136,"data_stored":1070193,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103206,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":851968,"data_stored":418210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":418108,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":1010451,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626484,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":417599,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":1009744,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":418427,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":417910,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":925696,"data_stored":479480,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":477739,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":418870,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:39:23.209 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:39:23.475 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:23.723 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.723 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.723 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:23 smithi016 ceph-mon[30855]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:23.724 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:23 smithi016 ceph-mon[30855]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:39:23.724 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:39:23.724 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:39:23.724 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:23 smithi071 ceph-mon[35018]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:23.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:23 smithi071 ceph-mon[35018]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:39:23.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:39:23.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:39:23.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:23 smithi066 ceph-mon[34761]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:23.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:23 smithi066 ceph-mon[34761]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:39:23.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:39:23.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:39:23.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:39:23.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 -- 172.21.15.16:0/3372590807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f41087f0 msgr2=0x7f20f4108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 --2- 172.21.15.16:0/3372590807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f41087f0 0x7f20f4108c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009900 tx=0x7f20e402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 -- 172.21.15.16:0/3372590807 shutdown_connections 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 --2- 172.21.15.16:0/3372590807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20f4109170 0x7f20f410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 --2- 172.21.15.16:0/3372590807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f41087f0 0x7f20f4108c30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 --2- 172.21.15.16:0/3372590807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20f4102de0 0x7f20f41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 -- 172.21.15.16:0/3372590807 >> 172.21.15.16:0/3372590807 conn(0x7f20f40fe830 msgr2=0x7f20f4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 -- 172.21.15.16:0/3372590807 shutdown_connections 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.962+0000 7f20fb833640 1 -- 172.21.15.16:0/3372590807 wait complete. 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 Processor -- start 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 -- start start 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f4102de0 0x7f20f4199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:23.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20f41087f0 0x7f20f4199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20f4109170 0x7f20f419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4112dc0 con 0x7f20f4102de0 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4112c40 con 0x7f20f41087f0 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20fb833640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4112f40 con 0x7f20f4109170 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f4102de0 0x7f20f4199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f4102de0 0x7f20f4199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46264/0 (socket says 172.21.15.16:46264) 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 -- 172.21.15.16:0/2241078676 learned_addr learned my addr 172.21.15.16:0/2241078676 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f8dce640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20f41087f0 0x7f20f4199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f9dd0640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20f4109170 0x7f20f419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 -- 172.21.15.16:0/2241078676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20f4109170 msgr2=0x7f20f419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20f4109170 0x7f20f419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 -- 172.21.15.16:0/2241078676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20f41087f0 msgr2=0x7f20f4199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:23.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20f41087f0 0x7f20f4199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 -- 172.21.15.16:0/2241078676 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f419f300 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.963+0000 7f20f95cf640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f4102de0 0x7f20f4199250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20f000c920 tx=0x7f20f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.964+0000 7f20ea7fc640 1 -- 172.21.15.16:0/2241078676 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0007c70 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.964+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f419f5f0 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.964+0000 7f20ea7fc640 1 -- 172.21.15.16:0/2241078676 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20f0007e10 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.964+0000 7f20ea7fc640 1 -- 172.21.15.16:0/2241078676 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0018820 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.964+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f41a5e80 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.965+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f41031c0 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.966+0000 7f20ea7fc640 1 -- 172.21.15.16:0/2241078676 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f20f000f450 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.967+0000 7f20ea7fc640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f20e00b53c0 0x7f20e00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.967+0000 7f20f8dce640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f20e00b53c0 0x7f20e00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.967+0000 7f20ea7fc640 1 -- 172.21.15.16:0/2241078676 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f20f00e61b0 con 0x7f20f4102de0 2024-09-10T23:39:23.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.968+0000 7f20f8dce640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f20e00b53c0 0x7f20e00b7880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20e4031440 tx=0x7f20e4005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:23.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:23.970+0000 7f20ea7fc640 1 -- 172.21.15.16:0/2241078676 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f20f0014030 con 0x7f20f4102de0 2024-09-10T23:39:24.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.154+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20f4063590 con 0x7f20e00b53c0 2024-09-10T23:39:24.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.158+0000 7f20ea7fc640 1 -- 172.21.15.16:0/2241078676 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258955 (secure 0 0 0) 0x7f20f4063590 con 0x7f20e00b53c0 2024-09-10T23:39:24.162 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:24.163 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-10T23:39:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f20e00b53c0 msgr2=0x7f20e00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f20e00b53c0 0x7f20e00b7880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20e4031440 tx=0x7f20e4005b50 comp rx=0 tx=0).stop 2024-09-10T23:39:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f4102de0 msgr2=0x7f20f4199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f4102de0 0x7f20f4199250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20f000c920 tx=0x7f20f000cde0 comp rx=0 tx=0).stop 2024-09-10T23:39:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 shutdown_connections 2024-09-10T23:39:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20f4109170 0x7f20f419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f20e00b53c0 0x7f20e00b7880 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20f41087f0 0x7f20f4199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 --2- 172.21.15.16:0/2241078676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f4102de0 0x7f20f4199250 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 >> 172.21.15.16:0/2241078676 conn(0x7f20f40fe830 msgr2=0x7f20f4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 shutdown_connections 2024-09-10T23:39:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:24.161+0000 7f20fb833640 1 -- 172.21.15.16:0/2241078676 wait complete. 2024-09-10T23:39:24.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:24 smithi016 ceph-mon[30855]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:39:24.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:24 smithi071 ceph-mon[35018]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:39:24.799 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-10T23:39:22.436794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655341,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":449,"num_read_kb":320,"num_write":286,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380456,"kb_used_data":10320,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561368,"statfs":{"total":1151940427776,"available":1151550840832,"internally_reserved":0,"allocated":10567680,"data_stored":6974727,"data_compressed":178827,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003401"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.535000+0000","last_change":"2024-09-10T23:38:12.217637+0000","last_active":"2024-09-10T23:38:43.535000+0000","last_peered":"2024-09-10T23:38:43.535000+0000","last_clean":"2024-09-10T23:38:43.535000+0000","last_became_active":"2024-09-10T23:38:12.217260+0000","last_became_peered":"2024-09-10T23:38:12.217260+0000","last_unstale":"2024-09-10T23:38:43.535000+0000","last_undegraded":"2024-09-10T23:38:43.535000+0000","last_fullsized":"2024-09-10T23:38:43.535000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.774575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533626+0000","last_change":"2024-09-10T23:38:12.217114+0000","last_active":"2024-09-10T23:38:43.533626+0000","last_peered":"2024-09-10T23:38:43.533626+0000","last_clean":"2024-09-10T23:38:43.533626+0000","last_became_active":"2024-09-10T23:38:12.216836+0000","last_became_peered":"2024-09-10T23:38:12.216836+0000","last_unstale":"2024-09-10T23:38:43.533626+0000","last_undegraded":"2024-09-10T23:38:43.533626+0000","last_fullsized":"2024-09-10T23:38:43.533626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:55.023668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533086+0000","last_change":"2024-09-10T23:38:12.219046+0000","last_active":"2024-09-10T23:38:43.533086+0000","last_peered":"2024-09-10T23:38:43.533086+0000","last_clean":"2024-09-10T23:38:43.533086+0000","last_became_active":"2024-09-10T23:38:12.218348+0000","last_became_peered":"2024-09-10T23:38:12.218348+0000","last_unstale":"2024-09-10T23:38:43.533086+0000","last_undegraded":"2024-09-10T23:38:43.533086+0000","last_fullsized":"2024-09-10T23:38:43.533086+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:07.419364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536765+0000","last_change":"2024-09-10T23:38:12.219211+0000","last_active":"2024-09-10T23:38:43.536765+0000","last_peered":"2024-09-10T23:38:43.536765+0000","last_clean":"2024-09-10T23:38:43.536765+0000","last_became_active":"2024-09-10T23:38:12.213452+0000","last_became_peered":"2024-09-10T23:38:12.213452+0000","last_unstale":"2024-09-10T23:38:43.536765+0000","last_undegraded":"2024-09-10T23:38:43.536765+0000","last_fullsized":"2024-09-10T23:38:43.536765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:59.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531947+0000","last_change":"2024-09-10T23:38:12.213636+0000","last_active":"2024-09-10T23:38:43.531947+0000","last_peered":"2024-09-10T23:38:43.531947+0000","last_clean":"2024-09-10T23:38:43.531947+0000","last_became_active":"2024-09-10T23:38:12.213309+0000","last_became_peered":"2024-09-10T23:38:12.213309+0000","last_unstale":"2024-09-10T23:38:43.531947+0000","last_undegraded":"2024-09-10T23:38:43.531947+0000","last_fullsized":"2024-09-10T23:38:43.531947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:34.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024439+0000","last_change":"2024-09-10T23:38:12.215995+0000","last_active":"2024-09-10T23:38:44.024439+0000","last_peered":"2024-09-10T23:38:44.024439+0000","last_clean":"2024-09-10T23:38:44.024439+0000","last_became_active":"2024-09-10T23:38:12.215601+0000","last_became_peered":"2024-09-10T23:38:12.215601+0000","last_unstale":"2024-09-10T23:38:44.024439+0000","last_undegraded":"2024-09-10T23:38:44.024439+0000","last_fullsized":"2024-09-10T23:38:44.024439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:24.770551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.090994+0000","last_change":"2024-09-10T23:38:12.226337+0000","last_active":"2024-09-10T23:38:44.090994+0000","last_peered":"2024-09-10T23:38:44.090994+0000","last_clean":"2024-09-10T23:38:44.090994+0000","last_became_active":"2024-09-10T23:38:12.225953+0000","last_became_peered":"2024-09-10T23:38:12.225953+0000","last_unstale":"2024-09-10T23:38:44.090994+0000","last_undegraded":"2024-09-10T23:38:44.090994+0000","last_fullsized":"2024-09-10T23:38:44.090994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:27.044867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965227+0000","last_change":"2024-09-10T23:38:12.219682+0000","last_active":"2024-09-10T23:38:43.965227+0000","last_peered":"2024-09-10T23:38:43.965227+0000","last_clean":"2024-09-10T23:38:43.965227+0000","last_became_active":"2024-09-10T23:38:12.218596+0000","last_became_peered":"2024-09-10T23:38:12.218596+0000","last_unstale":"2024-09-10T23:38:43.965227+0000","last_undegraded":"2024-09-10T23:38:43.965227+0000","last_fullsized":"2024-09-10T23:38:43.965227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:33.011117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532547+0000","last_change":"2024-09-10T23:38:12.223114+0000","last_active":"2024-09-10T23:38:43.532547+0000","last_peered":"2024-09-10T23:38:43.532547+0000","last_clean":"2024-09-10T23:38:43.532547+0000","last_became_active":"2024-09-10T23:38:12.222748+0000","last_became_peered":"2024-09-10T23:38:12.222748+0000","last_unstale":"2024-09-10T23:38:43.532547+0000","last_undegraded":"2024-09-10T23:38:43.532547+0000","last_fullsized":"2024-09-10T23:38:43.532547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:38.384821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024856+0000","last_change":"2024-09-10T23:38:12.225061+0000","last_active":"2024-09-10T23:38:44.024856+0000","last_peered":"2024-09-10T23:38:44.024856+0000","last_clean":"2024-09-10T23:38:44.024856+0000","last_became_active":"2024-09-10T23:38:12.224730+0000","last_became_peered":"2024-09-10T23:38:12.224730+0000","last_unstale":"2024-09-10T23:38:44.024856+0000","last_undegraded":"2024-09-10T23:38:44.024856+0000","last_fullsized":"2024-09-10T23:38:44.024856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:40.343294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091365+0000","last_change":"2024-09-10T23:38:12.219920+0000","last_active":"2024-09-10T23:38:44.091365+0000","last_peered":"2024-09-10T23:38:44.091365+0000","last_clean":"2024-09-10T23:38:44.091365+0000","last_became_active":"2024-09-10T23:38:12.219517+0000","last_became_peered":"2024-09-10T23:38:12.219517+0000","last_unstale":"2024-09-10T23:38:44.091365+0000","last_undegraded":"2024-09-10T23:38:44.091365+0000","last_fullsized":"2024-09-10T23:38:44.091365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:58.686977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536928+0000","last_change":"2024-09-10T23:38:12.219740+0000","last_active":"2024-09-10T23:38:43.536928+0000","last_peered":"2024-09-10T23:38:43.536928+0000","last_clean":"2024-09-10T23:38:43.536928+0000","last_became_active":"2024-09-10T23:38:12.215497+0000","last_became_peered":"2024-09-10T23:38:12.215497+0000","last_unstale":"2024-09-10T23:38:43.536928+0000","last_undegraded":"2024-09-10T23:38:43.536928+0000","last_fullsized":"2024-09-10T23:38:43.536928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:06.503836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530968+0000","last_change":"2024-09-10T23:38:12.217066+0000","last_active":"2024-09-10T23:38:43.530968+0000","last_peered":"2024-09-10T23:38:43.530968+0000","last_clean":"2024-09-10T23:38:43.530968+0000","last_became_active":"2024-09-10T23:38:12.216758+0000","last_became_peered":"2024-09-10T23:38:12.216758+0000","last_unstale":"2024-09-10T23:38:43.530968+0000","last_undegraded":"2024-09-10T23:38:43.530968+0000","last_fullsized":"2024-09-10T23:38:43.530968+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:53.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533299+0000","last_change":"2024-09-10T23:38:12.216584+0000","last_active":"2024-09-10T23:38:43.533299+0000","last_peered":"2024-09-10T23:38:43.533299+0000","last_clean":"2024-09-10T23:38:43.533299+0000","last_became_active":"2024-09-10T23:38:12.216296+0000","last_became_peered":"2024-09-10T23:38:12.216296+0000","last_unstale":"2024-09-10T23:38:43.533299+0000","last_undegraded":"2024-09-10T23:38:43.533299+0000","last_fullsized":"2024-09-10T23:38:43.533299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:11.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.772333+0000","last_change":"2024-09-10T23:38:43.772225+0000","last_active":"2024-09-10T23:38:43.772333+0000","last_peered":"2024-09-10T23:38:43.772333+0000","last_clean":"2024-09-10T23:38:43.772333+0000","last_became_active":"2024-09-10T23:38:43.771855+0000","last_became_peered":"2024-09-10T23:38:43.771855+0000","last_unstale":"2024-09-10T23:38:43.772333+0000","last_undegraded":"2024-09-10T23:38:43.772333+0000","last_fullsized":"2024-09-10T23:38:43.772333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:14.454340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531869+0000","last_change":"2024-09-10T23:38:12.229957+0000","last_active":"2024-09-10T23:38:43.531869+0000","last_peered":"2024-09-10T23:38:43.531869+0000","last_clean":"2024-09-10T23:38:43.531869+0000","last_became_active":"2024-09-10T23:38:12.229297+0000","last_became_peered":"2024-09-10T23:38:12.229297+0000","last_unstale":"2024-09-10T23:38:43.531869+0000","last_undegraded":"2024-09-10T23:38:43.531869+0000","last_fullsized":"2024-09-10T23:38:43.531869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:54.119455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.535230+0000","last_change":"2024-09-10T23:38:12.218345+0000","last_active":"2024-09-10T23:38:43.535230+0000","last_peered":"2024-09-10T23:38:43.535230+0000","last_clean":"2024-09-10T23:38:43.535230+0000","last_became_active":"2024-09-10T23:38:12.218060+0000","last_became_peered":"2024-09-10T23:38:12.218060+0000","last_unstale":"2024-09-10T23:38:43.535230+0000","last_undegraded":"2024-09-10T23:38:43.535230+0000","last_fullsized":"2024-09-10T23:38:43.535230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.912757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534017+0000","last_change":"2024-09-10T23:38:12.215025+0000","last_active":"2024-09-10T23:38:43.534017+0000","last_peered":"2024-09-10T23:38:43.534017+0000","last_clean":"2024-09-10T23:38:43.534017+0000","last_became_active":"2024-09-10T23:38:12.214709+0000","last_became_peered":"2024-09-10T23:38:12.214709+0000","last_unstale":"2024-09-10T23:38:43.534017+0000","last_undegraded":"2024-09-10T23:38:43.534017+0000","last_fullsized":"2024-09-10T23:38:43.534017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:00.925426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770954+0000","last_change":"2024-09-10T23:38:12.215536+0000","last_active":"2024-09-10T23:38:43.770954+0000","last_peered":"2024-09-10T23:38:43.770954+0000","last_clean":"2024-09-10T23:38:43.770954+0000","last_became_active":"2024-09-10T23:38:12.214991+0000","last_became_peered":"2024-09-10T23:38:12.214991+0000","last_unstale":"2024-09-10T23:38:43.770954+0000","last_undegraded":"2024-09-10T23:38:43.770954+0000","last_fullsized":"2024-09-10T23:38:43.770954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.059276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534090+0000","last_change":"2024-09-10T23:38:12.224919+0000","last_active":"2024-09-10T23:38:43.534090+0000","last_peered":"2024-09-10T23:38:43.534090+0000","last_clean":"2024-09-10T23:38:43.534090+0000","last_became_active":"2024-09-10T23:38:12.224559+0000","last_became_peered":"2024-09-10T23:38:12.224559+0000","last_unstale":"2024-09-10T23:38:43.534090+0000","last_undegraded":"2024-09-10T23:38:43.534090+0000","last_fullsized":"2024-09-10T23:38:43.534090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:23.373211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531089+0000","last_change":"2024-09-10T23:38:12.216995+0000","last_active":"2024-09-10T23:38:43.531089+0000","last_peered":"2024-09-10T23:38:43.531089+0000","last_clean":"2024-09-10T23:38:43.531089+0000","last_became_active":"2024-09-10T23:38:12.216681+0000","last_became_peered":"2024-09-10T23:38:12.216681+0000","last_unstale":"2024-09-10T23:38:43.531089+0000","last_undegraded":"2024-09-10T23:38:43.531089+0000","last_fullsized":"2024-09-10T23:38:43.531089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:37.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532257+0000","last_change":"2024-09-10T23:38:12.221618+0000","last_active":"2024-09-10T23:38:43.532257+0000","last_peered":"2024-09-10T23:38:43.532257+0000","last_clean":"2024-09-10T23:38:43.532257+0000","last_became_active":"2024-09-10T23:38:12.219352+0000","last_became_peered":"2024-09-10T23:38:12.219352+0000","last_unstale":"2024-09-10T23:38:43.532257+0000","last_undegraded":"2024-09-10T23:38:43.532257+0000","last_fullsized":"2024-09-10T23:38:43.532257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:48.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965268+0000","last_change":"2024-09-10T23:38:12.221530+0000","last_active":"2024-09-10T23:38:43.965268+0000","last_peered":"2024-09-10T23:38:43.965268+0000","last_clean":"2024-09-10T23:38:43.965268+0000","last_became_active":"2024-09-10T23:38:12.221024+0000","last_became_peered":"2024-09-10T23:38:12.221024+0000","last_unstale":"2024-09-10T23:38:43.965268+0000","last_undegraded":"2024-09-10T23:38:43.965268+0000","last_fullsized":"2024-09-10T23:38:43.965268+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536551+0000","last_change":"2024-09-10T23:38:12.219990+0000","last_active":"2024-09-10T23:38:43.536551+0000","last_peered":"2024-09-10T23:38:43.536551+0000","last_clean":"2024-09-10T23:38:43.536551+0000","last_became_active":"2024-09-10T23:38:12.219560+0000","last_became_peered":"2024-09-10T23:38:12.219560+0000","last_unstale":"2024-09-10T23:38:43.536551+0000","last_undegraded":"2024-09-10T23:38:43.536551+0000","last_fullsized":"2024-09-10T23:38:43.536551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:28.112467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965921+0000","last_change":"2024-09-10T23:38:12.225753+0000","last_active":"2024-09-10T23:38:43.965921+0000","last_peered":"2024-09-10T23:38:43.965921+0000","last_clean":"2024-09-10T23:38:43.965921+0000","last_became_active":"2024-09-10T23:38:12.225450+0000","last_became_peered":"2024-09-10T23:38:12.225450+0000","last_unstale":"2024-09-10T23:38:43.965921+0000","last_undegraded":"2024-09-10T23:38:43.965921+0000","last_fullsized":"2024-09-10T23:38:43.965921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:23.478611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.771150+0000","last_change":"2024-09-10T23:38:12.216917+0000","last_active":"2024-09-10T23:38:43.771150+0000","last_peered":"2024-09-10T23:38:43.771150+0000","last_clean":"2024-09-10T23:38:43.771150+0000","last_became_active":"2024-09-10T23:38:12.216528+0000","last_became_peered":"2024-09-10T23:38:12.216528+0000","last_unstale":"2024-09-10T23:38:43.771150+0000","last_undegraded":"2024-09-10T23:38:43.771150+0000","last_fullsized":"2024-09-10T23:38:43.771150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:03.902221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534170+0000","last_change":"2024-09-10T23:38:12.219372+0000","last_active":"2024-09-10T23:38:43.534170+0000","last_peered":"2024-09-10T23:38:43.534170+0000","last_clean":"2024-09-10T23:38:43.534170+0000","last_became_active":"2024-09-10T23:38:12.219072+0000","last_became_peered":"2024-09-10T23:38:12.219072+0000","last_unstale":"2024-09-10T23:38:43.534170+0000","last_undegraded":"2024-09-10T23:38:43.534170+0000","last_fullsized":"2024-09-10T23:38:43.534170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:07.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531045+0000","last_change":"2024-09-10T23:38:12.224716+0000","last_active":"2024-09-10T23:38:43.531045+0000","last_peered":"2024-09-10T23:38:43.531045+0000","last_clean":"2024-09-10T23:38:43.531045+0000","last_became_active":"2024-09-10T23:38:12.224393+0000","last_became_peered":"2024-09-10T23:38:12.224393+0000","last_unstale":"2024-09-10T23:38:43.531045+0000","last_undegraded":"2024-09-10T23:38:43.531045+0000","last_fullsized":"2024-09-10T23:38:43.531045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.995098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.092585+0000","last_change":"2024-09-10T23:38:44.092446+0000","last_active":"2024-09-10T23:38:44.092585+0000","last_peered":"2024-09-10T23:38:44.092585+0000","last_clean":"2024-09-10T23:38:44.092585+0000","last_became_active":"2024-09-10T23:38:44.092027+0000","last_became_peered":"2024-09-10T23:38:44.092027+0000","last_unstale":"2024-09-10T23:38:44.092585+0000","last_undegraded":"2024-09-10T23:38:44.092585+0000","last_fullsized":"2024-09-10T23:38:44.092585+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.804237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770652+0000","last_change":"2024-09-10T23:38:12.214278+0000","last_active":"2024-09-10T23:38:43.770652+0000","last_peered":"2024-09-10T23:38:43.770652+0000","last_clean":"2024-09-10T23:38:43.770652+0000","last_became_active":"2024-09-10T23:38:12.212079+0000","last_became_peered":"2024-09-10T23:38:12.212079+0000","last_unstale":"2024-09-10T23:38:43.770652+0000","last_undegraded":"2024-09-10T23:38:43.770652+0000","last_fullsized":"2024-09-10T23:38:43.770652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:42.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770801+0000","last_change":"2024-09-10T23:38:12.214703+0000","last_active":"2024-09-10T23:38:43.770801+0000","last_peered":"2024-09-10T23:38:43.770801+0000","last_clean":"2024-09-10T23:38:43.770801+0000","last_became_active":"2024-09-10T23:38:12.214353+0000","last_became_peered":"2024-09-10T23:38:12.214353+0000","last_unstale":"2024-09-10T23:38:43.770801+0000","last_undegraded":"2024-09-10T23:38:43.770801+0000","last_fullsized":"2024-09-10T23:38:43.770801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.004904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533954+0000","last_change":"2024-09-10T23:38:12.223462+0000","last_active":"2024-09-10T23:38:43.533954+0000","last_peered":"2024-09-10T23:38:43.533954+0000","last_clean":"2024-09-10T23:38:43.533954+0000","last_became_active":"2024-09-10T23:38:12.223159+0000","last_became_peered":"2024-09-10T23:38:12.223159+0000","last_unstale":"2024-09-10T23:38:43.533954+0000","last_undegraded":"2024-09-10T23:38:43.533954+0000","last_fullsized":"2024-09-10T23:38:43.533954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.587560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531872+0000","last_change":"2024-09-10T23:38:12.213290+0000","last_active":"2024-09-10T23:38:43.531872+0000","last_peered":"2024-09-10T23:38:43.531872+0000","last_clean":"2024-09-10T23:38:43.531872+0000","last_became_active":"2024-09-10T23:38:12.212999+0000","last_became_peered":"2024-09-10T23:38:12.212999+0000","last_unstale":"2024-09-10T23:38:43.531872+0000","last_undegraded":"2024-09-10T23:38:43.531872+0000","last_fullsized":"2024-09-10T23:38:43.531872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:54.448436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":91,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:20.364666+0000","last_change":"2024-09-10T23:38:10.210483+0000","last_active":"2024-09-10T23:39:20.364666+0000","last_peered":"2024-09-10T23:39:20.364666+0000","last_clean":"2024-09-10T23:39:20.364666+0000","last_became_active":"2024-09-10T23:38:10.210108+0000","last_became_peered":"2024-09-10T23:38:10.210108+0000","last_unstale":"2024-09-10T23:39:20.364666+0000","last_undegraded":"2024-09-10T23:39:20.364666+0000","last_fullsized":"2024-09-10T23:39:20.364666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:33.370496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.967231+0000","last_change":"2024-09-10T23:38:43.966800+0000","last_active":"2024-09-10T23:38:43.967231+0000","last_peered":"2024-09-10T23:38:43.967231+0000","last_clean":"2024-09-10T23:38:43.967231+0000","last_became_active":"2024-09-10T23:38:43.966274+0000","last_became_peered":"2024-09-10T23:38:43.966274+0000","last_unstale":"2024-09-10T23:38:43.967231+0000","last_undegraded":"2024-09-10T23:38:43.967231+0000","last_fullsized":"2024-09-10T23:38:43.967231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:02.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024529+0000","last_change":"2024-09-10T23:38:10.210875+0000","last_active":"2024-09-10T23:38:44.024529+0000","last_peered":"2024-09-10T23:38:44.024529+0000","last_clean":"2024-09-10T23:38:44.024529+0000","last_became_active":"2024-09-10T23:38:10.209254+0000","last_became_peered":"2024-09-10T23:38:10.209254+0000","last_unstale":"2024-09-10T23:38:44.024529+0000","last_undegraded":"2024-09-10T23:38:44.024529+0000","last_fullsized":"2024-09-10T23:38:44.024529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:21.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530747+0000","last_change":"2024-09-10T23:38:10.213483+0000","last_active":"2024-09-10T23:38:43.530747+0000","last_peered":"2024-09-10T23:38:43.530747+0000","last_clean":"2024-09-10T23:38:43.530747+0000","last_became_active":"2024-09-10T23:38:10.213109+0000","last_became_peered":"2024-09-10T23:38:10.213109+0000","last_unstale":"2024-09-10T23:38:43.530747+0000","last_undegraded":"2024-09-10T23:38:43.530747+0000","last_fullsized":"2024-09-10T23:38:43.530747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:03.563548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965299+0000","last_change":"2024-09-10T23:38:12.217136+0000","last_active":"2024-09-10T23:38:43.965299+0000","last_peered":"2024-09-10T23:38:43.965299+0000","last_clean":"2024-09-10T23:38:43.965299+0000","last_became_active":"2024-09-10T23:38:12.216813+0000","last_became_peered":"2024-09-10T23:38:12.216813+0000","last_unstale":"2024-09-10T23:38:43.965299+0000","last_undegraded":"2024-09-10T23:38:43.965299+0000","last_fullsized":"2024-09-10T23:38:43.965299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:26.184575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536951+0000","last_change":"2024-09-10T23:38:10.209109+0000","last_active":"2024-09-10T23:38:43.536951+0000","last_peered":"2024-09-10T23:38:43.536951+0000","last_clean":"2024-09-10T23:38:43.536951+0000","last_became_active":"2024-09-10T23:38:10.208450+0000","last_became_peered":"2024-09-10T23:38:10.208450+0000","last_unstale":"2024-09-10T23:38:43.536951+0000","last_undegraded":"2024-09-10T23:38:43.536951+0000","last_fullsized":"2024-09-10T23:38:43.536951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:29.453119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534085+0000","last_change":"2024-09-10T23:38:12.213755+0000","last_active":"2024-09-10T23:38:43.534085+0000","last_peered":"2024-09-10T23:38:43.534085+0000","last_clean":"2024-09-10T23:38:43.534085+0000","last_became_active":"2024-09-10T23:38:12.213454+0000","last_became_peered":"2024-09-10T23:38:12.213454+0000","last_unstale":"2024-09-10T23:38:43.534085+0000","last_undegraded":"2024-09-10T23:38:43.534085+0000","last_fullsized":"2024-09-10T23:38:43.534085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.958053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:16.358272+0000","last_change":"2024-09-10T23:38:10.209908+0000","last_active":"2024-09-10T23:39:16.358272+0000","last_peered":"2024-09-10T23:39:16.358272+0000","last_clean":"2024-09-10T23:39:16.358272+0000","last_became_active":"2024-09-10T23:38:10.208867+0000","last_became_peered":"2024-09-10T23:38:10.208867+0000","last_unstale":"2024-09-10T23:39:16.358272+0000","last_undegraded":"2024-09-10T23:39:16.358272+0000","last_fullsized":"2024-09-10T23:39:16.358272+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:09.239123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532347+0000","last_change":"2024-09-10T23:38:12.224353+0000","last_active":"2024-09-10T23:38:43.532347+0000","last_peered":"2024-09-10T23:38:43.532347+0000","last_clean":"2024-09-10T23:38:43.532347+0000","last_became_active":"2024-09-10T23:38:12.223997+0000","last_became_peered":"2024-09-10T23:38:12.223997+0000","last_unstale":"2024-09-10T23:38:43.532347+0000","last_undegraded":"2024-09-10T23:38:43.532347+0000","last_fullsized":"2024-09-10T23:38:43.532347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:53.092794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091493+0000","last_change":"2024-09-10T23:38:10.207978+0000","last_active":"2024-09-10T23:38:44.091493+0000","last_peered":"2024-09-10T23:38:44.091493+0000","last_clean":"2024-09-10T23:38:44.091493+0000","last_became_active":"2024-09-10T23:38:10.207566+0000","last_became_peered":"2024-09-10T23:38:10.207566+0000","last_unstale":"2024-09-10T23:38:44.091493+0000","last_undegraded":"2024-09-10T23:38:44.091493+0000","last_fullsized":"2024-09-10T23:38:44.091493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:00.715005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538710+0000","last_change":"2024-09-10T23:38:43.538619+0000","last_active":"2024-09-10T23:38:43.538710+0000","last_peered":"2024-09-10T23:38:43.538710+0000","last_clean":"2024-09-10T23:38:43.538710+0000","last_became_active":"2024-09-10T23:38:43.537752+0000","last_became_peered":"2024-09-10T23:38:43.537752+0000","last_unstale":"2024-09-10T23:38:43.538710+0000","last_undegraded":"2024-09-10T23:38:43.538710+0000","last_fullsized":"2024-09-10T23:38:43.538710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:08.399537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537358+0000","last_change":"2024-09-10T23:38:10.257254+0000","last_active":"2024-09-10T23:38:43.537358+0000","last_peered":"2024-09-10T23:38:43.537358+0000","last_clean":"2024-09-10T23:38:43.537358+0000","last_became_active":"2024-09-10T23:38:10.256791+0000","last_became_peered":"2024-09-10T23:38:10.256791+0000","last_unstale":"2024-09-10T23:38:43.537358+0000","last_undegraded":"2024-09-10T23:38:43.537358+0000","last_fullsized":"2024-09-10T23:38:43.537358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:35.931873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532022+0000","last_change":"2024-09-10T23:38:12.229295+0000","last_active":"2024-09-10T23:38:43.532022+0000","last_peered":"2024-09-10T23:38:43.532022+0000","last_clean":"2024-09-10T23:38:43.532022+0000","last_became_active":"2024-09-10T23:38:12.228846+0000","last_became_peered":"2024-09-10T23:38:12.228846+0000","last_unstale":"2024-09-10T23:38:43.532022+0000","last_undegraded":"2024-09-10T23:38:43.532022+0000","last_fullsized":"2024-09-10T23:38:43.532022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:15.383624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":167,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:17.359814+0000","last_change":"2024-09-10T23:38:10.203362+0000","last_active":"2024-09-10T23:39:17.359814+0000","last_peered":"2024-09-10T23:39:17.359814+0000","last_clean":"2024-09-10T23:39:17.359814+0000","last_became_active":"2024-09-10T23:38:10.202961+0000","last_became_peered":"2024-09-10T23:38:10.202961+0000","last_unstale":"2024-09-10T23:39:17.359814+0000","last_undegraded":"2024-09-10T23:39:17.359814+0000","last_fullsized":"2024-09-10T23:39:17.359814+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:33.580368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":28,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532341+0000","last_change":"2024-09-10T23:38:12.219094+0000","last_active":"2024-09-10T23:38:43.532341+0000","last_peered":"2024-09-10T23:38:43.532341+0000","last_clean":"2024-09-10T23:38:43.532341+0000","last_became_active":"2024-09-10T23:38:12.218778+0000","last_became_peered":"2024-09-10T23:38:12.218778+0000","last_unstale":"2024-09-10T23:38:43.532341+0000","last_undegraded":"2024-09-10T23:38:43.532341+0000","last_fullsized":"2024-09-10T23:38:43.532341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:59.019756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770789+0000","last_change":"2024-09-10T23:38:10.204204+0000","last_active":"2024-09-10T23:38:43.770789+0000","last_peered":"2024-09-10T23:38:43.770789+0000","last_clean":"2024-09-10T23:38:43.770789+0000","last_became_active":"2024-09-10T23:38:10.203662+0000","last_became_peered":"2024-09-10T23:38:10.203662+0000","last_unstale":"2024-09-10T23:38:43.770789+0000","last_undegraded":"2024-09-10T23:38:43.770789+0000","last_fullsized":"2024-09-10T23:38:43.770789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:44.243961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530782+0000","last_change":"2024-09-10T23:38:12.214337+0000","last_active":"2024-09-10T23:38:43.530782+0000","last_peered":"2024-09-10T23:38:43.530782+0000","last_clean":"2024-09-10T23:38:43.530782+0000","last_became_active":"2024-09-10T23:38:12.214024+0000","last_became_peered":"2024-09-10T23:38:12.214024+0000","last_unstale":"2024-09-10T23:38:43.530782+0000","last_undegraded":"2024-09-10T23:38:43.530782+0000","last_fullsized":"2024-09-10T23:38:43.530782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:19.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536668+0000","last_change":"2024-09-10T23:38:10.208001+0000","last_active":"2024-09-10T23:38:43.536668+0000","last_peered":"2024-09-10T23:38:43.536668+0000","last_clean":"2024-09-10T23:38:43.536668+0000","last_became_active":"2024-09-10T23:38:10.207656+0000","last_became_peered":"2024-09-10T23:38:10.207656+0000","last_unstale":"2024-09-10T23:38:43.536668+0000","last_undegraded":"2024-09-10T23:38:43.536668+0000","last_fullsized":"2024-09-10T23:38:43.536668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:44.679795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091260+0000","last_change":"2024-09-10T23:38:12.227780+0000","last_active":"2024-09-10T23:38:44.091260+0000","last_peered":"2024-09-10T23:38:44.091260+0000","last_clean":"2024-09-10T23:38:44.091260+0000","last_became_active":"2024-09-10T23:38:12.227404+0000","last_became_peered":"2024-09-10T23:38:12.227404+0000","last_unstale":"2024-09-10T23:38:44.091260+0000","last_undegraded":"2024-09-10T23:38:44.091260+0000","last_fullsized":"2024-09-10T23:38:44.091260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:58.453685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":88,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:19.363716+0000","last_change":"2024-09-10T23:38:10.214786+0000","last_active":"2024-09-10T23:39:19.363716+0000","last_peered":"2024-09-10T23:39:19.363716+0000","last_clean":"2024-09-10T23:39:19.363716+0000","last_became_active":"2024-09-10T23:38:10.214124+0000","last_became_peered":"2024-09-10T23:38:10.214124+0000","last_unstale":"2024-09-10T23:39:19.363716+0000","last_undegraded":"2024-09-10T23:39:19.363716+0000","last_fullsized":"2024-09-10T23:39:19.363716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:00.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.090875+0000","last_change":"2024-09-10T23:38:12.220507+0000","last_active":"2024-09-10T23:38:44.090875+0000","last_peered":"2024-09-10T23:38:44.090875+0000","last_clean":"2024-09-10T23:38:44.090875+0000","last_became_active":"2024-09-10T23:38:12.220178+0000","last_became_peered":"2024-09-10T23:38:12.220178+0000","last_unstale":"2024-09-10T23:38:44.090875+0000","last_undegraded":"2024-09-10T23:38:44.090875+0000","last_fullsized":"2024-09-10T23:38:44.090875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:57.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531867+0000","last_change":"2024-09-10T23:38:10.256166+0000","last_active":"2024-09-10T23:38:43.531867+0000","last_peered":"2024-09-10T23:38:43.531867+0000","last_clean":"2024-09-10T23:38:43.531867+0000","last_became_active":"2024-09-10T23:38:10.255792+0000","last_became_peered":"2024-09-10T23:38:10.255792+0000","last_unstale":"2024-09-10T23:38:43.531867+0000","last_undegraded":"2024-09-10T23:38:43.531867+0000","last_fullsized":"2024-09-10T23:38:43.531867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:44.621339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537237+0000","last_change":"2024-09-10T23:38:12.225151+0000","last_active":"2024-09-10T23:38:43.537237+0000","last_peered":"2024-09-10T23:38:43.537237+0000","last_clean":"2024-09-10T23:38:43.537237+0000","last_became_active":"2024-09-10T23:38:12.224748+0000","last_became_peered":"2024-09-10T23:38:12.224748+0000","last_unstale":"2024-09-10T23:38:43.537237+0000","last_undegraded":"2024-09-10T23:38:43.537237+0000","last_fullsized":"2024-09-10T23:38:43.537237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.543098+0000","last_change":"2024-09-10T23:38:43.542616+0000","last_active":"2024-09-10T23:38:43.543098+0000","last_peered":"2024-09-10T23:38:43.543098+0000","last_clean":"2024-09-10T23:38:43.543098+0000","last_became_active":"2024-09-10T23:38:43.537936+0000","last_became_peered":"2024-09-10T23:38:43.537936+0000","last_unstale":"2024-09-10T23:38:43.543098+0000","last_undegraded":"2024-09-10T23:38:43.543098+0000","last_fullsized":"2024-09-10T23:38:43.543098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:31.390914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534317+0000","last_change":"2024-09-10T23:38:12.225417+0000","last_active":"2024-09-10T23:38:43.534317+0000","last_peered":"2024-09-10T23:38:43.534317+0000","last_clean":"2024-09-10T23:38:43.534317+0000","last_became_active":"2024-09-10T23:38:12.225129+0000","last_became_peered":"2024-09-10T23:38:12.225129+0000","last_unstale":"2024-09-10T23:38:43.534317+0000","last_undegraded":"2024-09-10T23:38:43.534317+0000","last_fullsized":"2024-09-10T23:38:43.534317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:42.935776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530992+0000","last_change":"2024-09-10T23:38:10.204942+0000","last_active":"2024-09-10T23:38:43.530992+0000","last_peered":"2024-09-10T23:38:43.530992+0000","last_clean":"2024-09-10T23:38:43.530992+0000","last_became_active":"2024-09-10T23:38:10.204568+0000","last_became_peered":"2024-09-10T23:38:10.204568+0000","last_unstale":"2024-09-10T23:38:43.530992+0000","last_undegraded":"2024-09-10T23:38:43.530992+0000","last_fullsized":"2024-09-10T23:38:43.530992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:00.608617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091532+0000","last_change":"2024-09-10T23:38:12.217411+0000","last_active":"2024-09-10T23:38:44.091532+0000","last_peered":"2024-09-10T23:38:44.091532+0000","last_clean":"2024-09-10T23:38:44.091532+0000","last_became_active":"2024-09-10T23:38:12.216998+0000","last_became_peered":"2024-09-10T23:38:12.216998+0000","last_unstale":"2024-09-10T23:38:44.091532+0000","last_undegraded":"2024-09-10T23:38:44.091532+0000","last_fullsized":"2024-09-10T23:38:44.091532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:12.852239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537386+0000","last_change":"2024-09-10T23:38:10.209596+0000","last_active":"2024-09-10T23:38:43.537386+0000","last_peered":"2024-09-10T23:38:43.537386+0000","last_clean":"2024-09-10T23:38:43.537386+0000","last_became_active":"2024-09-10T23:38:10.209348+0000","last_became_peered":"2024-09-10T23:38:10.209348+0000","last_unstale":"2024-09-10T23:38:43.537386+0000","last_undegraded":"2024-09-10T23:38:43.537386+0000","last_fullsized":"2024-09-10T23:38:43.537386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:30.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091318+0000","last_change":"2024-09-10T23:38:12.224071+0000","last_active":"2024-09-10T23:38:44.091318+0000","last_peered":"2024-09-10T23:38:44.091318+0000","last_clean":"2024-09-10T23:38:44.091318+0000","last_became_active":"2024-09-10T23:38:12.223773+0000","last_became_peered":"2024-09-10T23:38:12.223773+0000","last_unstale":"2024-09-10T23:38:44.091318+0000","last_undegraded":"2024-09-10T23:38:44.091318+0000","last_fullsized":"2024-09-10T23:38:44.091318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:43.412524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.771165+0000","last_change":"2024-09-10T23:38:10.300065+0000","last_active":"2024-09-10T23:38:43.771165+0000","last_peered":"2024-09-10T23:38:43.771165+0000","last_clean":"2024-09-10T23:38:43.771165+0000","last_became_active":"2024-09-10T23:38:10.299624+0000","last_became_peered":"2024-09-10T23:38:10.299624+0000","last_unstale":"2024-09-10T23:38:43.771165+0000","last_undegraded":"2024-09-10T23:38:43.771165+0000","last_fullsized":"2024-09-10T23:38:43.771165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:02.516651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091462+0000","last_change":"2024-09-10T23:38:12.222280+0000","last_active":"2024-09-10T23:38:44.091462+0000","last_peered":"2024-09-10T23:38:44.091462+0000","last_clean":"2024-09-10T23:38:44.091462+0000","last_became_active":"2024-09-10T23:38:12.221644+0000","last_became_peered":"2024-09-10T23:38:12.221644+0000","last_unstale":"2024-09-10T23:38:44.091462+0000","last_undegraded":"2024-09-10T23:38:44.091462+0000","last_fullsized":"2024-09-10T23:38:44.091462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.823629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":96,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091140+0000","last_change":"2024-09-10T23:36:58.824948+0000","last_active":"2024-09-10T23:38:44.091140+0000","last_peered":"2024-09-10T23:38:44.091140+0000","last_clean":"2024-09-10T23:38:44.091140+0000","last_became_active":"2024-09-10T23:36:58.819334+0000","last_became_peered":"2024-09-10T23:36:58.819334+0000","last_unstale":"2024-09-10T23:38:44.091140+0000","last_undegraded":"2024-09-10T23:38:44.091140+0000","last_fullsized":"2024-09-10T23:38:44.091140+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_clean_scrub_stamp":"2024-09-10T23:33:36.806080+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:52.996301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536800+0000","last_change":"2024-09-10T23:38:10.215224+0000","last_active":"2024-09-10T23:38:43.536800+0000","last_peered":"2024-09-10T23:38:43.536800+0000","last_clean":"2024-09-10T23:38:43.536800+0000","last_became_active":"2024-09-10T23:38:10.214795+0000","last_became_peered":"2024-09-10T23:38:10.214795+0000","last_unstale":"2024-09-10T23:38:43.536800+0000","last_undegraded":"2024-09-10T23:38:43.536800+0000","last_fullsized":"2024-09-10T23:38:43.536800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:26.599793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.539066+0000","last_change":"2024-09-10T23:38:43.538480+0000","last_active":"2024-09-10T23:38:43.539066+0000","last_peered":"2024-09-10T23:38:43.539066+0000","last_clean":"2024-09-10T23:38:43.539066+0000","last_became_active":"2024-09-10T23:38:43.538091+0000","last_became_peered":"2024-09-10T23:38:43.538091+0000","last_unstale":"2024-09-10T23:38:43.539066+0000","last_undegraded":"2024-09-10T23:38:43.539066+0000","last_fullsized":"2024-09-10T23:38:43.539066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:40.890114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091042+0000","last_change":"2024-09-10T23:38:10.212748+0000","last_active":"2024-09-10T23:38:44.091042+0000","last_peered":"2024-09-10T23:38:44.091042+0000","last_clean":"2024-09-10T23:38:44.091042+0000","last_became_active":"2024-09-10T23:38:10.212427+0000","last_became_peered":"2024-09-10T23:38:10.212427+0000","last_unstale":"2024-09-10T23:38:44.091042+0000","last_undegraded":"2024-09-10T23:38:44.091042+0000","last_fullsized":"2024-09-10T23:38:44.091042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:23.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530729+0000","last_change":"2024-09-10T23:38:12.225178+0000","last_active":"2024-09-10T23:38:43.530729+0000","last_peered":"2024-09-10T23:38:43.530729+0000","last_clean":"2024-09-10T23:38:43.530729+0000","last_became_active":"2024-09-10T23:38:12.224860+0000","last_became_peered":"2024-09-10T23:38:12.224860+0000","last_unstale":"2024-09-10T23:38:43.530729+0000","last_undegraded":"2024-09-10T23:38:43.530729+0000","last_fullsized":"2024-09-10T23:38:43.530729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:10.986009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":87,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:21.365870+0000","last_change":"2024-09-10T23:38:10.254625+0000","last_active":"2024-09-10T23:39:21.365870+0000","last_peered":"2024-09-10T23:39:21.365870+0000","last_clean":"2024-09-10T23:39:21.365870+0000","last_became_active":"2024-09-10T23:38:10.254259+0000","last_became_peered":"2024-09-10T23:38:10.254259+0000","last_unstale":"2024-09-10T23:39:21.365870+0000","last_undegraded":"2024-09-10T23:39:21.365870+0000","last_fullsized":"2024-09-10T23:39:21.365870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:46.371999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536676+0000","last_change":"2024-09-10T23:38:12.217168+0000","last_active":"2024-09-10T23:38:43.536676+0000","last_peered":"2024-09-10T23:38:43.536676+0000","last_clean":"2024-09-10T23:38:43.536676+0000","last_became_active":"2024-09-10T23:38:12.216814+0000","last_became_peered":"2024-09-10T23:38:12.216814+0000","last_unstale":"2024-09-10T23:38:43.536676+0000","last_undegraded":"2024-09-10T23:38:43.536676+0000","last_fullsized":"2024-09-10T23:38:43.536676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:41.494690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091293+0000","last_change":"2024-09-10T23:38:10.207456+0000","last_active":"2024-09-10T23:38:44.091293+0000","last_peered":"2024-09-10T23:38:44.091293+0000","last_clean":"2024-09-10T23:38:44.091293+0000","last_became_active":"2024-09-10T23:38:10.207079+0000","last_became_peered":"2024-09-10T23:38:10.207079+0000","last_unstale":"2024-09-10T23:38:44.091293+0000","last_undegraded":"2024-09-10T23:38:44.091293+0000","last_fullsized":"2024-09-10T23:38:44.091293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:14.631231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024598+0000","last_change":"2024-09-10T23:38:12.218306+0000","last_active":"2024-09-10T23:38:44.024598+0000","last_peered":"2024-09-10T23:38:44.024598+0000","last_clean":"2024-09-10T23:38:44.024598+0000","last_became_active":"2024-09-10T23:38:12.217981+0000","last_became_peered":"2024-09-10T23:38:12.217981+0000","last_unstale":"2024-09-10T23:38:44.024598+0000","last_undegraded":"2024-09-10T23:38:44.024598+0000","last_fullsized":"2024-09-10T23:38:44.024598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:31.745904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538159+0000","last_change":"2024-09-10T23:38:43.538061+0000","last_active":"2024-09-10T23:38:43.538159+0000","last_peered":"2024-09-10T23:38:43.538159+0000","last_clean":"2024-09-10T23:38:43.538159+0000","last_became_active":"2024-09-10T23:38:43.537582+0000","last_became_peered":"2024-09-10T23:38:43.537582+0000","last_unstale":"2024-09-10T23:38:43.538159+0000","last_undegraded":"2024-09-10T23:38:43.538159+0000","last_fullsized":"2024-09-10T23:38:43.538159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:15.083698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024718+0000","last_change":"2024-09-10T23:38:12.214507+0000","last_active":"2024-09-10T23:38:44.024718+0000","last_peered":"2024-09-10T23:38:44.024718+0000","last_clean":"2024-09-10T23:38:44.024718+0000","last_became_active":"2024-09-10T23:38:12.214160+0000","last_became_peered":"2024-09-10T23:38:12.214160+0000","last_unstale":"2024-09-10T23:38:44.024718+0000","last_undegraded":"2024-09-10T23:38:44.024718+0000","last_fullsized":"2024-09-10T23:38:44.024718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:04.623624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532455+0000","last_change":"2024-09-10T23:38:10.256941+0000","last_active":"2024-09-10T23:38:43.532455+0000","last_peered":"2024-09-10T23:38:43.532455+0000","last_clean":"2024-09-10T23:38:43.532455+0000","last_became_active":"2024-09-10T23:38:10.256553+0000","last_became_peered":"2024-09-10T23:38:10.256553+0000","last_unstale":"2024-09-10T23:38:43.532455+0000","last_undegraded":"2024-09-10T23:38:43.532455+0000","last_fullsized":"2024-09-10T23:38:43.532455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:30.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531145+0000","last_change":"2024-09-10T23:38:12.221246+0000","last_active":"2024-09-10T23:38:43.531145+0000","last_peered":"2024-09-10T23:38:43.531145+0000","last_clean":"2024-09-10T23:38:43.531145+0000","last_became_active":"2024-09-10T23:38:12.220912+0000","last_became_peered":"2024-09-10T23:38:12.220912+0000","last_unstale":"2024-09-10T23:38:43.531145+0000","last_undegraded":"2024-09-10T23:38:43.531145+0000","last_fullsized":"2024-09-10T23:38:43.531145+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:33.918289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534169+0000","last_change":"2024-09-10T23:38:10.210151+0000","last_active":"2024-09-10T23:38:43.534169+0000","last_peered":"2024-09-10T23:38:43.534169+0000","last_clean":"2024-09-10T23:38:43.534169+0000","last_became_active":"2024-09-10T23:38:10.209832+0000","last_became_peered":"2024-09-10T23:38:10.209832+0000","last_unstale":"2024-09-10T23:38:43.534169+0000","last_undegraded":"2024-09-10T23:38:43.534169+0000","last_fullsized":"2024-09-10T23:38:43.534169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:52.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965986+0000","last_change":"2024-09-10T23:38:12.218256+0000","last_active":"2024-09-10T23:38:43.965986+0000","last_peered":"2024-09-10T23:38:43.965986+0000","last_clean":"2024-09-10T23:38:43.965986+0000","last_became_active":"2024-09-10T23:38:12.217853+0000","last_became_peered":"2024-09-10T23:38:12.217853+0000","last_unstale":"2024-09-10T23:38:43.965986+0000","last_undegraded":"2024-09-10T23:38:43.965986+0000","last_fullsized":"2024-09-10T23:38:43.965986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537082+0000","last_change":"2024-09-10T23:38:10.300017+0000","last_active":"2024-09-10T23:38:43.537082+0000","last_peered":"2024-09-10T23:38:43.537082+0000","last_clean":"2024-09-10T23:38:43.537082+0000","last_became_active":"2024-09-10T23:38:10.299733+0000","last_became_peered":"2024-09-10T23:38:10.299733+0000","last_unstale":"2024-09-10T23:38:43.537082+0000","last_undegraded":"2024-09-10T23:38:43.537082+0000","last_fullsized":"2024-09-10T23:38:43.537082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.193043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533724+0000","last_change":"2024-09-10T23:38:12.212818+0000","last_active":"2024-09-10T23:38:43.533724+0000","last_peered":"2024-09-10T23:38:43.533724+0000","last_clean":"2024-09-10T23:38:43.533724+0000","last_became_active":"2024-09-10T23:38:12.212502+0000","last_became_peered":"2024-09-10T23:38:12.212502+0000","last_unstale":"2024-09-10T23:38:43.533724+0000","last_undegraded":"2024-09-10T23:38:43.533724+0000","last_fullsized":"2024-09-10T23:38:43.533724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:26.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531972+0000","last_change":"2024-09-10T23:38:10.256366+0000","last_active":"2024-09-10T23:38:43.531972+0000","last_peered":"2024-09-10T23:38:43.531972+0000","last_clean":"2024-09-10T23:38:43.531972+0000","last_became_active":"2024-09-10T23:38:10.256056+0000","last_became_peered":"2024-09-10T23:38:10.256056+0000","last_unstale":"2024-09-10T23:38:43.531972+0000","last_undegraded":"2024-09-10T23:38:43.531972+0000","last_fullsized":"2024-09-10T23:38:43.531972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:00.612373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531864+0000","last_change":"2024-09-10T23:38:12.224629+0000","last_active":"2024-09-10T23:38:43.531864+0000","last_peered":"2024-09-10T23:38:43.531864+0000","last_clean":"2024-09-10T23:38:43.531864+0000","last_became_active":"2024-09-10T23:38:12.224018+0000","last_became_peered":"2024-09-10T23:38:12.224018+0000","last_unstale":"2024-09-10T23:38:43.531864+0000","last_undegraded":"2024-09-10T23:38:43.531864+0000","last_fullsized":"2024-09-10T23:38:43.531864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:44.067489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965400+0000","last_change":"2024-09-10T23:38:10.203395+0000","last_active":"2024-09-10T23:38:43.965400+0000","last_peered":"2024-09-10T23:38:43.965400+0000","last_clean":"2024-09-10T23:38:43.965400+0000","last_became_active":"2024-09-10T23:38:10.203067+0000","last_became_peered":"2024-09-10T23:38:10.203067+0000","last_unstale":"2024-09-10T23:38:43.965400+0000","last_undegraded":"2024-09-10T23:38:43.965400+0000","last_fullsized":"2024-09-10T23:38:43.965400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.398322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534004+0000","last_change":"2024-09-10T23:38:12.223207+0000","last_active":"2024-09-10T23:38:43.534004+0000","last_peered":"2024-09-10T23:38:43.534004+0000","last_clean":"2024-09-10T23:38:43.534004+0000","last_became_active":"2024-09-10T23:38:12.222841+0000","last_became_peered":"2024-09-10T23:38:12.222841+0000","last_unstale":"2024-09-10T23:38:43.534004+0000","last_undegraded":"2024-09-10T23:38:43.534004+0000","last_fullsized":"2024-09-10T23:38:43.534004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:26.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770702+0000","last_change":"2024-09-10T23:38:10.210479+0000","last_active":"2024-09-10T23:38:43.770702+0000","last_peered":"2024-09-10T23:38:43.770702+0000","last_clean":"2024-09-10T23:38:43.770702+0000","last_became_active":"2024-09-10T23:38:10.210124+0000","last_became_peered":"2024-09-10T23:38:10.210124+0000","last_unstale":"2024-09-10T23:38:43.770702+0000","last_undegraded":"2024-09-10T23:38:43.770702+0000","last_fullsized":"2024-09-10T23:38:43.770702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:39.017091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965576+0000","last_change":"2024-09-10T23:38:12.214748+0000","last_active":"2024-09-10T23:38:43.965576+0000","last_peered":"2024-09-10T23:38:43.965576+0000","last_clean":"2024-09-10T23:38:43.965576+0000","last_became_active":"2024-09-10T23:38:12.214431+0000","last_became_peered":"2024-09-10T23:38:12.214431+0000","last_unstale":"2024-09-10T23:38:43.965576+0000","last_undegraded":"2024-09-10T23:38:43.965576+0000","last_fullsized":"2024-09-10T23:38:43.965576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:02.092876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532097+0000","last_change":"2024-09-10T23:38:10.214134+0000","last_active":"2024-09-10T23:38:43.532097+0000","last_peered":"2024-09-10T23:38:43.532097+0000","last_clean":"2024-09-10T23:38:43.532097+0000","last_became_active":"2024-09-10T23:38:10.213690+0000","last_became_peered":"2024-09-10T23:38:10.213690+0000","last_unstale":"2024-09-10T23:38:43.532097+0000","last_undegraded":"2024-09-10T23:38:43.532097+0000","last_fullsized":"2024-09-10T23:38:43.532097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:19.369755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091140+0000","last_change":"2024-09-10T23:38:12.218254+0000","last_active":"2024-09-10T23:38:44.091140+0000","last_peered":"2024-09-10T23:38:44.091140+0000","last_clean":"2024-09-10T23:38:44.091140+0000","last_became_active":"2024-09-10T23:38:12.217937+0000","last_became_peered":"2024-09-10T23:38:12.217937+0000","last_unstale":"2024-09-10T23:38:44.091140+0000","last_undegraded":"2024-09-10T23:38:44.091140+0000","last_fullsized":"2024-09-10T23:38:44.091140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:57.080088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538290+0000","last_change":"2024-09-10T23:38:43.537716+0000","last_active":"2024-09-10T23:38:43.538290+0000","last_peered":"2024-09-10T23:38:43.538290+0000","last_clean":"2024-09-10T23:38:43.538290+0000","last_became_active":"2024-09-10T23:38:43.537357+0000","last_became_peered":"2024-09-10T23:38:43.537357+0000","last_unstale":"2024-09-10T23:38:43.538290+0000","last_undegraded":"2024-09-10T23:38:43.538290+0000","last_fullsized":"2024-09-10T23:38:43.538290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:59.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532282+0000","last_change":"2024-09-10T23:38:10.215022+0000","last_active":"2024-09-10T23:38:43.532282+0000","last_peered":"2024-09-10T23:38:43.532282+0000","last_clean":"2024-09-10T23:38:43.532282+0000","last_became_active":"2024-09-10T23:38:10.214678+0000","last_became_peered":"2024-09-10T23:38:10.214678+0000","last_unstale":"2024-09-10T23:38:43.532282+0000","last_undegraded":"2024-09-10T23:38:43.532282+0000","last_fullsized":"2024-09-10T23:38:43.532282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:20.592052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531960+0000","last_change":"2024-09-10T23:38:12.230449+0000","last_active":"2024-09-10T23:38:43.531960+0000","last_peered":"2024-09-10T23:38:43.531960+0000","last_clean":"2024-09-10T23:38:43.531960+0000","last_became_active":"2024-09-10T23:38:12.228939+0000","last_became_peered":"2024-09-10T23:38:12.228939+0000","last_unstale":"2024-09-10T23:38:43.531960+0000","last_undegraded":"2024-09-10T23:38:43.531960+0000","last_fullsized":"2024-09-10T23:38:43.531960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:45.495207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532292+0000","last_change":"2024-09-10T23:38:10.209586+0000","last_active":"2024-09-10T23:38:43.532292+0000","last_peered":"2024-09-10T23:38:43.532292+0000","last_clean":"2024-09-10T23:38:43.532292+0000","last_became_active":"2024-09-10T23:38:10.209211+0000","last_became_peered":"2024-09-10T23:38:10.209211+0000","last_unstale":"2024-09-10T23:38:43.532292+0000","last_undegraded":"2024-09-10T23:38:43.532292+0000","last_fullsized":"2024-09-10T23:38:43.532292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:29.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.533776+0000","last_change":"2024-09-10T23:38:12.219795+0000","last_active":"2024-09-10T23:38:43.533776+0000","last_peered":"2024-09-10T23:38:43.533776+0000","last_clean":"2024-09-10T23:38:43.533776+0000","last_became_active":"2024-09-10T23:38:12.219318+0000","last_became_peered":"2024-09-10T23:38:12.219318+0000","last_unstale":"2024-09-10T23:38:43.533776+0000","last_undegraded":"2024-09-10T23:38:43.533776+0000","last_fullsized":"2024-09-10T23:38:43.533776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:12.732264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965952+0000","last_change":"2024-09-10T23:38:10.255508+0000","last_active":"2024-09-10T23:38:43.965952+0000","last_peered":"2024-09-10T23:38:43.965952+0000","last_clean":"2024-09-10T23:38:43.965952+0000","last_became_active":"2024-09-10T23:38:10.255202+0000","last_became_peered":"2024-09-10T23:38:10.255202+0000","last_unstale":"2024-09-10T23:38:43.965952+0000","last_undegraded":"2024-09-10T23:38:43.965952+0000","last_fullsized":"2024-09-10T23:38:43.965952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:09.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965838+0000","last_change":"2024-09-10T23:38:12.222345+0000","last_active":"2024-09-10T23:38:43.965838+0000","last_peered":"2024-09-10T23:38:43.965838+0000","last_clean":"2024-09-10T23:38:43.965838+0000","last_became_active":"2024-09-10T23:38:12.220593+0000","last_became_peered":"2024-09-10T23:38:12.220593+0000","last_unstale":"2024-09-10T23:38:43.965838+0000","last_undegraded":"2024-09-10T23:38:43.965838+0000","last_fullsized":"2024-09-10T23:38:43.965838+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:00.909046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534353+0000","last_change":"2024-09-10T23:38:10.210071+0000","last_active":"2024-09-10T23:38:43.534353+0000","last_peered":"2024-09-10T23:38:43.534353+0000","last_clean":"2024-09-10T23:38:43.534353+0000","last_became_active":"2024-09-10T23:38:10.209778+0000","last_became_peered":"2024-09-10T23:38:10.209778+0000","last_unstale":"2024-09-10T23:38:43.534353+0000","last_undegraded":"2024-09-10T23:38:43.534353+0000","last_fullsized":"2024-09-10T23:38:43.534353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:14.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64739,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":368,"num_read_kb":251,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":194217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286063,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":417996,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":987136,"data_stored":1070193,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103206,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":851968,"data_stored":418210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":418108,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":1010451,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626484,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":417599,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":1009744,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":418427,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":417910,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":925696,"data_stored":479480,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":477739,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":860160,"data_stored":418870,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:39:24.804 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:39:24.804 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T23:39:24.804 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T23:39:24.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T23:39:24.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:24 smithi066 ceph-mon[34761]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:39:25.064 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:25.438 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:25 smithi016 ceph-mon[30855]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 -- 172.21.15.16:0/3307403119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 msgr2=0x7fee68102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/3307403119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68102070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fee60009900 tx=0x7fee6002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 -- 172.21.15.16:0/3307403119 shutdown_connections 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/3307403119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee68108020 0x7fee6810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/3307403119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee681076a0 0x7fee68107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/3307403119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68102070 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 -- 172.21.15.16:0/3307403119 >> 172.21.15.16:0/3307403119 conn(0x7fee680fd700 msgr2=0x7fee680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 -- 172.21.15.16:0/3307403119 shutdown_connections 2024-09-10T23:39:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.518+0000 7fee6cf1a640 1 -- 172.21.15.16:0/3307403119 wait complete. 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 Processor -- start 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 -- start start 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee681076a0 0x7fee68199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee68108020 0x7fee6819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fee68111d30 con 0x7fee68101c90 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fee68111bb0 con 0x7fee681076a0 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6cf1a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fee68111eb0 con 0x7fee68108020 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46290/0 (socket says 172.21.15.16:46290) 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 -- 172.21.15.16:0/2301276917 learned_addr learned my addr 172.21.15.16:0/2301276917 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee66d9d640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee68108020 0x7fee6819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee65d9b640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee681076a0 0x7fee68199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 -- 172.21.15.16:0/2301276917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee68108020 msgr2=0x7fee6819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee68108020 0x7fee6819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 -- 172.21.15.16:0/2301276917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee681076a0 msgr2=0x7fee68199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee681076a0 0x7fee68199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.519+0000 7fee6659c640 1 -- 172.21.15.16:0/2301276917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6819f3b0 con 0x7fee68101c90 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.520+0000 7fee6659c640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68199300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fee60005ab0 tx=0x7fee60003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.520+0000 7fee5f7fe640 1 -- 172.21.15.16:0/2301276917 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6003f070 con 0x7fee68101c90 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.520+0000 7fee5f7fe640 1 -- 172.21.15.16:0/2301276917 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee60031b50 con 0x7fee68101c90 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.520+0000 7fee5f7fe640 1 -- 172.21.15.16:0/2301276917 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60035030 con 0x7fee68101c90 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.520+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6819f640 con 0x7fee68101c90 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.520+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee681a5d60 con 0x7fee68101c90 2024-09-10T23:39:25.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.521+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee68102070 con 0x7fee68101c90 2024-09-10T23:39:25.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.522+0000 7fee5f7fe640 1 -- 172.21.15.16:0/2301276917 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fee600316a0 con 0x7fee68101c90 2024-09-10T23:39:25.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.523+0000 7fee5f7fe640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fee540b5400 0x7fee540b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:25.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.523+0000 7fee65d9b640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fee540b5400 0x7fee540b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:25.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.523+0000 7fee5f7fe640 1 -- 172.21.15.16:0/2301276917 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fee601067e0 con 0x7fee68101c90 2024-09-10T23:39:25.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.524+0000 7fee65d9b640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fee540b5400 0x7fee540b78c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fee68106eb0 tx=0x7fee50005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:25.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.527+0000 7fee5f7fe640 1 -- 172.21.15.16:0/2301276917 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fee600cce30 con 0x7fee68101c90 2024-09-10T23:39:25.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.755+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fee6819a430 con 0x7fee68101c90 2024-09-10T23:39:25.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.756+0000 7fee5f7fe640 1 -- 172.21.15.16:0/2301276917 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fee600d1860 con 0x7fee68101c90 2024-09-10T23:39:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:25.758 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fee540b5400 msgr2=0x7fee540b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fee540b5400 0x7fee540b78c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fee68106eb0 tx=0x7fee50005f90 comp rx=0 tx=0).stop 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 msgr2=0x7fee68199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68199300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fee60005ab0 tx=0x7fee60003c20 comp rx=0 tx=0).stop 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 shutdown_connections 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee68108020 0x7fee6819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fee540b5400 0x7fee540b78c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee681076a0 0x7fee68199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 --2- 172.21.15.16:0/2301276917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee68101c90 0x7fee68199300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:25.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 >> 172.21.15.16:0/2301276917 conn(0x7fee680fd700 msgr2=0x7fee6806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:25.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 shutdown_connections 2024-09-10T23:39:25.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:25.758+0000 7fee6cf1a640 1 -- 172.21.15.16:0/2301276917 wait complete. 2024-09-10T23:39:25.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:25 smithi071 ceph-mon[35018]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:25.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:25 smithi066 ceph-mon[34761]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:26.484 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T23:39:26.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:39:26.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:26 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2301276917' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:39:26.746 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:26.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:26 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2301276917' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:39:26.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:26 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2301276917' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:39:27.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 -- 172.21.15.16:0/2141315693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0102190 msgr2=0x7fb2a010eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:27.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/2141315693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0102190 0x7fb2a010eee0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb294009900 tx=0x7fb29402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 -- 172.21.15.16:0/2141315693 shutdown_connections 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/2141315693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2a010f420 0x7fb2a0111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/2141315693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0102190 0x7fb2a010eee0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/2141315693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a0101870 0x7fb2a0101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 -- 172.21.15.16:0/2141315693 >> 172.21.15.16:0/2141315693 conn(0x7fb2a00fd700 msgr2=0x7fb2a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 -- 172.21.15.16:0/2141315693 shutdown_connections 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.217+0000 7fb2a51d4640 1 -- 172.21.15.16:0/2141315693 wait complete. 2024-09-10T23:39:27.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.218+0000 7fb2a51d4640 1 Processor -- start 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.218+0000 7fb2a51d4640 1 -- start start 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.218+0000 7fb2a51d4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0101870 0x7fb2a019b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.218+0000 7fb2a51d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a0102190 0x7fb2a019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.218+0000 7fb2a51d4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2a010f420 0x7fb2a01a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb2a51d4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a0114fe0 con 0x7fb2a0101870 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb2a51d4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a0114e60 con 0x7fb2a0102190 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb2a51d4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a0115160 con 0x7fb2a010f420 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0101870 0x7fb2a019b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0101870 0x7fb2a019b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46320/0 (socket says 172.21.15.16:46320) 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 -- 172.21.15.16:0/1185564200 learned_addr learned my addr 172.21.15.16:0/1185564200 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29e59c640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a0102190 0x7fb2a019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29f59e640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2a010f420 0x7fb2a01a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 -- 172.21.15.16:0/1185564200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2a010f420 msgr2=0x7fb2a01a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2a010f420 0x7fb2a01a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 -- 172.21.15.16:0/1185564200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a0102190 msgr2=0x7fb2a019baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a0102190 0x7fb2a019baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 -- 172.21.15.16:0/1185564200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a01a1660 con 0x7fb2a0101870 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29f59e640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2a010f420 0x7fb2a01a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb29ed9d640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0101870 0x7fb2a019b5b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c890 tx=0x7fb29000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb287fff640 1 -- 172.21.15.16:0/1185564200 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290004220 con 0x7fb2a0101870 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb287fff640 1 -- 172.21.15.16:0/1185564200 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2900043c0 con 0x7fb2a0101870 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a01a1950 con 0x7fb2a0101870 2024-09-10T23:39:27.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb287fff640 1 -- 172.21.15.16:0/1185564200 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290004a00 con 0x7fb2a0101870 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.219+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a01a8010 con 0x7fb2a0101870 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.220+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a0101c50 con 0x7fb2a0101870 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.222+0000 7fb287fff640 1 -- 172.21.15.16:0/1185564200 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb2900079b0 con 0x7fb2a0101870 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.223+0000 7fb287fff640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2880b53c0 0x7fb2880b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.223+0000 7fb29e59c640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2880b53c0 0x7fb2880b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.223+0000 7fb287fff640 1 -- 172.21.15.16:0/1185564200 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb2900e6020 con 0x7fb2a0101870 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.223+0000 7fb29e59c640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2880b53c0 0x7fb2880b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb294005ab0 tx=0x7fb294005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.226+0000 7fb287fff640 1 -- 172.21.15.16:0/1185564200 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb290014030 con 0x7fb2a0101870 2024-09-10T23:39:27.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.451+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2a01a8370 con 0x7fb2a0101870 2024-09-10T23:39:27.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.451+0000 7fb287fff640 1 -- 172.21.15.16:0/1185564200 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11897 (secure 0 0 0) 0x7fb2900accc0 con 0x7fb2a0101870 2024-09-10T23:39:27.453 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:27.454 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"btime":"2024-09-10T23:38:25:271297+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:38:24.958870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24595,24608,24610]},"id":1}]} 2024-09-10T23:39:27.454 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-09-10T23:39:27.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.453+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2880b53c0 msgr2=0x7fb2880b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.453+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2880b53c0 0x7fb2880b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb294005ab0 tx=0x7fb294005a20 comp rx=0 tx=0).stop 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.453+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0101870 msgr2=0x7fb2a019b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.453+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0101870 0x7fb2a019b5b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c890 tx=0x7fb29000cd50 comp rx=0 tx=0).stop 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 shutdown_connections 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2a010f420 0x7fb2a01a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2880b53c0 0x7fb2880b7880 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a0102190 0x7fb2a019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 --2- 172.21.15.16:0/1185564200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a0101870 0x7fb2a019b5b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 >> 172.21.15.16:0/1185564200 conn(0x7fb2a00fd700 msgr2=0x7fb2a01115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:27.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 shutdown_connections 2024-09-10T23:39:27.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:27.454+0000 7fb2a51d4640 1 -- 172.21.15.16:0/1185564200 wait complete. 2024-09-10T23:39:27.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:27 smithi016 ceph-mon[30855]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:27 smithi071 ceph-mon[35018]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:27.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:27 smithi066 ceph-mon[34761]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:28.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:39:28.521 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:28.669 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:28 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1185564200' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:28.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:28 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1185564200' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:28.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:28 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1185564200' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 -- 172.21.15.16:0/966991252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86041077d0 msgr2=0x7f860410dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 --2- 172.21.15.16:0/966991252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86041077d0 0x7f860410dfd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009ca0 tx=0x7f85fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 -- 172.21.15.16:0/966991252 shutdown_connections 2024-09-10T23:39:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 --2- 172.21.15.16:0/966991252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86041077d0 0x7f860410dfd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 --2- 172.21.15.16:0/966991252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8604106e50 0x7f8604107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 --2- 172.21.15.16:0/966991252 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8604101440 0x7f8604101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 -- 172.21.15.16:0/966991252 >> 172.21.15.16:0/966991252 conn(0x7f8604078060 msgr2=0x7f86040ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 -- 172.21.15.16:0/966991252 shutdown_connections 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.010+0000 7f860b03b640 1 -- 172.21.15.16:0/966991252 wait complete. 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 Processor -- start 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 -- start start 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8604101440 0x7f8604199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8604106e50 0x7f8604199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86041077d0 0x7f860419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8604112e00 con 0x7f8604106e50 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8604112c80 con 0x7f86041077d0 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f860b03b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8604112f80 con 0x7f8604101440 2024-09-10T23:39:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f8603fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8604106e50 0x7f8604199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f8603fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8604106e50 0x7f8604199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46342/0 (socket says 172.21.15.16:46342) 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f8603fff640 1 -- 172.21.15.16:0/34419714 learned_addr learned my addr 172.21.15.16:0/34419714 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f8608dd7640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8604101440 0x7f8604199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.011+0000 7f86095d8640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86041077d0 0x7f860419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8603fff640 1 -- 172.21.15.16:0/34419714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8604101440 msgr2=0x7f8604199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8603fff640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8604101440 0x7f8604199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8603fff640 1 -- 172.21.15.16:0/34419714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86041077d0 msgr2=0x7f860419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8603fff640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86041077d0 0x7f860419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8603fff640 1 -- 172.21.15.16:0/34419714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860419f2e0 con 0x7f8604106e50 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8608dd7640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8604101440 0x7f8604199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8603fff640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8604106e50 0x7f8604199770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d950 tx=0x7f85f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8601ffb640 1 -- 172.21.15.16:0/34419714 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0017030 con 0x7f8604106e50 2024-09-10T23:39:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8601ffb640 1 -- 172.21.15.16:0/34419714 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85f0004020 con 0x7f8604106e50 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860419f5d0 con 0x7f8604106e50 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f8601ffb640 1 -- 172.21.15.16:0/34419714 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f00047a0 con 0x7f8604106e50 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.012+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86041a5c90 con 0x7f8604106e50 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.013+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8604101820 con 0x7f8604106e50 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.014+0000 7f8601ffb640 1 -- 172.21.15.16:0/34419714 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f85f0009a30 con 0x7f8604106e50 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.016+0000 7f8601ffb640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f85f40b53c0 0x7f85f40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.016+0000 7f8608dd7640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f85f40b53c0 0x7f85f40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.016+0000 7f8601ffb640 1 -- 172.21.15.16:0/34419714 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f85f00e5a10 con 0x7f8604106e50 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.016+0000 7f8608dd7640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f85f40b53c0 0x7f85f40b7880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85f80058c0 tx=0x7f85f8005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.020+0000 7f8601ffb640 1 -- 172.21.15.16:0/34419714 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85f00ac650 con 0x7f8604106e50 2024-09-10T23:39:29.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.244+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86041a6060 con 0x7f8604106e50 2024-09-10T23:39:29.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.245+0000 7f8601ffb640 1 -- 172.21.15.16:0/34419714 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11897 (secure 0 0 0) 0x7f85f00abf50 con 0x7f8604106e50 2024-09-10T23:39:29.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:29.247 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"btime":"2024-09-10T23:38:25:271297+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:38:24.958870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24595,24608,24610]},"id":1}]} 2024-09-10T23:39:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f85f40b53c0 msgr2=0x7f85f40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f85f40b53c0 0x7f85f40b7880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85f80058c0 tx=0x7f85f8005850 comp rx=0 tx=0).stop 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8604106e50 msgr2=0x7f8604199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8604106e50 0x7f8604199770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d950 tx=0x7f85f000de10 comp rx=0 tx=0).stop 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 shutdown_connections 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f85f40b53c0 0x7f85f40b7880 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86041077d0 0x7f860419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8604106e50 0x7f8604199770 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 --2- 172.21.15.16:0/34419714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8604101440 0x7f8604199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 >> 172.21.15.16:0/34419714 conn(0x7f8604078060 msgr2=0x7f8604104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 shutdown_connections 2024-09-10T23:39:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:29.247+0000 7f860b03b640 1 -- 172.21.15.16:0/34419714 wait complete. 2024-09-10T23:39:29.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:29 smithi016 ceph-mon[30855]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:39:29.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:29 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/34419714' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:29.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:29 smithi071 ceph-mon[35018]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:39:29.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:29 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/34419714' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:29.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:29 smithi066 ceph-mon[34761]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:39:29.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:29 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/34419714' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:29.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:39:30.231 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:30.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 -- 172.21.15.16:0/3989707785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 msgr2=0x7f496c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:30.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 --2- 172.21.15.16:0/3989707785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c10f950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4964009900 tx=0x7f496402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:30.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 -- 172.21.15.16:0/3989707785 shutdown_connections 2024-09-10T23:39:30.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 --2- 172.21.15.16:0/3989707785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c10f950 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 --2- 172.21.15.16:0/3989707785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496c1087d0 0x7f496c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 --2- 172.21.15.16:0/3989707785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f496c102dc0 0x7f496c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 -- 172.21.15.16:0/3989707785 >> 172.21.15.16:0/3989707785 conn(0x7f496c0fe830 msgr2=0x7f496c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 -- 172.21.15.16:0/3989707785 shutdown_connections 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.727+0000 7f4974417640 1 -- 172.21.15.16:0/3989707785 wait complete. 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 Processor -- start 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 -- start start 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f496c102dc0 0x7f496c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496c1087d0 0x7f496c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f496c112e20 con 0x7f496c109150 2024-09-10T23:39:30.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f496c112ca0 con 0x7f496c1087d0 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f4974417640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f496c112fa0 con 0x7f496c102dc0 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46354/0 (socket says 172.21.15.16:46354) 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 -- 172.21.15.16:0/1799047376 learned_addr learned my addr 172.21.15.16:0/1799047376 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49719b2640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496c1087d0 0x7f496c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49721b3640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f496c102dc0 0x7f496c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 -- 172.21.15.16:0/1799047376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f496c102dc0 msgr2=0x7f496c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f496c102dc0 0x7f496c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 -- 172.21.15.16:0/1799047376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496c1087d0 msgr2=0x7f496c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496c1087d0 0x7f496c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.728+0000 7f49729b4640 1 -- 172.21.15.16:0/1799047376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496c1a7670 con 0x7f496c109150 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.729+0000 7f49729b4640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c075f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f496402a930 tx=0x7f4964003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:30.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.729+0000 7f495f7fe640 1 -- 172.21.15.16:0/1799047376 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496403f070 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.729+0000 7f495f7fe640 1 -- 172.21.15.16:0/1799047376 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4964003e20 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.729+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496c1a7900 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.729+0000 7f495f7fe640 1 -- 172.21.15.16:0/1799047376 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964035030 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.729+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496c1a7de0 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.730+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f496c1031a0 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.731+0000 7f495f7fe640 1 -- 172.21.15.16:0/1799047376 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f496403b460 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.732+0000 7f495f7fe640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f49580b53c0 0x7f49580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.732+0000 7f49721b3640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f49580b53c0 0x7f49580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.732+0000 7f495f7fe640 1 -- 172.21.15.16:0/1799047376 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4964106f00 con 0x7f496c109150 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.733+0000 7f49721b3640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f49580b53c0 0x7f49580b7880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49680058c0 tx=0x7f496800a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:30.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.735+0000 7f495f7fe640 1 -- 172.21.15.16:0/1799047376 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f49640cd550 con 0x7f496c109150 2024-09-10T23:39:30.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.924+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f496c0767a0 con 0x7f496c109150 2024-09-10T23:39:30.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.926+0000 7f495f7fe640 1 -- 172.21.15.16:0/1799047376 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22944 (secure 0 0 0) 0x7f496c0767a0 con 0x7f496c109150 2024-09-10T23:39:30.928 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:30.928 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":77,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:43.527822+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:39:30.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f49580b53c0 msgr2=0x7f49580b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f49580b53c0 0x7f49580b7880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49680058c0 tx=0x7f496800a250 comp rx=0 tx=0).stop 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 msgr2=0x7f496c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c075f20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f496402a930 tx=0x7f4964003c00 comp rx=0 tx=0).stop 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 shutdown_connections 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f496c109150 0x7f496c075f20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f49580b53c0 0x7f49580b7880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496c1087d0 0x7f496c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 --2- 172.21.15.16:0/1799047376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f496c102dc0 0x7f496c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.928+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 >> 172.21.15.16:0/1799047376 conn(0x7f496c0fe830 msgr2=0x7f496c0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.929+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 shutdown_connections 2024-09-10T23:39:30.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:30.929+0000 7f4974417640 1 -- 172.21.15.16:0/1799047376 wait complete. 2024-09-10T23:39:31.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:31 smithi016 ceph-mon[30855]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:31.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:31 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1799047376' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:39:31.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:39:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:31 smithi071 ceph-mon[35018]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:31 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1799047376' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:39:31.804 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:31 smithi066 ceph-mon[34761]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:31.805 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:31 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1799047376' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:39:31.855 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:32.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 -- 172.21.15.16:0/323075425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4103b70 msgr2=0x7effe4103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 --2- 172.21.15.16:0/323075425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4103b70 0x7effe4103f50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7effd4009900 tx=0x7effd402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 -- 172.21.15.16:0/323075425 shutdown_connections 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 --2- 172.21.15.16:0/323075425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe410d120 0x7effe410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 --2- 172.21.15.16:0/323075425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effe4104570 0x7effe410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 --2- 172.21.15.16:0/323075425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4103b70 0x7effe4103f50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 -- 172.21.15.16:0/323075425 >> 172.21.15.16:0/323075425 conn(0x7effe40fd700 msgr2=0x7effe40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 -- 172.21.15.16:0/323075425 shutdown_connections 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.344+0000 7effe935d640 1 -- 172.21.15.16:0/323075425 wait complete. 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 Processor -- start 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 -- start start 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe4103b70 0x7effe4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effe4104570 0x7effe41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:32.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe410d120 0x7effe419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7effe4112da0 con 0x7effe410d120 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7effe4112c20 con 0x7effe4103b70 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe935d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effe4112f20 con 0x7effe4104570 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.345+0000 7effe37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe410d120 0x7effe419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe4103b70 0x7effe4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe410d120 0x7effe419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46366/0 (socket says 172.21.15.16:46366) 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe4103b70 0x7effe4199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:51136/0 (socket says 172.21.15.16:51136) 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 -- 172.21.15.16:0/47132516 learned_addr learned my addr 172.21.15.16:0/47132516 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe27fc640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effe4104570 0x7effe41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 -- 172.21.15.16:0/47132516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effe4104570 msgr2=0x7effe41997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effe4104570 0x7effe41997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 -- 172.21.15.16:0/47132516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe4103b70 msgr2=0x7effe4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe4103b70 0x7effe4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 -- 172.21.15.16:0/47132516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe419f340 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe27fc640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effe4104570 0x7effe41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe37fe640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe410d120 0x7effe419eb70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7effdc00eaa0 tx=0x7effdc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effcbfff640 1 -- 172.21.15.16:0/47132516 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc00cdb0 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe419f630 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effcbfff640 1 -- 172.21.15.16:0/47132516 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effdc005020 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effcbfff640 1 -- 172.21.15.16:0/47132516 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc0116d0 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.346+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe41a5cf0 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.347+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe4103f50 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.349+0000 7effcbfff640 1 -- 172.21.15.16:0/47132516 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7effdc00f040 con 0x7effe410d120 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.350+0000 7effcbfff640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effcc0b53c0 0x7effcc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.350+0000 7effe2ffd640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effcc0b53c0 0x7effcc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.350+0000 7effcbfff640 1 -- 172.21.15.16:0/47132516 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7effdc0e6070 con 0x7effe410d120 2024-09-10T23:39:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.350+0000 7effe2ffd640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effcc0b53c0 0x7effcc0b7880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7effd4031440 tx=0x7effd4005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.353+0000 7effcbfff640 1 -- 172.21.15.16:0/47132516 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7effdc016030 con 0x7effe410d120 2024-09-10T23:39:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.578+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effe419a3c0 con 0x7effe410d120 2024-09-10T23:39:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.579+0000 7effcbfff640 1 -- 172.21.15.16:0/47132516 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11897 (secure 0 0 0) 0x7effe419a3c0 con 0x7effe410d120 2024-09-10T23:39:32.581 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"btime":"2024-09-10T23:38:25:271297+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:38:24.958870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24595,24608,24610]},"id":1}]} 2024-09-10T23:39:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-09-10T23:39:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effcc0b53c0 msgr2=0x7effcc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effcc0b53c0 0x7effcc0b7880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7effd4031440 tx=0x7effd4005b50 comp rx=0 tx=0).stop 2024-09-10T23:39:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe410d120 msgr2=0x7effe419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe410d120 0x7effe419eb70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7effdc00eaa0 tx=0x7effdc00ef60 comp rx=0 tx=0).stop 2024-09-10T23:39:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 shutdown_connections 2024-09-10T23:39:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe410d120 0x7effe419eb70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effe4104570 0x7effe41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effcc0b53c0 0x7effcc0b7880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 --2- 172.21.15.16:0/47132516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe4103b70 0x7effe4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 >> 172.21.15.16:0/47132516 conn(0x7effe40fd700 msgr2=0x7effe40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 shutdown_connections 2024-09-10T23:39:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:32.581+0000 7effe935d640 1 -- 172.21.15.16:0/47132516 wait complete. 2024-09-10T23:39:33.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:38:12.987884+0000', 'modified': '2024-09-10T23:38:24.958870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24610, 'mds_1': 24608, 'mds_2': 24595}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24563': {'gid': 24563, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/1868979678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 1868979678}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 1868979678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6837/3622450021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 3622450021}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 3622450021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24589': {'gid': 24589, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/583734619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 583734619}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 583734619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.71:6837/1674889906', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 1674889906}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 1674889906}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.66:6839/3877648369', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 3877648369}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 3877648369}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.71:6839/542292698', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 542292698}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 542292698}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24610, 'qdb_cluster': [24595, 24608, 24610]} 2024-09-10T23:39:33.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:39:33.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T23:39:33.532 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:33.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:33 smithi071 ceph-mon[35018]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:33.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:33 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/47132516' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:33 smithi066 ceph-mon[34761]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:33.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:33 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/47132516' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:33.806 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:33 smithi016 ceph-mon[30855]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:33.806 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:33 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/47132516' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 -- 172.21.15.16:0/2693279620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb8103b50 msgr2=0x7f0cb8103f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/2693279620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb8103b50 0x7f0cb8103f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009ca0 tx=0x7f0cb002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 -- 172.21.15.16:0/2693279620 shutdown_connections 2024-09-10T23:39:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/2693279620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cb810d100 0x7f0cb810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/2693279620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cb8104550 0x7f0cb810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/2693279620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb8103b50 0x7f0cb8103f30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 -- 172.21.15.16:0/2693279620 >> 172.21.15.16:0/2693279620 conn(0x7f0cb80fd700 msgr2=0x7f0cb80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 -- 172.21.15.16:0/2693279620 shutdown_connections 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.028+0000 7f0cbc97d640 1 -- 172.21.15.16:0/2693279620 wait complete. 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 Processor -- start 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 -- start start 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cb8103b50 0x7f0cb8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cb8104550 0x7f0cb81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb810d100 0x7f0cb819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8112d60 con 0x7f0cb810d100 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8112be0 con 0x7f0cb8104550 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cbc97d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8112ee0 con 0x7f0cb8103b50 2024-09-10T23:39:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cb6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb810d100 0x7f0cb819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cb6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb810d100 0x7f0cb819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42700/0 (socket says 172.21.15.16:42700) 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cb6d9d640 1 -- 172.21.15.16:0/3741301784 learned_addr learned my addr 172.21.15.16:0/3741301784 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cb659c640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cb8103b50 0x7f0cb8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.029+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cb8104550 0x7f0cb81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cb6d9d640 1 -- 172.21.15.16:0/3741301784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cb8103b50 msgr2=0x7f0cb8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cb6d9d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cb8103b50 0x7f0cb8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cb6d9d640 1 -- 172.21.15.16:0/3741301784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cb8104550 msgr2=0x7f0cb81997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cb6d9d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cb8104550 0x7f0cb81997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cb6d9d640 1 -- 172.21.15.16:0/3741301784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb819f340 con 0x7f0cb810d100 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cb6d9d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb810d100 0x7f0cb819eb70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e970 tx=0x7f0ca800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0caf7fe640 1 -- 172.21.15.16:0/3741301784 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca800ccc0 con 0x7f0cb810d100 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0caf7fe640 1 -- 172.21.15.16:0/3741301784 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca800ce60 con 0x7f0cb810d100 2024-09-10T23:39:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb819f630 con 0x7f0cb810d100 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0caf7fe640 1 -- 172.21.15.16:0/3741301784 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8010430 con 0x7f0cb810d100 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.030+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb81a5cf0 con 0x7f0cb810d100 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.032+0000 7f0caf7fe640 1 -- 172.21.15.16:0/3741301784 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f0ca8004f90 con 0x7f0cb810d100 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 Processor -- start 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 -- start start 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de0d30 0x55a674de1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ded0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674def9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a674d58c10 con 0x55a674ded5e0 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a674d48040 con 0x55a674de1650 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cbed52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a674d4be50 con 0x55a674de0d30 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cb5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674def9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cb5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674def9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42714/0 (socket says 172.21.15.16:42714) 2024-09-10T23:39:34.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/158420765 learned_addr learned my addr 172.21.15.16:0/158420765 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de0d30 0x55a674de1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.033+0000 7f0cb659c640 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ded0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0caf7fe640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0ca40b53c0 0x7f0ca40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/158420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de0d30 msgr2=0x55a674de1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de0d30 0x55a674de1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/158420765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 msgr2=0x55a674ded0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ded0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/158420765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a674aa6540 con 0x55a674ded5e0 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb659c640 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ded0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb6d9d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0ca40b53c0 0x7f0ca40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674def9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00149f0 tx=0x7f0ca000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f14114620d6648 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0caf7fe640 1 -- 172.21.15.16:0/3741301784 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f0ca80e6370 con 0x7f0cb810d100 2024-09-10T23:39:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cacff9640 1 -- 172.21.15.16:0/158420765 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00142d0 con 0x55a674ded5e0 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cacff9640 1 -- 172.21.15.16:0/158420765 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca000fc10 con 0x55a674ded5e0 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.034+0000 7f0cacff9640 1 -- 172.21.15.16:0/158420765 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0012ba0 con 0x55a674ded5e0 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 -- 172.21.15.16:0/158420765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 msgr2=0x55a674def9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674def9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00149f0 tx=0x7f0ca000c4d0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cb6d9d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0ca40b53c0 0x7f0ca40b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80ac5b0 tx=0x7f0ca80049b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 -- 172.21.15.16:0/158420765 shutdown_connections 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674def9d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ded0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 --2- 172.21.15.16:0/158420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de0d30 0x55a674de1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 -- 172.21.15.16:0/158420765 >> 172.21.15.16:0/158420765 conn(0x55a674ddeb60 msgr2=0x55a674ddfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 -- 172.21.15.16:0/158420765 shutdown_connections 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 -- 172.21.15.16:0/158420765 wait complete. 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 -- start start 2024-09-10T23:39:34.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.035+0000 7f0cbed52740 1 Processor -- start 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674dea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de1650 0x55a674deab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674deb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cbed52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a674ba95f0 con 0x55a674de1650 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cbed52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a674ce3010 con 0x55a674de0d30 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cbed52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a674df0290 con 0x55a674ded5e0 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cbed52740 10 client.0 _ll_register_callbacks cb 0x55a674d42340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de1650 0x55a674deab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de1650 0x55a674deab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42728/0 (socket says 172.21.15.16:42728) 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 -- 172.21.15.16:0/260208549 learned_addr learned my addr 172.21.15.16:0/260208549 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674deb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674dea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 -- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 msgr2=0x55a674deb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674deb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 -- 172.21.15.16:0/260208549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 msgr2=0x55a674dea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674dea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 -- 172.21.15.16:0/260208549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a674d10a00 con 0x55a674de1650 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674dea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0cb659c640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de1650 0x55a674deab30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009ca0 tx=0x7f0cb0005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf4b595e3aba008 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.036+0000 7f0c9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0c9dffb640 1 -- 172.21.15.16:0/260208549 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0031720 con 0x55a674de1650 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0c9dffb640 1 -- 172.21.15.16:0/260208549 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f0cb00318c0 con 0x55a674de1650 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ca000fc10 con 0x55a674de1650 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0c9dffb640 1 -- 172.21.15.16:0/260208549 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0cb0004b40 con 0x55a674de1650 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 10 client.15153 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a674dfbf20 con 0x55a674de1650 2024-09-10T23:39:34.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0c9dffb640 1 -- 172.21.15.16:0/260208549 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca000fc10 con 0x55a674de1650 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0c9dffb640 1 -- 172.21.15.16:0/260208549 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0cb0004510 con 0x55a674de1650 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 10 client.15153 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 10 client.15153 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 20 client.15153 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674dfe550 0x55a674dff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 4 client.15153 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.037+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a674d5ab60 con 0x55a674dfe550 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.038+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674dfe550 0x55a674dff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.038+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674dfe550 0x55a674dff9c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85eb85ddbb975f70 server_cookie=5135db9288eec9bf in_seq=0 out_seq=0 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.038+0000 7f0c9dffb640 10 client.15153 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0c9dffb640 1 -- 172.21.15.16:0/260208549 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a674d5ab60 con 0x55a674dfe550 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0c9dffb640 10 client.15153 handle_command_reply: tid=0 2024-09-10T23:39:34.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 client.15153 shutdown 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de1650 msgr2=0x55a674deab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de1650 0x55a674deab30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009ca0 tx=0x7f0cb0005f80 comp rx=0 tx=0).stop 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 shutdown_connections 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674dfe550 0x55a674dff9c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674deb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de1650 0x55a674deab30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 --2- 172.21.15.16:0/260208549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674dea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 >> 172.21.15.16:0/260208549 conn(0x55a674ddeb60 msgr2=0x55a674de4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0c9dffb640 0 client.15153 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 shutdown_connections 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 1 -- 172.21.15.16:0/260208549 wait complete. 2024-09-10T23:39:34.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.039+0000 7f0cbed52740 20 client.15153 trim_cache size 0 max 16384 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 Processor -- start 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 -- start start 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de0d30 0x55a674de4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ddfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674ddff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a674dfdd00 con 0x55a674de0d30 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a674dfe3d0 con 0x55a674de1650 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cbed52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a674dfeaa0 con 0x55a674ded5e0 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cb5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de0d30 0x55a674de4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cb5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de0d30 0x55a674de4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42738/0 (socket says 172.21.15.16:42738) 2024-09-10T23:39:34.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/1513115247 learned_addr learned my addr 172.21.15.16:0/1513115247 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:34.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cb659c640 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ddfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.058+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674ddff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/1513115247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 msgr2=0x55a674ddff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674ddff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/1513115247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 msgr2=0x55a674ddfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ddfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/1513115247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a674dde990 con 0x55a674de0d30 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0cb659c640 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ddfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de0d30 0x55a674de4e30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55a674de0ce0 tx=0x7f0ca00126e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a929e02b53d92c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0c9ffff640 1 -- 172.21.15.16:0/1513115247 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca002f070 con 0x55a674de0d30 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0c9ffff640 1 -- 172.21.15.16:0/1513115247 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca00140c0 con 0x55a674de0d30 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.059+0000 7f0c9ffff640 1 -- 172.21.15.16:0/1513115247 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00128b0 con 0x55a674de0d30 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 -- 172.21.15.16:0/1513115247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de0d30 msgr2=0x55a674de4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de0d30 0x55a674de4e30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55a674de0ce0 tx=0x7f0ca00126e0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 -- 172.21.15.16:0/1513115247 shutdown_connections 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674ded5e0 0x55a674ddff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de1650 0x55a674ddfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 --2- 172.21.15.16:0/1513115247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674de0d30 0x55a674de4e30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 -- 172.21.15.16:0/1513115247 >> 172.21.15.16:0/1513115247 conn(0x55a674ddeb60 msgr2=0x55a674dfd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 -- 172.21.15.16:0/1513115247 shutdown_connections 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 -- 172.21.15.16:0/1513115247 wait complete. 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 -- start start 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.060+0000 7f0cbed52740 1 Processor -- start 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674e025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de1650 0x55a674e02b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cbed52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674e07bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cbed52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a674dff840 con 0x55a674ded5e0 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cbed52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a674dff170 con 0x55a674de0d30 2024-09-10T23:39:34.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cbed52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a674dfff10 con 0x55a674de1650 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cbed52740 10 client.0 _ll_register_callbacks cb 0x7f0cb0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674e07bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674e07bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42748/0 (socket says 172.21.15.16:42748) 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/2564139191 learned_addr learned my addr 172.21.15.16:0/2564139191 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb659c640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de1650 0x55a674e02b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674e025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de1650 msgr2=0x55a674e02b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de1650 0x55a674e02b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/2564139191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 msgr2=0x55a674e025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674e025f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 -- 172.21.15.16:0/2564139191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a674de5370 con 0x55a674ded5e0 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb659c640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de1650 0x55a674e02b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0cb5d9b640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674e07bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005bf0 tx=0x7f0ca0014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc17db80945ea7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:34.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.061+0000 7f0c9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:34.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0c9dffb640 1 -- 172.21.15.16:0/2564139191 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca002f040 con 0x55a674ded5e0 2024-09-10T23:39:34.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0c9dffb640 1 -- 172.21.15.16:0/2564139191 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f0ca0012960 con 0x55a674ded5e0 2024-09-10T23:39:34.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ca00140c0 con 0x55a674ded5e0 2024-09-10T23:39:34.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0c9dffb640 1 -- 172.21.15.16:0/2564139191 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ca0012b60 con 0x55a674ded5e0 2024-09-10T23:39:34.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 10 client.15159 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:34.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a674ddf5e0 con 0x55a674ded5e0 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0c9dffb640 1 -- 172.21.15.16:0/2564139191 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca00140c0 con 0x55a674ded5e0 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0c9dffb640 1 -- 172.21.15.16:0/2564139191 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0ca0035070 con 0x55a674ded5e0 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 10 client.15159 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 10 client.15159 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 20 client.15159 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674e78290 0x55a674e76fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 4 client.15159 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.062+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "status"}) -- 0x55a674d56610 con 0x55a674e78290 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.063+0000 7f0cb659c640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674e78290 0x55a674e76fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.063+0000 7f0c9dffb640 10 client.15159 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.063+0000 7f0cb659c640 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674e78290 0x55a674e76fa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53e6452e15f7e5f4 server_cookie=2ab354391bf03293 in_seq=0 out_seq=0 2024-09-10T23:39:34.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.063+0000 7f0c9dffb640 1 -- 172.21.15.16:0/2564139191 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a674d56610 con 0x55a674e78290 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.063+0000 7f0c9dffb640 10 client.15159 handle_command_reply: tid=0 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 client.15159 shutdown 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 msgr2=0x55a674e07bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674e07bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005bf0 tx=0x7f0ca0014f70 comp rx=0 tx=0).stop 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 shutdown_connections 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a674e78290 0x55a674e76fa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a674ded5e0 0x55a674e07bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a674de1650 0x55a674e02b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 --2- 172.21.15.16:0/2564139191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a674de0d30 0x55a674e025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 >> 172.21.15.16:0/2564139191 conn(0x55a674ddeb60 msgr2=0x55a674ddfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0c9dffb640 0 client.15159 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 shutdown_connections 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 1 -- 172.21.15.16:0/2564139191 wait complete. 2024-09-10T23:39:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbed52740 20 client.15159 trim_cache size 0 max 16384 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 2, 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24595, 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 71.802110869000003, 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 24, 2024-09-10T23:39:34.071 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 77, 2024-09-10T23:39:34.072 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:39:34.072 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 106.967584781 2024-09-10T23:39:34.072 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:39:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0ca40b53c0 msgr2=0x7f0ca40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0ca40b53c0 0x7f0ca40b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80ac5b0 tx=0x7f0ca80049b0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb810d100 msgr2=0x7f0cb819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.064+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb810d100 0x7f0cb819eb70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800e970 tx=0x7f0ca800ed70 comp rx=0 tx=0).stop 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 shutdown_connections 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb810d100 0x7f0cb819eb70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0ca40b53c0 0x7f0ca40b7880 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cb8104550 0x7f0cb81997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 --2- 172.21.15.16:0/3741301784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0cb8103b50 0x7f0cb8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 >> 172.21.15.16:0/3741301784 conn(0x7f0cb80fd700 msgr2=0x7f0cb80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 shutdown_connections 2024-09-10T23:39:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:34.065+0000 7f0cbc97d640 1 -- 172.21.15.16:0/3741301784 wait complete. 2024-09-10T23:39:34.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:39:35.145 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:35.540 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:35 smithi016 ceph-mon[30855]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:35.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 -- 172.21.15.16:0/3007214215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c104560 msgr2=0x7f500c10cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 --2- 172.21.15.16:0/3007214215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c104560 0x7f500c10cb40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5000009900 tx=0x7f500002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 -- 172.21.15.16:0/3007214215 shutdown_connections 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 --2- 172.21.15.16:0/3007214215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f500c10d110 0x7f500c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 --2- 172.21.15.16:0/3007214215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c104560 0x7f500c10cb40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 --2- 172.21.15.16:0/3007214215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f500c103b60 0x7f500c103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 -- 172.21.15.16:0/3007214215 >> 172.21.15.16:0/3007214215 conn(0x7f500c0fd770 msgr2=0x7f500c0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 -- 172.21.15.16:0/3007214215 shutdown_connections 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 -- 172.21.15.16:0/3007214215 wait complete. 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.622+0000 7f5011336640 1 Processor -- start 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f5011336640 1 -- start start 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f5011336640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f500c103b60 0x7f500c1019e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f5011336640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f500c104560 0x7f500c101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f5011336640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c10d110 0x7f500c102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f5011336640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f500c112de0 con 0x7f500c10d110 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f5011336640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f500c112c60 con 0x7f500c103b60 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f5011336640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f500c112f60 con 0x7f500c104560 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c10d110 0x7f500c102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c10d110 0x7f500c102460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42774/0 (socket says 172.21.15.16:42774) 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 -- 172.21.15.16:0/1938714808 learned_addr learned my addr 172.21.15.16:0/1938714808 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500affd640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f500c103b60 0x7f500c1019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500a7fc640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f500c104560 0x7f500c101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 -- 172.21.15.16:0/1938714808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f500c104560 msgr2=0x7f500c101f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f500c104560 0x7f500c101f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 -- 172.21.15.16:0/1938714808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f500c103b60 msgr2=0x7f500c1019e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f500c103b60 0x7f500c1019e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 -- 172.21.15.16:0/1938714808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c1a76d0 con 0x7f500c10d110 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500a7fc640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f500c104560 0x7f500c101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.623+0000 7f500b7fe640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c10d110 0x7f500c102460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f500400eaa0 tx=0x7f500400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.624+0000 7f4ff3fff640 1 -- 172.21.15.16:0/1938714808 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500400cdb0 con 0x7f500c10d110 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.624+0000 7f4ff3fff640 1 -- 172.21.15.16:0/1938714808 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5004005020 con 0x7f500c10d110 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.624+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c1a79c0 con 0x7f500c10d110 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.624+0000 7f4ff3fff640 1 -- 172.21.15.16:0/1938714808 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040116d0 con 0x7f500c10d110 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.624+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c1a7e80 con 0x7f500c10d110 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 Processor -- start 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f4ff3fff640 1 -- 172.21.15.16:0/1938714808 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f500400f040 con 0x7f500c10d110 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 -- start start 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540558110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d5405640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d5405669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d5404cfc10 con 0x55d5405645e0 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d5404bf040 con 0x55d540557d30 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.627+0000 7f501370b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d5404c2e50 con 0x55d540558650 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d5405669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d5405669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42782/0 (socket says 172.21.15.16:42782) 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 -- 172.21.15.16:0/1646272231 learned_addr learned my addr 172.21.15.16:0/1646272231 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540558110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500affd640 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d5405640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 -- 172.21.15.16:0/1646272231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 msgr2=0x55d5405640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d5405640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 -- 172.21.15.16:0/1646272231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 msgr2=0x55d540558110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540558110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 -- 172.21.15.16:0/1646272231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54021d540 con 0x55d5405645e0 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500a7fc640 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d5405669d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5000009230 tx=0x7f500002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c82cec98dc6a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f4ff3fff640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b53c0 0x7f4ff40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f500affd640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b53c0 0x7f4ff40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f4ff17fa640 1 -- 172.21.15.16:0/1646272231 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000035040 con 0x55d5405645e0 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f4ff17fa640 1 -- 172.21.15.16:0/1646272231 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50000314a0 con 0x55d5405645e0 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f4ff17fa640 1 -- 172.21.15.16:0/1646272231 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500003d6e0 con 0x55d5405645e0 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.628+0000 7f4ff3fff640 1 -- 172.21.15.16:0/1938714808 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f50040e5cf0 con 0x7f500c10d110 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 -- 172.21.15.16:0/1646272231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 msgr2=0x55d5405669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d5405669d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5000009230 tx=0x7f500002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f500affd640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b53c0 0x7f4ff40b7880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55d54055aeb0 tx=0x7f4ffc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:35.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 -- 172.21.15.16:0/1646272231 shutdown_connections 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d5405669d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d5405640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 --2- 172.21.15.16:0/1646272231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540558110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 -- 172.21.15.16:0/1646272231 >> 172.21.15.16:0/1646272231 conn(0x55d540555b60 msgr2=0x55d540556d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 -- 172.21.15.16:0/1646272231 shutdown_connections 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 -- 172.21.15.16:0/1646272231 wait complete. 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.629+0000 7f501370b740 1 -- start start 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 1 Processor -- start 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540561600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d540561b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d540562080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d5403205f0 con 0x55d5405645e0 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d54045a010 con 0x55d540557d30 2024-09-10T23:39:35.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d540567230 con 0x55d540558650 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f501370b740 10 client.0 _ll_register_callbacks cb 0x55d5404b9340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d540562080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d540562080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42798/0 (socket says 172.21.15.16:42798) 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 -- 172.21.15.16:0/4229335798 learned_addr learned my addr 172.21.15.16:0/4229335798 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500affd640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540561600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500a7fc640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d540561b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 -- 172.21.15.16:0/4229335798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 msgr2=0x55d540561b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d540561b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 -- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 msgr2=0x55d540561600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540561600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 -- 172.21.15.16:0/4229335798 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d540487a00 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500affd640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540561600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f500b7fe640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d540562080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f500400efd0 tx=0x7f50040e3a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6b6a3082654d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f4feeff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.630+0000 7f4feeff5640 1 -- 172.21.15.16:0/4229335798 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500401f030 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50000314a0 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f4feeff5640 1 -- 172.21.15.16:0/4229335798 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f50040cf070 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f4feeff5640 1 -- 172.21.15.16:0/4229335798 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f50040b0d70 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 10 client.15171 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d540572ec0 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f4feeff5640 1 -- 172.21.15.16:0/4229335798 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50000314a0 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f4feeff5640 1 -- 172.21.15.16:0/4229335798 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f50040a7be0 con 0x55d5405645e0 2024-09-10T23:39:35.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 10 client.15171 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 10 client.15171 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 20 client.15171 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d540575470 0x55d5405768e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 4 client.15171 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.631+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5404d1b60 con 0x55d540575470 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.632+0000 7f500affd640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d540575470 0x55d5405768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.632+0000 7f500affd640 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d540575470 0x55d5405768e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4742b2423a809cc5 server_cookie=c53dae67941886d in_seq=0 out_seq=0 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.632+0000 7f4feeff5640 10 client.15171 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f4feeff5640 1 -- 172.21.15.16:0/4229335798 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d5404d1b60 con 0x55d540575470 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f4feeff5640 10 client.15171 handle_command_reply: tid=0 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 client.15171 shutdown 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 msgr2=0x55d540562080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d540562080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f500400efd0 tx=0x7f50040e3a60 comp rx=0 tx=0).stop 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 shutdown_connections 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d540575470 0x55d5405768e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d5405645e0 0x55d540562080 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d540561b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 --2- 172.21.15.16:0/4229335798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540557d30 0x55d540561600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f4feeff5640 0 client.15171 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 >> 172.21.15.16:0/4229335798 conn(0x55d540555b60 msgr2=0x55d54055b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 shutdown_connections 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 1 -- 172.21.15.16:0/4229335798 wait complete. 2024-09-10T23:39:35.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.633+0000 7f501370b740 20 client.15171 trim_cache size 0 max 16384 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 Processor -- start 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 -- start start 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d54055bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540558650 0x55d540563340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5405645e0 0x55d54055e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d540574c20 con 0x55d540557d30 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d5405752f0 con 0x55d540558650 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.651+0000 7f501370b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d5405759c0 con 0x55d5405645e0 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d54055bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d54055bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42804/0 (socket says 172.21.15.16:42804) 2024-09-10T23:39:35.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 -- 172.21.15.16:0/423792177 learned_addr learned my addr 172.21.15.16:0/423792177 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500a7fc640 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540558650 0x55d540563340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500b7fe640 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5405645e0 0x55d54055e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 -- 172.21.15.16:0/423792177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5405645e0 msgr2=0x55d54055e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5405645e0 0x55d54055e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 -- 172.21.15.16:0/423792177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540558650 msgr2=0x55d540563340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540558650 0x55d540563340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 -- 172.21.15.16:0/423792177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d540555990 con 0x55d540557d30 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f500affd640 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d54055bef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55d5405773c0 tx=0x7f4ffc004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51b9505573e5f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f4ff0ff9640 1 -- 172.21.15.16:0/423792177 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc020110 con 0x55d540557d30 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f4ff0ff9640 1 -- 172.21.15.16:0/423792177 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ffc0054d0 con 0x55d540557d30 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.652+0000 7f4ff0ff9640 1 -- 172.21.15.16:0/423792177 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc004870 con 0x55d540557d30 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 -- 172.21.15.16:0/423792177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 msgr2=0x55d54055bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d54055bef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55d5405773c0 tx=0x7f4ffc004610 comp rx=0 tx=0).stop 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 -- 172.21.15.16:0/423792177 shutdown_connections 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d5405645e0 0x55d54055e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d540558650 0x55d540563340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 --2- 172.21.15.16:0/423792177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d54055bef0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 -- 172.21.15.16:0/423792177 >> 172.21.15.16:0/423792177 conn(0x55d540555b60 msgr2=0x55d540562c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 -- 172.21.15.16:0/423792177 shutdown_connections 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 -- 172.21.15.16:0/423792177 wait complete. 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.653+0000 7f501370b740 1 -- start start 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 1 Processor -- start 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d540579c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d54057a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5405645e0 0x55d54057a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d540576760 con 0x55d540557d30 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d540576090 con 0x55d5405645e0 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d540576e30 con 0x55d540558650 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f501370b740 10 client.0 _ll_register_callbacks cb 0x7f50040a88e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d540579c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d540579c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42814/0 (socket says 172.21.15.16:42814) 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 -- 172.21.15.16:0/4119813640 learned_addr learned my addr 172.21.15.16:0/4119813640 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500b7fe640 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5405645e0 0x55d54057a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500a7fc640 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d54057a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 -- 172.21.15.16:0/4119813640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 msgr2=0x55d54057a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d54057a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 -- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5405645e0 msgr2=0x55d54057a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5405645e0 0x55d54057a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 -- 172.21.15.16:0/4119813640 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d540556a50 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f500affd640 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d540579c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc004010 tx=0x7f4ffc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e0aeadda57e873 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.654+0000 7f4feeff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f4feeff5640 1 -- 172.21.15.16:0/4119813640 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc035070 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f4feeff5640 1 -- 172.21.15.16:0/4119813640 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4ffc02a430 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ffc0054d0 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f4feeff5640 1 -- 172.21.15.16:0/4119813640 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ffc02a670 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 10 client.15177 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5405565e0 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f4feeff5640 1 -- 172.21.15.16:0/4119813640 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ffc0054d0 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f4feeff5640 1 -- 172.21.15.16:0/4119813640 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4ffc0449d0 con 0x55d540557d30 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 10 client.15177 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:35.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 10 client.15177 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 20 client.15177 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d5405e7600 0x55d5405e6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 4 client.15177 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.655+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "status"}) -- 0x55d5404cd610 con 0x55d5405e7600 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f500a7fc640 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d5405e7600 0x55d5405e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f4feeff5640 10 client.15177 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f500a7fc640 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d5405e7600 0x55d5405e6310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=41bb73d86c784e75 server_cookie=2e9956836f98ff9c in_seq=0 out_seq=0 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f4feeff5640 1 -- 172.21.15.16:0/4119813640 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d5404cd610 con 0x55d5405e7600 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f4feeff5640 10 client.15177 handle_command_reply: tid=0 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 client.15177 shutdown 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 msgr2=0x55d540579c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d540579c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc004010 tx=0x7f4ffc003d40 comp rx=0 tx=0).stop 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 shutdown_connections 2024-09-10T23:39:35.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d5405e7600 0x55d5405e6310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5405645e0 0x55d54057a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d540558650 0x55d54057a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 --2- 172.21.15.16:0/4119813640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d540557d30 0x55d540579c50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 >> 172.21.15.16:0/4119813640 conn(0x55d540555b60 msgr2=0x55d540563450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.656+0000 7f4feeff5640 0 client.15177 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 shutdown_connections 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f501370b740 1 -- 172.21.15.16:0/4119813640 wait complete. 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f501370b740 20 client.15177 trim_cache size 0 max 16384 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:39:35.669 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 1, 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24608, 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 74.399608064999995, 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 24, 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 77, 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:39:35.670 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 94.567796998999995 2024-09-10T23:39:35.671 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:39:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b53c0 msgr2=0x7f4ff40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b53c0 0x7f4ff40b7880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55d54055aeb0 tx=0x7f4ffc00b390 comp rx=0 tx=0).stop 2024-09-10T23:39:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c10d110 msgr2=0x7f500c102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c10d110 0x7f500c102460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f500400eaa0 tx=0x7f500400ef60 comp rx=0 tx=0).stop 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 shutdown_connections 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f500c10d110 0x7f500c102460 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f500c104560 0x7f500c101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b53c0 0x7f4ff40b7880 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 --2- 172.21.15.16:0/1938714808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f500c103b60 0x7f500c1019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 >> 172.21.15.16:0/1938714808 conn(0x7f500c0fd770 msgr2=0x7f500c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 shutdown_connections 2024-09-10T23:39:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:35.657+0000 7f5011336640 1 -- 172.21.15.16:0/1938714808 wait complete. 2024-09-10T23:39:35.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:35 smithi071 ceph-mon[35018]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:35.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:35 smithi066 ceph-mon[34761]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:39:36.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T23:39:36.659 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 -- 172.21.15.16:0/2859963291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c1076e0 msgr2=0x7f611c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 --2- 172.21.15.16:0/2859963291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c1076e0 0x7f611c107b20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6104009900 tx=0x7f610402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 -- 172.21.15.16:0/2859963291 shutdown_connections 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 --2- 172.21.15.16:0/2859963291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f611c108060 0x7f611c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 --2- 172.21.15.16:0/2859963291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c1076e0 0x7f611c107b20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 --2- 172.21.15.16:0/2859963291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f611c101cd0 0x7f611c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 -- 172.21.15.16:0/2859963291 >> 172.21.15.16:0/2859963291 conn(0x7f611c0fd700 msgr2=0x7f611c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 -- 172.21.15.16:0/2859963291 shutdown_connections 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.138+0000 7f6121fdc640 1 -- 172.21.15.16:0/2859963291 wait complete. 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 Processor -- start 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 -- start start 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c101cd0 0x7f611c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f611c1076e0 0x7f611c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f611c108060 0x7f611c19da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f611c111d30 con 0x7f611c101cd0 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f611c111bb0 con 0x7f611c108060 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f6121fdc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f611c111eb0 con 0x7f611c1076e0 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f611b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c101cd0 0x7f611c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f611b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c101cd0 0x7f611c198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42834/0 (socket says 172.21.15.16:42834) 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.139+0000 7f611b7fe640 1 -- 172.21.15.16:0/823663192 learned_addr learned my addr 172.21.15.16:0/823663192 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f611bfff640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f611c108060 0x7f611c19da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f6113fff640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f611c1076e0 0x7f611c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f611b7fe640 1 -- 172.21.15.16:0/823663192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f611c1076e0 msgr2=0x7f611c1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f611b7fe640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f611c1076e0 0x7f611c1986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f611b7fe640 1 -- 172.21.15.16:0/823663192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f611c108060 msgr2=0x7f611c19da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f611b7fe640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f611c108060 0x7f611c19da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f611b7fe640 1 -- 172.21.15.16:0/823663192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c19e230 con 0x7f611c101cd0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f611b7fe640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c101cd0 0x7f611c198180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f610c00d950 tx=0x7f610c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f61197fa640 1 -- 172.21.15.16:0/823663192 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c017070 con 0x7f611c101cd0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f61197fa640 1 -- 172.21.15.16:0/823663192 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f610c009c30 con 0x7f611c101cd0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611c19e520 con 0x7f611c101cd0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f61197fa640 1 -- 172.21.15.16:0/823663192 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c00f620 con 0x7f611c101cd0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.140+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611c1a4db0 con 0x7f611c101cd0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 Processor -- start 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61197fa640 1 -- 172.21.15.16:0/823663192 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f610c010460 con 0x7f611c101cd0 2024-09-10T23:39:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 -- start start 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f3326f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326f860 0x555f3327b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3327b7f0 0x555f3327dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f331e4c10 con 0x555f3327b7f0 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f331d4040 con 0x555f3326f860 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f61243b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f331d7e50 con 0x555f3326ef40 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3327b7f0 0x555f3327dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3327b7f0 0x555f3327dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42848/0 (socket says 172.21.15.16:42848) 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 -- 172.21.15.16:0/2882714521 learned_addr learned my addr 172.21.15.16:0/2882714521 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f611bfff640 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f3326f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f611b7fe640 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326f860 0x555f3327b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 -- 172.21.15.16:0/2882714521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 msgr2=0x555f3326f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f3326f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 -- 172.21.15.16:0/2882714521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326f860 msgr2=0x555f3327b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326f860 0x555f3327b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f6113fff640 1 -- 172.21.15.16:0/2882714521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f32f32540 con 0x555f3327b7f0 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.143+0000 7f611b7fe640 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326f860 0x555f3327b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.144+0000 7f6113fff640 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3327b7f0 0x555f3327dbe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6104033000 tx=0x7f6104004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcbf0cbe52e6a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.144+0000 7f6111ffb640 1 -- 172.21.15.16:0/2882714521 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610403f070 con 0x555f3327b7f0 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.144+0000 7f6111ffb640 1 -- 172.21.15.16:0/2882714521 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6104005500 con 0x555f3327b7f0 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.144+0000 7f6111ffb640 1 -- 172.21.15.16:0/2882714521 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104035070 con 0x555f3327b7f0 2024-09-10T23:39:37.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.144+0000 7f61197fa640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61080b5440 0x7f61080b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.144+0000 7f611bfff640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61080b5440 0x7f61080b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.144+0000 7f61197fa640 1 -- 172.21.15.16:0/823663192 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f610c0e5aa0 con 0x7f611c101cd0 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 -- 172.21.15.16:0/2882714521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3327b7f0 msgr2=0x555f3327dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f611bfff640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61080b5440 0x7f61080b7900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6114005fd0 tx=0x7f6114009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3327b7f0 0x555f3327dbe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6104033000 tx=0x7f6104004170 comp rx=0 tx=0).stop 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 -- 172.21.15.16:0/2882714521 shutdown_connections 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3327b7f0 0x555f3327dbe0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326f860 0x555f3327b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 --2- 172.21.15.16:0/2882714521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f3326f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 -- 172.21.15.16:0/2882714521 >> 172.21.15.16:0/2882714521 conn(0x555f3326cd70 msgr2=0x555f3326df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 -- 172.21.15.16:0/2882714521 shutdown_connections 2024-09-10T23:39:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 -- 172.21.15.16:0/2882714521 wait complete. 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 -- start start 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 Processor -- start 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f33278750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.145+0000 7f61243b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33278c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f61243b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f332791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f61243b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f330355f0 con 0x555f3326f860 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f61243b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f3316f010 con 0x555f3326ef40 2024-09-10T23:39:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f61243b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f3327e440 con 0x555f3327b7f0 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f61243b1740 10 client.0 _ll_register_callbacks cb 0x555f331ce340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33278c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33278c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42858/0 (socket says 172.21.15.16:42858) 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 -- 172.21.15.16:0/1738856733 learned_addr learned my addr 172.21.15.16:0/1738856733 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f611b7fe640 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f33278750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f611bfff640 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f332791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 -- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 msgr2=0x555f332791d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f332791d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 -- 172.21.15.16:0/1738856733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 msgr2=0x555f33278750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f33278750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 -- 172.21.15.16:0/1738856733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3319ca00 con 0x555f3326f860 2024-09-10T23:39:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f6113fff640 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33278c90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6104009290 tx=0x7f61040056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db5ec952ea95108 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f60faffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f60faffd640 1 -- 172.21.15.16:0/1738856733 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610404d060 con 0x555f3326f860 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f60faffd640 1 -- 172.21.15.16:0/1738856733 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f61040035f0 con 0x555f3326f860 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.146+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6104005500 con 0x555f3326f860 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f60faffd640 1 -- 172.21.15.16:0/1738856733 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f610403f070 con 0x555f3326f860 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 10 client.15189 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f33289f40 con 0x555f3326f860 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f60faffd640 1 -- 172.21.15.16:0/1738856733 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6104005500 con 0x555f3326f860 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f60faffd640 1 -- 172.21.15.16:0/1738856733 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f61040318f0 con 0x555f3326f860 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 10 client.15189 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 10 client.15189 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 20 client.15189 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f3328c0f0 0x555f3328d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 4 client.15189 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f331e6b60 con 0x555f3328c0f0 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.147+0000 7f611b7fe640 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f3328c0f0 0x555f3328d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.148+0000 7f60faffd640 10 client.15189 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.148+0000 7f611b7fe640 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f3328c0f0 0x555f3328d560 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3b7dfe4eabc6144 server_cookie=be6c483af445e292 in_seq=0 out_seq=0 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f60faffd640 1 -- 172.21.15.16:0/1738856733 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555f331e6b60 con 0x555f3328c0f0 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f60faffd640 10 client.15189 handle_command_reply: tid=0 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 client.15189 shutdown 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 msgr2=0x555f33278c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33278c90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6104009290 tx=0x7f61040056b0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 shutdown_connections 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f3328c0f0 0x555f3328d560 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f332791d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33278c90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f60faffd640 0 client.15189 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:37.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 --2- 172.21.15.16:0/1738856733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f33278750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 >> 172.21.15.16:0/1738856733 conn(0x555f3326cd70 msgr2=0x555f33269d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:37.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 shutdown_connections 2024-09-10T23:39:37.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 1 -- 172.21.15.16:0/1738856733 wait complete. 2024-09-10T23:39:37.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.149+0000 7f61243b1740 20 client.15189 trim_cache size 0 max 16384 2024-09-10T23:39:37.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.167+0000 7f61243b1740 1 Processor -- start 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.167+0000 7f61243b1740 1 -- start start 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61243b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f3328d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61243b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33273020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61243b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f3326ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61243b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f3328b8a0 con 0x555f3326f860 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61243b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f3328bf70 con 0x555f3326ef40 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61243b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f3328c640 con 0x555f3327b7f0 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33273020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33273020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42860/0 (socket says 172.21.15.16:42860) 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 -- 172.21.15.16:0/2505251593 learned_addr learned my addr 172.21.15.16:0/2505251593 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f611bfff640 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f3326ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f611b7fe640 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f3328d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 -- 172.21.15.16:0/2505251593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 msgr2=0x555f3326ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f3326ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 -- 172.21.15.16:0/2505251593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 msgr2=0x555f3328d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f3328d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 -- 172.21.15.16:0/2505251593 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3326d7f0 con 0x555f3326f860 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f611b7fe640 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f3328d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f6113fff640 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33273020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f610402a930 tx=0x7f6104005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb95f5cbf64411a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61117fa640 1 -- 172.21.15.16:0/2505251593 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610404d070 con 0x555f3326f860 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61117fa640 1 -- 172.21.15.16:0/2505251593 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6104031950 con 0x555f3326f860 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.168+0000 7f61117fa640 1 -- 172.21.15.16:0/2505251593 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104035040 con 0x555f3326f860 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 -- 172.21.15.16:0/2505251593 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 msgr2=0x555f33273020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33273020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f610402a930 tx=0x7f6104005b50 comp rx=0 tx=0).stop 2024-09-10T23:39:37.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 -- 172.21.15.16:0/2505251593 shutdown_connections 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3327b7f0 0x555f3326ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f33273020 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 --2- 172.21.15.16:0/2505251593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3326ef40 0x555f3328d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 -- 172.21.15.16:0/2505251593 >> 172.21.15.16:0/2505251593 conn(0x555f3326cd70 msgr2=0x555f332694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 -- 172.21.15.16:0/2505251593 shutdown_connections 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 -- 172.21.15.16:0/2505251593 wait complete. 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.169+0000 7f61243b1740 1 -- start start 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 1 Processor -- start 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f33276220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f332694e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3327b7f0 0x555f33269a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f3328d3e0 con 0x555f3326f860 2024-09-10T23:39:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f3328cd10 con 0x555f3327b7f0 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555f3328dab0 con 0x555f3326ef40 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f61243b1740 10 client.0 _ll_register_callbacks cb 0x7f6114009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f332694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f332694e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42874/0 (socket says 172.21.15.16:42874) 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 -- 172.21.15.16:0/1186124007 learned_addr learned my addr 172.21.15.16:0/1186124007 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f611bfff640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3327b7f0 0x555f33269a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f611b7fe640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f33276220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 -- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 msgr2=0x555f33276220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f33276220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 -- 172.21.15.16:0/1186124007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3327b7f0 msgr2=0x555f33269a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3327b7f0 0x555f33269a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f6113fff640 1 -- 172.21.15.16:0/1186124007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3326a290 con 0x555f3326f860 2024-09-10T23:39:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.170+0000 7f611bfff640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3327b7f0 0x555f33269a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f6113fff640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f332694e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6104009900 tx=0x7f610402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee24b5eb9fbc7cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f60faffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f60faffd640 1 -- 172.21.15.16:0/1186124007 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104060060 con 0x555f3326f860 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f60faffd640 1 -- 172.21.15.16:0/1186124007 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f61040316a0 con 0x555f3326f860 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6104031950 con 0x555f3326f860 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f60faffd640 1 -- 172.21.15.16:0/1186124007 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6104035030 con 0x555f3326f860 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 10 client.15195 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f332fba60 con 0x555f3326f860 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f60faffd640 1 -- 172.21.15.16:0/1186124007 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6104031950 con 0x555f3326f860 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f60faffd640 1 -- 172.21.15.16:0/1186124007 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6104003710 con 0x555f3326f860 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 10 client.15195 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 10 client.15195 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 20 client.15195 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f33300390 0x555f332ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 4 client.15195 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.171+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "status"}) -- 0x555f331e2610 con 0x555f33300390 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f611b7fe640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f33300390 0x555f332ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f611b7fe640 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f33300390 0x555f332ff0a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a13b3db5ebe1c1 server_cookie=102435d3b2031bd8 in_seq=0 out_seq=0 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f60faffd640 10 client.15195 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f60faffd640 1 -- 172.21.15.16:0/1186124007 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555f331e2610 con 0x555f33300390 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f60faffd640 10 client.15195 handle_command_reply: tid=0 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 client.15195 shutdown 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 msgr2=0x555f332694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f332694e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6104009900 tx=0x7f610402a410 comp rx=0 tx=0).stop 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 shutdown_connections 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555f33300390 0x555f332ff0a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f3327b7f0 0x555f33269a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f3326f860 0x555f332694e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 --2- 172.21.15.16:0/1186124007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555f3326ef40 0x555f33276220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 >> 172.21.15.16:0/1186124007 conn(0x555f3326cd70 msgr2=0x555f3327a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.172+0000 7f60faffd640 0 client.15195 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 shutdown_connections 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f61243b1740 1 -- 172.21.15.16:0/1186124007 wait complete. 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f61243b1740 20 client.15195 trim_cache size 0 max 16384 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-09-10T23:39:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24610, 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 83.942416780000002, 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 24, 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 77, 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 104.752125811 2024-09-10T23:39:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:39:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61080b5440 msgr2=0x7f61080b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61080b5440 0x7f61080b7900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6114005fd0 tx=0x7f6114009600 comp rx=0 tx=0).stop 2024-09-10T23:39:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c101cd0 msgr2=0x7f611c198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c101cd0 0x7f611c198180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f610c00d950 tx=0x7f610c00de10 comp rx=0 tx=0).stop 2024-09-10T23:39:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 shutdown_connections 2024-09-10T23:39:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61080b5440 0x7f61080b7900 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f611c108060 0x7f611c19da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f611c1076e0 0x7f611c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 --2- 172.21.15.16:0/823663192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c101cd0 0x7f611c198180 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 >> 172.21.15.16:0/823663192 conn(0x7f611c0fd700 msgr2=0x7f611c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 shutdown_connections 2024-09-10T23:39:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:37.173+0000 7f6121fdc640 1 -- 172.21.15.16:0/823663192 wait complete. 2024-09-10T23:39:37.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:37 smithi071 ceph-mon[35018]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:37 smithi066 ceph-mon[34761]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:37.807 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:37 smithi016 ceph-mon[30855]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:39:37.912 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T23:39:37.912 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:39:37.921 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:39:37.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T23:39:38.181 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:38.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.613+0000 7fa061f61640 1 -- 172.21.15.16:0/3393648194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c101c90 msgr2=0x7fa05c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:38.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.613+0000 7fa061f61640 1 --2- 172.21.15.16:0/3393648194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c101c90 0x7fa05c102070 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009900 tx=0x7fa04c02a410 comp rx=0 tx=0).stop 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 -- 172.21.15.16:0/3393648194 shutdown_connections 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 --2- 172.21.15.16:0/3393648194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa05c108020 0x7fa05c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 --2- 172.21.15.16:0/3393648194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa05c1076a0 0x7fa05c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 --2- 172.21.15.16:0/3393648194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c101c90 0x7fa05c102070 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 -- 172.21.15.16:0/3393648194 >> 172.21.15.16:0/3393648194 conn(0x7fa05c0fd700 msgr2=0x7fa05c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 -- 172.21.15.16:0/3393648194 shutdown_connections 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 -- 172.21.15.16:0/3393648194 wait complete. 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.614+0000 7fa061f61640 1 Processor -- start 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa061f61640 1 -- start start 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa061f61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa05c101c90 0x7fa05c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa061f61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c1076a0 0x7fa05c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa061f61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa05c108020 0x7fa05c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa061f61640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c111cf0 con 0x7fa05c1076a0 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa061f61640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c111b70 con 0x7fa05c108020 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa061f61640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c111e70 con 0x7fa05c101c90 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c1076a0 0x7fa05c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c1076a0 0x7fa05c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42890/0 (socket says 172.21.15.16:42890) 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 -- 172.21.15.16:0/3243410478 learned_addr learned my addr 172.21.15.16:0/3243410478 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05b7fe640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa05c101c90 0x7fa05c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 -- 172.21.15.16:0/3243410478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa05c101c90 msgr2=0x7fa05c19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa05c101c90 0x7fa05c19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05bfff640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa05c108020 0x7fa05c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 -- 172.21.15.16:0/3243410478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa05c108020 msgr2=0x7fa05c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa05c108020 0x7fa05c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 -- 172.21.15.16:0/3243410478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c1a54a0 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05bfff640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa05c108020 0x7fa05c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.615+0000 7fa05affd640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c1076a0 0x7fa05c19a600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c890 tx=0x7fa05000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.616+0000 7fa058ff9640 1 -- 172.21.15.16:0/3243410478 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050004220 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.616+0000 7fa058ff9640 1 -- 172.21.15.16:0/3243410478 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0500043c0 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.616+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c1a5790 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.616+0000 7fa058ff9640 1 -- 172.21.15.16:0/3243410478 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050004a00 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.616+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c1a5cd0 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.617+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05c102070 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.618+0000 7fa058ff9640 1 -- 172.21.15.16:0/3243410478 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa0500079b0 con 0x7fa05c1076a0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.619+0000 7fa058ff9640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0440b53c0 0x7fa0440b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.619+0000 7fa05b7fe640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0440b53c0 0x7fa0440b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.619+0000 7fa058ff9640 1 -- 172.21.15.16:0/3243410478 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa0500e6030 con 0x7fa05c1076a0 2024-09-10T23:39:38.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.620+0000 7fa05b7fe640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0440b53c0 0x7fa0440b7880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005ab0 tx=0x7fa04c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:38.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.622+0000 7fa058ff9640 1 -- 172.21.15.16:0/3243410478 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa050014030 con 0x7fa05c1076a0 2024-09-10T23:39:38.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.824+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa05c063590 con 0x7fa0440b53c0 2024-09-10T23:39:38.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.825+0000 7fa058ff9640 1 -- 172.21.15.16:0/3243410478 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa05c063590 con 0x7fa0440b53c0 2024-09-10T23:39:38.827 INFO:teuthology.orchestra.run.smithi016.stdout:Backend: cephadm 2024-09-10T23:39:38.827 INFO:teuthology.orchestra.run.smithi016.stdout:Available: Yes 2024-09-10T23:39:38.827 INFO:teuthology.orchestra.run.smithi016.stdout:Paused: No 2024-09-10T23:39:38.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.827+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0440b53c0 msgr2=0x7fa0440b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:38.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.827+0000 7fa061f61640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0440b53c0 0x7fa0440b7880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005ab0 tx=0x7fa04c005a20 comp rx=0 tx=0).stop 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.827+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c1076a0 msgr2=0x7fa05c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.827+0000 7fa061f61640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c1076a0 0x7fa05c19a600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c890 tx=0x7fa05000cd50 comp rx=0 tx=0).stop 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.827+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 shutdown_connections 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.827+0000 7fa061f61640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa0440b53c0 0x7fa0440b7880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.828+0000 7fa061f61640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa05c108020 0x7fa05c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.828+0000 7fa061f61640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa05c1076a0 0x7fa05c19a600 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.828+0000 7fa061f61640 1 --2- 172.21.15.16:0/3243410478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa05c101c90 0x7fa05c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.828+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 >> 172.21.15.16:0/3243410478 conn(0x7fa05c0fd700 msgr2=0x7fa05c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.828+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 shutdown_connections 2024-09-10T23:39:38.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:38.828+0000 7fa061f61640 1 -- 172.21.15.16:0/3243410478 wait complete. 2024-09-10T23:39:39.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T23:39:39.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:39 smithi071 ceph-mon[35018]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:39:39.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:39 smithi071 ceph-mon[35018]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:39.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:39 smithi066 ceph-mon[34761]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:39:39.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:39 smithi066 ceph-mon[34761]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:39.831 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:39.952 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:39 smithi016 ceph-mon[30855]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:39:39.952 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:39 smithi016 ceph-mon[30855]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:40.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 -- 172.21.15.16:0/3887651300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a4103ca0 msgr2=0x7f23a4104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:40.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/3887651300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a4103ca0 0x7f23a4104080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f239c009900 tx=0x7f239c02a410 comp rx=0 tx=0).stop 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 -- 172.21.15.16:0/3887651300 shutdown_connections 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/3887651300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a410d100 0x7f23a410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/3887651300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23a41045c0 0x7f23a410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/3887651300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a4103ca0 0x7f23a4104080 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 -- 172.21.15.16:0/3887651300 >> 172.21.15.16:0/3887651300 conn(0x7f23a40fd700 msgr2=0x7f23a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 -- 172.21.15.16:0/3887651300 shutdown_connections 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.291+0000 7f23a8fc5640 1 -- 172.21.15.16:0/3887651300 wait complete. 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 Processor -- start 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 -- start start 2024-09-10T23:39:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23a4103ca0 0x7f23a4199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a41045c0 0x7f23a4199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a410d100 0x7f23a419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4112d70 con 0x7f23a410d100 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4112bf0 con 0x7f23a4103ca0 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a8fc5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4112ef0 con 0x7f23a41045c0 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a410d100 0x7f23a419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a410d100 0x7f23a419eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42914/0 (socket says 172.21.15.16:42914) 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 -- 172.21.15.16:0/1126412285 learned_addr learned my addr 172.21.15.16:0/1126412285 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a259c640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23a4103ca0 0x7f23a4199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a1d9b640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a41045c0 0x7f23a4199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 -- 172.21.15.16:0/1126412285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a41045c0 msgr2=0x7f23a4199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a41045c0 0x7f23a4199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 -- 172.21.15.16:0/1126412285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23a4103ca0 msgr2=0x7f23a4199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23a4103ca0 0x7f23a4199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a2d9d640 1 -- 172.21.15.16:0/1126412285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a419f2b0 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.292+0000 7f23a259c640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23a4103ca0 0x7f23a4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.293+0000 7f23a2d9d640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a410d100 0x7f23a419eae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f239400cce0 tx=0x7f239400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.293+0000 7f239b7fe640 1 -- 172.21.15.16:0/1126412285 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239400f450 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.293+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a419f5a0 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.293+0000 7f239b7fe640 1 -- 172.21.15.16:0/1126412285 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f239400faa0 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.293+0000 7f239b7fe640 1 -- 172.21.15.16:0/1126412285 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394018b70 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.293+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a41a5c60 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.294+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a4104080 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.296+0000 7f239b7fe640 1 -- 172.21.15.16:0/1126412285 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f239400f5f0 con 0x7f23a410d100 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.297+0000 7f239b7fe640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23900b53c0 0x7f23900b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.297+0000 7f23a259c640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23900b53c0 0x7f23900b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.297+0000 7f239b7fe640 1 -- 172.21.15.16:0/1126412285 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f23940e6760 con 0x7f23a410d100 2024-09-10T23:39:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.298+0000 7f23a259c640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23900b53c0 0x7f23900b7880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f239c031440 tx=0x7f239c0095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.301+0000 7f239b7fe640 1 -- 172.21.15.16:0/1126412285 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2394014030 con 0x7f23a410d100 2024-09-10T23:39:40.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.499+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f23a40ff310 con 0x7f23900b53c0 2024-09-10T23:39:40.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.511+0000 7f239b7fe640 1 -- 172.21.15.16:0/1126412285 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f23a40ff310 con 0x7f23900b53c0 2024-09-10T23:39:40.512 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.a smithi016 running (102s) 18s ago 102s 14.5M - 19.3.0-4854-g8f219c47 589dd18248e4 6d55afa028d9 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.b smithi066 running (99s) 32s ago 99s 20.1M - 19.3.0-4854-g8f219c47 589dd18248e4 d3f88bd26baa 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.c smithi071 running (113s) 32s ago 113s 18.3M - 19.3.0-4854-g8f219c47 589dd18248e4 e5a938f68e61 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.d smithi016 running (2m) 18s ago 2m 16.9M - 19.3.0-4854-g8f219c47 589dd18248e4 7bc8860cb09c 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.e smithi066 running (118s) 32s ago 118s 18.7M - 19.3.0-4854-g8f219c47 589dd18248e4 3fc3d5aeb3bd 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.f smithi071 running (116s) 32s ago 115s 18.0M - 19.3.0-4854-g8f219c47 589dd18248e4 f9294f6f77cc 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.g smithi016 running (105s) 18s ago 105s 14.5M - 19.3.0-4854-g8f219c47 589dd18248e4 107126098c05 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.h smithi066 running (111s) 32s ago 110s 16.2M - 19.3.0-4854-g8f219c47 589dd18248e4 6ca599a42820 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.i smithi071 running (108s) 32s ago 108s 26.5M - 19.3.0-4854-g8f219c47 589dd18248e4 5587b0520d03 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.j smithi016 running (2m) 18s ago 2m 16.0M - 19.3.0-4854-g8f219c47 589dd18248e4 ce66644e9da9 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.k smithi066 running (2m) 32s ago 2m 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 70f9ee2e6735 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mds.l smithi071 running (2m) 32s ago 2m 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 44f070f54c21 2024-09-10T23:39:40.513 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi016 *:9283,8765 running (9m) 18s ago 9m 517M - 19.3.0-4854-g8f219c47 589dd18248e4 73263e313d13 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi066 *:8443,8765 running (7m) 32s ago 7m 458M - 19.3.0-4854-g8f219c47 589dd18248e4 2bf6133cebaa 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.z smithi071 *:8443,8765 running (7m) 32s ago 7m 458M - 19.3.0-4854-g8f219c47 589dd18248e4 ddc124c97762 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (9m) 18s ago 9m 54.3M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3e2df7a6de60 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi066 running (8m) 32s ago 8m 40.9M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 28f2cdd56786 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi071 running (8m) 32s ago 8m 44.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 6101ca668f71 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 18s ago 7m 45.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 2b03f2066793 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi066 running (6m) 32s ago 6m 56.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 21f6520f3f2f 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi071 running (6m) 32s ago 6m 58.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 4e6520f9ee1b 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (5m) 18s ago 5m 57.3M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 64e95a26ab4c 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi066 running (5m) 32s ago 5m 43.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 3bcd6853d887 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi071 running (4m) 32s ago 4m 52.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 c6880f6a8d54 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi016 running (4m) 18s ago 4m 44.8M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 65abd48b4205 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi066 running (4m) 32s ago 4m 57.1M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 20e8707b6bf5 2024-09-10T23:39:40.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.8 smithi071 running (3m) 32s ago 3m 51.6M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 a1bab1a882fd 2024-09-10T23:39:40.515 INFO:teuthology.orchestra.run.smithi016.stdout:osd.9 smithi016 running (3m) 18s ago 3m 53.6M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 64a4a71425d3 2024-09-10T23:39:40.515 INFO:teuthology.orchestra.run.smithi016.stdout:osd.10 smithi066 running (2m) 32s ago 2m 52.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 b11ded34a55d 2024-09-10T23:39:40.515 INFO:teuthology.orchestra.run.smithi016.stdout:osd.11 smithi071 running (2m) 32s ago 2m 43.1M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 4d3bb3aab0a5 2024-09-10T23:39:40.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23900b53c0 msgr2=0x7f23900b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23900b53c0 0x7f23900b7880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f239c031440 tx=0x7f239c0095f0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a410d100 msgr2=0x7f23a419eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a410d100 0x7f23a419eae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f239400cce0 tx=0x7f239400a620 comp rx=0 tx=0).stop 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 shutdown_connections 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a410d100 0x7f23a419eae0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a41045c0 0x7f23a4199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f23900b53c0 0x7f23900b7880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 --2- 172.21.15.16:0/1126412285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23a4103ca0 0x7f23a4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.513+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 >> 172.21.15.16:0/1126412285 conn(0x7f23a40fd700 msgr2=0x7f23a410f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.514+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 shutdown_connections 2024-09-10T23:39:40.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:40.514+0000 7f23a8fc5640 1 -- 172.21.15.16:0/1126412285 wait complete. 2024-09-10T23:39:41.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T23:39:41.521 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:41.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:41 smithi071 ceph-mon[35018]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:41.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:41 smithi071 ceph-mon[35018]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:41.792 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:41 smithi016 ceph-mon[30855]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:41.792 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:41 smithi016 ceph-mon[30855]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:41.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:41 smithi066 ceph-mon[34761]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:39:41.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:41 smithi066 ceph-mon[34761]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 -- 172.21.15.16:0/443797893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 msgr2=0x7f7420107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 --2- 172.21.15.16:0/443797893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f7420107b20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f740c009900 tx=0x7f740c02a410 comp rx=0 tx=0).stop 2024-09-10T23:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 -- 172.21.15.16:0/443797893 shutdown_connections 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 --2- 172.21.15.16:0/443797893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7420108060 0x7f742010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 --2- 172.21.15.16:0/443797893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f7420107b20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 --2- 172.21.15.16:0/443797893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7420101cd0 0x7f74201020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 -- 172.21.15.16:0/443797893 >> 172.21.15.16:0/443797893 conn(0x7f74200fd720 msgr2=0x7f74200ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 -- 172.21.15.16:0/443797893 shutdown_connections 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.024+0000 7f74270e2640 1 -- 172.21.15.16:0/443797893 wait complete. 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 Processor -- start 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 -- start start 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7420101cd0 0x7f7420199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f74201997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7420108060 0x7f742019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7420112f10 con 0x7f74201076e0 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7420112d90 con 0x7f7420101cd0 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f74270e2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7420113090 con 0x7f7420108060 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f74201997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f74201997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42938/0 (socket says 172.21.15.16:42938) 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 -- 172.21.15.16:0/754340940 learned_addr learned my addr 172.21.15.16:0/754340940 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f742567f640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7420108060 0x7f742019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f7424e7e640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7420101cd0 0x7f7420199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 -- 172.21.15.16:0/754340940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7420108060 msgr2=0x7f742019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7420108060 0x7f742019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 -- 172.21.15.16:0/754340940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7420101cd0 msgr2=0x7f7420199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7420101cd0 0x7f7420199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.025+0000 7f741ffff640 1 -- 172.21.15.16:0/754340940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742019f320 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.026+0000 7f741ffff640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f74201997b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f740c005940 tx=0x7f740c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.026+0000 7f741dffb640 1 -- 172.21.15.16:0/754340940 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c03f030 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.026+0000 7f741dffb640 1 -- 172.21.15.16:0/754340940 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f740c003cb0 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.026+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742019f5b0 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.026+0000 7f741dffb640 1 -- 172.21.15.16:0/754340940 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c035070 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.026+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74201a5cd0 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.027+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74201020b0 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.029+0000 7f741dffb640 1 -- 172.21.15.16:0/754340940 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f740c03bbf0 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.029+0000 7f741dffb640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74100b5440 0x7f74100b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.029+0000 7f7424e7e640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74100b5440 0x7f74100b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.030+0000 7f741dffb640 1 -- 172.21.15.16:0/754340940 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f740c106ba0 con 0x7f74201076e0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.030+0000 7f7424e7e640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74100b5440 0x7f74100b7900 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7414005fd0 tx=0x7f741400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.033+0000 7f741dffb640 1 -- 172.21.15.16:0/754340940 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f740c0cd1f0 con 0x7f74201076e0 2024-09-10T23:39:42.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.226+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f7420063590 con 0x7f74100b5440 2024-09-10T23:39:42.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.232+0000 7f741dffb640 1 -- 172.21.15.16:0/754340940 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f7420063590 con 0x7f74100b5440 2024-09-10T23:39:42.233 INFO:teuthology.orchestra.run.smithi016.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T23:39:42.233 INFO:teuthology.orchestra.run.smithi016.stdout:mds.all 12/12 34s ago 2m smithi016=a;smithi016=d;smithi016=g;smithi016=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-10T23:39:42.233 INFO:teuthology.orchestra.run.smithi016.stdout:mgr 3/3 34s ago 7m smithi016=x;smithi066=y;smithi071=z;count:3 2024-09-10T23:39:42.233 INFO:teuthology.orchestra.run.smithi016.stdout:mon 3/3 34s ago 8m smithi016:172.21.15.16=a;smithi066:172.21.15.66=b;smithi071:172.21.15.71=c;count:3 2024-09-10T23:39:42.233 INFO:teuthology.orchestra.run.smithi016.stdout:osd 12 34s ago - 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74100b5440 msgr2=0x7f74100b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74100b5440 0x7f74100b7900 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7414005fd0 tx=0x7f741400b390 comp rx=0 tx=0).stop 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 msgr2=0x7f74201997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f74201997b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f740c005940 tx=0x7f740c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 shutdown_connections 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7420108060 0x7f742019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74201076e0 0x7f74201997b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f74100b5440 0x7f74100b7900 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 --2- 172.21.15.16:0/754340940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7420101cd0 0x7f7420199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:42.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 >> 172.21.15.16:0/754340940 conn(0x7f74200fd720 msgr2=0x7f74200ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:42.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 shutdown_connections 2024-09-10T23:39:42.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:42.234+0000 7f74270e2640 1 -- 172.21.15.16:0/754340940 wait complete. 2024-09-10T23:39:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:42 smithi071 ceph-mon[35018]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:42.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:42 smithi066 ceph-mon[34761]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:42.913 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:42 smithi016 ceph-mon[30855]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:42.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T23:39:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:43.643 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:43 smithi016 ceph-mon[30855]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:43.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 -- 172.21.15.16:0/3591797031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc102dc0 msgr2=0x7f8dfc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 --2- 172.21.15.16:0/3591797031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc102dc0 0x7f8dfc1031a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009ca0 tx=0x7f8dec02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 -- 172.21.15.16:0/3591797031 shutdown_connections 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 --2- 172.21.15.16:0/3591797031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dfc109150 0x7f8dfc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 --2- 172.21.15.16:0/3591797031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dfc1087d0 0x7f8dfc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 --2- 172.21.15.16:0/3591797031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc102dc0 0x7f8dfc1031a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 -- 172.21.15.16:0/3591797031 >> 172.21.15.16:0/3591797031 conn(0x7f8dfc0fe830 msgr2=0x7f8dfc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 -- 172.21.15.16:0/3591797031 shutdown_connections 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.725+0000 7f8e017df640 1 -- 172.21.15.16:0/3591797031 wait complete. 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.726+0000 7f8e017df640 1 Processor -- start 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.726+0000 7f8e017df640 1 -- start start 2024-09-10T23:39:43.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.726+0000 7f8e017df640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dfc102dc0 0x7f8dfc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.726+0000 7f8e017df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dfc1087d0 0x7f8dfc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.726+0000 7f8e017df640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc109150 0x7f8dfc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8e017df640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc112e10 con 0x7f8dfc109150 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8e017df640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc112c90 con 0x7f8dfc1087d0 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8e017df640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc112f90 con 0x7f8dfc102dc0 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc109150 0x7f8dfc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc109150 0x7f8dfc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42734/0 (socket says 172.21.15.16:42734) 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 -- 172.21.15.16:0/2865359123 learned_addr learned my addr 172.21.15.16:0/2865359123 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfaffd640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dfc102dc0 0x7f8dfc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfa7fc640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dfc1087d0 0x7f8dfc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 -- 172.21.15.16:0/2865359123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dfc102dc0 msgr2=0x7f8dfc0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dfc102dc0 0x7f8dfc0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 -- 172.21.15.16:0/2865359123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dfc1087d0 msgr2=0x7f8dfc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:43.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dfc1087d0 0x7f8dfc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 -- 172.21.15.16:0/2865359123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc1a7600 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8dfb7fe640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc109150 0x7f8dfc075f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c970 tx=0x7f8df400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8de3fff640 1 -- 172.21.15.16:0/2865359123 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4007bb0 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8de3fff640 1 -- 172.21.15.16:0/2865359123 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8df4007d50 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc1a78f0 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8de3fff640 1 -- 172.21.15.16:0/2865359123 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4018770 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.727+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc1a7e30 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.728+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc1031a0 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.730+0000 7f8de3fff640 1 -- 172.21.15.16:0/2865359123 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f8df400f990 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.731+0000 7f8de3fff640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8de40b5440 0x7f8de40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.731+0000 7f8dfaffd640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8de40b5440 0x7f8de40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.731+0000 7f8de3fff640 1 -- 172.21.15.16:0/2865359123 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f8df40e5fc0 con 0x7f8dfc109150 2024-09-10T23:39:43.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.731+0000 7f8dfaffd640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8de40b5440 0x7f8de40b7900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0098d0 tx=0x7f8dec009900 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:43.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.734+0000 7f8de3fff640 1 -- 172.21.15.16:0/2865359123 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8df4014030 con 0x7f8dfc109150 2024-09-10T23:39:43.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:43 smithi071 ceph-mon[35018]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:43.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:43 smithi066 ceph-mon[34761]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:39:43.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.926+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8dfc100670 con 0x7f8de40b5440 2024-09-10T23:39:43.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.927+0000 7f8de3fff640 1 -- 172.21.15.16:0/2865359123 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f8dfc100670 con 0x7f8de40b5440 2024-09-10T23:39:43.928 INFO:teuthology.orchestra.run.smithi016.stdout:HOST ADDR LABELS STATUS 2024-09-10T23:39:43.928 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016 172.21.15.16 2024-09-10T23:39:43.928 INFO:teuthology.orchestra.run.smithi016.stdout:smithi066 172.21.15.66 2024-09-10T23:39:43.929 INFO:teuthology.orchestra.run.smithi016.stdout:smithi071 172.21.15.71 2024-09-10T23:39:43.929 INFO:teuthology.orchestra.run.smithi016.stdout:3 hosts in cluster 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8de40b5440 msgr2=0x7f8de40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8de40b5440 0x7f8de40b7900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0098d0 tx=0x7f8dec009900 comp rx=0 tx=0).stop 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc109150 msgr2=0x7f8dfc075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc109150 0x7f8dfc075f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c970 tx=0x7f8df400ce30 comp rx=0 tx=0).stop 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 shutdown_connections 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dfc109150 0x7f8dfc075f20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8de40b5440 0x7f8de40b7900 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dfc1087d0 0x7f8dfc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 --2- 172.21.15.16:0/2865359123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dfc102dc0 0x7f8dfc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:43.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.929+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 >> 172.21.15.16:0/2865359123 conn(0x7f8dfc0fe830 msgr2=0x7f8dfc0fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:43.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.930+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 shutdown_connections 2024-09-10T23:39:43.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:43.930+0000 7f8e017df640 1 -- 172.21.15.16:0/2865359123 wait complete. 2024-09-10T23:39:44.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T23:39:44.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:44 smithi071 ceph-mon[35018]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:44.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:44 smithi066 ceph-mon[34761]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:44.854 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:44 smithi016 ceph-mon[30855]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:45.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 -- 172.21.15.16:0/64586544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b41087d0 msgr2=0x7f94b4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/64586544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b41087d0 0x7f94b4108c10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f949c009900 tx=0x7f949c02a410 comp rx=0 tx=0).stop 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 -- 172.21.15.16:0/64586544 shutdown_connections 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/64586544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4109150 0x7f94b410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/64586544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b41087d0 0x7f94b4108c10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/64586544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94b4102dc0 0x7f94b41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 -- 172.21.15.16:0/64586544 >> 172.21.15.16:0/64586544 conn(0x7f94b40fe830 msgr2=0x7f94b4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 -- 172.21.15.16:0/64586544 shutdown_connections 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.307+0000 7f94b8a1c640 1 -- 172.21.15.16:0/64586544 wait complete. 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.308+0000 7f94b8a1c640 1 Processor -- start 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.308+0000 7f94b8a1c640 1 -- start start 2024-09-10T23:39:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b4102dc0 0x7f94b40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94b41087d0 0x7f94b40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4109150 0x7f94b4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4112e10 con 0x7f94b4102dc0 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4112c90 con 0x7f94b41087d0 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4112f90 con 0x7f94b4109150 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b4102dc0 0x7f94b40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b4102dc0 0x7f94b40754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42754/0 (socket says 172.21.15.16:42754) 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 -- 172.21.15.16:0/4031627919 learned_addr learned my addr 172.21.15.16:0/4031627919 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b2d9d640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4109150 0x7f94b4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94abfff640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94b41087d0 0x7f94b40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 -- 172.21.15.16:0/4031627919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4109150 msgr2=0x7f94b4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4109150 0x7f94b4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 -- 172.21.15.16:0/4031627919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94b41087d0 msgr2=0x7f94b40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94b41087d0 0x7f94b40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 -- 172.21.15.16:0/4031627919 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b41a7680 con 0x7f94b4102dc0 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b259c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b4102dc0 0x7f94b40754a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f94a400e9f0 tx=0x7f94a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94ab7fe640 1 -- 172.21.15.16:0/4031627919 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a400cd80 con 0x7f94b4102dc0 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94ab7fe640 1 -- 172.21.15.16:0/4031627919 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94a40108e0 con 0x7f94b4102dc0 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b41a7970 con 0x7f94b4102dc0 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94ab7fe640 1 -- 172.21.15.16:0/4031627919 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4018980 con 0x7f94b4102dc0 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.309+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b41a7e80 con 0x7f94b4102dc0 2024-09-10T23:39:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.311+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b41031a0 con 0x7f94b4102dc0 2024-09-10T23:39:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.312+0000 7f94ab7fe640 1 -- 172.21.15.16:0/4031627919 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f94a4010430 con 0x7f94b4102dc0 2024-09-10T23:39:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.313+0000 7f94ab7fe640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f94a00b53c0 0x7f94a00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.313+0000 7f94abfff640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f94a00b53c0 0x7f94a00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.313+0000 7f94ab7fe640 1 -- 172.21.15.16:0/4031627919 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f94a40e6280 con 0x7f94b4102dc0 2024-09-10T23:39:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.313+0000 7f94abfff640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f94a00b53c0 0x7f94a00b7880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f949c031440 tx=0x7f949c0095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:45.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.317+0000 7f94ab7fe640 1 -- 172.21.15.16:0/4031627919 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f94a40acec0 con 0x7f94b4102dc0 2024-09-10T23:39:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.513+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f94b4063590 con 0x7f94a00b53c0 2024-09-10T23:39:45.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.514+0000 7f94ab7fe640 1 -- 172.21.15.16:0/4031627919 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f94b4063590 con 0x7f94a00b53c0 2024-09-10T23:39:45.515 INFO:teuthology.orchestra.run.smithi016.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T23:39:45.515 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002C480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-10T23:39:45.515 INFO:teuthology.orchestra.run.smithi016.stdout:smithi066 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53430091400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T23:39:45.515 INFO:teuthology.orchestra.run.smithi016.stdout:smithi071 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040172400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f94a00b53c0 msgr2=0x7f94a00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f94a00b53c0 0x7f94a00b7880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f949c031440 tx=0x7f949c0095f0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b4102dc0 msgr2=0x7f94b40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b4102dc0 0x7f94b40754a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f94a400e9f0 tx=0x7f94a400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 shutdown_connections 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94b4109150 0x7f94b4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f94a00b53c0 0x7f94a00b7880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94b41087d0 0x7f94b40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 --2- 172.21.15.16:0/4031627919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94b4102dc0 0x7f94b40754a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:45.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 >> 172.21.15.16:0/4031627919 conn(0x7f94b40fe830 msgr2=0x7f94b4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:45.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 shutdown_connections 2024-09-10T23:39:45.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:45.517+0000 7f94b8a1c640 1 -- 172.21.15.16:0/4031627919 wait complete. 2024-09-10T23:39:45.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:45 smithi066 ceph-mon[34761]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-10T23:39:45.886 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:45 smithi016 ceph-mon[30855]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-10T23:39:46.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:45 smithi071 ceph-mon[35018]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-10T23:39:46.241 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:39:46.251 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:39:46.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T23:39:46.517 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:46.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:46 smithi066 ceph-mon[34761]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:46.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:46 smithi066 ceph-mon[34761]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-10T23:39:46.806 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:46 smithi016 ceph-mon[30855]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:46.806 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:46 smithi016 ceph-mon[30855]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-10T23:39:47.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:46 smithi071 ceph-mon[35018]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:39:47.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:46 smithi071 ceph-mon[35018]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-10T23:39:47.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 -- 172.21.15.16:0/861568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 msgr2=0x7f295810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:47.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 --2- 172.21.15.16:0/861568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295810e820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2950009900 tx=0x7f295002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:47.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 -- 172.21.15.16:0/861568 shutdown_connections 2024-09-10T23:39:47.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 --2- 172.21.15.16:0/861568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295810e820 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 --2- 172.21.15.16:0/861568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29581076a0 0x7f2958107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 --2- 172.21.15.16:0/861568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958101c90 0x7f2958102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 -- 172.21.15.16:0/861568 >> 172.21.15.16:0/861568 conn(0x7f29580fd700 msgr2=0x7f29580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 -- 172.21.15.16:0/861568 shutdown_connections 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 -- 172.21.15.16:0/861568 wait complete. 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.006+0000 7f295f37a640 1 Processor -- start 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295f37a640 1 -- start start 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295f37a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958101c90 0x7f2958199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295f37a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29581076a0 0x7f295819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295f37a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295f37a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2958111ce0 con 0x7f2958108020 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295f37a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2958111b60 con 0x7f29581076a0 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295f37a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2958111e60 con 0x7f2958101c90 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42784/0 (socket says 172.21.15.16:42784) 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 -- 172.21.15.16:0/1166864752 learned_addr learned my addr 172.21.15.16:0/1166864752 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:47.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d116640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958101c90 0x7f2958199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295c915640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29581076a0 0x7f295819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 -- 172.21.15.16:0/1166864752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958101c90 msgr2=0x7f2958199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958101c90 0x7f2958199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 -- 172.21.15.16:0/1166864752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29581076a0 msgr2=0x7f295819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29581076a0 0x7f295819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 -- 172.21.15.16:0/1166864752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29581a53b0 con 0x7f2958108020 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295c915640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29581076a0 0x7f295819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.007+0000 7f295d917640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295819aa70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2950009a20 tx=0x7f2950004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.008+0000 7f294e7fc640 1 -- 172.21.15.16:0/1166864752 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295003f030 con 0x7f2958108020 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.008+0000 7f294e7fc640 1 -- 172.21.15.16:0/1166864752 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2950003aa0 con 0x7f2958108020 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.008+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29581a5640 con 0x7f2958108020 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.008+0000 7f294e7fc640 1 -- 172.21.15.16:0/1166864752 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2950035070 con 0x7f2958108020 2024-09-10T23:39:47.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.008+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29581a5b20 con 0x7f2958108020 2024-09-10T23:39:47.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.008+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2958102070 con 0x7f2958108020 2024-09-10T23:39:47.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.010+0000 7f294e7fc640 1 -- 172.21.15.16:0/1166864752 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f29500035f0 con 0x7f2958108020 2024-09-10T23:39:47.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.011+0000 7f294e7fc640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29440b5330 0x7f29440b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:47.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.011+0000 7f295d116640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29440b5330 0x7f29440b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:47.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.011+0000 7f294e7fc640 1 -- 172.21.15.16:0/1166864752 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2950106a30 con 0x7f2958108020 2024-09-10T23:39:47.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.012+0000 7f295d116640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29440b5330 0x7f29440b77f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2954005c40 tx=0x7f295400a590 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:47.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.014+0000 7f294e7fc640 1 -- 172.21.15.16:0/1166864752 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f29500cd830 con 0x7f2958108020 2024-09-10T23:39:47.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.236+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f29581a5f20 con 0x7f2958108020 2024-09-10T23:39:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.237+0000 7f294e7fc640 1 -- 172.21.15.16:0/1166864752 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3077 (secure 0 0 0) 0x7f29500cd130 con 0x7f2958108020 2024-09-10T23:39:47.238 INFO:teuthology.orchestra.run.smithi016.stdout:e24 2024-09-10T23:39:47.238 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-09-10T23:38:25:271297+0000 2024-09-10T23:39:47.238 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:39:47.238 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:39:47.238 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 24 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-09-10T23:38:12.987884+0000 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-09-10T23:38:24.958870+0000 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 300 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-09-10T23:39:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 0 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 3 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1,2 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=24610,1=24608,2=24595} 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-09-10T23:39:47.240 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 0 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 24610 members: 24595,24608,24610 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.i{0:24610} state up:active seq 7 addr [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f{0:24589} state up:standby-replay seq 1 addr [v2:172.21.15.71:6834/583734619,v1:172.21.15.71:6835/583734619] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b{1:24608} state up:active seq 7 addr [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.h{1:24578} state up:standby-replay seq 1 addr [v2:172.21.15.66:6836/3622450021,v1:172.21.15.66:6837/3622450021] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c{2:24595} state up:active seq 10 addr [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e{2:24563} state up:standby-replay seq 1 addr [v2:172.21.15.66:6834/1868979678,v1:172.21.15.66:6835/1868979678] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout:Standby daemons: 2024-09-10T23:39:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:47.242 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.j{-1:14718} state up:standby seq 1 addr [v2:172.21.15.16:6834/3416253581,v1:172.21.15.16:6835/3416253581] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.242 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d{-1:14730} state up:standby seq 1 addr [v2:172.21.15.16:6836/3189484685,v1:172.21.15.16:6837/3189484685] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.242 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.g{-1:14781} state up:standby seq 1 addr [v2:172.21.15.16:6838/1264367217,v1:172.21.15.16:6839/1264367217] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.242 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a{-1:14793} state up:standby seq 1 addr [v2:172.21.15.16:6840/3690738179,v1:172.21.15.16:6841/3690738179] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.242 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.k{-1:24539} state up:standby seq 1 addr [v2:172.21.15.66:6832/1708771330,v1:172.21.15.66:6833/1708771330] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.242 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.l{-1:24550} state up:standby seq 1 addr [v2:172.21.15.71:6832/3386039321,v1:172.21.15.71:6833/3386039321] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29440b5330 msgr2=0x7f29440b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29440b5330 0x7f29440b77f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2954005c40 tx=0x7f295400a590 comp rx=0 tx=0).stop 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 msgr2=0x7f295819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295819aa70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2950009a20 tx=0x7f2950004270 comp rx=0 tx=0).stop 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 shutdown_connections 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2958108020 0x7f295819aa70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29440b5330 0x7f29440b77f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29581076a0 0x7f295819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 --2- 172.21.15.16:0/1166864752 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2958101c90 0x7f2958199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 >> 172.21.15.16:0/1166864752 conn(0x7f29580fd700 msgr2=0x7f29580ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 shutdown_connections 2024-09-10T23:39:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:47.239+0000 7f295f37a640 1 -- 172.21.15.16:0/1166864752 wait complete. 2024-09-10T23:39:47.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:47 smithi066 ceph-mon[34761]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:39:47.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:47 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1166864752' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:39:47.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:47 smithi016 ceph-mon[30855]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:39:47.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:47 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1166864752' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:39:48.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:47 smithi071 ceph-mon[35018]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:39:48.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:47 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1166864752' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:39:48.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T23:39:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:48.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 -- 172.21.15.16:0/2476088335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 msgr2=0x7f656c108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:48.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 --2- 172.21.15.16:0/2476088335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c108be0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f655c009900 tx=0x7f655c02a410 comp rx=0 tx=0).stop 2024-09-10T23:39:48.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 -- 172.21.15.16:0/2476088335 shutdown_connections 2024-09-10T23:39:48.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 --2- 172.21.15.16:0/2476088335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c109120 0x7f656c10f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 --2- 172.21.15.16:0/2476088335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c108be0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 --2- 172.21.15.16:0/2476088335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c102d90 0x7f656c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 -- 172.21.15.16:0/2476088335 >> 172.21.15.16:0/2476088335 conn(0x7f656c0fe820 msgr2=0x7f656c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 -- 172.21.15.16:0/2476088335 shutdown_connections 2024-09-10T23:39:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 -- 172.21.15.16:0/2476088335 wait complete. 2024-09-10T23:39:48.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 Processor -- start 2024-09-10T23:39:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.865+0000 7f65732c3640 1 -- start start 2024-09-10T23:39:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65732c3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c102d90 0x7f656c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65732c3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65732c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c109120 0x7f656c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65732c3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f656c112de0 con 0x7f656c1087a0 2024-09-10T23:39:48.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65732c3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f656c112c60 con 0x7f656c102d90 2024-09-10T23:39:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65732c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f656c112f60 con 0x7f656c109120 2024-09-10T23:39:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42812/0 (socket says 172.21.15.16:42812) 2024-09-10T23:39:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 -- 172.21.15.16:0/3950038110 learned_addr learned my addr 172.21.15.16:0/3950038110 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f6571860640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c109120 0x7f656c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:48.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657105f640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c102d90 0x7f656c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 -- 172.21.15.16:0/3950038110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c109120 msgr2=0x7f656c19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c109120 0x7f656c19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:48.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 -- 172.21.15.16:0/3950038110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c102d90 msgr2=0x7f656c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c102d90 0x7f656c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 -- 172.21.15.16:0/3950038110 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656c19f400 con 0x7f656c1087a0 2024-09-10T23:39:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657105f640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c102d90 0x7f656c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f657085e640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c199890 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f655c005940 tx=0x7f655c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65627fc640 1 -- 172.21.15.16:0/3950038110 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c03f030 con 0x7f656c1087a0 2024-09-10T23:39:48.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65627fc640 1 -- 172.21.15.16:0/3950038110 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f655c003cb0 con 0x7f656c1087a0 2024-09-10T23:39:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656c19f690 con 0x7f656c1087a0 2024-09-10T23:39:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.866+0000 7f65627fc640 1 -- 172.21.15.16:0/3950038110 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c035070 con 0x7f656c1087a0 2024-09-10T23:39:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.867+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656c1a5db0 con 0x7f656c1087a0 2024-09-10T23:39:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.868+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f656c103170 con 0x7f656c1087a0 2024-09-10T23:39:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.869+0000 7f65627fc640 1 -- 172.21.15.16:0/3950038110 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f655c03bbf0 con 0x7f656c1087a0 2024-09-10T23:39:48.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.870+0000 7f65627fc640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5330 0x7f65580b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:48.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.870+0000 7f657105f640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5330 0x7f65580b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:48.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.870+0000 7f65627fc640 1 -- 172.21.15.16:0/3950038110 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f655c106c00 con 0x7f656c1087a0 2024-09-10T23:39:48.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.870+0000 7f657105f640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5330 0x7f65580b77f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6568006fd0 tx=0x7f6568008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:48.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:48.873+0000 7f65627fc640 1 -- 172.21.15.16:0/3950038110 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f655c0cd9a0 con 0x7f656c1087a0 2024-09-10T23:39:49.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.064+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f656c19a480 con 0x7f656c1087a0 2024-09-10T23:39:49.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.065+0000 7f65627fc640 1 -- 172.21.15.16:0/3950038110 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5637 (secure 0 0 0) 0x7f656c19a480 con 0x7f656c1087a0 2024-09-10T23:39:49.065 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 77 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-09-10T23:29:41.593723+0000 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-09-10T23:38:43.527822+0000 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:crush_version 26 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:full_ratio 0.95 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:backfillfull_ratio 0.9 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:nearfull_ratio 0.85 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:require_min_compat_client luminous 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:min_compat_client luminous 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:require_osd_release squid 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:stretch_mode_enabled false 2024-09-10T23:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:max_osd 12 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 up in weight 1 up_from 9 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6802/709153273,v1:172.21.15.16:6803/709153273] [v2:172.21.15.16:6804/709153273,v1:172.21.15.16:6805/709153273] exists,up 763805be-7761-4d09-a36e-ae89566679dd 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 up in weight 1 up_from 14 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6800/842526831,v1:172.21.15.66:6801/842526831] [v2:172.21.15.66:6802/842526831,v1:172.21.15.66:6803/842526831] exists,up 36db88e0-9ce6-4c36-9b9f-a96493341bb5 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 up in weight 1 up_from 18 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/3069059707,v1:172.21.15.71:6801/3069059707] [v2:172.21.15.71:6802/3069059707,v1:172.21.15.71:6803/3069059707] exists,up 60a55961-0d3d-415c-8e44-f72d0f544182 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 up in weight 1 up_from 25 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6810/2604369772,v1:172.21.15.16:6811/2604369772] [v2:172.21.15.16:6812/2604369772,v1:172.21.15.16:6813/2604369772] exists,up 4451b800-b930-497f-8377-21700cc37299 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6808/2175362919,v1:172.21.15.66:6809/2175362919] [v2:172.21.15.66:6810/2175362919,v1:172.21.15.66:6811/2175362919] exists,up 5bbe8aa1-89f3-4850-99aa-5601e9ca5152 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 up in weight 1 up_from 36 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6808/2984688439,v1:172.21.15.71:6809/2984688439] [v2:172.21.15.71:6810/2984688439,v1:172.21.15.71:6811/2984688439] exists,up 9699d403-60cd-4ba2-b896-9b03c18b2128 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 up in weight 1 up_from 42 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6818/3830581477,v1:172.21.15.16:6819/3830581477] [v2:172.21.15.16:6820/3830581477,v1:172.21.15.16:6821/3830581477] exists,up c2ff1e51-01cb-4ecc-bf83-f6250f3c724b 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 up in weight 1 up_from 47 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6816/3815713704,v1:172.21.15.66:6817/3815713704] [v2:172.21.15.66:6818/3815713704,v1:172.21.15.66:6819/3815713704] exists,up c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.8 up in weight 1 up_from 52 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6816/2889878704,v1:172.21.15.71:6817/2889878704] [v2:172.21.15.71:6818/2889878704,v1:172.21.15.71:6819/2889878704] exists,up 6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.9 up in weight 1 up_from 58 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6826/2503971838,v1:172.21.15.16:6827/2503971838] [v2:172.21.15.16:6828/2503971838,v1:172.21.15.16:6829/2503971838] exists,up b87feb45-8cb5-4818-983d-4aa333e0276b 2024-09-10T23:39:49.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.10 up in weight 1 up_from 63 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6824/168536242,v1:172.21.15.66:6825/168536242] [v2:172.21.15.66:6826/168536242,v1:172.21.15.66:6827/168536242] exists,up 9675564e-158f-4242-b54a-4a710e94ef77 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/2875208782,v1:172.21.15.71:6825/2875208782] [v2:172.21.15.71:6826/2875208782,v1:172.21.15.71:6827/2875208782] exists,up c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 2.4 [2,11] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 2.f [8,11] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.2 [3,9] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.17 [4,6] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.1b [5,9] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.1d [5,9] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.23 [4,7] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:pg_upmap_items 3.31 [4,8] 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6801/3183663764 expires 2024-09-11T23:31:42.335701+0000 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/2040139033 expires 2024-09-11T23:30:16.164092+0000 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6800/1838016037 expires 2024-09-11T23:30:16.164092+0000 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/1952619887 expires 2024-09-11T23:31:42.335701+0000 2024-09-10T23:39:49.068 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6801/1838016037 expires 2024-09-11T23:30:16.164092+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/3343059075 expires 2024-09-11T23:31:42.335701+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/1489458820 expires 2024-09-11T23:30:39.646876+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6800/3183663764 expires 2024-09-11T23:31:42.335701+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/3511379318 expires 2024-09-11T23:30:16.164092+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/1963800074 expires 2024-09-11T23:30:39.646876+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/3428304012 expires 2024-09-11T23:30:16.164092+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/83801371 expires 2024-09-11T23:30:39.646876+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6801/3233639538 expires 2024-09-11T23:30:39.646876+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:6800/3233639538 expires 2024-09-11T23:30:39.646876+0000 2024-09-10T23:39:49.069 INFO:teuthology.orchestra.run.smithi016.stdout:blocklist 172.21.15.16:0/2667683333 expires 2024-09-11T23:31:42.335701+0000 2024-09-10T23:39:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5330 msgr2=0x7f65580b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5330 0x7f65580b77f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6568006fd0 tx=0x7f6568008040 comp rx=0 tx=0).stop 2024-09-10T23:39:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 msgr2=0x7f656c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c199890 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f655c005940 tx=0x7f655c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:39:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 shutdown_connections 2024-09-10T23:39:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c109120 0x7f656c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:49.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c1087a0 0x7f656c199890 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5330 0x7f65580b77f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 --2- 172.21.15.16:0/3950038110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c102d90 0x7f656c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.068+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 >> 172.21.15.16:0/3950038110 conn(0x7f656c0fe820 msgr2=0x7f656c100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.069+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 shutdown_connections 2024-09-10T23:39:49.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:49.069+0000 7f65732c3640 1 -- 172.21.15.16:0/3950038110 wait complete. 2024-09-10T23:39:49.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:49 smithi016 ceph-mon[30855]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:39:49.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:49 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3950038110' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:39:49.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:49 smithi066 ceph-mon[34761]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:39:49.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:49 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3950038110' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:39:49.856 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T23:39:49.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:39:50.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:49 smithi071 ceph-mon[35018]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:39:50.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:49 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3950038110' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:39:50.129 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 -- 172.21.15.16:0/1515903708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c101c80 msgr2=0x7fd19c102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/1515903708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c101c80 0x7fd19c102060 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009ca0 tx=0x7fd18c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 -- 172.21.15.16:0/1515903708 shutdown_connections 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/1515903708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19c108010 0x7fd19c10e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/1515903708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd19c107690 0x7fd19c107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/1515903708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c101c80 0x7fd19c102060 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 -- 172.21.15.16:0/1515903708 >> 172.21.15.16:0/1515903708 conn(0x7fd19c0fd6d0 msgr2=0x7fd19c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 -- 172.21.15.16:0/1515903708 shutdown_connections 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 -- 172.21.15.16:0/1515903708 wait complete. 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.641+0000 7fd1a1f70640 1 Processor -- start 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd1a1f70640 1 -- start start 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd1a1f70640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19c101c80 0x7fd19c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd1a1f70640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd19c107690 0x7fd19c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd1a1f70640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c108010 0x7fd19c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd1a1f70640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c112df0 con 0x7fd19c108010 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd1a1f70640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c112c70 con 0x7fd19c107690 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd1a1f70640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c112f70 con 0x7fd19c101c80 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c108010 0x7fd19c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c108010 0x7fd19c19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42838/0 (socket says 172.21.15.16:42838) 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 -- 172.21.15.16:0/882075286 learned_addr learned my addr 172.21.15.16:0/882075286 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19affd640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd19c107690 0x7fd19c199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19b7fe640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19c101c80 0x7fd19c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 -- 172.21.15.16:0/882075286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19c101c80 msgr2=0x7fd19c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19c101c80 0x7fd19c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 -- 172.21.15.16:0/882075286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd19c107690 msgr2=0x7fd19c199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd19c107690 0x7fd19c199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.642+0000 7fd19bfff640 1 -- 172.21.15.16:0/882075286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c19f2f0 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.643+0000 7fd19bfff640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c108010 0x7fd19c19eb20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd19400e970 tx=0x7fd19400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.643+0000 7fd198ff9640 1 -- 172.21.15.16:0/882075286 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19400ccc0 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.643+0000 7fd198ff9640 1 -- 172.21.15.16:0/882075286 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd19400ce60 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.643+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19c19f5e0 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.643+0000 7fd198ff9640 1 -- 172.21.15.16:0/882075286 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194010430 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.643+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19c1a5ca0 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.644+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd19c102060 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.645+0000 7fd198ff9640 1 -- 172.21.15.16:0/882075286 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fd194004f70 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.646+0000 7fd198ff9640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1840b5330 0x7fd1840b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.646+0000 7fd19b7fe640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1840b5330 0x7fd1840b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.646+0000 7fd198ff9640 1 -- 172.21.15.16:0/882075286 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd1940e6380 con 0x7fd19c108010 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.646+0000 7fd19b7fe640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1840b5330 0x7fd1840b77f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd18c000f80 tx=0x7fd18c005ef0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.649+0000 7fd198ff9640 1 -- 172.21.15.16:0/882075286 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd194056220 con 0x7fd19c108010 2024-09-10T23:39:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.872+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd19c19a370 con 0x7fd19c108010 2024-09-10T23:39:50.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.872+0000 7fd198ff9640 1 -- 172.21.15.16:0/882075286 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11897 (secure 0 0 0) 0x7fd1940ad180 con 0x7fd19c108010 2024-09-10T23:39:50.873 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:50.874 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"btime":"2024-09-10T23:38:25:271297+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:38:24.958870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24595,24608,24610]},"id":1}]} 2024-09-10T23:39:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-09-10T23:39:50.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.875+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1840b5330 msgr2=0x7fd1840b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.875+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1840b5330 0x7fd1840b77f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd18c000f80 tx=0x7fd18c005ef0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.875+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c108010 msgr2=0x7fd19c19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.875+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c108010 0x7fd19c19eb20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd19400e970 tx=0x7fd19400ed70 comp rx=0 tx=0).stop 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 shutdown_connections 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd19c108010 0x7fd19c19eb20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1840b5330 0x7fd1840b77f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd19c107690 0x7fd19c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 --2- 172.21.15.16:0/882075286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19c101c80 0x7fd19c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 >> 172.21.15.16:0/882075286 conn(0x7fd19c0fd6d0 msgr2=0x7fd19c0ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 shutdown_connections 2024-09-10T23:39:50.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:50.876+0000 7fd1a1f70640 1 -- 172.21.15.16:0/882075286 wait complete. 2024-09-10T23:39:51.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:39:51.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:51 smithi066 ceph-mon[34761]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T23:39:51.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:51 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/882075286' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:51.973 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:51.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:51 smithi016 ceph-mon[30855]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T23:39:51.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:51 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/882075286' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:52.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:51 smithi071 ceph-mon[35018]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T23:39:52.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:51 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/882075286' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:52.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.477+0000 7f0d5b580640 1 -- 172.21.15.16:0/1341062694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54103b30 msgr2=0x7f0d54103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.477+0000 7f0d5b580640 1 --2- 172.21.15.16:0/1341062694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54103b30 0x7f0d54103f10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009900 tx=0x7f0d5002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.477+0000 7f0d5b580640 1 -- 172.21.15.16:0/1341062694 shutdown_connections 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.477+0000 7f0d5b580640 1 --2- 172.21.15.16:0/1341062694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d5410d0e0 0x7f0d5410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.477+0000 7f0d5b580640 1 --2- 172.21.15.16:0/1341062694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d54104530 0x7f0d5410cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.477+0000 7f0d5b580640 1 --2- 172.21.15.16:0/1341062694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54103b30 0x7f0d54103f10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.477+0000 7f0d5b580640 1 -- 172.21.15.16:0/1341062694 >> 172.21.15.16:0/1341062694 conn(0x7f0d540fd700 msgr2=0x7f0d540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 -- 172.21.15.16:0/1341062694 shutdown_connections 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 -- 172.21.15.16:0/1341062694 wait complete. 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 Processor -- start 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 -- start start 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d54103b30 0x7f0d541019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54104530 0x7f0d54101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:52.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d5410d0e0 0x7f0d54102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54112d60 con 0x7f0d54104530 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54112be0 con 0x7f0d54103b30 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d5b580640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54112ee0 con 0x7f0d5410d0e0 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.478+0000 7f0d58b1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54104530 0x7f0d54101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d5931c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d54103b30 0x7f0d541019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54104530 0x7f0d54101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42864/0 (socket says 172.21.15.16:42864) 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 -- 172.21.15.16:0/3686785511 learned_addr learned my addr 172.21.15.16:0/3686785511 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d59b1d640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d5410d0e0 0x7f0d54102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 -- 172.21.15.16:0/3686785511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d5410d0e0 msgr2=0x7f0d54102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d5410d0e0 0x7f0d54102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 -- 172.21.15.16:0/3686785511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d54103b30 msgr2=0x7f0d541019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d54103b30 0x7f0d541019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 -- 172.21.15.16:0/3686785511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d541a76d0 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d58b1b640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54104530 0x7f0d54101ef0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c890 tx=0x7f0d4400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d4a7fc640 1 -- 172.21.15.16:0/3686785511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44004220 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d4a7fc640 1 -- 172.21.15.16:0/3686785511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d440043c0 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d541a79c0 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d4a7fc640 1 -- 172.21.15.16:0/3686785511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44004a00 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.479+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d541a7f00 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.480+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d54103f10 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.482+0000 7f0d4a7fc640 1 -- 172.21.15.16:0/3686785511 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f0d440079b0 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.483+0000 7f0d4a7fc640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0d400b5330 0x7f0d400b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.483+0000 7f0d5931c640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0d400b5330 0x7f0d400b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.483+0000 7f0d4a7fc640 1 -- 172.21.15.16:0/3686785511 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f0d440e5df0 con 0x7f0d54104530 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.483+0000 7f0d5931c640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0d400b5330 0x7f0d400b77f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d50031440 tx=0x7f0d50005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:52.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.486+0000 7f0d4a7fc640 1 -- 172.21.15.16:0/3686785511 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0d44014030 con 0x7f0d54104530 2024-09-10T23:39:52.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.714+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d5402e5c0 con 0x7f0d54104530 2024-09-10T23:39:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.715+0000 7f0d4a7fc640 1 -- 172.21.15.16:0/3686785511 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11897 (secure 0 0 0) 0x7f0d440ac540 con 0x7f0d54104530 2024-09-10T23:39:52.717 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:52.717 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"btime":"2024-09-10T23:38:25:271297+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:38:24.958870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24595,24608,24610]},"id":1}]} 2024-09-10T23:39:52.717 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-09-10T23:39:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0d400b5330 msgr2=0x7f0d400b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0d400b5330 0x7f0d400b77f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d50031440 tx=0x7f0d50005b50 comp rx=0 tx=0).stop 2024-09-10T23:39:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54104530 msgr2=0x7f0d54101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54104530 0x7f0d54101ef0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c890 tx=0x7f0d4400cd50 comp rx=0 tx=0).stop 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 shutdown_connections 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d5410d0e0 0x7f0d54102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54104530 0x7f0d54101ef0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0d400b5330 0x7f0d400b77f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 --2- 172.21.15.16:0/3686785511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d54103b30 0x7f0d541019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 >> 172.21.15.16:0/3686785511 conn(0x7f0d540fd700 msgr2=0x7f0d540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 shutdown_connections 2024-09-10T23:39:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:52.718+0000 7f0d5b580640 1 -- 172.21.15.16:0/3686785511 wait complete. 2024-09-10T23:39:53.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:39:53.647 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:53.705 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:53 smithi016 ceph-mon[30855]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:39:53.706 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:53 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3686785511' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:53.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:53 smithi066 ceph-mon[34761]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:39:53.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:53 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3686785511' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:53.821 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:53 smithi071 ceph-mon[35018]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:39:53.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:53 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3686785511' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3682260326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 msgr2=0x7fb0e410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3682260326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e410cab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009900 tx=0x7fb0cc02a410 comp rx=0 tx=0).stop 2024-09-10T23:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3682260326 shutdown_connections 2024-09-10T23:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3682260326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0e410d100 0x7fb0e410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3682260326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e410cab0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3682260326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0e4103ca0 0x7fb0e4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3682260326 >> 172.21.15.16:0/3682260326 conn(0x7fb0e40fd700 msgr2=0x7fb0e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3682260326 shutdown_connections 2024-09-10T23:39:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.119+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3682260326 wait complete. 2024-09-10T23:39:54.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 Processor -- start 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 -- start start 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0e4103ca0 0x7fb0e419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0e410d100 0x7fb0e41a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41193c0 con 0x7fb0e41045c0 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e4119240 con 0x7fb0e4103ca0 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0eac3b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e4119540 con 0x7fb0e410d100 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e419fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33884/0 (socket says 172.21.15.16:33884) 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0e3fff640 1 -- 172.21.15.16:0/3406087241 learned_addr learned my addr 172.21.15.16:0/3406087241 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0e89d7640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0e4103ca0 0x7fb0e419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.120+0000 7fb0e91d8640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0e410d100 0x7fb0e41a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:54.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e3fff640 1 -- 172.21.15.16:0/3406087241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0e410d100 msgr2=0x7fb0e41a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e3fff640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0e410d100 0x7fb0e41a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e3fff640 1 -- 172.21.15.16:0/3406087241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0e4103ca0 msgr2=0x7fb0e419f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e3fff640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0e4103ca0 0x7fb0e419f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e3fff640 1 -- 172.21.15.16:0/3406087241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e41a59c0 con 0x7fb0e41045c0 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e3fff640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e419fe50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc031440 tx=0x7fb0cc003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e1ffb640 1 -- 172.21.15.16:0/3406087241 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc03f070 con 0x7fb0e41045c0 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e1ffb640 1 -- 172.21.15.16:0/3406087241 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0cc031950 con 0x7fb0e41045c0 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e41a5c50 con 0x7fb0e41045c0 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0e1ffb640 1 -- 172.21.15.16:0/3406087241 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc035030 con 0x7fb0e41045c0 2024-09-10T23:39:54.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.121+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e41ac370 con 0x7fb0e41045c0 2024-09-10T23:39:54.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.122+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e4104080 con 0x7fb0e41045c0 2024-09-10T23:39:54.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.124+0000 7fb0e1ffb640 1 -- 172.21.15.16:0/3406087241 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fb0cc0314a0 con 0x7fb0e41045c0 2024-09-10T23:39:54.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.124+0000 7fb0e1ffb640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb0d00b5370 0x7fb0d00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:54.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.125+0000 7fb0e89d7640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb0d00b5370 0x7fb0d00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:54.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.125+0000 7fb0e1ffb640 1 -- 172.21.15.16:0/3406087241 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb0cc1069c0 con 0x7fb0e41045c0 2024-09-10T23:39:54.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.125+0000 7fb0e89d7640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb0d00b5370 0x7fb0d00b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009bd0 tx=0x7fb0d4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:54.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.128+0000 7fb0e1ffb640 1 -- 172.21.15.16:0/3406087241 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb0cc0cd7c0 con 0x7fb0e41045c0 2024-09-10T23:39:54.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.317+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0e41ac570 con 0x7fb0e41045c0 2024-09-10T23:39:54.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.318+0000 7fb0e1ffb640 1 -- 172.21.15.16:0/3406087241 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22944 (secure 0 0 0) 0x7fb0cc0cd0c0 con 0x7fb0e41045c0 2024-09-10T23:39:54.319 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:39:54.320 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":77,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:43.527822+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb0d00b5370 msgr2=0x7fb0d00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb0d00b5370 0x7fb0d00b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009bd0 tx=0x7fb0d4005f90 comp rx=0 tx=0).stop 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 msgr2=0x7fb0e419fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e419fe50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc031440 tx=0x7fb0cc003a70 comp rx=0 tx=0).stop 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 shutdown_connections 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0e410d100 0x7fb0e41a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0e41045c0 0x7fb0e419fe50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb0d00b5370 0x7fb0d00b7830 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 --2- 172.21.15.16:0/3406087241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0e4103ca0 0x7fb0e419f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:54.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 >> 172.21.15.16:0/3406087241 conn(0x7fb0e40fd700 msgr2=0x7fb0e40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:54.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 shutdown_connections 2024-09-10T23:39:54.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:54.321+0000 7fb0eac3b640 1 -- 172.21.15.16:0/3406087241 wait complete. 2024-09-10T23:39:54.697 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:54 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3406087241' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:39:55.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:54 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3406087241' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:39:55.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:38:12.987884+0000', 'modified': '2024-09-10T23:38:24.958870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24610, 'mds_1': 24608, 'mds_2': 24595}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24563': {'gid': 24563, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/1868979678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 1868979678}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 1868979678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6837/3622450021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 3622450021}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 3622450021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24589': {'gid': 24589, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/583734619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 583734619}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 583734619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.71:6837/1674889906', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 1674889906}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 1674889906}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.66:6839/3877648369', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 3877648369}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 3877648369}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.71:6839/542292698', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 542292698}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 542292698}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24610, 'qdb_cluster': [24595, 24608, 24610]} 2024-09-10T23:39:55.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:39:55.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T23:39:55.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:54 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3406087241' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:39:55.305 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:55.710 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:55 smithi016 ceph-mon[30855]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4199671527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 msgr2=0x7fa16810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4199671527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa16810cb50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa150009900 tx=0x7fa15002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4199671527 shutdown_connections 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4199671527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa16810d120 0x7fa16810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4199671527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa16810cb50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4199671527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa168103b70 0x7fa168103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4199671527 >> 172.21.15.16:0/4199671527 conn(0x7fa1680fd700 msgr2=0x7fa1680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:55.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4199671527 shutdown_connections 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.792+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4199671527 wait complete. 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 Processor -- start 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 -- start start 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa168103b70 0x7fa168199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa1681997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa16810d120 0x7fa16819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa168112d60 con 0x7fa168104570 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa168112be0 con 0x7fa168103b70 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16c8a2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa168112ee0 con 0x7fa16810d120 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa1681997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa1681997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33910/0 (socket says 172.21.15.16:33910) 2024-09-10T23:39:55.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 -- 172.21.15.16:0/4210106567 learned_addr learned my addr 172.21.15.16:0/4210106567 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa16659c640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa168103b70 0x7fa168199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa166d9d640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa16810d120 0x7fa16819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 -- 172.21.15.16:0/4210106567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa16810d120 msgr2=0x7fa16819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa16810d120 0x7fa16819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 -- 172.21.15.16:0/4210106567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa168103b70 msgr2=0x7fa168199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa168103b70 0x7fa168199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.793+0000 7fa165d9b640 1 -- 172.21.15.16:0/4210106567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16819f320 con 0x7fa168104570 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.794+0000 7fa165d9b640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa1681997b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa150005940 tx=0x7fa1500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.794+0000 7fa15f7fe640 1 -- 172.21.15.16:0/4210106567 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15003f030 con 0x7fa168104570 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.794+0000 7fa15f7fe640 1 -- 172.21.15.16:0/4210106567 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa150003cb0 con 0x7fa168104570 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.794+0000 7fa15f7fe640 1 -- 172.21.15.16:0/4210106567 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150035070 con 0x7fa168104570 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.794+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16819f5b0 con 0x7fa168104570 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.794+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1681a5cd0 con 0x7fa168104570 2024-09-10T23:39:55.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.797+0000 7fa16ec77740 1 Processor -- start 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.797+0000 7fa16ec77740 1 -- start start 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.797+0000 7fa15f7fe640 1 -- 172.21.15.16:0/4210106567 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fa15003bbf0 con 0x7fa168104570 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.797+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057233110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.797+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057233650 0x56205723f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56205723f5e0 0x5620572419d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa16ec77740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5620571aac10 con 0x56205723f5e0 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa16ec77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56205719a040 con 0x562057233650 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa16ec77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56205719de50 con 0x562057232d30 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56205723f5e0 0x5620572419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56205723f5e0 0x5620572419d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33926/0 (socket says 172.21.15.16:33926) 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 -- 172.21.15.16:0/708499221 learned_addr learned my addr 172.21.15.16:0/708499221 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa16659c640 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057233650 0x56205723f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa166d9d640 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057233110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 -- 172.21.15.16:0/708499221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 msgr2=0x562057233110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057233110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 -- 172.21.15.16:0/708499221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057233650 msgr2=0x56205723f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057233650 0x56205723f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 -- 172.21.15.16:0/708499221 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562056ef8540 con 0x56205723f5e0 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa16659c640 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057233650 0x56205723f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa15f7fe640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa1540b5330 0x7fa1540b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.798+0000 7fa165d9b640 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56205723f5e0 0x5620572419d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa15010cc40 tx=0x7fa15010cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0146400b546e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa166d9d640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa1540b5330 0x7fa1540b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa15cff9640 1 -- 172.21.15.16:0/708499221 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150109e60 con 0x56205723f5e0 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa15f7fe640 1 -- 172.21.15.16:0/4210106567 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa150106870 con 0x7fa168104570 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa15cff9640 1 -- 172.21.15.16:0/708499221 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1500cca80 con 0x56205723f5e0 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa15cff9640 1 -- 172.21.15.16:0/708499221 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1500c95c0 con 0x56205723f5e0 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa16ec77740 1 -- 172.21.15.16:0/708499221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56205723f5e0 msgr2=0x5620572419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa166d9d640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa1540b5330 0x7fa1540b77f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa158005fd0 tx=0x7fa1580097e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa16ec77740 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56205723f5e0 0x5620572419d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa15010cc40 tx=0x7fa15010cd30 comp rx=0 tx=0).stop 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa16ec77740 1 -- 172.21.15.16:0/708499221 shutdown_connections 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa16ec77740 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56205723f5e0 0x5620572419d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.799+0000 7fa16ec77740 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057233650 0x56205723f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 --2- 172.21.15.16:0/708499221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057233110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 -- 172.21.15.16:0/708499221 >> 172.21.15.16:0/708499221 conn(0x562057230b60 msgr2=0x562057231d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 -- 172.21.15.16:0/708499221 shutdown_connections 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 -- 172.21.15.16:0/708499221 wait complete. 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 -- start start 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 Processor -- start 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057232d30 0x56205723c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057233650 0x56205723cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x56205723d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562056ffb5f0 con 0x562057232d30 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562057135010 con 0x56205723f5e0 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.800+0000 7fa16ec77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562057242050 con 0x562057233650 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057232d30 0x56205723c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057232d30 0x56205723c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33930/0 (socket says 172.21.15.16:33930) 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 -- 172.21.15.16:0/1818868213 learned_addr learned my addr 172.21.15.16:0/1818868213 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16ec77740 10 client.0 _ll_register_callbacks cb 0x562057194340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa166d9d640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x56205723d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa165d9b640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057233650 0x56205723cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 -- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057233650 msgr2=0x56205723cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057233650 0x56205723cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 -- 172.21.15.16:0/1818868213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 msgr2=0x56205723d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x56205723d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 -- 172.21.15.16:0/1818868213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562057162a00 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa165d9b640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057233650 0x56205723cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16659c640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057232d30 0x56205723c5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa16000b990 tx=0x7fa16000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b554c7a6cde53e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa14dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa14dffb640 1 -- 172.21.15.16:0/1818868213 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160003da0 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa14dffb640 1 -- 172.21.15.16:0/1818868213 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa160011440 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1500cca80 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa14dffb640 1 -- 172.21.15.16:0/1818868213 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa160011640 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16ec77740 10 client.15267 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.801+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56205724dbd0 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa14dffb640 1 -- 172.21.15.16:0/1818868213 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1500cca80 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa14dffb640 1 -- 172.21.15.16:0/1818868213 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa16001b910 con 0x562057232d30 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa16ec77740 10 client.15267 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa16ec77740 10 client.15267 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:39:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa16ec77740 20 client.15267 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa16ec77740 4 client.15267 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620571acb60 con 0x562057250280 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.802+0000 7fa165d9b640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.803+0000 7fa14dffb640 10 client.15267 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.803+0000 7fa165d9b640 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572516f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a40bfc818dd212b server_cookie=149b4bf6ecc3b130 in_seq=0 out_seq=0 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.803+0000 7fa14dffb640 1 -- 172.21.15.16:0/1818868213 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620571acb60 con 0x562057250280 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.803+0000 7fa14dffb640 10 client.15267 handle_command_reply: tid=0 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 client.15267 shutdown 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057232d30 msgr2=0x56205723c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057232d30 0x56205723c5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa16000b990 tx=0x7fa16000be50 comp rx=0 tx=0).stop 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 shutdown_connections 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572516f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x56205723d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa14dffb640 0 client.15267 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057233650 0x56205723cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1818868213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057232d30 0x56205723c5d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 >> 172.21.15.16:0/1818868213 conn(0x562057230b60 msgr2=0x562057236700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 shutdown_connections 2024-09-10T23:39:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 1 -- 172.21.15.16:0/1818868213 wait complete. 2024-09-10T23:39:55.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.804+0000 7fa16ec77740 20 client.15267 trim_cache size 0 max 16384 2024-09-10T23:39:55.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 Processor -- start 2024-09-10T23:39:55.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 -- start start 2024-09-10T23:39:55.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057236da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057231a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x562057231f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56205724fa30 con 0x562057233650 2024-09-10T23:39:55.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562057250100 con 0x56205723f5e0 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16ec77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5620572507d0 con 0x562057232d30 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057231a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057231a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33934/0 (socket says 172.21.15.16:33934) 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 -- 172.21.15.16:0/3297879511 learned_addr learned my addr 172.21.15.16:0/3297879511 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa166d9d640 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x562057231f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa16659c640 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057236da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 -- 172.21.15.16:0/3297879511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 msgr2=0x562057236da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057236da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 -- 172.21.15.16:0/3297879511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 msgr2=0x562057231f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x562057231f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 -- 172.21.15.16:0/3297879511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205724f860 con 0x562057233650 2024-09-10T23:39:55.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.823+0000 7fa165d9b640 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057231a00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa150032af0 tx=0x7fa150106b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3b347a32fafe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa14ffff640 1 -- 172.21.15.16:0/3297879511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150049070 con 0x562057233650 2024-09-10T23:39:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa14ffff640 1 -- 172.21.15.16:0/3297879511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa15010c400 con 0x562057233650 2024-09-10T23:39:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa14ffff640 1 -- 172.21.15.16:0/3297879511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150109e60 con 0x562057233650 2024-09-10T23:39:55.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 -- 172.21.15.16:0/3297879511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 msgr2=0x562057231a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057231a00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa150032af0 tx=0x7fa150106b70 comp rx=0 tx=0).stop 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 -- 172.21.15.16:0/3297879511 shutdown_connections 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56205723f5e0 0x562057231f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057231a00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 --2- 172.21.15.16:0/3297879511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562057232d30 0x562057236da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 -- 172.21.15.16:0/3297879511 >> 172.21.15.16:0/3297879511 conn(0x562057230b60 msgr2=0x562057237880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 -- 172.21.15.16:0/3297879511 shutdown_connections 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.824+0000 7fa16ec77740 1 -- 172.21.15.16:0/3297879511 wait complete. 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 -- start start 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 Processor -- start 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057232d30 0x562057253a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057253fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56205723f5e0 0x5620572544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562057251570 con 0x562057233650 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562057250ea0 con 0x562057232d30 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562057251c40 con 0x56205723f5e0 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16ec77740 10 client.0 _ll_register_callbacks cb 0x7fa1600041d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057253fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057253fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33944/0 (socket says 172.21.15.16:33944) 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 -- 172.21.15.16:0/1913577838 learned_addr learned my addr 172.21.15.16:0/1913577838 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa16659c640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057232d30 0x562057253a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa166d9d640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56205723f5e0 0x5620572544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 -- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56205723f5e0 msgr2=0x5620572544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56205723f5e0 0x5620572544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 -- 172.21.15.16:0/1913577838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057232d30 msgr2=0x562057253a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057232d30 0x562057253a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa165d9b640 1 -- 172.21.15.16:0/1913577838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620572593a0 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.825+0000 7fa166d9d640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56205723f5e0 0x5620572544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa165d9b640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057253fa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa150006010 tx=0x7fa15002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde02459d568877 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa14dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa14dffb640 1 -- 172.21.15.16:0/1913577838 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150049070 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa14dffb640 1 -- 172.21.15.16:0/1913577838 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa15010c790 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620571a8610 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa14dffb640 1 -- 172.21.15.16:0/1913577838 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa150005d50 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 10 client.15273 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5620572bd060 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa14dffb640 1 -- 172.21.15.16:0/1913577838 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5620571a8610 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa14dffb640 1 -- 172.21.15.16:0/1913577838 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa1500b80c0 con 0x562057233650 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 10 client.15273 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 10 client.15273 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:39:55.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 20 client.15273 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 4 client.15273 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.826+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "status"}) -- 0x5620571a5a40 con 0x562057250280 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16659c640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16659c640 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572c03c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eda22ce12ddbe1ed server_cookie=7c2c399c064542b5 in_seq=0 out_seq=0 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa14dffb640 10 client.15273 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa14dffb640 1 -- 172.21.15.16:0/1913577838 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5620571a5a40 con 0x562057250280 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa14dffb640 10 client.15273 handle_command_reply: tid=0 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16ec77740 1 client.15273 shutdown 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 msgr2=0x562057253fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057253fa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa150006010 tx=0x7fa15002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 shutdown_connections 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x562057250280 0x5620572c03c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.827+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56205723f5e0 0x5620572544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562057233650 0x562057253fa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16ec77740 1 --2- 172.21.15.16:0/1913577838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562057232d30 0x562057253a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa14dffb640 0 client.15273 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 >> 172.21.15.16:0/1913577838 conn(0x562057230b60 msgr2=0x562057231a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 shutdown_connections 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16ec77740 1 -- 172.21.15.16:0/1913577838 wait complete. 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16ec77740 20 client.15273 trim_cache size 0 max 16384 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:39:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 2, 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24595, 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 93.564909142000005, 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 24, 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 77, 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 128.73038312899999 2024-09-10T23:39:55.835 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa1540b5330 msgr2=0x7fa1540b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa1540b5330 0x7fa1540b77f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa158005fd0 tx=0x7fa1580097e0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 msgr2=0x7fa1681997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa1681997b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa150005940 tx=0x7fa1500042f0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 shutdown_connections 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa16810d120 0x7fa16819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa168104570 0x7fa1681997b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa1540b5330 0x7fa1540b77f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 --2- 172.21.15.16:0/4210106567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa168103b70 0x7fa168199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 >> 172.21.15.16:0/4210106567 conn(0x7fa1680fd700 msgr2=0x7fa1680fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:55.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 shutdown_connections 2024-09-10T23:39:55.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:55.828+0000 7fa16c8a2640 1 -- 172.21.15.16:0/4210106567 wait complete. 2024-09-10T23:39:56.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:55 smithi071 ceph-mon[35018]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:39:56.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:55 smithi066 ceph-mon[34761]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:39:56.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:39:56.774 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 -- 172.21.15.16:0/3242875680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 msgr2=0x7f226410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 --2- 172.21.15.16:0/3242875680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f226410e860 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f225c009ca0 tx=0x7f225c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 -- 172.21.15.16:0/3242875680 shutdown_connections 2024-09-10T23:39:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 --2- 172.21.15.16:0/3242875680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f226410e860 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 --2- 172.21.15.16:0/3242875680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22641076e0 0x7f2264107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 --2- 172.21.15.16:0/3242875680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2264101cd0 0x7f22641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 -- 172.21.15.16:0/3242875680 >> 172.21.15.16:0/3242875680 conn(0x7f22640fd700 msgr2=0x7f22640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 -- 172.21.15.16:0/3242875680 shutdown_connections 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.242+0000 7f226b828640 1 -- 172.21.15.16:0/3242875680 wait complete. 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 Processor -- start 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 -- start start 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2264101cd0 0x7f226419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22641076e0 0x7f226419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f22641a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2264111ce0 con 0x7f2264108060 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2264111b60 con 0x7f22641076e0 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f226b828640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2264111e60 con 0x7f2264101cd0 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f2269dc5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f22641a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f2269dc5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f22641a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33956/0 (socket says 172.21.15.16:33956) 2024-09-10T23:39:57.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f2269dc5640 1 -- 172.21.15.16:0/3775322442 learned_addr learned my addr 172.21.15.16:0/3775322442 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.243+0000 7f2268dc3640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22641076e0 0x7f226419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f22695c4640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2264101cd0 0x7f226419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f2269dc5640 1 -- 172.21.15.16:0/3775322442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2264101cd0 msgr2=0x7f226419b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f2269dc5640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2264101cd0 0x7f226419b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f2269dc5640 1 -- 172.21.15.16:0/3775322442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22641076e0 msgr2=0x7f226419b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f2269dc5640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22641076e0 0x7f226419b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f2269dc5640 1 -- 172.21.15.16:0/3775322442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22641a1460 con 0x7f2264108060 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f2269dc5640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f22641a0c90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f225c005cc0 tx=0x7f225c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f225a7fc640 1 -- 172.21.15.16:0/3775322442 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c003bf0 con 0x7f2264108060 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22641a16f0 con 0x7f2264108060 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f225a7fc640 1 -- 172.21.15.16:0/3775322442 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f225c003d90 con 0x7f2264108060 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f225a7fc640 1 -- 172.21.15.16:0/3775322442 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c02fbc0 con 0x7f2264108060 2024-09-10T23:39:57.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.244+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22641a7e10 con 0x7f2264108060 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f225a7fc640 1 -- 172.21.15.16:0/3775322442 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f225c004610 con 0x7f2264108060 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 Processor -- start 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 -- start start 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62adfb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f62ad72c10 con 0x55f62ae075e0 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f62ad62040 con 0x55f62adfad30 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f226dbfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f62ad65e50 con 0x55f62adfb650 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f2268dc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f2268dc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33966/0 (socket says 172.21.15.16:33966) 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.247+0000 7f2268dc3640 1 -- 172.21.15.16:0/2327345803 learned_addr learned my addr 172.21.15.16:0/2327345803 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:57.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62adfb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f22695c4640 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2268dc3640 1 -- 172.21.15.16:0/2327345803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 msgr2=0x55f62ae070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2268dc3640 1 -- 172.21.15.16:0/2327345803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 msgr2=0x55f62adfb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f225a7fc640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22500b5330 0x7f22500b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62adfb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2268dc3640 1 -- 172.21.15.16:0/2327345803 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f62aac0540 con 0x55f62ae075e0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2269dc5640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22500b5330 0x7f22500b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae099d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f22540125f0 tx=0x7f225400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13c4e309775351a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f224f7fe640 1 -- 172.21.15.16:0/2327345803 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22540106b0 con 0x55f62ae075e0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f225a7fc640 1 -- 172.21.15.16:0/3775322442 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f225c107210 con 0x7f2264108060 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f224f7fe640 1 -- 172.21.15.16:0/2327345803 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2254010d00 con 0x55f62ae075e0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.248+0000 7f224f7fe640 1 -- 172.21.15.16:0/2327345803 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225401dc60 con 0x55f62ae075e0 2024-09-10T23:39:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 -- 172.21.15.16:0/2327345803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 msgr2=0x55f62ae099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f2269dc5640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22500b5330 0x7f22500b77f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f225c0cab80 tx=0x7f225c0fdd80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae099d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f22540125f0 tx=0x7f225400b870 comp rx=0 tx=0).stop 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 -- 172.21.15.16:0/2327345803 shutdown_connections 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae099d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2327345803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62adfb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 -- 172.21.15.16:0/2327345803 >> 172.21.15.16:0/2327345803 conn(0x55f62adf8b60 msgr2=0x55f62adf9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 -- 172.21.15.16:0/2327345803 shutdown_connections 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 -- 172.21.15.16:0/2327345803 wait complete. 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 -- start start 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.249+0000 7f226dbfd740 1 Processor -- start 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfad30 0x55f62ae04600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfb650 0x55f62ae04b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae05080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f226dbfd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f62abc35f0 con 0x55f62ae075e0 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f226dbfd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f62acfd010 con 0x55f62adfb650 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f226dbfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f62ae0a290 con 0x55f62adfad30 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f226dbfd740 10 client.0 _ll_register_callbacks cb 0x55f62ad5c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae05080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33982/0 (socket says 172.21.15.16:33982) 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 -- 172.21.15.16:0/3772267247 learned_addr learned my addr 172.21.15.16:0/3772267247 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f22695c4640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfb650 0x55f62ae04b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfad30 0x55f62ae04600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 -- 172.21.15.16:0/3772267247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfad30 msgr2=0x55f62ae04600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfad30 0x55f62ae04600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 -- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfb650 msgr2=0x55f62ae04b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfb650 0x55f62ae04b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f2268dc3640 1 -- 172.21.15.16:0/3772267247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f62ad2aa00 con 0x55f62ae075e0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.250+0000 7f22695c4640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfb650 0x55f62ae04b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f2268dc3640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae05080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2254001eb0 tx=0x7f225401d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75662bf1380708fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f224cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f224cff9640 1 -- 172.21.15.16:0/3772267247 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254032060 con 0x55f62ae075e0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2254010d00 con 0x55f62ae075e0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f224cff9640 1 -- 172.21.15.16:0/3772267247 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f22540106b0 con 0x55f62ae075e0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f224cff9640 1 -- 172.21.15.16:0/3772267247 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f225401d450 con 0x55f62ae075e0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 10 client.15285 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f62ae15ea0 con 0x55f62ae075e0 2024-09-10T23:39:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f224cff9640 1 -- 172.21.15.16:0/3772267247 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2254010d00 con 0x55f62ae075e0 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f224cff9640 1 -- 172.21.15.16:0/3772267247 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f225401c070 con 0x55f62ae075e0 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 10 client.15285 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 20 client.15285 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae18280 0x55f62ae196f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 4 client.15285 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.251+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f62ad74b60 con 0x55f62ae18280 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.252+0000 7f22695c4640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae18280 0x55f62ae196f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.252+0000 7f22695c4640 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae18280 0x55f62ae196f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36207057bede3c42 server_cookie=798d2aef5fc8bca8 in_seq=0 out_seq=0 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.252+0000 7f224cff9640 10 client.15285 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f224cff9640 1 -- 172.21.15.16:0/3772267247 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f62ad74b60 con 0x55f62ae18280 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f224cff9640 10 client.15285 handle_command_reply: tid=0 2024-09-10T23:39:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 client.15285 shutdown 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 msgr2=0x55f62ae05080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae05080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2254001eb0 tx=0x7f225401d860 comp rx=0 tx=0).stop 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 shutdown_connections 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae18280 0x55f62ae196f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae05080 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfb650 0x55f62ae04b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f224cff9640 0 client.15285 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 --2- 172.21.15.16:0/3772267247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfad30 0x55f62ae04600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 >> 172.21.15.16:0/3772267247 conn(0x55f62adf8b60 msgr2=0x55f62adfe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 shutdown_connections 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 1 -- 172.21.15.16:0/3772267247 wait complete. 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.253+0000 7f226dbfd740 20 client.15285 trim_cache size 0 max 16384 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.271+0000 7f226dbfd740 1 Processor -- start 2024-09-10T23:39:57.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f226dbfd740 1 -- start start 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62ae06340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62adfb650 0x55f62ae01810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62ae075e0 0x55f62ae01d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f226dbfd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f62ae17a30 con 0x55f62adfb650 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f226dbfd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f62ae18100 con 0x55f62adfad30 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f226dbfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f62ae187d0 con 0x55f62ae075e0 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62adfb650 0x55f62ae01810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62adfb650 0x55f62ae01810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33994/0 (socket says 172.21.15.16:33994) 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 -- 172.21.15.16:0/223680572 learned_addr learned my addr 172.21.15.16:0/223680572 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 -- 172.21.15.16:0/223680572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62ae075e0 msgr2=0x55f62ae01d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 --2- 172.21.15.16:0/223680572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62ae075e0 0x55f62ae01d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 -- 172.21.15.16:0/223680572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 msgr2=0x55f62ae06340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 --2- 172.21.15.16:0/223680572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62ae06340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 -- 172.21.15.16:0/223680572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f62adf8990 con 0x55f62adfb650 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f22695c4640 1 --2- 172.21.15.16:0/223680572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62adfb650 0x55f62ae01810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2260000c00 tx=0x7f2260013d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f38e1e1c23d78b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f224effd640 1 -- 172.21.15.16:0/223680572 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260013110 con 0x55f62adfb650 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f224effd640 1 -- 172.21.15.16:0/223680572 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22600132b0 con 0x55f62adfb650 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.272+0000 7f224effd640 1 -- 172.21.15.16:0/223680572 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260011660 con 0x55f62adfb650 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 -- 172.21.15.16:0/223680572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62adfb650 msgr2=0x55f62ae01810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 --2- 172.21.15.16:0/223680572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62adfb650 0x55f62ae01810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2260000c00 tx=0x7f2260013d20 comp rx=0 tx=0).stop 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 -- 172.21.15.16:0/223680572 shutdown_connections 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 --2- 172.21.15.16:0/223680572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62ae075e0 0x55f62ae01d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 --2- 172.21.15.16:0/223680572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62adfb650 0x55f62ae01810 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 --2- 172.21.15.16:0/223680572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62ae06340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 -- 172.21.15.16:0/223680572 >> 172.21.15.16:0/223680572 conn(0x55f62adf8b60 msgr2=0x55f62ae05c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 -- 172.21.15.16:0/223680572 shutdown_connections 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 -- 172.21.15.16:0/223680572 wait complete. 2024-09-10T23:39:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 -- start start 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.273+0000 7f226dbfd740 1 Processor -- start 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62ae223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae1b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f226dbfd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae1c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f226dbfd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f62ae19570 con 0x55f62ae075e0 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f226dbfd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f62ae18ea0 con 0x55f62adfad30 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f226dbfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f62ae19c40 con 0x55f62adfb650 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f226dbfd740 10 client.0 _ll_register_callbacks cb 0x7f22540123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae1c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae1c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34008/0 (socket says 172.21.15.16:34008) 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 -- 172.21.15.16:0/2318297588 learned_addr learned my addr 172.21.15.16:0/2318297588 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62ae223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f22695c4640 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae1b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 -- 172.21.15.16:0/2318297588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 msgr2=0x55f62ae1b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae1b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 -- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 msgr2=0x55f62ae223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62ae223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 -- 172.21.15.16:0/2318297588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f62adf95e0 con 0x55f62ae075e0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f2268dc3640 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae1c080 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f225400c010 tx=0x7f225401eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c0cf319dc5952b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.274+0000 7f224cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f224cff9640 1 -- 172.21.15.16:0/2318297588 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254032030 con 0x55f62ae075e0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f224cff9640 1 -- 172.21.15.16:0/2318297588 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f225401d6f0 con 0x55f62ae075e0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22600132b0 con 0x55f62ae075e0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f224cff9640 1 -- 172.21.15.16:0/2318297588 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f22540104b0 con 0x55f62ae075e0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 10 client.15291 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f62ae84cb0 con 0x55f62ae075e0 2024-09-10T23:39:57.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f224cff9640 1 -- 172.21.15.16:0/2318297588 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22600132b0 con 0x55f62ae075e0 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f224cff9640 1 -- 172.21.15.16:0/2318297588 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f225401c040 con 0x55f62ae075e0 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 10 client.15291 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 20 client.15291 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae89770 0x55f62ae88480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 4 client.15291 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.275+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "status"}) -- 0x55f62ad70610 con 0x55f62ae89770 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f22695c4640 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae89770 0x55f62ae88480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f22695c4640 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae89770 0x55f62ae88480 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc536c64c09824a0 server_cookie=25605d5b9da17896 in_seq=0 out_seq=0 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f224cff9640 10 client.15291 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f224cff9640 1 -- 172.21.15.16:0/2318297588 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f62ad70610 con 0x55f62ae89770 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f224cff9640 10 client.15291 handle_command_reply: tid=0 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 client.15291 shutdown 2024-09-10T23:39:57.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 msgr2=0x55f62ae1c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae1c080 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f225400c010 tx=0x7f225401eb00 comp rx=0 tx=0).stop 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 shutdown_connections 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f62ae89770 0x55f62ae88480 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f62ae075e0 0x55f62ae1c080 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f62adfb650 0x55f62ae1b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f224cff9640 0 client.15291 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 --2- 172.21.15.16:0/2318297588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f62adfad30 0x55f62ae223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.276+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 >> 172.21.15.16:0/2318297588 conn(0x55f62adf8b60 msgr2=0x55f62ae06450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 shutdown_connections 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226dbfd740 1 -- 172.21.15.16:0/2318297588 wait complete. 2024-09-10T23:39:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226dbfd740 20 client.15291 trim_cache size 0 max 16384 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 1, 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24608, 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 96.018523329999994, 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 24, 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 77, 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 116.18670928100001 2024-09-10T23:39:57.294 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22500b5330 msgr2=0x7f22500b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22500b5330 0x7f22500b77f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f225c0cab80 tx=0x7f225c0fdd80 comp rx=0 tx=0).stop 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 msgr2=0x7f22641a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f22641a0c90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f225c005cc0 tx=0x7f225c02f380 comp rx=0 tx=0).stop 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 shutdown_connections 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2264108060 0x7f22641a0c90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f22500b5330 0x7f22500b77f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22641076e0 0x7f226419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 --2- 172.21.15.16:0/3775322442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2264101cd0 0x7f226419b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.277+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 >> 172.21.15.16:0/3775322442 conn(0x7f22640fd700 msgr2=0x7f226410d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.278+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 shutdown_connections 2024-09-10T23:39:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:57.278+0000 7f226b828640 1 -- 172.21.15.16:0/3775322442 wait complete. 2024-09-10T23:39:57.965 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:57 smithi016 ceph-mon[30855]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:39:57.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T23:39:58.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:57 smithi071 ceph-mon[35018]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:39:58.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:57 smithi066 ceph-mon[34761]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:39:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 -- 172.21.15.16:0/3510454092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0101c90 msgr2=0x7f58e0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 --2- 172.21.15.16:0/3510454092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0101c90 0x7f58e0102070 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009900 tx=0x7f58d002a410 comp rx=0 tx=0).stop 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 -- 172.21.15.16:0/3510454092 shutdown_connections 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 --2- 172.21.15.16:0/3510454092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0108020 0x7f58e010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 --2- 172.21.15.16:0/3510454092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e01076a0 0x7f58e0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 --2- 172.21.15.16:0/3510454092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0101c90 0x7f58e0102070 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 -- 172.21.15.16:0/3510454092 >> 172.21.15.16:0/3510454092 conn(0x7f58e00fd700 msgr2=0x7f58e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 -- 172.21.15.16:0/3510454092 shutdown_connections 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.733+0000 7f58e649e640 1 -- 172.21.15.16:0/3510454092 wait complete. 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.734+0000 7f58e649e640 1 Processor -- start 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.734+0000 7f58e649e640 1 -- start start 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e649e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0101c90 0x7f58e019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e649e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e01076a0 0x7f58e019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e649e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0108020 0x7f58e019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e649e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0111ce0 con 0x7f58e0108020 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e649e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0111b60 con 0x7f58e0101c90 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e649e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0111e60 con 0x7f58e01076a0 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0108020 0x7f58e019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0108020 0x7f58e019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34022/0 (socket says 172.21.15.16:34022) 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 -- 172.21.15.16:0/2607284662 learned_addr learned my addr 172.21.15.16:0/2607284662 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58dffff640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0101c90 0x7f58e019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e01076a0 0x7f58e019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 -- 172.21.15.16:0/2607284662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e01076a0 msgr2=0x7f58e019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e01076a0 0x7f58e019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 -- 172.21.15.16:0/2607284662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0101c90 msgr2=0x7f58e019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0101c90 0x7f58e019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 -- 172.21.15.16:0/2607284662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e01a5470 con 0x7f58e0108020 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e01076a0 0x7f58e019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e4a3b640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0108020 0x7f58e019ab30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f58d800eaa0 tx=0x7f58d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58dd7fa640 1 -- 172.21.15.16:0/2607284662 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d800cdb0 con 0x7f58e0108020 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e01a5760 con 0x7f58e0108020 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58dd7fa640 1 -- 172.21.15.16:0/2607284662 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d8005020 con 0x7f58e0108020 2024-09-10T23:39:58.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.735+0000 7f58dd7fa640 1 -- 172.21.15.16:0/2607284662 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80116d0 con 0x7f58e0108020 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.736+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01a5cf0 con 0x7f58e0108020 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58dd7fa640 1 -- 172.21.15.16:0/2607284662 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f58d800f040 con 0x7f58e0108020 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 Processor -- start 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 -- start start 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e8437790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843779610 0x55e843785060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e843787990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e8436f0c10 con 0x55e843779610 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e8436e0040 con 0x55e843778cf0 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58e8873740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e8436e3e50 con 0x55e8437855a0 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843779610 0x55e843785060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.738+0000 7f58dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843779610 0x55e843785060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34026/0 (socket says 172.21.15.16:34026) 2024-09-10T23:39:58.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dffff640 1 -- 172.21.15.16:0/909052497 learned_addr learned my addr 172.21.15.16:0/909052497 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "65d5fa74-6fcc-11ef-bcea-c7b262605968", 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 24610, 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 105.536782972, 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 24, 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 77, 2024-09-10T23:39:58.775 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 75, 2024-09-10T23:39:58.776 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 126.346492384 2024-09-10T23:39:58.776 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:39:58.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58df7fe640 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e8437790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58df7fe640 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e843787990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dd7fa640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58e4a3b640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dffff640 1 -- 172.21.15.16:0/909052497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 msgr2=0x55e843787990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dffff640 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e843787990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dffff640 1 -- 172.21.15.16:0/909052497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 msgr2=0x55e8437790d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dffff640 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e8437790d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dffff640 1 -- 172.21.15.16:0/909052497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e84343e540 con 0x55e843779610 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58df7fe640 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e8437790d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dd7fa640 1 -- 172.21.15.16:0/2607284662 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f58d80e5b60 con 0x7f58e0108020 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58dffff640 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843779610 0x55e843785060 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f58d0033000 tx=0x7f58d0032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00c55d3337e89c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58c67fc640 1 -- 172.21.15.16:0/909052497 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0035040 con 0x55e843779610 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58e4a3b640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58d80a94d0 tx=0x7f58d80796e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58c67fc640 1 -- 172.21.15.16:0/909052497 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d00316a0 con 0x55e843779610 2024-09-10T23:39:58.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.739+0000 7f58c67fc640 1 -- 172.21.15.16:0/909052497 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0004750 con 0x55e843779610 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 -- 172.21.15.16:0/909052497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843779610 msgr2=0x55e843785060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843779610 0x55e843785060 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f58d0033000 tx=0x7f58d0032e60 comp rx=0 tx=0).stop 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 -- 172.21.15.16:0/909052497 shutdown_connections 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e843787990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843779610 0x55e843785060 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 --2- 172.21.15.16:0/909052497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e8437790d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 -- 172.21.15.16:0/909052497 >> 172.21.15.16:0/909052497 conn(0x55e843776b20 msgr2=0x55e843777cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 -- 172.21.15.16:0/909052497 shutdown_connections 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.740+0000 7f58e8873740 1 -- 172.21.15.16:0/909052497 wait complete. 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 -- start start 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 Processor -- start 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e843782600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e843782b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e843783080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e8435415f0 con 0x55e843778cf0 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e84367b010 con 0x55e843779610 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e8437881f0 con 0x55e8437855a0 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58e8873740 10 client.0 _ll_register_callbacks cb 0x55e8436da340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e843782600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e843782600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34038/0 (socket says 172.21.15.16:34038) 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 -- 172.21.15.16:0/2431550978 learned_addr learned my addr 172.21.15.16:0/2431550978 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58dffff640 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e843782b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 -- 172.21.15.16:0/2431550978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 msgr2=0x55e843783080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e843783080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 -- 172.21.15.16:0/2431550978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 msgr2=0x55e843782b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e843782b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.741+0000 7f58df7fe640 1 -- 172.21.15.16:0/2431550978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8436a8a00 con 0x55e843778cf0 2024-09-10T23:39:58.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58dffff640 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e843782b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e843782600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58e006b6b0 tx=0x7f58d400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b99e3df9a7318 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2431550978 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4004020 con 0x55e843778cf0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2431550978 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f58d40041c0 con 0x55e843778cf0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d00316a0 con 0x55e843778cf0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2431550978 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58d40043c0 con 0x55e843778cf0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58e8873740 10 client.15303 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e843793ea0 con 0x55e843778cf0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2431550978 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d00316a0 con 0x55e843778cf0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.742+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2431550978 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58d401e580 con 0x55e843778cf0 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.743+0000 7f58e8873740 10 client.15303 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.743+0000 7f58e8873740 10 client.15303 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.743+0000 7f58e8873740 20 client.15303 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:58.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.743+0000 7f58e8873740 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e843796470 0x55e8437978e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.743+0000 7f58e8873740 4 client.15303 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.743+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8436f2b60 con 0x55e843796470 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.743+0000 7f58dffff640 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e843796470 0x55e8437978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.744+0000 7f58dffff640 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e843796470 0x55e8437978e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d816fcc43b28ba server_cookie=c99a629dc71a794f in_seq=0 out_seq=0 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.744+0000 7f58bf7fe640 10 client.15303 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.744+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2431550978 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8436f2b60 con 0x55e843796470 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.744+0000 7f58bf7fe640 10 client.15303 handle_command_reply: tid=0 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.744+0000 7f58e8873740 1 client.15303 shutdown 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 msgr2=0x55e843782600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e843782600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58e006b6b0 tx=0x7f58d400b9a0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 shutdown_connections 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e843796470 0x55e8437978e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e843783080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e843782b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58bf7fe640 0 client.15303 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 --2- 172.21.15.16:0/2431550978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e843782600 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 >> 172.21.15.16:0/2431550978 conn(0x55e843776b20 msgr2=0x55e84377c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 shutdown_connections 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 1 -- 172.21.15.16:0/2431550978 wait complete. 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.745+0000 7f58e8873740 20 client.15303 trim_cache size 0 max 16384 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 Processor -- start 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 -- start start 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e843781af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e843779610 0x55e84379ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e8437855a0 0x55e8437a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e843795c20 con 0x55e8437855a0 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e8437962f0 con 0x55e843778cf0 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58e8873740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e8437969c0 con 0x55e843779610 2024-09-10T23:39:58.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e8437855a0 0x55e8437a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e8437855a0 0x55e8437a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34044/0 (socket says 172.21.15.16:34044) 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.763+0000 7f58df7fe640 1 -- 172.21.15.16:0/1833263005 learned_addr learned my addr 172.21.15.16:0/1833263005 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58df7fe640 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e843781af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58dffff640 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e843779610 0x55e84379ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58df7fe640 1 -- 172.21.15.16:0/1833263005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e843779610 msgr2=0x55e84379ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58df7fe640 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e843779610 0x55e84379ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58df7fe640 1 -- 172.21.15.16:0/1833263005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 msgr2=0x55e843781af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58df7fe640 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e843781af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58df7fe640 1 -- 172.21.15.16:0/1833263005 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8437775a0 con 0x55e8437855a0 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58df7fe640 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e8437855a0 0x55e8437a04f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f58d4005cd0 tx=0x7f58d4005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff80d894ca16b24a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58c5ffb640 1 -- 172.21.15.16:0/1833263005 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d401e480 con 0x55e8437855a0 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58c5ffb640 1 -- 172.21.15.16:0/1833263005 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d402e040 con 0x55e8437855a0 2024-09-10T23:39:58.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58c5ffb640 1 -- 172.21.15.16:0/1833263005 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d40035f0 con 0x55e8437855a0 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58e8873740 1 -- 172.21.15.16:0/1833263005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e8437855a0 msgr2=0x55e8437a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58e8873740 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e8437855a0 0x55e8437a04f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f58d4005cd0 tx=0x7f58d4005c60 comp rx=0 tx=0).stop 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58e8873740 1 -- 172.21.15.16:0/1833263005 shutdown_connections 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58e8873740 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e8437855a0 0x55e8437a04f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58e8873740 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e843779610 0x55e84379ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58e8873740 1 --2- 172.21.15.16:0/1833263005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843778cf0 0x55e843781af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.764+0000 7f58e8873740 1 -- 172.21.15.16:0/1833263005 >> 172.21.15.16:0/1833263005 conn(0x55e843776b20 msgr2=0x55e843777a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 -- 172.21.15.16:0/1833263005 shutdown_connections 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 -- 172.21.15.16:0/1833263005 wait complete. 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 -- start start 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 Processor -- start 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e8437a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e84379e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e84379edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e843797760 con 0x55e843778cf0 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e843797090 con 0x55e843779610 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e843797e30 con 0x55e8437855a0 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58e8873740 10 client.0 _ll_register_callbacks cb 0x7f58d400bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e8437a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e8437a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34050/0 (socket says 172.21.15.16:34050) 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.765+0000 7f58df7fe640 1 -- 172.21.15.16:0/2683498294 learned_addr learned my addr 172.21.15.16:0/2683498294 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58dffff640 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e84379e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e84379edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58df7fe640 1 -- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 msgr2=0x55e84379edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e84379edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58df7fe640 1 -- 172.21.15.16:0/2683498294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 msgr2=0x55e84379e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:39:58.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e84379e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58df7fe640 1 -- 172.21.15.16:0/2683498294 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e84379f4c0 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58df7fe640 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e8437a01f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f58d4004360 tx=0x7f58d400b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ada7d2cb159009 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2683498294 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d400b840 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2683498294 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f58d4005020 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d402e040 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2683498294 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58d4005220 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58e8873740 10 client.15309 fetch_fsmap learned FSMap version 24 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e843807cf0 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.766+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2683498294 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d402e040 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2683498294 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58d4004b10 con 0x55e843778cf0 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58e8873740 10 client.15309 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58e8873740 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58e8873740 20 client.15309 populate_metadata read hostname 'smithi016' 2024-09-10T23:39:58.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58e8873740 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e84380c630 0x55e84380b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58e8873740 4 client.15309 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "status"}) -- 0x55e8436ee610 con 0x55e84380c630 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58dffff640 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e84380c630 0x55e84380b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58dffff640 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e84380c630 0x55e84380b340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43a8b25be209acf2 server_cookie=5bb5e5d217308b05 in_seq=0 out_seq=0 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.767+0000 7f58bf7fe640 10 client.15309 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58bf7fe640 1 -- 172.21.15.16:0/2683498294 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55e8436ee610 con 0x55e84380c630 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58bf7fe640 10 client.15309 handle_command_reply: tid=0 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 client.15309 shutdown 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 msgr2=0x55e8437a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e8437a01f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f58d4004360 tx=0x7f58d400b3c0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 shutdown_connections 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e84380c630 0x55e84380b340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8437855a0 0x55e84379edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e843779610 0x55e84379e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58bf7fe640 0 client.15309 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 --2- 172.21.15.16:0/2683498294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e843778cf0 0x55e8437a01f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 >> 172.21.15.16:0/2683498294 conn(0x55e843776b20 msgr2=0x55e843780ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 shutdown_connections 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 1 -- 172.21.15.16:0/2683498294 wait complete. 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.768+0000 7f58e8873740 20 client.15309 trim_cache size 0 max 16384 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 msgr2=0x7f58c80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58d80a94d0 tx=0x7f58d80796e0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0108020 msgr2=0x7f58e019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0108020 0x7f58e019ab30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f58d800eaa0 tx=0x7f58d800ef60 comp rx=0 tx=0).stop 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 shutdown_connections 2024-09-10T23:39:58.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e0108020 0x7f58e019ab30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e01076a0 0x7f58e019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 --2- 172.21.15.16:0/2607284662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0101c90 0x7f58e019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:39:58.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 >> 172.21.15.16:0/2607284662 conn(0x7f58e00fd700 msgr2=0x7f58e00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:39:58.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 shutdown_connections 2024-09-10T23:39:58.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:39:58.769+0000 7f58e649e640 1 -- 172.21.15.16:0/2607284662 wait complete. 2024-09-10T23:39:59.577 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T23:39:59.605 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T23:39:59.605 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T23:39:59.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:39:59.605 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-09-10T23:39:59.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:39:59.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-09-10T23:39:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-09-10T23:39:59.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:39:59.695 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-10T23:39:59.695 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:39:59.695 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:39:59.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:39:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:39:59 smithi016 ceph-mon[30855]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:39:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:00.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:39:59 smithi071 ceph-mon[35018]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:40:00.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:39:59 smithi066 ceph-mon[34761]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:40:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 -- 172.21.15.16:0/1618102744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff898108060 msgr2=0x7ff89810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/1618102744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff898108060 0x7ff89810e860 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff890009ca0 tx=0x7ff89002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 -- 172.21.15.16:0/1618102744 shutdown_connections 2024-09-10T23:40:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/1618102744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff898108060 0x7ff89810e860 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/1618102744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8981076e0 0x7ff898107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/1618102744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff898101cd0 0x7ff8981020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 -- 172.21.15.16:0/1618102744 >> 172.21.15.16:0/1618102744 conn(0x7ff8980fd700 msgr2=0x7ff8980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 -- 172.21.15.16:0/1618102744 shutdown_connections 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.472+0000 7ff8a00a4640 1 -- 172.21.15.16:0/1618102744 wait complete. 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 Processor -- start 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 -- start start 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff898101cd0 0x7ff8981991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8981076e0 0x7ff898199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff898108060 0x7ff89819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff898111d20 con 0x7ff8981076e0 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff898111ba0 con 0x7ff898101cd0 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff8a00a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff898111ea0 con 0x7ff898108060 2024-09-10T23:40:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff89d63f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8981076e0 0x7ff898199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff89d63f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8981076e0 0x7ff898199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34064/0 (socket says 172.21.15.16:34064) 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff89d63f640 1 -- 172.21.15.16:0/250484071 learned_addr learned my addr 172.21.15.16:0/250484071 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.473+0000 7ff89de40640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff898101cd0 0x7ff8981991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff89e641640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff898108060 0x7ff89819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff89d63f640 1 -- 172.21.15.16:0/250484071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff898108060 msgr2=0x7ff89819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff89d63f640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff898108060 0x7ff89819eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff89d63f640 1 -- 172.21.15.16:0/250484071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff898101cd0 msgr2=0x7ff8981991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff89d63f640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff898101cd0 0x7ff8981991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff89d63f640 1 -- 172.21.15.16:0/250484071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89819f270 con 0x7ff8981076e0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff89d63f640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8981076e0 0x7ff898199700 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c920 tx=0x7ff88800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff88effd640 1 -- 172.21.15.16:0/250484071 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888007c70 con 0x7ff8981076e0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89819f560 con 0x7ff8981076e0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff88effd640 1 -- 172.21.15.16:0/250484071 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff888007e10 con 0x7ff8981076e0 2024-09-10T23:40:00.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff88effd640 1 -- 172.21.15.16:0/250484071 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888018820 con 0x7ff8981076e0 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.474+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981a5df0 con 0x7ff8981076e0 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.475+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8981020b0 con 0x7ff8981076e0 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.476+0000 7ff88effd640 1 -- 172.21.15.16:0/250484071 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7ff88800f450 con 0x7ff8981076e0 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.477+0000 7ff88effd640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8840b5330 0x7ff8840b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.477+0000 7ff89de40640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8840b5330 0x7ff8840b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.477+0000 7ff88effd640 1 -- 172.21.15.16:0/250484071 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff8880e5e40 con 0x7ff8981076e0 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.478+0000 7ff89de40640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8840b5330 0x7ff8840b77f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff894005fd0 tx=0x7ff89400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:00.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.481+0000 7ff88effd640 1 -- 172.21.15.16:0/250484071 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff888014030 con 0x7ff8981076e0 2024-09-10T23:40:00.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.713+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff8981a6020 con 0x7ff8981076e0 2024-09-10T23:40:00.714 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:00 smithi016 ceph-mon[30855]: overall HEALTH_OK 2024-09-10T23:40:00.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.713+0000 7ff88effd640 1 -- 172.21.15.16:0/250484071 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7ff8880acc40 con 0x7ff8981076e0 2024-09-10T23:40:00.715 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8840b5330 msgr2=0x7ff8840b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8840b5330 0x7ff8840b77f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff894005fd0 tx=0x7ff89400b390 comp rx=0 tx=0).stop 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8981076e0 msgr2=0x7ff898199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8981076e0 0x7ff898199700 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c920 tx=0x7ff88800cde0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 shutdown_connections 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff898108060 0x7ff89819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8981076e0 0x7ff898199700 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8840b5330 0x7ff8840b77f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 --2- 172.21.15.16:0/250484071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff898101cd0 0x7ff8981991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 >> 172.21.15.16:0/250484071 conn(0x7ff8980fd700 msgr2=0x7ff89806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 shutdown_connections 2024-09-10T23:40:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:00.716+0000 7ff8a00a4640 1 -- 172.21.15.16:0/250484071 wait complete. 2024-09-10T23:40:01.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:00 smithi071 ceph-mon[35018]: overall HEALTH_OK 2024-09-10T23:40:01.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:00 smithi066 ceph-mon[34761]: overall HEALTH_OK 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:40:01.516 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:40:01.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:40:01.517 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-09-10T23:40:01.536 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:40:01.536 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:40:01.536 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:40:01.536 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:40:01.536 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T23:40:01.537 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42131sec preferred_lft 42131sec 2024-09-10T23:40:01.538 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-09-10T23:40:01.538 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:40:01.538 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:40:01.538 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:40:01.538 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-09-10T23:40:01.538 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:40:01.538 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:40:01.539 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-10T23:40:01.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:40:01.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-09-10T23:40:01.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-09-10T23:40:01.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:40:01.539 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-10T23:40:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:40:01.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:01 smithi016 ceph-mon[30855]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:01.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:01 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/250484071' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:40:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:01.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:40:01.764 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:40:01.790 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-09-10T23:40:01.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:40:01.792 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-09-10T23:40:01.863 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-09-10T23:40:01.863 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:40:01.863 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T23:40:01.863 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T23:40:01.863 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:40:01.864 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:40:01.864 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-10T23:40:01.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:40:01.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:40:01.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:40:01.864 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-10T23:40:01.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:40:02.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:01 smithi071 ceph-mon[35018]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:02.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:01 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/250484071' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:40:02.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:01 smithi066 ceph-mon[34761]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:02.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:01 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/250484071' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:40:02.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:02.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:40:02.215 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-09-10T23:40:02.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:40:02.232 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-09-10T23:40:02.288 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:40:02.288 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-10T23:40:02.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:40:02.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T23:40:02.288 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-10T23:40:02.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:40:02.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:02.408 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T23:40:02.409 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-10T23:40:02.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:40:02.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:02.567 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:40:02.568 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-09-10T23:40:02.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-09-10T23:40:02.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:40:02.568 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-09-10T23:40:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:40:02.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:02.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:40:02.653 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:40:02.668 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:40:02.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:40:02.669 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:40:02.724 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T23:40:02.725 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T23:40:02.725 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/e192eee7-9903-461b-9e09-b059130a5d5c 2024-09-10T23:40:02.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:40:02.725 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/e192eee7-9903-461b-9e09-b059130a5d5c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-10T23:40:02.852 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-10T23:40:02.853 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-10T23:40:02.853 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2024-09-10T23:40:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-10T23:40:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-10T23:40:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2024-09-10T23:40:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.66:3300,172.21.15.71:3300" 2024-09-10T23:40:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:3300,172.21.15.66:3300,172.21.15.71:3300:/volumes/qa/sv_1/e192eee7-9903-461b-9e09-b059130a5d5c 2024-09-10T23:40:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=65d5fa74-6fcc-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T23:40:02.987 INFO:teuthology.orchestra.run.smithi016.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T23:40:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: You just mounted a file system that supports labels which does not 2024-09-10T23:40:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T23:40:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T23:40:02.987 INFO:teuthology.orchestra.run.smithi016.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T23:40:02.988 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T23:40:02.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:40:02.989 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:40:03.016 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:40:03.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:40:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:03.114 INFO:teuthology.orchestra.run.smithi016.stdout:client25001 2024-09-10T23:40:03.114 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:40:03.114 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:40:03.132 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:40:03.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:40:03.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:03.229 INFO:teuthology.orchestra.run.smithi016.stdout:client25001 2024-09-10T23:40:03.229 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T23:40:03.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:40:03.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:03.288 INFO:teuthology.orchestra.run.smithi016.stdout:client25001 2024-09-10T23:40:03.289 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968.client25001/status') 2024-09-10T23:40:03.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:40:03.350 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.25001 (3)172.21.15.16:0/2194974003 2024-09-10T23:40:03.350 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2024-09-10T23:40:03.350 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2024-09-10T23:40:03.351 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2024-09-10T23:40:03.351 INFO:teuthology.orchestra.run.smithi016.stderr:71 bytes copied, 2.6349e-05 s, 2.7 MB/s 2024-09-10T23:40:03.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:40:03.358 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T23:40:03.369 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:40:03.369 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:40:03.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T23:40:03.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1126106922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc0109070 msgr2=0x7f2bc010f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1126106922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc0109070 0x7f2bc010f870 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8009ca0 tx=0x7f2bb802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1126106922 shutdown_connections 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1126106922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc0109070 0x7f2bc010f870 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1126106922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc01086f0 0x7f2bc0108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1126106922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bc006ac10 0x7f2bc006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1126106922 >> 172.21.15.16:0/1126106922 conn(0x7f2bc0077660 msgr2=0x7f2bc0077a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1126106922 shutdown_connections 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1126106922 wait complete. 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.474+0000 7f2bc86b6640 1 Processor -- start 2024-09-10T23:40:03.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc86b6640 1 -- start start 2024-09-10T23:40:03.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc86b6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc006ac10 0x7f2bc0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc86b6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc01086f0 0x7f2bc01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc86b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bc0109070 0x7f2bc019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc86b6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0112cf0 con 0x7f2bc006ac10 2024-09-10T23:40:03.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc86b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0112b70 con 0x7f2bc0109070 2024-09-10T23:40:03.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc86b6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0112e70 con 0x7f2bc01086f0 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc006ac10 0x7f2bc0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc006ac10 0x7f2bc0199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34090/0 (socket says 172.21.15.16:34090) 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 -- 172.21.15.16:0/1768279383 learned_addr learned my addr 172.21.15.16:0/1768279383 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc5c51640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc01086f0 0x7f2bc01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6c53640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bc0109070 0x7f2bc019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 -- 172.21.15.16:0/1768279383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc01086f0 msgr2=0x7f2bc01997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc01086f0 0x7f2bc01997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 -- 172.21.15.16:0/1768279383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bc0109070 msgr2=0x7f2bc019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bc0109070 0x7f2bc019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 -- 172.21.15.16:0/1768279383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc019f330 con 0x7f2bc006ac10 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6c53640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bc0109070 0x7f2bc019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.475+0000 7f2bc6452640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc006ac10 0x7f2bc0199290 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d950 tx=0x7f2bb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.476+0000 7f2bb37fe640 1 -- 172.21.15.16:0/1768279383 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4017030 con 0x7f2bc006ac10 2024-09-10T23:40:03.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.476+0000 7f2bb37fe640 1 -- 172.21.15.16:0/1768279383 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bb4004020 con 0x7f2bc006ac10 2024-09-10T23:40:03.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.476+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc019f620 con 0x7f2bc006ac10 2024-09-10T23:40:03.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.476+0000 7f2bb37fe640 1 -- 172.21.15.16:0/1768279383 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40047a0 con 0x7f2bc006ac10 2024-09-10T23:40:03.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.476+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc01a5ec0 con 0x7f2bc006ac10 2024-09-10T23:40:03.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.477+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc006aff0 con 0x7f2bc006ac10 2024-09-10T23:40:03.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.478+0000 7f2bb37fe640 1 -- 172.21.15.16:0/1768279383 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f2bb4009a30 con 0x7f2bc006ac10 2024-09-10T23:40:03.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.479+0000 7f2bb37fe640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2bac0b53b0 0x7f2bac0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.480+0000 7f2bc5c51640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2bac0b53b0 0x7f2bac0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.480+0000 7f2bb37fe640 1 -- 172.21.15.16:0/1768279383 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2bb40e56f0 con 0x7f2bc006ac10 2024-09-10T23:40:03.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.480+0000 7f2bc5c51640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2bac0b53b0 0x7f2bac0b7870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0077c60 tx=0x7f2bbc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:03.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.484+0000 7f2bb37fe640 1 -- 172.21.15.16:0/1768279383 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2bb40ac490 con 0x7f2bc006ac10 2024-09-10T23:40:03.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.708+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f2bc002e5c0 con 0x7f2bc006ac10 2024-09-10T23:40:03.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.758+0000 7f2bb37fe640 1 -- 172.21.15.16:0/1768279383 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f2bb40abd90 con 0x7f2bc006ac10 2024-09-10T23:40:03.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2bac0b53b0 msgr2=0x7f2bac0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2bac0b53b0 0x7f2bac0b7870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0077c60 tx=0x7f2bbc00b390 comp rx=0 tx=0).stop 2024-09-10T23:40:03.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc006ac10 msgr2=0x7f2bc0199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc006ac10 0x7f2bc0199290 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d950 tx=0x7f2bb400de10 comp rx=0 tx=0).stop 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 shutdown_connections 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2bac0b53b0 0x7f2bac0b7870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bc0109070 0x7f2bc019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bc01086f0 0x7f2bc01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 --2- 172.21.15.16:0/1768279383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bc006ac10 0x7f2bc0199290 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 >> 172.21.15.16:0/1768279383 conn(0x7f2bc0077660 msgr2=0x7f2bc00ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.760+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 shutdown_connections 2024-09-10T23:40:03.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.761+0000 7f2bc86b6640 1 -- 172.21.15.16:0/1768279383 wait complete. 2024-09-10T23:40:03.773 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T23:40:03.783 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T23:40:03.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:40:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2777911503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107610 msgr2=0x7fc9c4107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2777911503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107610 0x7fc9c4107a50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009ca0 tx=0x7fc9b402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2777911503 shutdown_connections 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2777911503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9c4107f90 0x7fc9c410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2777911503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107610 0x7fc9c4107a50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2777911503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9c4101f90 0x7fc9c4102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2777911503 >> 172.21.15.16:0/2777911503 conn(0x7fc9c4077600 msgr2=0x7fc9c4079df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2777911503 shutdown_connections 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.896+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2777911503 wait complete. 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 Processor -- start 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 -- start start 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9c4101f90 0x7fc9c419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9c4107610 0x7fc9c419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107f90 0x7fc9c41a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4111c50 con 0x7fc9c4107f90 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4111ad0 con 0x7fc9c4101f90 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9cae6a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4111dd0 con 0x7fc9c4107610 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c9407640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107f90 0x7fc9c41a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c9407640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107f90 0x7fc9c41a50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47246/0 (socket says 172.21.15.16:47246) 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c9407640 1 -- 172.21.15.16:0/2119111191 learned_addr learned my addr 172.21.15.16:0/2119111191 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c3fff640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9c4107610 0x7fc9c419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c8c06640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9c4101f90 0x7fc9c419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c9407640 1 -- 172.21.15.16:0/2119111191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9c4107610 msgr2=0x7fc9c419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c9407640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9c4107610 0x7fc9c419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c9407640 1 -- 172.21.15.16:0/2119111191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9c4101f90 msgr2=0x7fc9c419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.897+0000 7fc9c9407640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9c4101f90 0x7fc9c419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9c9407640 1 -- 172.21.15.16:0/2119111191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c41a5620 con 0x7fc9c4107f90 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9c8c06640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9c4101f90 0x7fc9c419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:03.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9c9407640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107f90 0x7fc9c41a50e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d750 tx=0x7fc9bc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:03.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9c1ffb640 1 -- 172.21.15.16:0/2119111191 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc017070 con 0x7fc9c4107f90 2024-09-10T23:40:03.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9c1ffb640 1 -- 172.21.15.16:0/2119111191 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc0054d0 con 0x7fc9c4107f90 2024-09-10T23:40:03.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c41a57f0 con 0x7fc9c4107f90 2024-09-10T23:40:03.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9c1ffb640 1 -- 172.21.15.16:0/2119111191 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc004c60 con 0x7fc9c4107f90 2024-09-10T23:40:03.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.898+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c41a5cb0 con 0x7fc9c4107f90 2024-09-10T23:40:03.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.899+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c4102370 con 0x7fc9c4107f90 2024-09-10T23:40:03.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.901+0000 7fc9c1ffb640 1 -- 172.21.15.16:0/2119111191 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fc9bc004e00 con 0x7fc9c4107f90 2024-09-10T23:40:03.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.902+0000 7fc9c1ffb640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b00b5330 0x7fc9b00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:03.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.902+0000 7fc9c8c06640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b00b5330 0x7fc9b00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:03.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.902+0000 7fc9c1ffb640 1 -- 172.21.15.16:0/2119111191 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc9bc0e5690 con 0x7fc9c4107f90 2024-09-10T23:40:03.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.903+0000 7fc9c8c06640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b00b5330 0x7fc9b00b77f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0058c0 tx=0x7fc9ac005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:03.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:03.906+0000 7fc9c1ffb640 1 -- 172.21.15.16:0/2119111191 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9bc0ac430 con 0x7fc9c4107f90 2024-09-10T23:40:04.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:03 smithi071 ceph-mon[35018]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-10T23:40:04.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:03 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1768279383' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T23:40:04.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:03 smithi016 ceph-mon[30855]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-10T23:40:04.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:03 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1768279383' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T23:40:04.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:03 smithi066 ceph-mon[34761]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-10T23:40:04.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:03 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1768279383' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T23:40:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.102+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9c402e5c0 con 0x7fc9c4107f90 2024-09-10T23:40:04.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.103+0000 7fc9c1ffb640 1 -- 172.21.15.16:0/2119111191 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22944 (secure 0 0 0) 0x7fc9bc0abd30 con 0x7fc9c4107f90 2024-09-10T23:40:04.105 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:04.105 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":77,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:43.527822+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:40:04.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b00b5330 msgr2=0x7fc9b00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b00b5330 0x7fc9b00b77f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0058c0 tx=0x7fc9ac005850 comp rx=0 tx=0).stop 2024-09-10T23:40:04.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107f90 msgr2=0x7fc9c41a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107f90 0x7fc9c41a50e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d750 tx=0x7fc9bc00dc10 comp rx=0 tx=0).stop 2024-09-10T23:40:04.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 shutdown_connections 2024-09-10T23:40:04.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9c4107f90 0x7fc9c41a50e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9c4107610 0x7fc9c419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b00b5330 0x7fc9b00b77f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 --2- 172.21.15.16:0/2119111191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9c4101f90 0x7fc9c419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 >> 172.21.15.16:0/2119111191 conn(0x7fc9c4077600 msgr2=0x7fc9c4103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:04.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 shutdown_connections 2024-09-10T23:40:04.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.106+0000 7fc9cae6a640 1 -- 172.21.15.16:0/2119111191 wait complete. 2024-09-10T23:40:04.118 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:33:36.795990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:38:08.796841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:38:11.028262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:40:04.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:40:04.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 -- 172.21.15.16:0/3793450429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc564108e60 msgr2=0x7fc56410f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 --2- 172.21.15.16:0/3793450429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc564108e60 0x7fc56410f660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009ca0 tx=0x7fc55c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 -- 172.21.15.16:0/3793450429 shutdown_connections 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 --2- 172.21.15.16:0/3793450429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc564108e60 0x7fc56410f660 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 --2- 172.21.15.16:0/3793450429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5641084e0 0x7fc564108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 --2- 172.21.15.16:0/3793450429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc564102ae0 0x7fc564102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 -- 172.21.15.16:0/3793450429 >> 172.21.15.16:0/3793450429 conn(0x7fc5640fe500 msgr2=0x7fc564100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 -- 172.21.15.16:0/3793450429 shutdown_connections 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.227+0000 7fc56899f640 1 -- 172.21.15.16:0/3793450429 wait complete. 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 Processor -- start 2024-09-10T23:40:04.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 -- start start 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc564102ae0 0x7fc564199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5641084e0 0x7fc564199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc564108e60 0x7fc56419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc564112ae0 con 0x7fc5641084e0 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc564112960 con 0x7fc564102ae0 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc56899f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc564112c60 con 0x7fc564108e60 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.228+0000 7fc55bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5641084e0 0x7fc564199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5641084e0 0x7fc564199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47262/0 (socket says 172.21.15.16:47262) 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 -- 172.21.15.16:0/2794632545 learned_addr learned my addr 172.21.15.16:0/2794632545 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc5637fe640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc564102ae0 0x7fc564199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc563fff640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc564108e60 0x7fc56419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 -- 172.21.15.16:0/2794632545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc564108e60 msgr2=0x7fc56419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc564108e60 0x7fc56419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 -- 172.21.15.16:0/2794632545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc564102ae0 msgr2=0x7fc564199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc564102ae0 0x7fc564199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 -- 172.21.15.16:0/2794632545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56419f0c0 con 0x7fc5641084e0 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc55bfff640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5641084e0 0x7fc564199560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00e9f0 tx=0x7fc54c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc5617fa640 1 -- 172.21.15.16:0/2794632545 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c00cd80 con 0x7fc5641084e0 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc5617fa640 1 -- 172.21.15.16:0/2794632545 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc54c0108e0 con 0x7fc5641084e0 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56419f3b0 con 0x7fc5641084e0 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc5617fa640 1 -- 172.21.15.16:0/2794632545 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c018980 con 0x7fc5641084e0 2024-09-10T23:40:04.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.229+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5641a5a70 con 0x7fc5641084e0 2024-09-10T23:40:04.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.231+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc564102ec0 con 0x7fc5641084e0 2024-09-10T23:40:04.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.232+0000 7fc5617fa640 1 -- 172.21.15.16:0/2794632545 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fc54c010430 con 0x7fc5641084e0 2024-09-10T23:40:04.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.233+0000 7fc5617fa640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5500b5330 0x7fc5500b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.233+0000 7fc5637fe640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5500b5330 0x7fc5500b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.233+0000 7fc5617fa640 1 -- 172.21.15.16:0/2794632545 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc54c0e6020 con 0x7fc5641084e0 2024-09-10T23:40:04.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.233+0000 7fc5637fe640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5500b5330 0x7fc5500b77f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc554009bd0 tx=0x7fc554005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:04.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.237+0000 7fc5617fa640 1 -- 172.21.15.16:0/2794632545 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc54c0ace20 con 0x7fc5641084e0 2024-09-10T23:40:04.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.420+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc56402e5c0 con 0x7fc5641084e0 2024-09-10T23:40:04.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.421+0000 7fc5617fa640 1 -- 172.21.15.16:0/2794632545 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7fc54c0a6e20 con 0x7fc5641084e0 2024-09-10T23:40:04.422 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-09-10T23:40:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5500b5330 msgr2=0x7fc5500b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5500b5330 0x7fc5500b77f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc554009bd0 tx=0x7fc554005f90 comp rx=0 tx=0).stop 2024-09-10T23:40:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5641084e0 msgr2=0x7fc564199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5641084e0 0x7fc564199560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00e9f0 tx=0x7fc54c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 shutdown_connections 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc564108e60 0x7fc56419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5641084e0 0x7fc564199560 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5500b5330 0x7fc5500b77f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 --2- 172.21.15.16:0/2794632545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc564102ae0 0x7fc564199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 >> 172.21.15.16:0/2794632545 conn(0x7fc5640fe500 msgr2=0x7fc5640feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 shutdown_connections 2024-09-10T23:40:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.423+0000 7fc56899f640 1 -- 172.21.15.16:0/2794632545 wait complete. 2024-09-10T23:40:04.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T23:40:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 -- 172.21.15.16:0/2384820293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 msgr2=0x7f2cbc108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 --2- 172.21.15.16:0/2384820293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc108c60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009900 tx=0x7f2ca402a410 comp rx=0 tx=0).stop 2024-09-10T23:40:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 -- 172.21.15.16:0/2384820293 shutdown_connections 2024-09-10T23:40:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 --2- 172.21.15.16:0/2384820293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cbc1091a0 0x7f2cbc10f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 --2- 172.21.15.16:0/2384820293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc108c60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 --2- 172.21.15.16:0/2384820293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cbc1016c0 0x7f2cbc101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 -- 172.21.15.16:0/2384820293 >> 172.21.15.16:0/2384820293 conn(0x7f2cbc076f10 msgr2=0x7f2cbc077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 -- 172.21.15.16:0/2384820293 shutdown_connections 2024-09-10T23:40:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.544+0000 7f2cc0847640 1 -- 172.21.15.16:0/2384820293 wait complete. 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 Processor -- start 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 -- start start 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cbc1016c0 0x7f2cbc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cbc1091a0 0x7f2cbc19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc112db0 con 0x7f2cbc108820 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc112c30 con 0x7f2cbc1016c0 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cc0847640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc112f30 con 0x7f2cbc1091a0 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47276/0 (socket says 172.21.15.16:47276) 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cb3fff640 1 -- 172.21.15.16:0/1197995228 learned_addr learned my addr 172.21.15.16:0/1197995228 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.545+0000 7f2cba59c640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cbc1016c0 0x7f2cbc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cbad9d640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cbc1091a0 0x7f2cbc19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb3fff640 1 -- 172.21.15.16:0/1197995228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cbc1091a0 msgr2=0x7f2cbc19eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb3fff640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cbc1091a0 0x7f2cbc19eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb3fff640 1 -- 172.21.15.16:0/1197995228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cbc1016c0 msgr2=0x7f2cbc1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb3fff640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cbc1016c0 0x7f2cbc1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb3fff640 1 -- 172.21.15.16:0/1197995228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc19f290 con 0x7f2cbc108820 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb3fff640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc199730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4004770 tx=0x7f2ca4003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb37fe640 1 -- 172.21.15.16:0/1197995228 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca403f070 con 0x7f2cbc108820 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb37fe640 1 -- 172.21.15.16:0/1197995228 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca403bd20 con 0x7f2cbc108820 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cb37fe640 1 -- 172.21.15.16:0/1197995228 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4035030 con 0x7f2cbc108820 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cbc19f520 con 0x7f2cbc108820 2024-09-10T23:40:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.546+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cbc1a5c40 con 0x7f2cbc108820 2024-09-10T23:40:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.547+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cbc101aa0 con 0x7f2cbc108820 2024-09-10T23:40:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.549+0000 7f2cb37fe640 1 -- 172.21.15.16:0/1197995228 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f2ca4031430 con 0x7f2cbc108820 2024-09-10T23:40:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.549+0000 7f2cb37fe640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2ca80b53b0 0x7f2ca80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.550+0000 7f2cba59c640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2ca80b53b0 0x7f2ca80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.550+0000 7f2cb37fe640 1 -- 172.21.15.16:0/1197995228 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2ca4106b40 con 0x7f2cbc108820 2024-09-10T23:40:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.550+0000 7f2cba59c640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2ca80b53b0 0x7f2ca80b7870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00bbe0 tx=0x7f2cac00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:04.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.552+0000 7f2cb37fe640 1 -- 172.21.15.16:0/1197995228 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2ca40cd940 con 0x7f2cbc108820 2024-09-10T23:40:04.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.737+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2cbc1a5f80 con 0x7f2cbc108820 2024-09-10T23:40:04.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.737+0000 7f2cb37fe640 1 -- 172.21.15.16:0/1197995228 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f2ca40d60f0 con 0x7f2cbc108820 2024-09-10T23:40:04.738 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-09-10T23:40:04.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2ca80b53b0 msgr2=0x7f2ca80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2ca80b53b0 0x7f2ca80b7870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00bbe0 tx=0x7f2cac00b390 comp rx=0 tx=0).stop 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 msgr2=0x7f2cbc199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc199730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4004770 tx=0x7f2ca4003ca0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 shutdown_connections 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cbc1091a0 0x7f2cbc19eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cbc108820 0x7f2cbc199730 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2ca80b53b0 0x7f2ca80b7870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 --2- 172.21.15.16:0/1197995228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cbc1016c0 0x7f2cbc1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.739+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 >> 172.21.15.16:0/1197995228 conn(0x7f2cbc076f10 msgr2=0x7f2cbc100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.740+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 shutdown_connections 2024-09-10T23:40:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.740+0000 7f2cc0847640 1 -- 172.21.15.16:0/1197995228 wait complete. 2024-09-10T23:40:04.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T23:40:04.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.858+0000 7fd384b2b640 1 -- 172.21.15.16:0/605811782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 msgr2=0x7fd38010ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.858+0000 7fd384b2b640 1 --2- 172.21.15.16:0/605811782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd38010ca70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd374009900 tx=0x7fd37402a410 comp rx=0 tx=0).stop 2024-09-10T23:40:04.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.858+0000 7fd384b2b640 1 -- 172.21.15.16:0/605811782 shutdown_connections 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.858+0000 7fd384b2b640 1 --2- 172.21.15.16:0/605811782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38010d040 0x7fd38010f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.858+0000 7fd384b2b640 1 --2- 172.21.15.16:0/605811782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd38010ca70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.858+0000 7fd384b2b640 1 --2- 172.21.15.16:0/605811782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd380103a90 0x7fd380103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.858+0000 7fd384b2b640 1 -- 172.21.15.16:0/605811782 >> 172.21.15.16:0/605811782 conn(0x7fd3800fd620 msgr2=0x7fd3800ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.859+0000 7fd384b2b640 1 -- 172.21.15.16:0/605811782 shutdown_connections 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.859+0000 7fd384b2b640 1 -- 172.21.15.16:0/605811782 wait complete. 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.859+0000 7fd384b2b640 1 Processor -- start 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.859+0000 7fd384b2b640 1 -- start start 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.859+0000 7fd384b2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd380103a90 0x7fd380199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.859+0000 7fd384b2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd380199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd384b2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38010d040 0x7fd38019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd384b2b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd380112cd0 con 0x7fd380104490 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd384b2b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd380112b50 con 0x7fd380103a90 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd384b2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd380112e50 con 0x7fd38010d040 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd380199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd380199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47294/0 (socket says 172.21.15.16:47294) 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 -- 172.21.15.16:0/464815515 learned_addr learned my addr 172.21.15.16:0/464815515 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37ed9d640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38010d040 0x7fd38019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37e59c640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd380103a90 0x7fd380199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 -- 172.21.15.16:0/464815515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38010d040 msgr2=0x7fd38019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38010d040 0x7fd38019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 -- 172.21.15.16:0/464815515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd380103a90 msgr2=0x7fd380199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd380103a90 0x7fd380199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 -- 172.21.15.16:0/464815515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38019f2d0 con 0x7fd380104490 2024-09-10T23:40:04.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37ed9d640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38010d040 0x7fd38019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37e59c640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd380103a90 0x7fd380199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd37dd9b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd380199770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd374005940 tx=0x7fd3740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd36f7fe640 1 -- 172.21.15.16:0/464815515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37403f030 con 0x7fd380104490 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd36f7fe640 1 -- 172.21.15.16:0/464815515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd374003cb0 con 0x7fd380104490 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38019f560 con 0x7fd380104490 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd36f7fe640 1 -- 172.21.15.16:0/464815515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374035070 con 0x7fd380104490 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.860+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3801a5c80 con 0x7fd380104490 2024-09-10T23:40:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.861+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd380103e70 con 0x7fd380104490 2024-09-10T23:40:04.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.863+0000 7fd36f7fe640 1 -- 172.21.15.16:0/464815515 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fd37403bbf0 con 0x7fd380104490 2024-09-10T23:40:04.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.863+0000 7fd36f7fe640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3680b5330 0x7fd3680b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:04.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.864+0000 7fd37e59c640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3680b5330 0x7fd3680b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:04.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.864+0000 7fd36f7fe640 1 -- 172.21.15.16:0/464815515 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd374106ba0 con 0x7fd380104490 2024-09-10T23:40:04.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.864+0000 7fd37e59c640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3680b5330 0x7fd3680b77f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd3700058c0 tx=0x7fd370005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:04.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:04.867+0000 7fd36f7fe640 1 -- 172.21.15.16:0/464815515 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd3740cd9a0 con 0x7fd380104490 2024-09-10T23:40:05.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:04 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1768279383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T23:40:05.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:04 smithi071 ceph-mon[35018]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:40:05.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:04 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2119111191' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:40:05.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:04 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2794632545' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:40:05.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:04 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1197995228' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:40:05.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.049+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd38002e5c0 con 0x7fd380104490 2024-09-10T23:40:05.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.050+0000 7fd36f7fe640 1 -- 172.21.15.16:0/464815515 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fd3740cd2a0 con 0x7fd380104490 2024-09-10T23:40:05.051 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-09-10T23:40:05.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:04 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1768279383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T23:40:05.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:04 smithi066 ceph-mon[34761]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:40:05.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:04 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2119111191' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:40:05.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:04 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2794632545' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:40:05.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:04 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1197995228' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3680b5330 msgr2=0x7fd3680b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3680b5330 0x7fd3680b77f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd3700058c0 tx=0x7fd370005ec0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 msgr2=0x7fd380199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd380199770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd374005940 tx=0x7fd3740042f0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 shutdown_connections 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd38010d040 0x7fd38019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd380104490 0x7fd380199770 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3680b5330 0x7fd3680b77f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 --2- 172.21.15.16:0/464815515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd380103a90 0x7fd380199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 >> 172.21.15.16:0/464815515 conn(0x7fd3800fd620 msgr2=0x7fd3800fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 shutdown_connections 2024-09-10T23:40:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.052+0000 7fd384b2b640 1 -- 172.21.15.16:0/464815515 wait complete. 2024-09-10T23:40:05.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:04 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1768279383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T23:40:05.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:04 smithi016 ceph-mon[30855]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:40:05.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:04 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2119111191' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:40:05.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:04 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2794632545' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:40:05.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:04 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1197995228' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:40:05.064 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T23:40:05.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:40:05.322 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:05.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 -- 172.21.15.16:0/3639226748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 msgr2=0x7f58e010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:05.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 --2- 172.21.15.16:0/3639226748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e010f550 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009900 tx=0x7f58d002a410 comp rx=0 tx=0).stop 2024-09-10T23:40:05.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 -- 172.21.15.16:0/3639226748 shutdown_connections 2024-09-10T23:40:05.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 --2- 172.21.15.16:0/3639226748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e010f550 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 --2- 172.21.15.16:0/3639226748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0104570 0x7f58e010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 --2- 172.21.15.16:0/3639226748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0103b70 0x7f58e0103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 -- 172.21.15.16:0/3639226748 >> 172.21.15.16:0/3639226748 conn(0x7f58e00fd700 msgr2=0x7f58e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 -- 172.21.15.16:0/3639226748 shutdown_connections 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.805+0000 7f58e830f640 1 -- 172.21.15.16:0/3639226748 wait complete. 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 Processor -- start 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 -- start start 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0103b70 0x7f58e01019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0104570 0x7f58e0101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e0102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0112d60 con 0x7f58e010d120 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0112be0 con 0x7f58e0104570 2024-09-10T23:40:05.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e830f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0112ee0 con 0x7f58e0103b70 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e0102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e0102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47316/0 (socket says 172.21.15.16:47316) 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 -- 172.21.15.16:0/3197547222 learned_addr learned my addr 172.21.15.16:0/3197547222 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e60ab640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0103b70 0x7f58e01019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e58aa640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0104570 0x7f58e0101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 -- 172.21.15.16:0/3197547222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0103b70 msgr2=0x7f58e01019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0103b70 0x7f58e01019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 -- 172.21.15.16:0/3197547222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0104570 msgr2=0x7f58e0101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0104570 0x7f58e0101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 -- 172.21.15.16:0/3197547222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e01a75b0 con 0x7f58e010d120 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e58aa640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0104570 0x7f58e0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e60ab640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0103b70 0x7f58e01019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:05.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.806+0000 7f58e68ac640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e0102470 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f58d0004770 tx=0x7f58d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.807+0000 7f58df7fe640 1 -- 172.21.15.16:0/3197547222 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d003f030 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.807+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e01a7840 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.807+0000 7f58df7fe640 1 -- 172.21.15.16:0/3197547222 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d0003aa0 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.807+0000 7f58df7fe640 1 -- 172.21.15.16:0/3197547222 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0035070 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.807+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01a7d70 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.808+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e0103f50 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.809+0000 7f58df7fe640 1 -- 172.21.15.16:0/3197547222 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f58d003bb10 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.810+0000 7f58df7fe640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.810+0000 7f58e60ab640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.810+0000 7f58df7fe640 1 -- 172.21.15.16:0/3197547222 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f58d0106a90 con 0x7f58e010d120 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.810+0000 7f58e60ab640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005fd0 tx=0x7f58d8009520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:05.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:05.813+0000 7f58df7fe640 1 -- 172.21.15.16:0/3197547222 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f58d00cd890 con 0x7f58e010d120 2024-09-10T23:40:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:05 smithi016 ceph-mon[30855]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:40:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:05 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/464815515' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:40:06.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.035+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58e0102cf0 con 0x7f58e010d120 2024-09-10T23:40:06.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.036+0000 7f58df7fe640 1 -- 172.21.15.16:0/3197547222 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f58d00cd190 con 0x7f58e010d120 2024-09-10T23:40:06.037 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:06.038 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:40:06.038 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 msgr2=0x7f58c80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005fd0 tx=0x7f58d8009520 comp rx=0 tx=0).stop 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 msgr2=0x7f58e0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e0102470 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f58d0004770 tx=0x7f58d0004270 comp rx=0 tx=0).stop 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 shutdown_connections 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e010d120 0x7f58e0102470 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f58c80b5330 0x7f58c80b77f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58e0104570 0x7f58e0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 --2- 172.21.15.16:0/3197547222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58e0103b70 0x7f58e01019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.038+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 >> 172.21.15.16:0/3197547222 conn(0x7f58e00fd700 msgr2=0x7f58e010f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:06.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.039+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 shutdown_connections 2024-09-10T23:40:06.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:06.039+0000 7f58e830f640 1 -- 172.21.15.16:0/3197547222 wait complete. 2024-09-10T23:40:06.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:05 smithi066 ceph-mon[34761]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:40:06.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:05 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/464815515' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:40:06.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:05 smithi071 ceph-mon[35018]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T23:40:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:05 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/464815515' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:40:06.924 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T23:40:06.924 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T23:40:06.924 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.036+0000 7f28f1117640 1 -- 172.21.15.16:0/4011783219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec102030 msgr2=0x7f28ec108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.036+0000 7f28f1117640 1 --2- 172.21.15.16:0/4011783219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec102030 0x7f28ec108800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009900 tx=0x7f28e002a480 comp rx=0 tx=0).stop 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.036+0000 7f28f1117640 1 -- 172.21.15.16:0/4011783219 shutdown_connections 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.036+0000 7f28f1117640 1 --2- 172.21.15.16:0/4011783219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec108fe0 0x7f28ec10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.036+0000 7f28f1117640 1 --2- 172.21.15.16:0/4011783219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec102030 0x7f28ec108800 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.036+0000 7f28f1117640 1 --2- 172.21.15.16:0/4011783219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ec101710 0x7f28ec101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.036+0000 7f28f1117640 1 -- 172.21.15.16:0/4011783219 >> 172.21.15.16:0/4011783219 conn(0x7f28ec076de0 msgr2=0x7f28ec0771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.037+0000 7f28f1117640 1 -- 172.21.15.16:0/4011783219 shutdown_connections 2024-09-10T23:40:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.037+0000 7f28f1117640 1 -- 172.21.15.16:0/4011783219 wait complete. 2024-09-10T23:40:07.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.037+0000 7f28f1117640 1 Processor -- start 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.037+0000 7f28f1117640 1 -- start start 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28f1117640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec101710 0x7f28ec1026d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28f1117640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ec102030 0x7f28ec102c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28f1117640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec108fe0 0x7f28ec103150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28f1117640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec112ce0 con 0x7f28ec101710 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28f1117640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec112b60 con 0x7f28ec102030 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28f1117640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec112e60 con 0x7f28ec108fe0 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec101710 0x7f28ec1026d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec101710 0x7f28ec1026d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47328/0 (socket says 172.21.15.16:47328) 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 -- 172.21.15.16:0/3226178819 learned_addr learned my addr 172.21.15.16:0/3226178819 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28eb59e640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec108fe0 0x7f28ec103150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ea59c640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ec102030 0x7f28ec102c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 -- 172.21.15.16:0/3226178819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec108fe0 msgr2=0x7f28ec103150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec108fe0 0x7f28ec103150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 -- 172.21.15.16:0/3226178819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ec102030 msgr2=0x7f28ec102c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ec102030 0x7f28ec102c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 -- 172.21.15.16:0/3226178819 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec1a7690 con 0x7f28ec101710 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ea59c640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ec102030 0x7f28ec102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28ead9d640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec101710 0x7f28ec1026d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e9f0 tx=0x7f28dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.038+0000 7f28d3fff640 1 -- 172.21.15.16:0/3226178819 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00cd80 con 0x7f28ec101710 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.039+0000 7f28d3fff640 1 -- 172.21.15.16:0/3226178819 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28dc0108e0 con 0x7f28ec101710 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.039+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec1a7980 con 0x7f28ec101710 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.039+0000 7f28d3fff640 1 -- 172.21.15.16:0/3226178819 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc018980 con 0x7f28ec101710 2024-09-10T23:40:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.039+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec1a7ed0 con 0x7f28ec101710 2024-09-10T23:40:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.040+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ec101af0 con 0x7f28ec101710 2024-09-10T23:40:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.041+0000 7f28d3fff640 1 -- 172.21.15.16:0/3226178819 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f28dc010430 con 0x7f28ec101710 2024-09-10T23:40:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.042+0000 7f28d3fff640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d40b5330 0x7f28d40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.042+0000 7f28ea59c640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d40b5330 0x7f28d40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.042+0000 7f28d3fff640 1 -- 172.21.15.16:0/3226178819 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f28dc0e65a0 con 0x7f28ec101710 2024-09-10T23:40:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.042+0000 7f28ea59c640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d40b5330 0x7f28d40b77f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000c00 tx=0x7f28e0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:07.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.045+0000 7f28d3fff640 1 -- 172.21.15.16:0/3226178819 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28dc0ad3a0 con 0x7f28ec101710 2024-09-10T23:40:07.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:06 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3197547222' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:07.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.230+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28ec063590 con 0x7f28d40b5330 2024-09-10T23:40:07.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:06 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3197547222' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.234+0000 7f28d3fff640 1 -- 172.21.15.16:0/3226178819 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259071 (secure 0 0 0) 0x7f28ec063590 con 0x7f28d40b5330 2024-09-10T23:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:07.239 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d40b5330 msgr2=0x7f28d40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d40b5330 0x7f28d40b77f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000c00 tx=0x7f28e0031400 comp rx=0 tx=0).stop 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec101710 msgr2=0x7f28ec1026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec101710 0x7f28ec1026d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e9f0 tx=0x7f28dc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 shutdown_connections 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28ec108fe0 0x7f28ec103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d40b5330 0x7f28d40b77f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ec102030 0x7f28ec102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 --2- 172.21.15.16:0/3226178819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28ec101710 0x7f28ec1026d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 >> 172.21.15.16:0/3226178819 conn(0x7f28ec076de0 msgr2=0x7f28ec1069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 shutdown_connections 2024-09-10T23:40:07.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.237+0000 7f28f1117640 1 -- 172.21.15.16:0/3226178819 wait complete. 2024-09-10T23:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-10T23:40:06.447649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656180,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":711,"num_read_kb":452,"num_write":297,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384528,"kb_used_data":10320,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124557296,"statfs":{"total":1151940427776,"available":1151546671104,"internally_reserved":0,"allocated":10567680,"data_stored":6976628,"data_compressed":178827,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002699"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841669+0000","last_change":"2024-09-10T23:38:12.217637+0000","last_active":"2024-09-10T23:39:42.841669+0000","last_peered":"2024-09-10T23:39:42.841669+0000","last_clean":"2024-09-10T23:39:42.841669+0000","last_became_active":"2024-09-10T23:38:12.217260+0000","last_became_peered":"2024-09-10T23:38:12.217260+0000","last_unstale":"2024-09-10T23:39:42.841669+0000","last_undegraded":"2024-09-10T23:39:42.841669+0000","last_fullsized":"2024-09-10T23:39:42.841669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.774575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.831938+0000","last_change":"2024-09-10T23:38:12.217114+0000","last_active":"2024-09-10T23:39:42.831938+0000","last_peered":"2024-09-10T23:39:42.831938+0000","last_clean":"2024-09-10T23:39:42.831938+0000","last_became_active":"2024-09-10T23:38:12.216836+0000","last_became_peered":"2024-09-10T23:38:12.216836+0000","last_unstale":"2024-09-10T23:39:42.831938+0000","last_undegraded":"2024-09-10T23:39:42.831938+0000","last_fullsized":"2024-09-10T23:39:42.831938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:55.023668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835068+0000","last_change":"2024-09-10T23:38:12.219046+0000","last_active":"2024-09-10T23:39:42.835068+0000","last_peered":"2024-09-10T23:39:42.835068+0000","last_clean":"2024-09-10T23:39:42.835068+0000","last_became_active":"2024-09-10T23:38:12.218348+0000","last_became_peered":"2024-09-10T23:38:12.218348+0000","last_unstale":"2024-09-10T23:39:42.835068+0000","last_undegraded":"2024-09-10T23:39:42.835068+0000","last_fullsized":"2024-09-10T23:39:42.835068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:07.419364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828772+0000","last_change":"2024-09-10T23:38:12.219211+0000","last_active":"2024-09-10T23:39:42.828772+0000","last_peered":"2024-09-10T23:39:42.828772+0000","last_clean":"2024-09-10T23:39:42.828772+0000","last_became_active":"2024-09-10T23:38:12.213452+0000","last_became_peered":"2024-09-10T23:38:12.213452+0000","last_unstale":"2024-09-10T23:39:42.828772+0000","last_undegraded":"2024-09-10T23:39:42.828772+0000","last_fullsized":"2024-09-10T23:39:42.828772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:59.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823728+0000","last_change":"2024-09-10T23:38:12.213636+0000","last_active":"2024-09-10T23:39:42.823728+0000","last_peered":"2024-09-10T23:39:42.823728+0000","last_clean":"2024-09-10T23:39:42.823728+0000","last_became_active":"2024-09-10T23:38:12.213309+0000","last_became_peered":"2024-09-10T23:38:12.213309+0000","last_unstale":"2024-09-10T23:39:42.823728+0000","last_undegraded":"2024-09-10T23:39:42.823728+0000","last_fullsized":"2024-09-10T23:39:42.823728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:34.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825688+0000","last_change":"2024-09-10T23:38:12.215995+0000","last_active":"2024-09-10T23:39:42.825688+0000","last_peered":"2024-09-10T23:39:42.825688+0000","last_clean":"2024-09-10T23:39:42.825688+0000","last_became_active":"2024-09-10T23:38:12.215601+0000","last_became_peered":"2024-09-10T23:38:12.215601+0000","last_unstale":"2024-09-10T23:39:42.825688+0000","last_undegraded":"2024-09-10T23:39:42.825688+0000","last_fullsized":"2024-09-10T23:39:42.825688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:24.770551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836251+0000","last_change":"2024-09-10T23:38:12.226337+0000","last_active":"2024-09-10T23:39:42.836251+0000","last_peered":"2024-09-10T23:39:42.836251+0000","last_clean":"2024-09-10T23:39:42.836251+0000","last_became_active":"2024-09-10T23:38:12.225953+0000","last_became_peered":"2024-09-10T23:38:12.225953+0000","last_unstale":"2024-09-10T23:39:42.836251+0000","last_undegraded":"2024-09-10T23:39:42.836251+0000","last_fullsized":"2024-09-10T23:39:42.836251+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:27.044867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.824994+0000","last_change":"2024-09-10T23:38:12.219682+0000","last_active":"2024-09-10T23:39:42.824994+0000","last_peered":"2024-09-10T23:39:42.824994+0000","last_clean":"2024-09-10T23:39:42.824994+0000","last_became_active":"2024-09-10T23:38:12.218596+0000","last_became_peered":"2024-09-10T23:38:12.218596+0000","last_unstale":"2024-09-10T23:39:42.824994+0000","last_undegraded":"2024-09-10T23:39:42.824994+0000","last_fullsized":"2024-09-10T23:39:42.824994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:33.011117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840934+0000","last_change":"2024-09-10T23:38:12.223114+0000","last_active":"2024-09-10T23:39:42.840934+0000","last_peered":"2024-09-10T23:39:42.840934+0000","last_clean":"2024-09-10T23:39:42.840934+0000","last_became_active":"2024-09-10T23:38:12.222748+0000","last_became_peered":"2024-09-10T23:38:12.222748+0000","last_unstale":"2024-09-10T23:39:42.840934+0000","last_undegraded":"2024-09-10T23:39:42.840934+0000","last_fullsized":"2024-09-10T23:39:42.840934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:38.384821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835460+0000","last_change":"2024-09-10T23:38:12.225061+0000","last_active":"2024-09-10T23:39:42.835460+0000","last_peered":"2024-09-10T23:39:42.835460+0000","last_clean":"2024-09-10T23:39:42.835460+0000","last_became_active":"2024-09-10T23:38:12.224730+0000","last_became_peered":"2024-09-10T23:38:12.224730+0000","last_unstale":"2024-09-10T23:39:42.835460+0000","last_undegraded":"2024-09-10T23:39:42.835460+0000","last_fullsized":"2024-09-10T23:39:42.835460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:40.343294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840365+0000","last_change":"2024-09-10T23:38:12.219920+0000","last_active":"2024-09-10T23:39:42.840365+0000","last_peered":"2024-09-10T23:39:42.840365+0000","last_clean":"2024-09-10T23:39:42.840365+0000","last_became_active":"2024-09-10T23:38:12.219517+0000","last_became_peered":"2024-09-10T23:38:12.219517+0000","last_unstale":"2024-09-10T23:39:42.840365+0000","last_undegraded":"2024-09-10T23:39:42.840365+0000","last_fullsized":"2024-09-10T23:39:42.840365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:58.686977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828097+0000","last_change":"2024-09-10T23:38:12.219740+0000","last_active":"2024-09-10T23:39:42.828097+0000","last_peered":"2024-09-10T23:39:42.828097+0000","last_clean":"2024-09-10T23:39:42.828097+0000","last_became_active":"2024-09-10T23:38:12.215497+0000","last_became_peered":"2024-09-10T23:38:12.215497+0000","last_unstale":"2024-09-10T23:39:42.828097+0000","last_undegraded":"2024-09-10T23:39:42.828097+0000","last_fullsized":"2024-09-10T23:39:42.828097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:06.503836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.826375+0000","last_change":"2024-09-10T23:38:12.217066+0000","last_active":"2024-09-10T23:39:42.826375+0000","last_peered":"2024-09-10T23:39:42.826375+0000","last_clean":"2024-09-10T23:39:42.826375+0000","last_became_active":"2024-09-10T23:38:12.216758+0000","last_became_peered":"2024-09-10T23:38:12.216758+0000","last_unstale":"2024-09-10T23:39:42.826375+0000","last_undegraded":"2024-09-10T23:39:42.826375+0000","last_fullsized":"2024-09-10T23:39:42.826375+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:53.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833516+0000","last_change":"2024-09-10T23:38:12.216584+0000","last_active":"2024-09-10T23:39:42.833516+0000","last_peered":"2024-09-10T23:39:42.833516+0000","last_clean":"2024-09-10T23:39:42.833516+0000","last_became_active":"2024-09-10T23:38:12.216296+0000","last_became_peered":"2024-09-10T23:38:12.216296+0000","last_unstale":"2024-09-10T23:39:42.833516+0000","last_undegraded":"2024-09-10T23:39:42.833516+0000","last_fullsized":"2024-09-10T23:39:42.833516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:11.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834463+0000","last_change":"2024-09-10T23:38:43.772225+0000","last_active":"2024-09-10T23:39:42.834463+0000","last_peered":"2024-09-10T23:39:42.834463+0000","last_clean":"2024-09-10T23:39:42.834463+0000","last_became_active":"2024-09-10T23:38:43.771855+0000","last_became_peered":"2024-09-10T23:38:43.771855+0000","last_unstale":"2024-09-10T23:39:42.834463+0000","last_undegraded":"2024-09-10T23:39:42.834463+0000","last_fullsized":"2024-09-10T23:39:42.834463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:14.454340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837082+0000","last_change":"2024-09-10T23:38:12.229957+0000","last_active":"2024-09-10T23:39:42.837082+0000","last_peered":"2024-09-10T23:39:42.837082+0000","last_clean":"2024-09-10T23:39:42.837082+0000","last_became_active":"2024-09-10T23:38:12.229297+0000","last_became_peered":"2024-09-10T23:38:12.229297+0000","last_unstale":"2024-09-10T23:39:42.837082+0000","last_undegraded":"2024-09-10T23:39:42.837082+0000","last_fullsized":"2024-09-10T23:39:42.837082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:54.119455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841682+0000","last_change":"2024-09-10T23:38:12.218345+0000","last_active":"2024-09-10T23:39:42.841682+0000","last_peered":"2024-09-10T23:39:42.841682+0000","last_clean":"2024-09-10T23:39:42.841682+0000","last_became_active":"2024-09-10T23:38:12.218060+0000","last_became_peered":"2024-09-10T23:38:12.218060+0000","last_unstale":"2024-09-10T23:39:42.841682+0000","last_undegraded":"2024-09-10T23:39:42.841682+0000","last_fullsized":"2024-09-10T23:39:42.841682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.912757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839948+0000","last_change":"2024-09-10T23:38:12.215025+0000","last_active":"2024-09-10T23:39:42.839948+0000","last_peered":"2024-09-10T23:39:42.839948+0000","last_clean":"2024-09-10T23:39:42.839948+0000","last_became_active":"2024-09-10T23:38:12.214709+0000","last_became_peered":"2024-09-10T23:38:12.214709+0000","last_unstale":"2024-09-10T23:39:42.839948+0000","last_undegraded":"2024-09-10T23:39:42.839948+0000","last_fullsized":"2024-09-10T23:39:42.839948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:00.925426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.831755+0000","last_change":"2024-09-10T23:38:12.215536+0000","last_active":"2024-09-10T23:39:42.831755+0000","last_peered":"2024-09-10T23:39:42.831755+0000","last_clean":"2024-09-10T23:39:42.831755+0000","last_became_active":"2024-09-10T23:38:12.214991+0000","last_became_peered":"2024-09-10T23:38:12.214991+0000","last_unstale":"2024-09-10T23:39:42.831755+0000","last_undegraded":"2024-09-10T23:39:42.831755+0000","last_fullsized":"2024-09-10T23:39:42.831755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.059276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823917+0000","last_change":"2024-09-10T23:38:12.224919+0000","last_active":"2024-09-10T23:39:42.823917+0000","last_peered":"2024-09-10T23:39:42.823917+0000","last_clean":"2024-09-10T23:39:42.823917+0000","last_became_active":"2024-09-10T23:38:12.224559+0000","last_became_peered":"2024-09-10T23:38:12.224559+0000","last_unstale":"2024-09-10T23:39:42.823917+0000","last_undegraded":"2024-09-10T23:39:42.823917+0000","last_fullsized":"2024-09-10T23:39:42.823917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:23.373211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837096+0000","last_change":"2024-09-10T23:38:12.216995+0000","last_active":"2024-09-10T23:39:42.837096+0000","last_peered":"2024-09-10T23:39:42.837096+0000","last_clean":"2024-09-10T23:39:42.837096+0000","last_became_active":"2024-09-10T23:38:12.216681+0000","last_became_peered":"2024-09-10T23:38:12.216681+0000","last_unstale":"2024-09-10T23:39:42.837096+0000","last_undegraded":"2024-09-10T23:39:42.837096+0000","last_fullsized":"2024-09-10T23:39:42.837096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:37.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839956+0000","last_change":"2024-09-10T23:38:12.221618+0000","last_active":"2024-09-10T23:39:42.839956+0000","last_peered":"2024-09-10T23:39:42.839956+0000","last_clean":"2024-09-10T23:39:42.839956+0000","last_became_active":"2024-09-10T23:38:12.219352+0000","last_became_peered":"2024-09-10T23:38:12.219352+0000","last_unstale":"2024-09-10T23:39:42.839956+0000","last_undegraded":"2024-09-10T23:39:42.839956+0000","last_fullsized":"2024-09-10T23:39:42.839956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:48.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828289+0000","last_change":"2024-09-10T23:38:12.221530+0000","last_active":"2024-09-10T23:39:42.828289+0000","last_peered":"2024-09-10T23:39:42.828289+0000","last_clean":"2024-09-10T23:39:42.828289+0000","last_became_active":"2024-09-10T23:38:12.221024+0000","last_became_peered":"2024-09-10T23:38:12.221024+0000","last_unstale":"2024-09-10T23:39:42.828289+0000","last_undegraded":"2024-09-10T23:39:42.828289+0000","last_fullsized":"2024-09-10T23:39:42.828289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.821792+0000","last_change":"2024-09-10T23:38:12.219990+0000","last_active":"2024-09-10T23:39:42.821792+0000","last_peered":"2024-09-10T23:39:42.821792+0000","last_clean":"2024-09-10T23:39:42.821792+0000","last_became_active":"2024-09-10T23:38:12.219560+0000","last_became_peered":"2024-09-10T23:38:12.219560+0000","last_unstale":"2024-09-10T23:39:42.821792+0000","last_undegraded":"2024-09-10T23:39:42.821792+0000","last_fullsized":"2024-09-10T23:39:42.821792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:28.112467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.822901+0000","last_change":"2024-09-10T23:38:12.225753+0000","last_active":"2024-09-10T23:39:42.822901+0000","last_peered":"2024-09-10T23:39:42.822901+0000","last_clean":"2024-09-10T23:39:42.822901+0000","last_became_active":"2024-09-10T23:38:12.225450+0000","last_became_peered":"2024-09-10T23:38:12.225450+0000","last_unstale":"2024-09-10T23:39:42.822901+0000","last_undegraded":"2024-09-10T23:39:42.822901+0000","last_fullsized":"2024-09-10T23:39:42.822901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:23.478611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828425+0000","last_change":"2024-09-10T23:38:12.216917+0000","last_active":"2024-09-10T23:39:42.828425+0000","last_peered":"2024-09-10T23:39:42.828425+0000","last_clean":"2024-09-10T23:39:42.828425+0000","last_became_active":"2024-09-10T23:38:12.216528+0000","last_became_peered":"2024-09-10T23:38:12.216528+0000","last_unstale":"2024-09-10T23:39:42.828425+0000","last_undegraded":"2024-09-10T23:39:42.828425+0000","last_fullsized":"2024-09-10T23:39:42.828425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:03.902221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825120+0000","last_change":"2024-09-10T23:38:12.219372+0000","last_active":"2024-09-10T23:39:42.825120+0000","last_peered":"2024-09-10T23:39:42.825120+0000","last_clean":"2024-09-10T23:39:42.825120+0000","last_became_active":"2024-09-10T23:38:12.219072+0000","last_became_peered":"2024-09-10T23:38:12.219072+0000","last_unstale":"2024-09-10T23:39:42.825120+0000","last_undegraded":"2024-09-10T23:39:42.825120+0000","last_fullsized":"2024-09-10T23:39:42.825120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:07.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834730+0000","last_change":"2024-09-10T23:38:12.224716+0000","last_active":"2024-09-10T23:39:42.834730+0000","last_peered":"2024-09-10T23:39:42.834730+0000","last_clean":"2024-09-10T23:39:42.834730+0000","last_became_active":"2024-09-10T23:38:12.224393+0000","last_became_peered":"2024-09-10T23:38:12.224393+0000","last_unstale":"2024-09-10T23:39:42.834730+0000","last_undegraded":"2024-09-10T23:39:42.834730+0000","last_fullsized":"2024-09-10T23:39:42.834730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.995098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836203+0000","last_change":"2024-09-10T23:38:44.092446+0000","last_active":"2024-09-10T23:39:42.836203+0000","last_peered":"2024-09-10T23:39:42.836203+0000","last_clean":"2024-09-10T23:39:42.836203+0000","last_became_active":"2024-09-10T23:38:44.092027+0000","last_became_peered":"2024-09-10T23:38:44.092027+0000","last_unstale":"2024-09-10T23:39:42.836203+0000","last_undegraded":"2024-09-10T23:39:42.836203+0000","last_fullsized":"2024-09-10T23:39:42.836203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.804237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834694+0000","last_change":"2024-09-10T23:38:12.214278+0000","last_active":"2024-09-10T23:39:42.834694+0000","last_peered":"2024-09-10T23:39:42.834694+0000","last_clean":"2024-09-10T23:39:42.834694+0000","last_became_active":"2024-09-10T23:38:12.212079+0000","last_became_peered":"2024-09-10T23:38:12.212079+0000","last_unstale":"2024-09-10T23:39:42.834694+0000","last_undegraded":"2024-09-10T23:39:42.834694+0000","last_fullsized":"2024-09-10T23:39:42.834694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:42.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833730+0000","last_change":"2024-09-10T23:38:12.214703+0000","last_active":"2024-09-10T23:39:42.833730+0000","last_peered":"2024-09-10T23:39:42.833730+0000","last_clean":"2024-09-10T23:39:42.833730+0000","last_became_active":"2024-09-10T23:38:12.214353+0000","last_became_peered":"2024-09-10T23:38:12.214353+0000","last_unstale":"2024-09-10T23:39:42.833730+0000","last_undegraded":"2024-09-10T23:39:42.833730+0000","last_fullsized":"2024-09-10T23:39:42.833730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.004904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832133+0000","last_change":"2024-09-10T23:38:12.223462+0000","last_active":"2024-09-10T23:39:42.832133+0000","last_peered":"2024-09-10T23:39:42.832133+0000","last_clean":"2024-09-10T23:39:42.832133+0000","last_became_active":"2024-09-10T23:38:12.223159+0000","last_became_peered":"2024-09-10T23:38:12.223159+0000","last_unstale":"2024-09-10T23:39:42.832133+0000","last_undegraded":"2024-09-10T23:39:42.832133+0000","last_fullsized":"2024-09-10T23:39:42.832133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.587560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.818551+0000","last_change":"2024-09-10T23:38:12.213290+0000","last_active":"2024-09-10T23:39:42.818551+0000","last_peered":"2024-09-10T23:39:42.818551+0000","last_clean":"2024-09-10T23:39:42.818551+0000","last_became_active":"2024-09-10T23:38:12.212999+0000","last_became_peered":"2024-09-10T23:38:12.212999+0000","last_unstale":"2024-09-10T23:39:42.818551+0000","last_undegraded":"2024-09-10T23:39:42.818551+0000","last_fullsized":"2024-09-10T23:39:42.818551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:54.448436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'7","reported_seq":133,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:00.422876+0000","last_change":"2024-09-10T23:38:10.210483+0000","last_active":"2024-09-10T23:40:00.422876+0000","last_peered":"2024-09-10T23:40:00.422876+0000","last_clean":"2024-09-10T23:40:00.422876+0000","last_became_active":"2024-09-10T23:38:10.210108+0000","last_became_peered":"2024-09-10T23:38:10.210108+0000","last_unstale":"2024-09-10T23:40:00.422876+0000","last_undegraded":"2024-09-10T23:40:00.422876+0000","last_fullsized":"2024-09-10T23:40:00.422876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:33.370496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.826119+0000","last_change":"2024-09-10T23:38:43.966800+0000","last_active":"2024-09-10T23:39:42.826119+0000","last_peered":"2024-09-10T23:39:42.826119+0000","last_clean":"2024-09-10T23:39:42.826119+0000","last_became_active":"2024-09-10T23:38:43.966274+0000","last_became_peered":"2024-09-10T23:38:43.966274+0000","last_unstale":"2024-09-10T23:39:42.826119+0000","last_undegraded":"2024-09-10T23:39:42.826119+0000","last_fullsized":"2024-09-10T23:39:42.826119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:02.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024529+0000","last_change":"2024-09-10T23:38:10.210875+0000","last_active":"2024-09-10T23:38:44.024529+0000","last_peered":"2024-09-10T23:38:44.024529+0000","last_clean":"2024-09-10T23:38:44.024529+0000","last_became_active":"2024-09-10T23:38:10.209254+0000","last_became_peered":"2024-09-10T23:38:10.209254+0000","last_unstale":"2024-09-10T23:38:44.024529+0000","last_undegraded":"2024-09-10T23:38:44.024529+0000","last_fullsized":"2024-09-10T23:38:44.024529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:21.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530747+0000","last_change":"2024-09-10T23:38:10.213483+0000","last_active":"2024-09-10T23:38:43.530747+0000","last_peered":"2024-09-10T23:38:43.530747+0000","last_clean":"2024-09-10T23:38:43.530747+0000","last_became_active":"2024-09-10T23:38:10.213109+0000","last_became_peered":"2024-09-10T23:38:10.213109+0000","last_unstale":"2024-09-10T23:38:43.530747+0000","last_undegraded":"2024-09-10T23:38:43.530747+0000","last_fullsized":"2024-09-10T23:38:43.530747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:03.563548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.827193+0000","last_change":"2024-09-10T23:38:12.217136+0000","last_active":"2024-09-10T23:39:42.827193+0000","last_peered":"2024-09-10T23:39:42.827193+0000","last_clean":"2024-09-10T23:39:42.827193+0000","last_became_active":"2024-09-10T23:38:12.216813+0000","last_became_peered":"2024-09-10T23:38:12.216813+0000","last_unstale":"2024-09-10T23:39:42.827193+0000","last_undegraded":"2024-09-10T23:39:42.827193+0000","last_fullsized":"2024-09-10T23:39:42.827193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:26.184575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536951+0000","last_change":"2024-09-10T23:38:10.209109+0000","last_active":"2024-09-10T23:38:43.536951+0000","last_peered":"2024-09-10T23:38:43.536951+0000","last_clean":"2024-09-10T23:38:43.536951+0000","last_became_active":"2024-09-10T23:38:10.208450+0000","last_became_peered":"2024-09-10T23:38:10.208450+0000","last_unstale":"2024-09-10T23:38:43.536951+0000","last_undegraded":"2024-09-10T23:38:43.536951+0000","last_fullsized":"2024-09-10T23:38:43.536951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:29.453119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.829671+0000","last_change":"2024-09-10T23:38:12.213755+0000","last_active":"2024-09-10T23:39:42.829671+0000","last_peered":"2024-09-10T23:39:42.829671+0000","last_clean":"2024-09-10T23:39:42.829671+0000","last_became_active":"2024-09-10T23:38:12.213454+0000","last_became_peered":"2024-09-10T23:38:12.213454+0000","last_unstale":"2024-09-10T23:39:42.829671+0000","last_undegraded":"2024-09-10T23:39:42.829671+0000","last_fullsized":"2024-09-10T23:39:42.829671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.958053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":127,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:01.423747+0000","last_change":"2024-09-10T23:38:10.209908+0000","last_active":"2024-09-10T23:40:01.423747+0000","last_peered":"2024-09-10T23:40:01.423747+0000","last_clean":"2024-09-10T23:40:01.423747+0000","last_became_active":"2024-09-10T23:38:10.208867+0000","last_became_peered":"2024-09-10T23:38:10.208867+0000","last_unstale":"2024-09-10T23:40:01.423747+0000","last_undegraded":"2024-09-10T23:40:01.423747+0000","last_fullsized":"2024-09-10T23:40:01.423747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:09.239123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836630+0000","last_change":"2024-09-10T23:38:12.224353+0000","last_active":"2024-09-10T23:39:42.836630+0000","last_peered":"2024-09-10T23:39:42.836630+0000","last_clean":"2024-09-10T23:39:42.836630+0000","last_became_active":"2024-09-10T23:38:12.223997+0000","last_became_peered":"2024-09-10T23:38:12.223997+0000","last_unstale":"2024-09-10T23:39:42.836630+0000","last_undegraded":"2024-09-10T23:39:42.836630+0000","last_fullsized":"2024-09-10T23:39:42.836630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:53.092794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091493+0000","last_change":"2024-09-10T23:38:10.207978+0000","last_active":"2024-09-10T23:38:44.091493+0000","last_peered":"2024-09-10T23:38:44.091493+0000","last_clean":"2024-09-10T23:38:44.091493+0000","last_became_active":"2024-09-10T23:38:10.207566+0000","last_became_peered":"2024-09-10T23:38:10.207566+0000","last_unstale":"2024-09-10T23:38:44.091493+0000","last_undegraded":"2024-09-10T23:38:44.091493+0000","last_fullsized":"2024-09-10T23:38:44.091493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:00.715005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835254+0000","last_change":"2024-09-10T23:38:43.538619+0000","last_active":"2024-09-10T23:39:42.835254+0000","last_peered":"2024-09-10T23:39:42.835254+0000","last_clean":"2024-09-10T23:39:42.835254+0000","last_became_active":"2024-09-10T23:38:43.537752+0000","last_became_peered":"2024-09-10T23:38:43.537752+0000","last_unstale":"2024-09-10T23:39:42.835254+0000","last_undegraded":"2024-09-10T23:39:42.835254+0000","last_fullsized":"2024-09-10T23:39:42.835254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:08.399537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537358+0000","last_change":"2024-09-10T23:38:10.257254+0000","last_active":"2024-09-10T23:38:43.537358+0000","last_peered":"2024-09-10T23:38:43.537358+0000","last_clean":"2024-09-10T23:38:43.537358+0000","last_became_active":"2024-09-10T23:38:10.256791+0000","last_became_peered":"2024-09-10T23:38:10.256791+0000","last_unstale":"2024-09-10T23:38:43.537358+0000","last_undegraded":"2024-09-10T23:38:43.537358+0000","last_fullsized":"2024-09-10T23:38:43.537358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:35.931873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840987+0000","last_change":"2024-09-10T23:38:12.229295+0000","last_active":"2024-09-10T23:39:42.840987+0000","last_peered":"2024-09-10T23:39:42.840987+0000","last_clean":"2024-09-10T23:39:42.840987+0000","last_became_active":"2024-09-10T23:38:12.228846+0000","last_became_peered":"2024-09-10T23:38:12.228846+0000","last_unstale":"2024-09-10T23:39:42.840987+0000","last_undegraded":"2024-09-10T23:39:42.840987+0000","last_fullsized":"2024-09-10T23:39:42.840987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:15.383624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'32","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:02.984349+0000","last_change":"2024-09-10T23:38:10.203362+0000","last_active":"2024-09-10T23:40:02.984349+0000","last_peered":"2024-09-10T23:40:02.984349+0000","last_clean":"2024-09-10T23:40:02.984349+0000","last_became_active":"2024-09-10T23:38:10.202961+0000","last_became_peered":"2024-09-10T23:38:10.202961+0000","last_unstale":"2024-09-10T23:40:02.984349+0000","last_undegraded":"2024-09-10T23:40:02.984349+0000","last_fullsized":"2024-09-10T23:40:02.984349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:33.580368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60904,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":163,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835801+0000","last_change":"2024-09-10T23:38:12.219094+0000","last_active":"2024-09-10T23:39:42.835801+0000","last_peered":"2024-09-10T23:39:42.835801+0000","last_clean":"2024-09-10T23:39:42.835801+0000","last_became_active":"2024-09-10T23:38:12.218778+0000","last_became_peered":"2024-09-10T23:38:12.218778+0000","last_unstale":"2024-09-10T23:39:42.835801+0000","last_undegraded":"2024-09-10T23:39:42.835801+0000","last_fullsized":"2024-09-10T23:39:42.835801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:59.019756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770789+0000","last_change":"2024-09-10T23:38:10.204204+0000","last_active":"2024-09-10T23:38:43.770789+0000","last_peered":"2024-09-10T23:38:43.770789+0000","last_clean":"2024-09-10T23:38:43.770789+0000","last_became_active":"2024-09-10T23:38:10.203662+0000","last_became_peered":"2024-09-10T23:38:10.203662+0000","last_unstale":"2024-09-10T23:38:43.770789+0000","last_undegraded":"2024-09-10T23:38:43.770789+0000","last_fullsized":"2024-09-10T23:38:43.770789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:44.243961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836597+0000","last_change":"2024-09-10T23:38:12.214337+0000","last_active":"2024-09-10T23:39:42.836597+0000","last_peered":"2024-09-10T23:39:42.836597+0000","last_clean":"2024-09-10T23:39:42.836597+0000","last_became_active":"2024-09-10T23:38:12.214024+0000","last_became_peered":"2024-09-10T23:38:12.214024+0000","last_unstale":"2024-09-10T23:39:42.836597+0000","last_undegraded":"2024-09-10T23:39:42.836597+0000","last_fullsized":"2024-09-10T23:39:42.836597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:19.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536668+0000","last_change":"2024-09-10T23:38:10.208001+0000","last_active":"2024-09-10T23:38:43.536668+0000","last_peered":"2024-09-10T23:38:43.536668+0000","last_clean":"2024-09-10T23:38:43.536668+0000","last_became_active":"2024-09-10T23:38:10.207656+0000","last_became_peered":"2024-09-10T23:38:10.207656+0000","last_unstale":"2024-09-10T23:38:43.536668+0000","last_undegraded":"2024-09-10T23:38:43.536668+0000","last_fullsized":"2024-09-10T23:38:43.536668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:44.679795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839998+0000","last_change":"2024-09-10T23:38:12.227780+0000","last_active":"2024-09-10T23:39:42.839998+0000","last_peered":"2024-09-10T23:39:42.839998+0000","last_clean":"2024-09-10T23:39:42.839998+0000","last_became_active":"2024-09-10T23:38:12.227404+0000","last_became_peered":"2024-09-10T23:38:12.227404+0000","last_unstale":"2024-09-10T23:39:42.839998+0000","last_undegraded":"2024-09-10T23:39:42.839998+0000","last_fullsized":"2024-09-10T23:39:42.839998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:58.453685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":135,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:04.428734+0000","last_change":"2024-09-10T23:38:10.214786+0000","last_active":"2024-09-10T23:40:04.428734+0000","last_peered":"2024-09-10T23:40:04.428734+0000","last_clean":"2024-09-10T23:40:04.428734+0000","last_became_active":"2024-09-10T23:38:10.214124+0000","last_became_peered":"2024-09-10T23:38:10.214124+0000","last_unstale":"2024-09-10T23:40:04.428734+0000","last_undegraded":"2024-09-10T23:40:04.428734+0000","last_fullsized":"2024-09-10T23:40:04.428734+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:00.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.838449+0000","last_change":"2024-09-10T23:38:12.220507+0000","last_active":"2024-09-10T23:39:42.838449+0000","last_peered":"2024-09-10T23:39:42.838449+0000","last_clean":"2024-09-10T23:39:42.838449+0000","last_became_active":"2024-09-10T23:38:12.220178+0000","last_became_peered":"2024-09-10T23:38:12.220178+0000","last_unstale":"2024-09-10T23:39:42.838449+0000","last_undegraded":"2024-09-10T23:39:42.838449+0000","last_fullsized":"2024-09-10T23:39:42.838449+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:57.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531867+0000","last_change":"2024-09-10T23:38:10.256166+0000","last_active":"2024-09-10T23:38:43.531867+0000","last_peered":"2024-09-10T23:38:43.531867+0000","last_clean":"2024-09-10T23:38:43.531867+0000","last_became_active":"2024-09-10T23:38:10.255792+0000","last_became_peered":"2024-09-10T23:38:10.255792+0000","last_unstale":"2024-09-10T23:38:43.531867+0000","last_undegraded":"2024-09-10T23:38:43.531867+0000","last_fullsized":"2024-09-10T23:38:43.531867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:44.621339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.822820+0000","last_change":"2024-09-10T23:38:12.225151+0000","last_active":"2024-09-10T23:39:42.822820+0000","last_peered":"2024-09-10T23:39:42.822820+0000","last_clean":"2024-09-10T23:39:42.822820+0000","last_became_active":"2024-09-10T23:38:12.224748+0000","last_became_peered":"2024-09-10T23:38:12.224748+0000","last_unstale":"2024-09-10T23:39:42.822820+0000","last_undegraded":"2024-09-10T23:39:42.822820+0000","last_fullsized":"2024-09-10T23:39:42.822820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.543098+0000","last_change":"2024-09-10T23:38:43.542616+0000","last_active":"2024-09-10T23:38:43.543098+0000","last_peered":"2024-09-10T23:38:43.543098+0000","last_clean":"2024-09-10T23:38:43.543098+0000","last_became_active":"2024-09-10T23:38:43.537936+0000","last_became_peered":"2024-09-10T23:38:43.537936+0000","last_unstale":"2024-09-10T23:38:43.543098+0000","last_undegraded":"2024-09-10T23:38:43.543098+0000","last_fullsized":"2024-09-10T23:38:43.543098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:31.390914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825391+0000","last_change":"2024-09-10T23:38:12.225417+0000","last_active":"2024-09-10T23:39:42.825391+0000","last_peered":"2024-09-10T23:39:42.825391+0000","last_clean":"2024-09-10T23:39:42.825391+0000","last_became_active":"2024-09-10T23:38:12.225129+0000","last_became_peered":"2024-09-10T23:38:12.225129+0000","last_unstale":"2024-09-10T23:39:42.825391+0000","last_undegraded":"2024-09-10T23:39:42.825391+0000","last_fullsized":"2024-09-10T23:39:42.825391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:42.935776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530992+0000","last_change":"2024-09-10T23:38:10.204942+0000","last_active":"2024-09-10T23:38:43.530992+0000","last_peered":"2024-09-10T23:38:43.530992+0000","last_clean":"2024-09-10T23:38:43.530992+0000","last_became_active":"2024-09-10T23:38:10.204568+0000","last_became_peered":"2024-09-10T23:38:10.204568+0000","last_unstale":"2024-09-10T23:38:43.530992+0000","last_undegraded":"2024-09-10T23:38:43.530992+0000","last_fullsized":"2024-09-10T23:38:43.530992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:00.608617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837848+0000","last_change":"2024-09-10T23:38:12.217411+0000","last_active":"2024-09-10T23:39:42.837848+0000","last_peered":"2024-09-10T23:39:42.837848+0000","last_clean":"2024-09-10T23:39:42.837848+0000","last_became_active":"2024-09-10T23:38:12.216998+0000","last_became_peered":"2024-09-10T23:38:12.216998+0000","last_unstale":"2024-09-10T23:39:42.837848+0000","last_undegraded":"2024-09-10T23:39:42.837848+0000","last_fullsized":"2024-09-10T23:39:42.837848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:12.852239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537386+0000","last_change":"2024-09-10T23:38:10.209596+0000","last_active":"2024-09-10T23:38:43.537386+0000","last_peered":"2024-09-10T23:38:43.537386+0000","last_clean":"2024-09-10T23:38:43.537386+0000","last_became_active":"2024-09-10T23:38:10.209348+0000","last_became_peered":"2024-09-10T23:38:10.209348+0000","last_unstale":"2024-09-10T23:38:43.537386+0000","last_undegraded":"2024-09-10T23:38:43.537386+0000","last_fullsized":"2024-09-10T23:38:43.537386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:30.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833587+0000","last_change":"2024-09-10T23:38:12.224071+0000","last_active":"2024-09-10T23:39:42.833587+0000","last_peered":"2024-09-10T23:39:42.833587+0000","last_clean":"2024-09-10T23:39:42.833587+0000","last_became_active":"2024-09-10T23:38:12.223773+0000","last_became_peered":"2024-09-10T23:38:12.223773+0000","last_unstale":"2024-09-10T23:39:42.833587+0000","last_undegraded":"2024-09-10T23:39:42.833587+0000","last_fullsized":"2024-09-10T23:39:42.833587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:43.412524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.771165+0000","last_change":"2024-09-10T23:38:10.300065+0000","last_active":"2024-09-10T23:38:43.771165+0000","last_peered":"2024-09-10T23:38:43.771165+0000","last_clean":"2024-09-10T23:38:43.771165+0000","last_became_active":"2024-09-10T23:38:10.299624+0000","last_became_peered":"2024-09-10T23:38:10.299624+0000","last_unstale":"2024-09-10T23:38:43.771165+0000","last_undegraded":"2024-09-10T23:38:43.771165+0000","last_fullsized":"2024-09-10T23:38:43.771165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:02.516651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840844+0000","last_change":"2024-09-10T23:38:12.222280+0000","last_active":"2024-09-10T23:39:42.840844+0000","last_peered":"2024-09-10T23:39:42.840844+0000","last_clean":"2024-09-10T23:39:42.840844+0000","last_became_active":"2024-09-10T23:38:12.221644+0000","last_became_peered":"2024-09-10T23:38:12.221644+0000","last_unstale":"2024-09-10T23:39:42.840844+0000","last_undegraded":"2024-09-10T23:39:42.840844+0000","last_fullsized":"2024-09-10T23:39:42.840844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.823629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091209+0000","last_change":"2024-09-10T23:36:58.824948+0000","last_active":"2024-09-10T23:38:44.091209+0000","last_peered":"2024-09-10T23:38:44.091209+0000","last_clean":"2024-09-10T23:38:44.091209+0000","last_became_active":"2024-09-10T23:36:58.819334+0000","last_became_peered":"2024-09-10T23:36:58.819334+0000","last_unstale":"2024-09-10T23:38:44.091209+0000","last_undegraded":"2024-09-10T23:38:44.091209+0000","last_fullsized":"2024-09-10T23:38:44.091209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_clean_scrub_stamp":"2024-09-10T23:33:36.806080+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:52.996301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536800+0000","last_change":"2024-09-10T23:38:10.215224+0000","last_active":"2024-09-10T23:38:43.536800+0000","last_peered":"2024-09-10T23:38:43.536800+0000","last_clean":"2024-09-10T23:38:43.536800+0000","last_became_active":"2024-09-10T23:38:10.214795+0000","last_became_peered":"2024-09-10T23:38:10.214795+0000","last_unstale":"2024-09-10T23:38:43.536800+0000","last_undegraded":"2024-09-10T23:38:43.536800+0000","last_fullsized":"2024-09-10T23:38:43.536800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:26.599793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840106+0000","last_change":"2024-09-10T23:38:43.538480+0000","last_active":"2024-09-10T23:39:42.840106+0000","last_peered":"2024-09-10T23:39:42.840106+0000","last_clean":"2024-09-10T23:39:42.840106+0000","last_became_active":"2024-09-10T23:38:43.538091+0000","last_became_peered":"2024-09-10T23:38:43.538091+0000","last_unstale":"2024-09-10T23:39:42.840106+0000","last_undegraded":"2024-09-10T23:39:42.840106+0000","last_fullsized":"2024-09-10T23:39:42.840106+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:40.890114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091042+0000","last_change":"2024-09-10T23:38:10.212748+0000","last_active":"2024-09-10T23:38:44.091042+0000","last_peered":"2024-09-10T23:38:44.091042+0000","last_clean":"2024-09-10T23:38:44.091042+0000","last_became_active":"2024-09-10T23:38:10.212427+0000","last_became_peered":"2024-09-10T23:38:10.212427+0000","last_unstale":"2024-09-10T23:38:44.091042+0000","last_undegraded":"2024-09-10T23:38:44.091042+0000","last_fullsized":"2024-09-10T23:38:44.091042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:23.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828706+0000","last_change":"2024-09-10T23:38:12.225178+0000","last_active":"2024-09-10T23:39:42.828706+0000","last_peered":"2024-09-10T23:39:42.828706+0000","last_clean":"2024-09-10T23:39:42.828706+0000","last_became_active":"2024-09-10T23:38:12.224860+0000","last_became_peered":"2024-09-10T23:38:12.224860+0000","last_unstale":"2024-09-10T23:39:42.828706+0000","last_undegraded":"2024-09-10T23:39:42.828706+0000","last_fullsized":"2024-09-10T23:39:42.828706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:10.986009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":127,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:00.421428+0000","last_change":"2024-09-10T23:38:10.254625+0000","last_active":"2024-09-10T23:40:00.421428+0000","last_peered":"2024-09-10T23:40:00.421428+0000","last_clean":"2024-09-10T23:40:00.421428+0000","last_became_active":"2024-09-10T23:38:10.254259+0000","last_became_peered":"2024-09-10T23:38:10.254259+0000","last_unstale":"2024-09-10T23:40:00.421428+0000","last_undegraded":"2024-09-10T23:40:00.421428+0000","last_fullsized":"2024-09-10T23:40:00.421428+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:46.371999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833004+0000","last_change":"2024-09-10T23:38:12.217168+0000","last_active":"2024-09-10T23:39:42.833004+0000","last_peered":"2024-09-10T23:39:42.833004+0000","last_clean":"2024-09-10T23:39:42.833004+0000","last_became_active":"2024-09-10T23:38:12.216814+0000","last_became_peered":"2024-09-10T23:38:12.216814+0000","last_unstale":"2024-09-10T23:39:42.833004+0000","last_undegraded":"2024-09-10T23:39:42.833004+0000","last_fullsized":"2024-09-10T23:39:42.833004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:41.494690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091293+0000","last_change":"2024-09-10T23:38:10.207456+0000","last_active":"2024-09-10T23:38:44.091293+0000","last_peered":"2024-09-10T23:38:44.091293+0000","last_clean":"2024-09-10T23:38:44.091293+0000","last_became_active":"2024-09-10T23:38:10.207079+0000","last_became_peered":"2024-09-10T23:38:10.207079+0000","last_unstale":"2024-09-10T23:38:44.091293+0000","last_undegraded":"2024-09-10T23:38:44.091293+0000","last_fullsized":"2024-09-10T23:38:44.091293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:14.631231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825830+0000","last_change":"2024-09-10T23:38:12.218306+0000","last_active":"2024-09-10T23:39:42.825830+0000","last_peered":"2024-09-10T23:39:42.825830+0000","last_clean":"2024-09-10T23:39:42.825830+0000","last_became_active":"2024-09-10T23:38:12.217981+0000","last_became_peered":"2024-09-10T23:38:12.217981+0000","last_unstale":"2024-09-10T23:39:42.825830+0000","last_undegraded":"2024-09-10T23:39:42.825830+0000","last_fullsized":"2024-09-10T23:39:42.825830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:31.745904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538159+0000","last_change":"2024-09-10T23:38:43.538061+0000","last_active":"2024-09-10T23:38:43.538159+0000","last_peered":"2024-09-10T23:38:43.538159+0000","last_clean":"2024-09-10T23:38:43.538159+0000","last_became_active":"2024-09-10T23:38:43.537582+0000","last_became_peered":"2024-09-10T23:38:43.537582+0000","last_unstale":"2024-09-10T23:38:43.538159+0000","last_undegraded":"2024-09-10T23:38:43.538159+0000","last_fullsized":"2024-09-10T23:38:43.538159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:15.083698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.818233+0000","last_change":"2024-09-10T23:38:12.214507+0000","last_active":"2024-09-10T23:39:42.818233+0000","last_peered":"2024-09-10T23:39:42.818233+0000","last_clean":"2024-09-10T23:39:42.818233+0000","last_became_active":"2024-09-10T23:38:12.214160+0000","last_became_peered":"2024-09-10T23:38:12.214160+0000","last_unstale":"2024-09-10T23:39:42.818233+0000","last_undegraded":"2024-09-10T23:39:42.818233+0000","last_fullsized":"2024-09-10T23:39:42.818233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:04.623624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532455+0000","last_change":"2024-09-10T23:38:10.256941+0000","last_active":"2024-09-10T23:38:43.532455+0000","last_peered":"2024-09-10T23:38:43.532455+0000","last_clean":"2024-09-10T23:38:43.532455+0000","last_became_active":"2024-09-10T23:38:10.256553+0000","last_became_peered":"2024-09-10T23:38:10.256553+0000","last_unstale":"2024-09-10T23:38:43.532455+0000","last_undegraded":"2024-09-10T23:38:43.532455+0000","last_fullsized":"2024-09-10T23:38:43.532455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:30.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828906+0000","last_change":"2024-09-10T23:38:12.221246+0000","last_active":"2024-09-10T23:39:42.828906+0000","last_peered":"2024-09-10T23:39:42.828906+0000","last_clean":"2024-09-10T23:39:42.828906+0000","last_became_active":"2024-09-10T23:38:12.220912+0000","last_became_peered":"2024-09-10T23:38:12.220912+0000","last_unstale":"2024-09-10T23:39:42.828906+0000","last_undegraded":"2024-09-10T23:39:42.828906+0000","last_fullsized":"2024-09-10T23:39:42.828906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:33.918289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'11","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534224+0000","last_change":"2024-09-10T23:38:10.210151+0000","last_active":"2024-09-10T23:38:43.534224+0000","last_peered":"2024-09-10T23:38:43.534224+0000","last_clean":"2024-09-10T23:38:43.534224+0000","last_became_active":"2024-09-10T23:38:10.209832+0000","last_became_peered":"2024-09-10T23:38:10.209832+0000","last_unstale":"2024-09-10T23:38:43.534224+0000","last_undegraded":"2024-09-10T23:38:43.534224+0000","last_fullsized":"2024-09-10T23:38:43.534224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:52.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835750+0000","last_change":"2024-09-10T23:38:12.218256+0000","last_active":"2024-09-10T23:39:42.835750+0000","last_peered":"2024-09-10T23:39:42.835750+0000","last_clean":"2024-09-10T23:39:42.835750+0000","last_became_active":"2024-09-10T23:38:12.217853+0000","last_became_peered":"2024-09-10T23:38:12.217853+0000","last_unstale":"2024-09-10T23:39:42.835750+0000","last_undegraded":"2024-09-10T23:39:42.835750+0000","last_fullsized":"2024-09-10T23:39:42.835750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537082+0000","last_change":"2024-09-10T23:38:10.300017+0000","last_active":"2024-09-10T23:38:43.537082+0000","last_peered":"2024-09-10T23:38:43.537082+0000","last_clean":"2024-09-10T23:38:43.537082+0000","last_became_active":"2024-09-10T23:38:10.299733+0000","last_became_peered":"2024-09-10T23:38:10.299733+0000","last_unstale":"2024-09-10T23:38:43.537082+0000","last_undegraded":"2024-09-10T23:38:43.537082+0000","last_fullsized":"2024-09-10T23:38:43.537082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.193043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832436+0000","last_change":"2024-09-10T23:38:12.212818+0000","last_active":"2024-09-10T23:39:42.832436+0000","last_peered":"2024-09-10T23:39:42.832436+0000","last_clean":"2024-09-10T23:39:42.832436+0000","last_became_active":"2024-09-10T23:38:12.212502+0000","last_became_peered":"2024-09-10T23:38:12.212502+0000","last_unstale":"2024-09-10T23:39:42.832436+0000","last_undegraded":"2024-09-10T23:39:42.832436+0000","last_fullsized":"2024-09-10T23:39:42.832436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:26.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531972+0000","last_change":"2024-09-10T23:38:10.256366+0000","last_active":"2024-09-10T23:38:43.531972+0000","last_peered":"2024-09-10T23:38:43.531972+0000","last_clean":"2024-09-10T23:38:43.531972+0000","last_became_active":"2024-09-10T23:38:10.256056+0000","last_became_peered":"2024-09-10T23:38:10.256056+0000","last_unstale":"2024-09-10T23:38:43.531972+0000","last_undegraded":"2024-09-10T23:38:43.531972+0000","last_fullsized":"2024-09-10T23:38:43.531972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:00.612373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.793751+0000","last_change":"2024-09-10T23:38:12.224629+0000","last_active":"2024-09-10T23:39:42.793751+0000","last_peered":"2024-09-10T23:39:42.793751+0000","last_clean":"2024-09-10T23:39:42.793751+0000","last_became_active":"2024-09-10T23:38:12.224018+0000","last_became_peered":"2024-09-10T23:38:12.224018+0000","last_unstale":"2024-09-10T23:39:42.793751+0000","last_undegraded":"2024-09-10T23:39:42.793751+0000","last_fullsized":"2024-09-10T23:39:42.793751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:44.067489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965400+0000","last_change":"2024-09-10T23:38:10.203395+0000","last_active":"2024-09-10T23:38:43.965400+0000","last_peered":"2024-09-10T23:38:43.965400+0000","last_clean":"2024-09-10T23:38:43.965400+0000","last_became_active":"2024-09-10T23:38:10.203067+0000","last_became_peered":"2024-09-10T23:38:10.203067+0000","last_unstale":"2024-09-10T23:38:43.965400+0000","last_undegraded":"2024-09-10T23:38:43.965400+0000","last_fullsized":"2024-09-10T23:38:43.965400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.398322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828373+0000","last_change":"2024-09-10T23:38:12.223207+0000","last_active":"2024-09-10T23:39:42.828373+0000","last_peered":"2024-09-10T23:39:42.828373+0000","last_clean":"2024-09-10T23:39:42.828373+0000","last_became_active":"2024-09-10T23:38:12.222841+0000","last_became_peered":"2024-09-10T23:38:12.222841+0000","last_unstale":"2024-09-10T23:39:42.828373+0000","last_undegraded":"2024-09-10T23:39:42.828373+0000","last_fullsized":"2024-09-10T23:39:42.828373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:26.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770702+0000","last_change":"2024-09-10T23:38:10.210479+0000","last_active":"2024-09-10T23:38:43.770702+0000","last_peered":"2024-09-10T23:38:43.770702+0000","last_clean":"2024-09-10T23:38:43.770702+0000","last_became_active":"2024-09-10T23:38:10.210124+0000","last_became_peered":"2024-09-10T23:38:10.210124+0000","last_unstale":"2024-09-10T23:38:43.770702+0000","last_undegraded":"2024-09-10T23:38:43.770702+0000","last_fullsized":"2024-09-10T23:38:43.770702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:39.017091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.816318+0000","last_change":"2024-09-10T23:38:12.214748+0000","last_active":"2024-09-10T23:39:42.816318+0000","last_peered":"2024-09-10T23:39:42.816318+0000","last_clean":"2024-09-10T23:39:42.816318+0000","last_became_active":"2024-09-10T23:38:12.214431+0000","last_became_peered":"2024-09-10T23:38:12.214431+0000","last_unstale":"2024-09-10T23:39:42.816318+0000","last_undegraded":"2024-09-10T23:39:42.816318+0000","last_fullsized":"2024-09-10T23:39:42.816318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:02.092876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532097+0000","last_change":"2024-09-10T23:38:10.214134+0000","last_active":"2024-09-10T23:38:43.532097+0000","last_peered":"2024-09-10T23:38:43.532097+0000","last_clean":"2024-09-10T23:38:43.532097+0000","last_became_active":"2024-09-10T23:38:10.213690+0000","last_became_peered":"2024-09-10T23:38:10.213690+0000","last_unstale":"2024-09-10T23:38:43.532097+0000","last_undegraded":"2024-09-10T23:38:43.532097+0000","last_fullsized":"2024-09-10T23:38:43.532097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:19.369755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840926+0000","last_change":"2024-09-10T23:38:12.218254+0000","last_active":"2024-09-10T23:39:42.840926+0000","last_peered":"2024-09-10T23:39:42.840926+0000","last_clean":"2024-09-10T23:39:42.840926+0000","last_became_active":"2024-09-10T23:38:12.217937+0000","last_became_peered":"2024-09-10T23:38:12.217937+0000","last_unstale":"2024-09-10T23:39:42.840926+0000","last_undegraded":"2024-09-10T23:39:42.840926+0000","last_fullsized":"2024-09-10T23:39:42.840926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:57.080088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840222+0000","last_change":"2024-09-10T23:38:43.537716+0000","last_active":"2024-09-10T23:39:42.840222+0000","last_peered":"2024-09-10T23:39:42.840222+0000","last_clean":"2024-09-10T23:39:42.840222+0000","last_became_active":"2024-09-10T23:38:43.537357+0000","last_became_peered":"2024-09-10T23:38:43.537357+0000","last_unstale":"2024-09-10T23:39:42.840222+0000","last_undegraded":"2024-09-10T23:39:42.840222+0000","last_fullsized":"2024-09-10T23:39:42.840222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:59.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532282+0000","last_change":"2024-09-10T23:38:10.215022+0000","last_active":"2024-09-10T23:38:43.532282+0000","last_peered":"2024-09-10T23:38:43.532282+0000","last_clean":"2024-09-10T23:38:43.532282+0000","last_became_active":"2024-09-10T23:38:10.214678+0000","last_became_peered":"2024-09-10T23:38:10.214678+0000","last_unstale":"2024-09-10T23:38:43.532282+0000","last_undegraded":"2024-09-10T23:38:43.532282+0000","last_fullsized":"2024-09-10T23:38:43.532282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:20.592052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841698+0000","last_change":"2024-09-10T23:38:12.230449+0000","last_active":"2024-09-10T23:39:42.841698+0000","last_peered":"2024-09-10T23:39:42.841698+0000","last_clean":"2024-09-10T23:39:42.841698+0000","last_became_active":"2024-09-10T23:38:12.228939+0000","last_became_peered":"2024-09-10T23:38:12.228939+0000","last_unstale":"2024-09-10T23:39:42.841698+0000","last_undegraded":"2024-09-10T23:39:42.841698+0000","last_fullsized":"2024-09-10T23:39:42.841698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:45.495207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532292+0000","last_change":"2024-09-10T23:38:10.209586+0000","last_active":"2024-09-10T23:38:43.532292+0000","last_peered":"2024-09-10T23:38:43.532292+0000","last_clean":"2024-09-10T23:38:43.532292+0000","last_became_active":"2024-09-10T23:38:10.209211+0000","last_became_peered":"2024-09-10T23:38:10.209211+0000","last_unstale":"2024-09-10T23:38:43.532292+0000","last_undegraded":"2024-09-10T23:38:43.532292+0000","last_fullsized":"2024-09-10T23:38:43.532292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:29.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832321+0000","last_change":"2024-09-10T23:38:12.219795+0000","last_active":"2024-09-10T23:39:42.832321+0000","last_peered":"2024-09-10T23:39:42.832321+0000","last_clean":"2024-09-10T23:39:42.832321+0000","last_became_active":"2024-09-10T23:38:12.219318+0000","last_became_peered":"2024-09-10T23:38:12.219318+0000","last_unstale":"2024-09-10T23:39:42.832321+0000","last_undegraded":"2024-09-10T23:39:42.832321+0000","last_fullsized":"2024-09-10T23:39:42.832321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:12.732264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965952+0000","last_change":"2024-09-10T23:38:10.255508+0000","last_active":"2024-09-10T23:38:43.965952+0000","last_peered":"2024-09-10T23:38:43.965952+0000","last_clean":"2024-09-10T23:38:43.965952+0000","last_became_active":"2024-09-10T23:38:10.255202+0000","last_became_peered":"2024-09-10T23:38:10.255202+0000","last_unstale":"2024-09-10T23:38:43.965952+0000","last_undegraded":"2024-09-10T23:38:43.965952+0000","last_fullsized":"2024-09-10T23:38:43.965952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:09.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823314+0000","last_change":"2024-09-10T23:38:12.222345+0000","last_active":"2024-09-10T23:39:42.823314+0000","last_peered":"2024-09-10T23:39:42.823314+0000","last_clean":"2024-09-10T23:39:42.823314+0000","last_became_active":"2024-09-10T23:38:12.220593+0000","last_became_peered":"2024-09-10T23:38:12.220593+0000","last_unstale":"2024-09-10T23:39:42.823314+0000","last_undegraded":"2024-09-10T23:39:42.823314+0000","last_fullsized":"2024-09-10T23:39:42.823314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:00.909046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534353+0000","last_change":"2024-09-10T23:38:10.210071+0000","last_active":"2024-09-10T23:38:43.534353+0000","last_peered":"2024-09-10T23:38:43.534353+0000","last_clean":"2024-09-10T23:38:43.534353+0000","last_became_active":"2024-09-10T23:38:10.209778+0000","last_became_peered":"2024-09-10T23:38:10.209778+0000","last_unstale":"2024-09-10T23:38:43.534353+0000","last_undegraded":"2024-09-10T23:38:43.534353+0000","last_fullsized":"2024-09-10T23:38:43.534353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:14.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65578,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":630,"num_read_kb":383,"num_write":172,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":196426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286063,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":417996,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1070583,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103214,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":418210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":418108,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":1010733,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":417599,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":1009885,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":418568,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417910,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":480178,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":477988,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":418870,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:40:07.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:40:07.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:06 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3197547222' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:07.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.391+0000 7f07ee67f640 1 -- 172.21.15.16:0/2534059267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 msgr2=0x7f07e8107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.391+0000 7f07ee67f640 1 --2- 172.21.15.16:0/2534059267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e8107a50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009900 tx=0x7f07dc02a410 comp rx=0 tx=0).stop 2024-09-10T23:40:07.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.391+0000 7f07ee67f640 1 -- 172.21.15.16:0/2534059267 shutdown_connections 2024-09-10T23:40:07.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.391+0000 7f07ee67f640 1 --2- 172.21.15.16:0/2534059267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8107f90 0x7f07e810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.391+0000 7f07ee67f640 1 --2- 172.21.15.16:0/2534059267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e8107a50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.391+0000 7f07ee67f640 1 --2- 172.21.15.16:0/2534059267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07e8101c10 0x7f07e8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.391+0000 7f07ee67f640 1 -- 172.21.15.16:0/2534059267 >> 172.21.15.16:0/2534059267 conn(0x7f07e80fd670 msgr2=0x7f07e80ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:07.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.392+0000 7f07ee67f640 1 -- 172.21.15.16:0/2534059267 shutdown_connections 2024-09-10T23:40:07.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.392+0000 7f07ee67f640 1 -- 172.21.15.16:0/2534059267 wait complete. 2024-09-10T23:40:07.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.392+0000 7f07ee67f640 1 Processor -- start 2024-09-10T23:40:07.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.392+0000 7f07ee67f640 1 -- start start 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ee67f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8101c10 0x7f07e810f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ee67f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e810f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ee67f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07e8107f90 0x7f07e810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ee67f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8112d70 con 0x7f07e8107610 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ee67f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8112bf0 con 0x7f07e8101c10 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ee67f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8112ef0 con 0x7f07e8107f90 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e810f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e810f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47350/0 (socket says 172.21.15.16:47350) 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 -- 172.21.15.16:0/1697852418 learned_addr learned my addr 172.21.15.16:0/1697852418 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ecc1c640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07e8107f90 0x7f07e810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e7fff640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8101c10 0x7f07e810f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 -- 172.21.15.16:0/1697852418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07e8107f90 msgr2=0x7f07e810fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07e8107f90 0x7f07e810fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 -- 172.21.15.16:0/1697852418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8101c10 msgr2=0x7f07e810f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8101c10 0x7f07e810f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 -- 172.21.15.16:0/1697852418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e81a7660 con 0x7f07e8107610 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e77fe640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e810f7e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f07dc005940 tx=0x7f07dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e57fa640 1 -- 172.21.15.16:0/1697852418 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc03f030 con 0x7f07e8107610 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e57fa640 1 -- 172.21.15.16:0/1697852418 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07dc003cb0 con 0x7f07e8107610 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e81a78f0 con 0x7f07e8107610 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.393+0000 7f07e57fa640 1 -- 172.21.15.16:0/1697852418 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc035070 con 0x7f07e8107610 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.394+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e81a7de0 con 0x7f07e8107610 2024-09-10T23:40:07.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.394+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e8101ff0 con 0x7f07e8107610 2024-09-10T23:40:07.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.396+0000 7f07e57fa640 1 -- 172.21.15.16:0/1697852418 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f07dc03bbf0 con 0x7f07e8107610 2024-09-10T23:40:07.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.396+0000 7f07e57fa640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07d00b5330 0x7f07d00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.397+0000 7f07e7fff640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07d00b5330 0x7f07d00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.397+0000 7f07e57fa640 1 -- 172.21.15.16:0/1697852418 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f07dc106a40 con 0x7f07e8107610 2024-09-10T23:40:07.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.397+0000 7f07e7fff640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07d00b5330 0x7f07d00b77f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:07.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.400+0000 7f07e57fa640 1 -- 172.21.15.16:0/1697852418 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07dc0cd1f0 con 0x7f07e8107610 2024-09-10T23:40:07.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.581+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07e8063590 con 0x7f07d00b5330 2024-09-10T23:40:07.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.586+0000 7f07e57fa640 1 -- 172.21.15.16:0/1697852418 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259071 (secure 0 0 0) 0x7f07e8063590 con 0x7f07d00b5330 2024-09-10T23:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07d00b5330 msgr2=0x7f07d00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07d00b5330 0x7f07d00b77f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d800b390 comp rx=0 tx=0).stop 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 msgr2=0x7f07e810f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e810f7e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f07dc005940 tx=0x7f07dc0042f0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 shutdown_connections 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07e8107f90 0x7f07e810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07e8107610 0x7f07e810f7e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f07d00b5330 0x7f07d00b77f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 --2- 172.21.15.16:0/1697852418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07e8101c10 0x7f07e810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 >> 172.21.15.16:0/1697852418 conn(0x7f07e80fd670 msgr2=0x7f07e80ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 shutdown_connections 2024-09-10T23:40:07.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.589+0000 7f07ee67f640 1 -- 172.21.15.16:0/1697852418 wait complete. 2024-09-10T23:40:07.600 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-10T23:40:06.447649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656180,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":711,"num_read_kb":452,"num_write":297,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384528,"kb_used_data":10320,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124557296,"statfs":{"total":1151940427776,"available":1151546671104,"internally_reserved":0,"allocated":10567680,"data_stored":6976628,"data_compressed":178827,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002699"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841669+0000","last_change":"2024-09-10T23:38:12.217637+0000","last_active":"2024-09-10T23:39:42.841669+0000","last_peered":"2024-09-10T23:39:42.841669+0000","last_clean":"2024-09-10T23:39:42.841669+0000","last_became_active":"2024-09-10T23:38:12.217260+0000","last_became_peered":"2024-09-10T23:38:12.217260+0000","last_unstale":"2024-09-10T23:39:42.841669+0000","last_undegraded":"2024-09-10T23:39:42.841669+0000","last_fullsized":"2024-09-10T23:39:42.841669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.774575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.831938+0000","last_change":"2024-09-10T23:38:12.217114+0000","last_active":"2024-09-10T23:39:42.831938+0000","last_peered":"2024-09-10T23:39:42.831938+0000","last_clean":"2024-09-10T23:39:42.831938+0000","last_became_active":"2024-09-10T23:38:12.216836+0000","last_became_peered":"2024-09-10T23:38:12.216836+0000","last_unstale":"2024-09-10T23:39:42.831938+0000","last_undegraded":"2024-09-10T23:39:42.831938+0000","last_fullsized":"2024-09-10T23:39:42.831938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:55.023668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835068+0000","last_change":"2024-09-10T23:38:12.219046+0000","last_active":"2024-09-10T23:39:42.835068+0000","last_peered":"2024-09-10T23:39:42.835068+0000","last_clean":"2024-09-10T23:39:42.835068+0000","last_became_active":"2024-09-10T23:38:12.218348+0000","last_became_peered":"2024-09-10T23:38:12.218348+0000","last_unstale":"2024-09-10T23:39:42.835068+0000","last_undegraded":"2024-09-10T23:39:42.835068+0000","last_fullsized":"2024-09-10T23:39:42.835068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:07.419364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828772+0000","last_change":"2024-09-10T23:38:12.219211+0000","last_active":"2024-09-10T23:39:42.828772+0000","last_peered":"2024-09-10T23:39:42.828772+0000","last_clean":"2024-09-10T23:39:42.828772+0000","last_became_active":"2024-09-10T23:38:12.213452+0000","last_became_peered":"2024-09-10T23:38:12.213452+0000","last_unstale":"2024-09-10T23:39:42.828772+0000","last_undegraded":"2024-09-10T23:39:42.828772+0000","last_fullsized":"2024-09-10T23:39:42.828772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:59.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823728+0000","last_change":"2024-09-10T23:38:12.213636+0000","last_active":"2024-09-10T23:39:42.823728+0000","last_peered":"2024-09-10T23:39:42.823728+0000","last_clean":"2024-09-10T23:39:42.823728+0000","last_became_active":"2024-09-10T23:38:12.213309+0000","last_became_peered":"2024-09-10T23:38:12.213309+0000","last_unstale":"2024-09-10T23:39:42.823728+0000","last_undegraded":"2024-09-10T23:39:42.823728+0000","last_fullsized":"2024-09-10T23:39:42.823728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:34.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825688+0000","last_change":"2024-09-10T23:38:12.215995+0000","last_active":"2024-09-10T23:39:42.825688+0000","last_peered":"2024-09-10T23:39:42.825688+0000","last_clean":"2024-09-10T23:39:42.825688+0000","last_became_active":"2024-09-10T23:38:12.215601+0000","last_became_peered":"2024-09-10T23:38:12.215601+0000","last_unstale":"2024-09-10T23:39:42.825688+0000","last_undegraded":"2024-09-10T23:39:42.825688+0000","last_fullsized":"2024-09-10T23:39:42.825688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:24.770551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836251+0000","last_change":"2024-09-10T23:38:12.226337+0000","last_active":"2024-09-10T23:39:42.836251+0000","last_peered":"2024-09-10T23:39:42.836251+0000","last_clean":"2024-09-10T23:39:42.836251+0000","last_became_active":"2024-09-10T23:38:12.225953+0000","last_became_peered":"2024-09-10T23:38:12.225953+0000","last_unstale":"2024-09-10T23:39:42.836251+0000","last_undegraded":"2024-09-10T23:39:42.836251+0000","last_fullsized":"2024-09-10T23:39:42.836251+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:27.044867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.824994+0000","last_change":"2024-09-10T23:38:12.219682+0000","last_active":"2024-09-10T23:39:42.824994+0000","last_peered":"2024-09-10T23:39:42.824994+0000","last_clean":"2024-09-10T23:39:42.824994+0000","last_became_active":"2024-09-10T23:38:12.218596+0000","last_became_peered":"2024-09-10T23:38:12.218596+0000","last_unstale":"2024-09-10T23:39:42.824994+0000","last_undegraded":"2024-09-10T23:39:42.824994+0000","last_fullsized":"2024-09-10T23:39:42.824994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:33.011117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840934+0000","last_change":"2024-09-10T23:38:12.223114+0000","last_active":"2024-09-10T23:39:42.840934+0000","last_peered":"2024-09-10T23:39:42.840934+0000","last_clean":"2024-09-10T23:39:42.840934+0000","last_became_active":"2024-09-10T23:38:12.222748+0000","last_became_peered":"2024-09-10T23:38:12.222748+0000","last_unstale":"2024-09-10T23:39:42.840934+0000","last_undegraded":"2024-09-10T23:39:42.840934+0000","last_fullsized":"2024-09-10T23:39:42.840934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:38.384821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835460+0000","last_change":"2024-09-10T23:38:12.225061+0000","last_active":"2024-09-10T23:39:42.835460+0000","last_peered":"2024-09-10T23:39:42.835460+0000","last_clean":"2024-09-10T23:39:42.835460+0000","last_became_active":"2024-09-10T23:38:12.224730+0000","last_became_peered":"2024-09-10T23:38:12.224730+0000","last_unstale":"2024-09-10T23:39:42.835460+0000","last_undegraded":"2024-09-10T23:39:42.835460+0000","last_fullsized":"2024-09-10T23:39:42.835460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:40.343294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840365+0000","last_change":"2024-09-10T23:38:12.219920+0000","last_active":"2024-09-10T23:39:42.840365+0000","last_peered":"2024-09-10T23:39:42.840365+0000","last_clean":"2024-09-10T23:39:42.840365+0000","last_became_active":"2024-09-10T23:38:12.219517+0000","last_became_peered":"2024-09-10T23:38:12.219517+0000","last_unstale":"2024-09-10T23:39:42.840365+0000","last_undegraded":"2024-09-10T23:39:42.840365+0000","last_fullsized":"2024-09-10T23:39:42.840365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:58.686977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828097+0000","last_change":"2024-09-10T23:38:12.219740+0000","last_active":"2024-09-10T23:39:42.828097+0000","last_peered":"2024-09-10T23:39:42.828097+0000","last_clean":"2024-09-10T23:39:42.828097+0000","last_became_active":"2024-09-10T23:38:12.215497+0000","last_became_peered":"2024-09-10T23:38:12.215497+0000","last_unstale":"2024-09-10T23:39:42.828097+0000","last_undegraded":"2024-09-10T23:39:42.828097+0000","last_fullsized":"2024-09-10T23:39:42.828097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:06.503836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.826375+0000","last_change":"2024-09-10T23:38:12.217066+0000","last_active":"2024-09-10T23:39:42.826375+0000","last_peered":"2024-09-10T23:39:42.826375+0000","last_clean":"2024-09-10T23:39:42.826375+0000","last_became_active":"2024-09-10T23:38:12.216758+0000","last_became_peered":"2024-09-10T23:38:12.216758+0000","last_unstale":"2024-09-10T23:39:42.826375+0000","last_undegraded":"2024-09-10T23:39:42.826375+0000","last_fullsized":"2024-09-10T23:39:42.826375+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:53.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833516+0000","last_change":"2024-09-10T23:38:12.216584+0000","last_active":"2024-09-10T23:39:42.833516+0000","last_peered":"2024-09-10T23:39:42.833516+0000","last_clean":"2024-09-10T23:39:42.833516+0000","last_became_active":"2024-09-10T23:38:12.216296+0000","last_became_peered":"2024-09-10T23:38:12.216296+0000","last_unstale":"2024-09-10T23:39:42.833516+0000","last_undegraded":"2024-09-10T23:39:42.833516+0000","last_fullsized":"2024-09-10T23:39:42.833516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:11.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834463+0000","last_change":"2024-09-10T23:38:43.772225+0000","last_active":"2024-09-10T23:39:42.834463+0000","last_peered":"2024-09-10T23:39:42.834463+0000","last_clean":"2024-09-10T23:39:42.834463+0000","last_became_active":"2024-09-10T23:38:43.771855+0000","last_became_peered":"2024-09-10T23:38:43.771855+0000","last_unstale":"2024-09-10T23:39:42.834463+0000","last_undegraded":"2024-09-10T23:39:42.834463+0000","last_fullsized":"2024-09-10T23:39:42.834463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:14.454340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837082+0000","last_change":"2024-09-10T23:38:12.229957+0000","last_active":"2024-09-10T23:39:42.837082+0000","last_peered":"2024-09-10T23:39:42.837082+0000","last_clean":"2024-09-10T23:39:42.837082+0000","last_became_active":"2024-09-10T23:38:12.229297+0000","last_became_peered":"2024-09-10T23:38:12.229297+0000","last_unstale":"2024-09-10T23:39:42.837082+0000","last_undegraded":"2024-09-10T23:39:42.837082+0000","last_fullsized":"2024-09-10T23:39:42.837082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:54.119455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841682+0000","last_change":"2024-09-10T23:38:12.218345+0000","last_active":"2024-09-10T23:39:42.841682+0000","last_peered":"2024-09-10T23:39:42.841682+0000","last_clean":"2024-09-10T23:39:42.841682+0000","last_became_active":"2024-09-10T23:38:12.218060+0000","last_became_peered":"2024-09-10T23:38:12.218060+0000","last_unstale":"2024-09-10T23:39:42.841682+0000","last_undegraded":"2024-09-10T23:39:42.841682+0000","last_fullsized":"2024-09-10T23:39:42.841682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.912757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839948+0000","last_change":"2024-09-10T23:38:12.215025+0000","last_active":"2024-09-10T23:39:42.839948+0000","last_peered":"2024-09-10T23:39:42.839948+0000","last_clean":"2024-09-10T23:39:42.839948+0000","last_became_active":"2024-09-10T23:38:12.214709+0000","last_became_peered":"2024-09-10T23:38:12.214709+0000","last_unstale":"2024-09-10T23:39:42.839948+0000","last_undegraded":"2024-09-10T23:39:42.839948+0000","last_fullsized":"2024-09-10T23:39:42.839948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:00.925426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.831755+0000","last_change":"2024-09-10T23:38:12.215536+0000","last_active":"2024-09-10T23:39:42.831755+0000","last_peered":"2024-09-10T23:39:42.831755+0000","last_clean":"2024-09-10T23:39:42.831755+0000","last_became_active":"2024-09-10T23:38:12.214991+0000","last_became_peered":"2024-09-10T23:38:12.214991+0000","last_unstale":"2024-09-10T23:39:42.831755+0000","last_undegraded":"2024-09-10T23:39:42.831755+0000","last_fullsized":"2024-09-10T23:39:42.831755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.059276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823917+0000","last_change":"2024-09-10T23:38:12.224919+0000","last_active":"2024-09-10T23:39:42.823917+0000","last_peered":"2024-09-10T23:39:42.823917+0000","last_clean":"2024-09-10T23:39:42.823917+0000","last_became_active":"2024-09-10T23:38:12.224559+0000","last_became_peered":"2024-09-10T23:38:12.224559+0000","last_unstale":"2024-09-10T23:39:42.823917+0000","last_undegraded":"2024-09-10T23:39:42.823917+0000","last_fullsized":"2024-09-10T23:39:42.823917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:23.373211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837096+0000","last_change":"2024-09-10T23:38:12.216995+0000","last_active":"2024-09-10T23:39:42.837096+0000","last_peered":"2024-09-10T23:39:42.837096+0000","last_clean":"2024-09-10T23:39:42.837096+0000","last_became_active":"2024-09-10T23:38:12.216681+0000","last_became_peered":"2024-09-10T23:38:12.216681+0000","last_unstale":"2024-09-10T23:39:42.837096+0000","last_undegraded":"2024-09-10T23:39:42.837096+0000","last_fullsized":"2024-09-10T23:39:42.837096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:37.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839956+0000","last_change":"2024-09-10T23:38:12.221618+0000","last_active":"2024-09-10T23:39:42.839956+0000","last_peered":"2024-09-10T23:39:42.839956+0000","last_clean":"2024-09-10T23:39:42.839956+0000","last_became_active":"2024-09-10T23:38:12.219352+0000","last_became_peered":"2024-09-10T23:38:12.219352+0000","last_unstale":"2024-09-10T23:39:42.839956+0000","last_undegraded":"2024-09-10T23:39:42.839956+0000","last_fullsized":"2024-09-10T23:39:42.839956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:48.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828289+0000","last_change":"2024-09-10T23:38:12.221530+0000","last_active":"2024-09-10T23:39:42.828289+0000","last_peered":"2024-09-10T23:39:42.828289+0000","last_clean":"2024-09-10T23:39:42.828289+0000","last_became_active":"2024-09-10T23:38:12.221024+0000","last_became_peered":"2024-09-10T23:38:12.221024+0000","last_unstale":"2024-09-10T23:39:42.828289+0000","last_undegraded":"2024-09-10T23:39:42.828289+0000","last_fullsized":"2024-09-10T23:39:42.828289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.821792+0000","last_change":"2024-09-10T23:38:12.219990+0000","last_active":"2024-09-10T23:39:42.821792+0000","last_peered":"2024-09-10T23:39:42.821792+0000","last_clean":"2024-09-10T23:39:42.821792+0000","last_became_active":"2024-09-10T23:38:12.219560+0000","last_became_peered":"2024-09-10T23:38:12.219560+0000","last_unstale":"2024-09-10T23:39:42.821792+0000","last_undegraded":"2024-09-10T23:39:42.821792+0000","last_fullsized":"2024-09-10T23:39:42.821792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:28.112467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.822901+0000","last_change":"2024-09-10T23:38:12.225753+0000","last_active":"2024-09-10T23:39:42.822901+0000","last_peered":"2024-09-10T23:39:42.822901+0000","last_clean":"2024-09-10T23:39:42.822901+0000","last_became_active":"2024-09-10T23:38:12.225450+0000","last_became_peered":"2024-09-10T23:38:12.225450+0000","last_unstale":"2024-09-10T23:39:42.822901+0000","last_undegraded":"2024-09-10T23:39:42.822901+0000","last_fullsized":"2024-09-10T23:39:42.822901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:23.478611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828425+0000","last_change":"2024-09-10T23:38:12.216917+0000","last_active":"2024-09-10T23:39:42.828425+0000","last_peered":"2024-09-10T23:39:42.828425+0000","last_clean":"2024-09-10T23:39:42.828425+0000","last_became_active":"2024-09-10T23:38:12.216528+0000","last_became_peered":"2024-09-10T23:38:12.216528+0000","last_unstale":"2024-09-10T23:39:42.828425+0000","last_undegraded":"2024-09-10T23:39:42.828425+0000","last_fullsized":"2024-09-10T23:39:42.828425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:03.902221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825120+0000","last_change":"2024-09-10T23:38:12.219372+0000","last_active":"2024-09-10T23:39:42.825120+0000","last_peered":"2024-09-10T23:39:42.825120+0000","last_clean":"2024-09-10T23:39:42.825120+0000","last_became_active":"2024-09-10T23:38:12.219072+0000","last_became_peered":"2024-09-10T23:38:12.219072+0000","last_unstale":"2024-09-10T23:39:42.825120+0000","last_undegraded":"2024-09-10T23:39:42.825120+0000","last_fullsized":"2024-09-10T23:39:42.825120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:07.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834730+0000","last_change":"2024-09-10T23:38:12.224716+0000","last_active":"2024-09-10T23:39:42.834730+0000","last_peered":"2024-09-10T23:39:42.834730+0000","last_clean":"2024-09-10T23:39:42.834730+0000","last_became_active":"2024-09-10T23:38:12.224393+0000","last_became_peered":"2024-09-10T23:38:12.224393+0000","last_unstale":"2024-09-10T23:39:42.834730+0000","last_undegraded":"2024-09-10T23:39:42.834730+0000","last_fullsized":"2024-09-10T23:39:42.834730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.995098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836203+0000","last_change":"2024-09-10T23:38:44.092446+0000","last_active":"2024-09-10T23:39:42.836203+0000","last_peered":"2024-09-10T23:39:42.836203+0000","last_clean":"2024-09-10T23:39:42.836203+0000","last_became_active":"2024-09-10T23:38:44.092027+0000","last_became_peered":"2024-09-10T23:38:44.092027+0000","last_unstale":"2024-09-10T23:39:42.836203+0000","last_undegraded":"2024-09-10T23:39:42.836203+0000","last_fullsized":"2024-09-10T23:39:42.836203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.804237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834694+0000","last_change":"2024-09-10T23:38:12.214278+0000","last_active":"2024-09-10T23:39:42.834694+0000","last_peered":"2024-09-10T23:39:42.834694+0000","last_clean":"2024-09-10T23:39:42.834694+0000","last_became_active":"2024-09-10T23:38:12.212079+0000","last_became_peered":"2024-09-10T23:38:12.212079+0000","last_unstale":"2024-09-10T23:39:42.834694+0000","last_undegraded":"2024-09-10T23:39:42.834694+0000","last_fullsized":"2024-09-10T23:39:42.834694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:42.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833730+0000","last_change":"2024-09-10T23:38:12.214703+0000","last_active":"2024-09-10T23:39:42.833730+0000","last_peered":"2024-09-10T23:39:42.833730+0000","last_clean":"2024-09-10T23:39:42.833730+0000","last_became_active":"2024-09-10T23:38:12.214353+0000","last_became_peered":"2024-09-10T23:38:12.214353+0000","last_unstale":"2024-09-10T23:39:42.833730+0000","last_undegraded":"2024-09-10T23:39:42.833730+0000","last_fullsized":"2024-09-10T23:39:42.833730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.004904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832133+0000","last_change":"2024-09-10T23:38:12.223462+0000","last_active":"2024-09-10T23:39:42.832133+0000","last_peered":"2024-09-10T23:39:42.832133+0000","last_clean":"2024-09-10T23:39:42.832133+0000","last_became_active":"2024-09-10T23:38:12.223159+0000","last_became_peered":"2024-09-10T23:38:12.223159+0000","last_unstale":"2024-09-10T23:39:42.832133+0000","last_undegraded":"2024-09-10T23:39:42.832133+0000","last_fullsized":"2024-09-10T23:39:42.832133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.587560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.818551+0000","last_change":"2024-09-10T23:38:12.213290+0000","last_active":"2024-09-10T23:39:42.818551+0000","last_peered":"2024-09-10T23:39:42.818551+0000","last_clean":"2024-09-10T23:39:42.818551+0000","last_became_active":"2024-09-10T23:38:12.212999+0000","last_became_peered":"2024-09-10T23:38:12.212999+0000","last_unstale":"2024-09-10T23:39:42.818551+0000","last_undegraded":"2024-09-10T23:39:42.818551+0000","last_fullsized":"2024-09-10T23:39:42.818551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:54.448436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'7","reported_seq":133,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:00.422876+0000","last_change":"2024-09-10T23:38:10.210483+0000","last_active":"2024-09-10T23:40:00.422876+0000","last_peered":"2024-09-10T23:40:00.422876+0000","last_clean":"2024-09-10T23:40:00.422876+0000","last_became_active":"2024-09-10T23:38:10.210108+0000","last_became_peered":"2024-09-10T23:38:10.210108+0000","last_unstale":"2024-09-10T23:40:00.422876+0000","last_undegraded":"2024-09-10T23:40:00.422876+0000","last_fullsized":"2024-09-10T23:40:00.422876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:33.370496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.826119+0000","last_change":"2024-09-10T23:38:43.966800+0000","last_active":"2024-09-10T23:39:42.826119+0000","last_peered":"2024-09-10T23:39:42.826119+0000","last_clean":"2024-09-10T23:39:42.826119+0000","last_became_active":"2024-09-10T23:38:43.966274+0000","last_became_peered":"2024-09-10T23:38:43.966274+0000","last_unstale":"2024-09-10T23:39:42.826119+0000","last_undegraded":"2024-09-10T23:39:42.826119+0000","last_fullsized":"2024-09-10T23:39:42.826119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:02.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024529+0000","last_change":"2024-09-10T23:38:10.210875+0000","last_active":"2024-09-10T23:38:44.024529+0000","last_peered":"2024-09-10T23:38:44.024529+0000","last_clean":"2024-09-10T23:38:44.024529+0000","last_became_active":"2024-09-10T23:38:10.209254+0000","last_became_peered":"2024-09-10T23:38:10.209254+0000","last_unstale":"2024-09-10T23:38:44.024529+0000","last_undegraded":"2024-09-10T23:38:44.024529+0000","last_fullsized":"2024-09-10T23:38:44.024529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:21.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530747+0000","last_change":"2024-09-10T23:38:10.213483+0000","last_active":"2024-09-10T23:38:43.530747+0000","last_peered":"2024-09-10T23:38:43.530747+0000","last_clean":"2024-09-10T23:38:43.530747+0000","last_became_active":"2024-09-10T23:38:10.213109+0000","last_became_peered":"2024-09-10T23:38:10.213109+0000","last_unstale":"2024-09-10T23:38:43.530747+0000","last_undegraded":"2024-09-10T23:38:43.530747+0000","last_fullsized":"2024-09-10T23:38:43.530747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:03.563548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.827193+0000","last_change":"2024-09-10T23:38:12.217136+0000","last_active":"2024-09-10T23:39:42.827193+0000","last_peered":"2024-09-10T23:39:42.827193+0000","last_clean":"2024-09-10T23:39:42.827193+0000","last_became_active":"2024-09-10T23:38:12.216813+0000","last_became_peered":"2024-09-10T23:38:12.216813+0000","last_unstale":"2024-09-10T23:39:42.827193+0000","last_undegraded":"2024-09-10T23:39:42.827193+0000","last_fullsized":"2024-09-10T23:39:42.827193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:26.184575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536951+0000","last_change":"2024-09-10T23:38:10.209109+0000","last_active":"2024-09-10T23:38:43.536951+0000","last_peered":"2024-09-10T23:38:43.536951+0000","last_clean":"2024-09-10T23:38:43.536951+0000","last_became_active":"2024-09-10T23:38:10.208450+0000","last_became_peered":"2024-09-10T23:38:10.208450+0000","last_unstale":"2024-09-10T23:38:43.536951+0000","last_undegraded":"2024-09-10T23:38:43.536951+0000","last_fullsized":"2024-09-10T23:38:43.536951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:29.453119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.829671+0000","last_change":"2024-09-10T23:38:12.213755+0000","last_active":"2024-09-10T23:39:42.829671+0000","last_peered":"2024-09-10T23:39:42.829671+0000","last_clean":"2024-09-10T23:39:42.829671+0000","last_became_active":"2024-09-10T23:38:12.213454+0000","last_became_peered":"2024-09-10T23:38:12.213454+0000","last_unstale":"2024-09-10T23:39:42.829671+0000","last_undegraded":"2024-09-10T23:39:42.829671+0000","last_fullsized":"2024-09-10T23:39:42.829671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.958053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":127,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:01.423747+0000","last_change":"2024-09-10T23:38:10.209908+0000","last_active":"2024-09-10T23:40:01.423747+0000","last_peered":"2024-09-10T23:40:01.423747+0000","last_clean":"2024-09-10T23:40:01.423747+0000","last_became_active":"2024-09-10T23:38:10.208867+0000","last_became_peered":"2024-09-10T23:38:10.208867+0000","last_unstale":"2024-09-10T23:40:01.423747+0000","last_undegraded":"2024-09-10T23:40:01.423747+0000","last_fullsized":"2024-09-10T23:40:01.423747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:09.239123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836630+0000","last_change":"2024-09-10T23:38:12.224353+0000","last_active":"2024-09-10T23:39:42.836630+0000","last_peered":"2024-09-10T23:39:42.836630+0000","last_clean":"2024-09-10T23:39:42.836630+0000","last_became_active":"2024-09-10T23:38:12.223997+0000","last_became_peered":"2024-09-10T23:38:12.223997+0000","last_unstale":"2024-09-10T23:39:42.836630+0000","last_undegraded":"2024-09-10T23:39:42.836630+0000","last_fullsized":"2024-09-10T23:39:42.836630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:53.092794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091493+0000","last_change":"2024-09-10T23:38:10.207978+0000","last_active":"2024-09-10T23:38:44.091493+0000","last_peered":"2024-09-10T23:38:44.091493+0000","last_clean":"2024-09-10T23:38:44.091493+0000","last_became_active":"2024-09-10T23:38:10.207566+0000","last_became_peered":"2024-09-10T23:38:10.207566+0000","last_unstale":"2024-09-10T23:38:44.091493+0000","last_undegraded":"2024-09-10T23:38:44.091493+0000","last_fullsized":"2024-09-10T23:38:44.091493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:00.715005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835254+0000","last_change":"2024-09-10T23:38:43.538619+0000","last_active":"2024-09-10T23:39:42.835254+0000","last_peered":"2024-09-10T23:39:42.835254+0000","last_clean":"2024-09-10T23:39:42.835254+0000","last_became_active":"2024-09-10T23:38:43.537752+0000","last_became_peered":"2024-09-10T23:38:43.537752+0000","last_unstale":"2024-09-10T23:39:42.835254+0000","last_undegraded":"2024-09-10T23:39:42.835254+0000","last_fullsized":"2024-09-10T23:39:42.835254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:08.399537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537358+0000","last_change":"2024-09-10T23:38:10.257254+0000","last_active":"2024-09-10T23:38:43.537358+0000","last_peered":"2024-09-10T23:38:43.537358+0000","last_clean":"2024-09-10T23:38:43.537358+0000","last_became_active":"2024-09-10T23:38:10.256791+0000","last_became_peered":"2024-09-10T23:38:10.256791+0000","last_unstale":"2024-09-10T23:38:43.537358+0000","last_undegraded":"2024-09-10T23:38:43.537358+0000","last_fullsized":"2024-09-10T23:38:43.537358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:35.931873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840987+0000","last_change":"2024-09-10T23:38:12.229295+0000","last_active":"2024-09-10T23:39:42.840987+0000","last_peered":"2024-09-10T23:39:42.840987+0000","last_clean":"2024-09-10T23:39:42.840987+0000","last_became_active":"2024-09-10T23:38:12.228846+0000","last_became_peered":"2024-09-10T23:38:12.228846+0000","last_unstale":"2024-09-10T23:39:42.840987+0000","last_undegraded":"2024-09-10T23:39:42.840987+0000","last_fullsized":"2024-09-10T23:39:42.840987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:15.383624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'32","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:02.984349+0000","last_change":"2024-09-10T23:38:10.203362+0000","last_active":"2024-09-10T23:40:02.984349+0000","last_peered":"2024-09-10T23:40:02.984349+0000","last_clean":"2024-09-10T23:40:02.984349+0000","last_became_active":"2024-09-10T23:38:10.202961+0000","last_became_peered":"2024-09-10T23:38:10.202961+0000","last_unstale":"2024-09-10T23:40:02.984349+0000","last_undegraded":"2024-09-10T23:40:02.984349+0000","last_fullsized":"2024-09-10T23:40:02.984349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:33.580368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60904,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":163,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835801+0000","last_change":"2024-09-10T23:38:12.219094+0000","last_active":"2024-09-10T23:39:42.835801+0000","last_peered":"2024-09-10T23:39:42.835801+0000","last_clean":"2024-09-10T23:39:42.835801+0000","last_became_active":"2024-09-10T23:38:12.218778+0000","last_became_peered":"2024-09-10T23:38:12.218778+0000","last_unstale":"2024-09-10T23:39:42.835801+0000","last_undegraded":"2024-09-10T23:39:42.835801+0000","last_fullsized":"2024-09-10T23:39:42.835801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:59.019756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770789+0000","last_change":"2024-09-10T23:38:10.204204+0000","last_active":"2024-09-10T23:38:43.770789+0000","last_peered":"2024-09-10T23:38:43.770789+0000","last_clean":"2024-09-10T23:38:43.770789+0000","last_became_active":"2024-09-10T23:38:10.203662+0000","last_became_peered":"2024-09-10T23:38:10.203662+0000","last_unstale":"2024-09-10T23:38:43.770789+0000","last_undegraded":"2024-09-10T23:38:43.770789+0000","last_fullsized":"2024-09-10T23:38:43.770789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:44.243961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836597+0000","last_change":"2024-09-10T23:38:12.214337+0000","last_active":"2024-09-10T23:39:42.836597+0000","last_peered":"2024-09-10T23:39:42.836597+0000","last_clean":"2024-09-10T23:39:42.836597+0000","last_became_active":"2024-09-10T23:38:12.214024+0000","last_became_peered":"2024-09-10T23:38:12.214024+0000","last_unstale":"2024-09-10T23:39:42.836597+0000","last_undegraded":"2024-09-10T23:39:42.836597+0000","last_fullsized":"2024-09-10T23:39:42.836597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:19.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536668+0000","last_change":"2024-09-10T23:38:10.208001+0000","last_active":"2024-09-10T23:38:43.536668+0000","last_peered":"2024-09-10T23:38:43.536668+0000","last_clean":"2024-09-10T23:38:43.536668+0000","last_became_active":"2024-09-10T23:38:10.207656+0000","last_became_peered":"2024-09-10T23:38:10.207656+0000","last_unstale":"2024-09-10T23:38:43.536668+0000","last_undegraded":"2024-09-10T23:38:43.536668+0000","last_fullsized":"2024-09-10T23:38:43.536668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:44.679795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839998+0000","last_change":"2024-09-10T23:38:12.227780+0000","last_active":"2024-09-10T23:39:42.839998+0000","last_peered":"2024-09-10T23:39:42.839998+0000","last_clean":"2024-09-10T23:39:42.839998+0000","last_became_active":"2024-09-10T23:38:12.227404+0000","last_became_peered":"2024-09-10T23:38:12.227404+0000","last_unstale":"2024-09-10T23:39:42.839998+0000","last_undegraded":"2024-09-10T23:39:42.839998+0000","last_fullsized":"2024-09-10T23:39:42.839998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:58.453685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":135,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:04.428734+0000","last_change":"2024-09-10T23:38:10.214786+0000","last_active":"2024-09-10T23:40:04.428734+0000","last_peered":"2024-09-10T23:40:04.428734+0000","last_clean":"2024-09-10T23:40:04.428734+0000","last_became_active":"2024-09-10T23:38:10.214124+0000","last_became_peered":"2024-09-10T23:38:10.214124+0000","last_unstale":"2024-09-10T23:40:04.428734+0000","last_undegraded":"2024-09-10T23:40:04.428734+0000","last_fullsized":"2024-09-10T23:40:04.428734+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:00.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.838449+0000","last_change":"2024-09-10T23:38:12.220507+0000","last_active":"2024-09-10T23:39:42.838449+0000","last_peered":"2024-09-10T23:39:42.838449+0000","last_clean":"2024-09-10T23:39:42.838449+0000","last_became_active":"2024-09-10T23:38:12.220178+0000","last_became_peered":"2024-09-10T23:38:12.220178+0000","last_unstale":"2024-09-10T23:39:42.838449+0000","last_undegraded":"2024-09-10T23:39:42.838449+0000","last_fullsized":"2024-09-10T23:39:42.838449+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:57.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531867+0000","last_change":"2024-09-10T23:38:10.256166+0000","last_active":"2024-09-10T23:38:43.531867+0000","last_peered":"2024-09-10T23:38:43.531867+0000","last_clean":"2024-09-10T23:38:43.531867+0000","last_became_active":"2024-09-10T23:38:10.255792+0000","last_became_peered":"2024-09-10T23:38:10.255792+0000","last_unstale":"2024-09-10T23:38:43.531867+0000","last_undegraded":"2024-09-10T23:38:43.531867+0000","last_fullsized":"2024-09-10T23:38:43.531867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:44.621339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.822820+0000","last_change":"2024-09-10T23:38:12.225151+0000","last_active":"2024-09-10T23:39:42.822820+0000","last_peered":"2024-09-10T23:39:42.822820+0000","last_clean":"2024-09-10T23:39:42.822820+0000","last_became_active":"2024-09-10T23:38:12.224748+0000","last_became_peered":"2024-09-10T23:38:12.224748+0000","last_unstale":"2024-09-10T23:39:42.822820+0000","last_undegraded":"2024-09-10T23:39:42.822820+0000","last_fullsized":"2024-09-10T23:39:42.822820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.543098+0000","last_change":"2024-09-10T23:38:43.542616+0000","last_active":"2024-09-10T23:38:43.543098+0000","last_peered":"2024-09-10T23:38:43.543098+0000","last_clean":"2024-09-10T23:38:43.543098+0000","last_became_active":"2024-09-10T23:38:43.537936+0000","last_became_peered":"2024-09-10T23:38:43.537936+0000","last_unstale":"2024-09-10T23:38:43.543098+0000","last_undegraded":"2024-09-10T23:38:43.543098+0000","last_fullsized":"2024-09-10T23:38:43.543098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:31.390914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825391+0000","last_change":"2024-09-10T23:38:12.225417+0000","last_active":"2024-09-10T23:39:42.825391+0000","last_peered":"2024-09-10T23:39:42.825391+0000","last_clean":"2024-09-10T23:39:42.825391+0000","last_became_active":"2024-09-10T23:38:12.225129+0000","last_became_peered":"2024-09-10T23:38:12.225129+0000","last_unstale":"2024-09-10T23:39:42.825391+0000","last_undegraded":"2024-09-10T23:39:42.825391+0000","last_fullsized":"2024-09-10T23:39:42.825391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:42.935776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530992+0000","last_change":"2024-09-10T23:38:10.204942+0000","last_active":"2024-09-10T23:38:43.530992+0000","last_peered":"2024-09-10T23:38:43.530992+0000","last_clean":"2024-09-10T23:38:43.530992+0000","last_became_active":"2024-09-10T23:38:10.204568+0000","last_became_peered":"2024-09-10T23:38:10.204568+0000","last_unstale":"2024-09-10T23:38:43.530992+0000","last_undegraded":"2024-09-10T23:38:43.530992+0000","last_fullsized":"2024-09-10T23:38:43.530992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:00.608617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837848+0000","last_change":"2024-09-10T23:38:12.217411+0000","last_active":"2024-09-10T23:39:42.837848+0000","last_peered":"2024-09-10T23:39:42.837848+0000","last_clean":"2024-09-10T23:39:42.837848+0000","last_became_active":"2024-09-10T23:38:12.216998+0000","last_became_peered":"2024-09-10T23:38:12.216998+0000","last_unstale":"2024-09-10T23:39:42.837848+0000","last_undegraded":"2024-09-10T23:39:42.837848+0000","last_fullsized":"2024-09-10T23:39:42.837848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:12.852239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537386+0000","last_change":"2024-09-10T23:38:10.209596+0000","last_active":"2024-09-10T23:38:43.537386+0000","last_peered":"2024-09-10T23:38:43.537386+0000","last_clean":"2024-09-10T23:38:43.537386+0000","last_became_active":"2024-09-10T23:38:10.209348+0000","last_became_peered":"2024-09-10T23:38:10.209348+0000","last_unstale":"2024-09-10T23:38:43.537386+0000","last_undegraded":"2024-09-10T23:38:43.537386+0000","last_fullsized":"2024-09-10T23:38:43.537386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:30.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833587+0000","last_change":"2024-09-10T23:38:12.224071+0000","last_active":"2024-09-10T23:39:42.833587+0000","last_peered":"2024-09-10T23:39:42.833587+0000","last_clean":"2024-09-10T23:39:42.833587+0000","last_became_active":"2024-09-10T23:38:12.223773+0000","last_became_peered":"2024-09-10T23:38:12.223773+0000","last_unstale":"2024-09-10T23:39:42.833587+0000","last_undegraded":"2024-09-10T23:39:42.833587+0000","last_fullsized":"2024-09-10T23:39:42.833587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:43.412524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.771165+0000","last_change":"2024-09-10T23:38:10.300065+0000","last_active":"2024-09-10T23:38:43.771165+0000","last_peered":"2024-09-10T23:38:43.771165+0000","last_clean":"2024-09-10T23:38:43.771165+0000","last_became_active":"2024-09-10T23:38:10.299624+0000","last_became_peered":"2024-09-10T23:38:10.299624+0000","last_unstale":"2024-09-10T23:38:43.771165+0000","last_undegraded":"2024-09-10T23:38:43.771165+0000","last_fullsized":"2024-09-10T23:38:43.771165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:02.516651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840844+0000","last_change":"2024-09-10T23:38:12.222280+0000","last_active":"2024-09-10T23:39:42.840844+0000","last_peered":"2024-09-10T23:39:42.840844+0000","last_clean":"2024-09-10T23:39:42.840844+0000","last_became_active":"2024-09-10T23:38:12.221644+0000","last_became_peered":"2024-09-10T23:38:12.221644+0000","last_unstale":"2024-09-10T23:39:42.840844+0000","last_undegraded":"2024-09-10T23:39:42.840844+0000","last_fullsized":"2024-09-10T23:39:42.840844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.823629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091209+0000","last_change":"2024-09-10T23:36:58.824948+0000","last_active":"2024-09-10T23:38:44.091209+0000","last_peered":"2024-09-10T23:38:44.091209+0000","last_clean":"2024-09-10T23:38:44.091209+0000","last_became_active":"2024-09-10T23:36:58.819334+0000","last_became_peered":"2024-09-10T23:36:58.819334+0000","last_unstale":"2024-09-10T23:38:44.091209+0000","last_undegraded":"2024-09-10T23:38:44.091209+0000","last_fullsized":"2024-09-10T23:38:44.091209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_clean_scrub_stamp":"2024-09-10T23:33:36.806080+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:52.996301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536800+0000","last_change":"2024-09-10T23:38:10.215224+0000","last_active":"2024-09-10T23:38:43.536800+0000","last_peered":"2024-09-10T23:38:43.536800+0000","last_clean":"2024-09-10T23:38:43.536800+0000","last_became_active":"2024-09-10T23:38:10.214795+0000","last_became_peered":"2024-09-10T23:38:10.214795+0000","last_unstale":"2024-09-10T23:38:43.536800+0000","last_undegraded":"2024-09-10T23:38:43.536800+0000","last_fullsized":"2024-09-10T23:38:43.536800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:26.599793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840106+0000","last_change":"2024-09-10T23:38:43.538480+0000","last_active":"2024-09-10T23:39:42.840106+0000","last_peered":"2024-09-10T23:39:42.840106+0000","last_clean":"2024-09-10T23:39:42.840106+0000","last_became_active":"2024-09-10T23:38:43.538091+0000","last_became_peered":"2024-09-10T23:38:43.538091+0000","last_unstale":"2024-09-10T23:39:42.840106+0000","last_undegraded":"2024-09-10T23:39:42.840106+0000","last_fullsized":"2024-09-10T23:39:42.840106+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:40.890114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091042+0000","last_change":"2024-09-10T23:38:10.212748+0000","last_active":"2024-09-10T23:38:44.091042+0000","last_peered":"2024-09-10T23:38:44.091042+0000","last_clean":"2024-09-10T23:38:44.091042+0000","last_became_active":"2024-09-10T23:38:10.212427+0000","last_became_peered":"2024-09-10T23:38:10.212427+0000","last_unstale":"2024-09-10T23:38:44.091042+0000","last_undegraded":"2024-09-10T23:38:44.091042+0000","last_fullsized":"2024-09-10T23:38:44.091042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:23.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828706+0000","last_change":"2024-09-10T23:38:12.225178+0000","last_active":"2024-09-10T23:39:42.828706+0000","last_peered":"2024-09-10T23:39:42.828706+0000","last_clean":"2024-09-10T23:39:42.828706+0000","last_became_active":"2024-09-10T23:38:12.224860+0000","last_became_peered":"2024-09-10T23:38:12.224860+0000","last_unstale":"2024-09-10T23:39:42.828706+0000","last_undegraded":"2024-09-10T23:39:42.828706+0000","last_fullsized":"2024-09-10T23:39:42.828706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:10.986009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":127,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:00.421428+0000","last_change":"2024-09-10T23:38:10.254625+0000","last_active":"2024-09-10T23:40:00.421428+0000","last_peered":"2024-09-10T23:40:00.421428+0000","last_clean":"2024-09-10T23:40:00.421428+0000","last_became_active":"2024-09-10T23:38:10.254259+0000","last_became_peered":"2024-09-10T23:38:10.254259+0000","last_unstale":"2024-09-10T23:40:00.421428+0000","last_undegraded":"2024-09-10T23:40:00.421428+0000","last_fullsized":"2024-09-10T23:40:00.421428+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:46.371999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833004+0000","last_change":"2024-09-10T23:38:12.217168+0000","last_active":"2024-09-10T23:39:42.833004+0000","last_peered":"2024-09-10T23:39:42.833004+0000","last_clean":"2024-09-10T23:39:42.833004+0000","last_became_active":"2024-09-10T23:38:12.216814+0000","last_became_peered":"2024-09-10T23:38:12.216814+0000","last_unstale":"2024-09-10T23:39:42.833004+0000","last_undegraded":"2024-09-10T23:39:42.833004+0000","last_fullsized":"2024-09-10T23:39:42.833004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:41.494690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091293+0000","last_change":"2024-09-10T23:38:10.207456+0000","last_active":"2024-09-10T23:38:44.091293+0000","last_peered":"2024-09-10T23:38:44.091293+0000","last_clean":"2024-09-10T23:38:44.091293+0000","last_became_active":"2024-09-10T23:38:10.207079+0000","last_became_peered":"2024-09-10T23:38:10.207079+0000","last_unstale":"2024-09-10T23:38:44.091293+0000","last_undegraded":"2024-09-10T23:38:44.091293+0000","last_fullsized":"2024-09-10T23:38:44.091293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:14.631231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825830+0000","last_change":"2024-09-10T23:38:12.218306+0000","last_active":"2024-09-10T23:39:42.825830+0000","last_peered":"2024-09-10T23:39:42.825830+0000","last_clean":"2024-09-10T23:39:42.825830+0000","last_became_active":"2024-09-10T23:38:12.217981+0000","last_became_peered":"2024-09-10T23:38:12.217981+0000","last_unstale":"2024-09-10T23:39:42.825830+0000","last_undegraded":"2024-09-10T23:39:42.825830+0000","last_fullsized":"2024-09-10T23:39:42.825830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:31.745904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538159+0000","last_change":"2024-09-10T23:38:43.538061+0000","last_active":"2024-09-10T23:38:43.538159+0000","last_peered":"2024-09-10T23:38:43.538159+0000","last_clean":"2024-09-10T23:38:43.538159+0000","last_became_active":"2024-09-10T23:38:43.537582+0000","last_became_peered":"2024-09-10T23:38:43.537582+0000","last_unstale":"2024-09-10T23:38:43.538159+0000","last_undegraded":"2024-09-10T23:38:43.538159+0000","last_fullsized":"2024-09-10T23:38:43.538159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:15.083698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.818233+0000","last_change":"2024-09-10T23:38:12.214507+0000","last_active":"2024-09-10T23:39:42.818233+0000","last_peered":"2024-09-10T23:39:42.818233+0000","last_clean":"2024-09-10T23:39:42.818233+0000","last_became_active":"2024-09-10T23:38:12.214160+0000","last_became_peered":"2024-09-10T23:38:12.214160+0000","last_unstale":"2024-09-10T23:39:42.818233+0000","last_undegraded":"2024-09-10T23:39:42.818233+0000","last_fullsized":"2024-09-10T23:39:42.818233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:04.623624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532455+0000","last_change":"2024-09-10T23:38:10.256941+0000","last_active":"2024-09-10T23:38:43.532455+0000","last_peered":"2024-09-10T23:38:43.532455+0000","last_clean":"2024-09-10T23:38:43.532455+0000","last_became_active":"2024-09-10T23:38:10.256553+0000","last_became_peered":"2024-09-10T23:38:10.256553+0000","last_unstale":"2024-09-10T23:38:43.532455+0000","last_undegraded":"2024-09-10T23:38:43.532455+0000","last_fullsized":"2024-09-10T23:38:43.532455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:30.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828906+0000","last_change":"2024-09-10T23:38:12.221246+0000","last_active":"2024-09-10T23:39:42.828906+0000","last_peered":"2024-09-10T23:39:42.828906+0000","last_clean":"2024-09-10T23:39:42.828906+0000","last_became_active":"2024-09-10T23:38:12.220912+0000","last_became_peered":"2024-09-10T23:38:12.220912+0000","last_unstale":"2024-09-10T23:39:42.828906+0000","last_undegraded":"2024-09-10T23:39:42.828906+0000","last_fullsized":"2024-09-10T23:39:42.828906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:33.918289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'11","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534224+0000","last_change":"2024-09-10T23:38:10.210151+0000","last_active":"2024-09-10T23:38:43.534224+0000","last_peered":"2024-09-10T23:38:43.534224+0000","last_clean":"2024-09-10T23:38:43.534224+0000","last_became_active":"2024-09-10T23:38:10.209832+0000","last_became_peered":"2024-09-10T23:38:10.209832+0000","last_unstale":"2024-09-10T23:38:43.534224+0000","last_undegraded":"2024-09-10T23:38:43.534224+0000","last_fullsized":"2024-09-10T23:38:43.534224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:52.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835750+0000","last_change":"2024-09-10T23:38:12.218256+0000","last_active":"2024-09-10T23:39:42.835750+0000","last_peered":"2024-09-10T23:39:42.835750+0000","last_clean":"2024-09-10T23:39:42.835750+0000","last_became_active":"2024-09-10T23:38:12.217853+0000","last_became_peered":"2024-09-10T23:38:12.217853+0000","last_unstale":"2024-09-10T23:39:42.835750+0000","last_undegraded":"2024-09-10T23:39:42.835750+0000","last_fullsized":"2024-09-10T23:39:42.835750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537082+0000","last_change":"2024-09-10T23:38:10.300017+0000","last_active":"2024-09-10T23:38:43.537082+0000","last_peered":"2024-09-10T23:38:43.537082+0000","last_clean":"2024-09-10T23:38:43.537082+0000","last_became_active":"2024-09-10T23:38:10.299733+0000","last_became_peered":"2024-09-10T23:38:10.299733+0000","last_unstale":"2024-09-10T23:38:43.537082+0000","last_undegraded":"2024-09-10T23:38:43.537082+0000","last_fullsized":"2024-09-10T23:38:43.537082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.193043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832436+0000","last_change":"2024-09-10T23:38:12.212818+0000","last_active":"2024-09-10T23:39:42.832436+0000","last_peered":"2024-09-10T23:39:42.832436+0000","last_clean":"2024-09-10T23:39:42.832436+0000","last_became_active":"2024-09-10T23:38:12.212502+0000","last_became_peered":"2024-09-10T23:38:12.212502+0000","last_unstale":"2024-09-10T23:39:42.832436+0000","last_undegraded":"2024-09-10T23:39:42.832436+0000","last_fullsized":"2024-09-10T23:39:42.832436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:26.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531972+0000","last_change":"2024-09-10T23:38:10.256366+0000","last_active":"2024-09-10T23:38:43.531972+0000","last_peered":"2024-09-10T23:38:43.531972+0000","last_clean":"2024-09-10T23:38:43.531972+0000","last_became_active":"2024-09-10T23:38:10.256056+0000","last_became_peered":"2024-09-10T23:38:10.256056+0000","last_unstale":"2024-09-10T23:38:43.531972+0000","last_undegraded":"2024-09-10T23:38:43.531972+0000","last_fullsized":"2024-09-10T23:38:43.531972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:00.612373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.793751+0000","last_change":"2024-09-10T23:38:12.224629+0000","last_active":"2024-09-10T23:39:42.793751+0000","last_peered":"2024-09-10T23:39:42.793751+0000","last_clean":"2024-09-10T23:39:42.793751+0000","last_became_active":"2024-09-10T23:38:12.224018+0000","last_became_peered":"2024-09-10T23:38:12.224018+0000","last_unstale":"2024-09-10T23:39:42.793751+0000","last_undegraded":"2024-09-10T23:39:42.793751+0000","last_fullsized":"2024-09-10T23:39:42.793751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:44.067489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965400+0000","last_change":"2024-09-10T23:38:10.203395+0000","last_active":"2024-09-10T23:38:43.965400+0000","last_peered":"2024-09-10T23:38:43.965400+0000","last_clean":"2024-09-10T23:38:43.965400+0000","last_became_active":"2024-09-10T23:38:10.203067+0000","last_became_peered":"2024-09-10T23:38:10.203067+0000","last_unstale":"2024-09-10T23:38:43.965400+0000","last_undegraded":"2024-09-10T23:38:43.965400+0000","last_fullsized":"2024-09-10T23:38:43.965400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.398322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828373+0000","last_change":"2024-09-10T23:38:12.223207+0000","last_active":"2024-09-10T23:39:42.828373+0000","last_peered":"2024-09-10T23:39:42.828373+0000","last_clean":"2024-09-10T23:39:42.828373+0000","last_became_active":"2024-09-10T23:38:12.222841+0000","last_became_peered":"2024-09-10T23:38:12.222841+0000","last_unstale":"2024-09-10T23:39:42.828373+0000","last_undegraded":"2024-09-10T23:39:42.828373+0000","last_fullsized":"2024-09-10T23:39:42.828373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:26.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770702+0000","last_change":"2024-09-10T23:38:10.210479+0000","last_active":"2024-09-10T23:38:43.770702+0000","last_peered":"2024-09-10T23:38:43.770702+0000","last_clean":"2024-09-10T23:38:43.770702+0000","last_became_active":"2024-09-10T23:38:10.210124+0000","last_became_peered":"2024-09-10T23:38:10.210124+0000","last_unstale":"2024-09-10T23:38:43.770702+0000","last_undegraded":"2024-09-10T23:38:43.770702+0000","last_fullsized":"2024-09-10T23:38:43.770702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:39.017091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.816318+0000","last_change":"2024-09-10T23:38:12.214748+0000","last_active":"2024-09-10T23:39:42.816318+0000","last_peered":"2024-09-10T23:39:42.816318+0000","last_clean":"2024-09-10T23:39:42.816318+0000","last_became_active":"2024-09-10T23:38:12.214431+0000","last_became_peered":"2024-09-10T23:38:12.214431+0000","last_unstale":"2024-09-10T23:39:42.816318+0000","last_undegraded":"2024-09-10T23:39:42.816318+0000","last_fullsized":"2024-09-10T23:39:42.816318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:02.092876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532097+0000","last_change":"2024-09-10T23:38:10.214134+0000","last_active":"2024-09-10T23:38:43.532097+0000","last_peered":"2024-09-10T23:38:43.532097+0000","last_clean":"2024-09-10T23:38:43.532097+0000","last_became_active":"2024-09-10T23:38:10.213690+0000","last_became_peered":"2024-09-10T23:38:10.213690+0000","last_unstale":"2024-09-10T23:38:43.532097+0000","last_undegraded":"2024-09-10T23:38:43.532097+0000","last_fullsized":"2024-09-10T23:38:43.532097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:19.369755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840926+0000","last_change":"2024-09-10T23:38:12.218254+0000","last_active":"2024-09-10T23:39:42.840926+0000","last_peered":"2024-09-10T23:39:42.840926+0000","last_clean":"2024-09-10T23:39:42.840926+0000","last_became_active":"2024-09-10T23:38:12.217937+0000","last_became_peered":"2024-09-10T23:38:12.217937+0000","last_unstale":"2024-09-10T23:39:42.840926+0000","last_undegraded":"2024-09-10T23:39:42.840926+0000","last_fullsized":"2024-09-10T23:39:42.840926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:57.080088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840222+0000","last_change":"2024-09-10T23:38:43.537716+0000","last_active":"2024-09-10T23:39:42.840222+0000","last_peered":"2024-09-10T23:39:42.840222+0000","last_clean":"2024-09-10T23:39:42.840222+0000","last_became_active":"2024-09-10T23:38:43.537357+0000","last_became_peered":"2024-09-10T23:38:43.537357+0000","last_unstale":"2024-09-10T23:39:42.840222+0000","last_undegraded":"2024-09-10T23:39:42.840222+0000","last_fullsized":"2024-09-10T23:39:42.840222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:59.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532282+0000","last_change":"2024-09-10T23:38:10.215022+0000","last_active":"2024-09-10T23:38:43.532282+0000","last_peered":"2024-09-10T23:38:43.532282+0000","last_clean":"2024-09-10T23:38:43.532282+0000","last_became_active":"2024-09-10T23:38:10.214678+0000","last_became_peered":"2024-09-10T23:38:10.214678+0000","last_unstale":"2024-09-10T23:38:43.532282+0000","last_undegraded":"2024-09-10T23:38:43.532282+0000","last_fullsized":"2024-09-10T23:38:43.532282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:20.592052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841698+0000","last_change":"2024-09-10T23:38:12.230449+0000","last_active":"2024-09-10T23:39:42.841698+0000","last_peered":"2024-09-10T23:39:42.841698+0000","last_clean":"2024-09-10T23:39:42.841698+0000","last_became_active":"2024-09-10T23:38:12.228939+0000","last_became_peered":"2024-09-10T23:38:12.228939+0000","last_unstale":"2024-09-10T23:39:42.841698+0000","last_undegraded":"2024-09-10T23:39:42.841698+0000","last_fullsized":"2024-09-10T23:39:42.841698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:45.495207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532292+0000","last_change":"2024-09-10T23:38:10.209586+0000","last_active":"2024-09-10T23:38:43.532292+0000","last_peered":"2024-09-10T23:38:43.532292+0000","last_clean":"2024-09-10T23:38:43.532292+0000","last_became_active":"2024-09-10T23:38:10.209211+0000","last_became_peered":"2024-09-10T23:38:10.209211+0000","last_unstale":"2024-09-10T23:38:43.532292+0000","last_undegraded":"2024-09-10T23:38:43.532292+0000","last_fullsized":"2024-09-10T23:38:43.532292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:29.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832321+0000","last_change":"2024-09-10T23:38:12.219795+0000","last_active":"2024-09-10T23:39:42.832321+0000","last_peered":"2024-09-10T23:39:42.832321+0000","last_clean":"2024-09-10T23:39:42.832321+0000","last_became_active":"2024-09-10T23:38:12.219318+0000","last_became_peered":"2024-09-10T23:38:12.219318+0000","last_unstale":"2024-09-10T23:39:42.832321+0000","last_undegraded":"2024-09-10T23:39:42.832321+0000","last_fullsized":"2024-09-10T23:39:42.832321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:12.732264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965952+0000","last_change":"2024-09-10T23:38:10.255508+0000","last_active":"2024-09-10T23:38:43.965952+0000","last_peered":"2024-09-10T23:38:43.965952+0000","last_clean":"2024-09-10T23:38:43.965952+0000","last_became_active":"2024-09-10T23:38:10.255202+0000","last_became_peered":"2024-09-10T23:38:10.255202+0000","last_unstale":"2024-09-10T23:38:43.965952+0000","last_undegraded":"2024-09-10T23:38:43.965952+0000","last_fullsized":"2024-09-10T23:38:43.965952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:09.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823314+0000","last_change":"2024-09-10T23:38:12.222345+0000","last_active":"2024-09-10T23:39:42.823314+0000","last_peered":"2024-09-10T23:39:42.823314+0000","last_clean":"2024-09-10T23:39:42.823314+0000","last_became_active":"2024-09-10T23:38:12.220593+0000","last_became_peered":"2024-09-10T23:38:12.220593+0000","last_unstale":"2024-09-10T23:39:42.823314+0000","last_undegraded":"2024-09-10T23:39:42.823314+0000","last_fullsized":"2024-09-10T23:39:42.823314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:00.909046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534353+0000","last_change":"2024-09-10T23:38:10.210071+0000","last_active":"2024-09-10T23:38:43.534353+0000","last_peered":"2024-09-10T23:38:43.534353+0000","last_clean":"2024-09-10T23:38:43.534353+0000","last_became_active":"2024-09-10T23:38:10.209778+0000","last_became_peered":"2024-09-10T23:38:10.209778+0000","last_unstale":"2024-09-10T23:38:43.534353+0000","last_undegraded":"2024-09-10T23:38:43.534353+0000","last_fullsized":"2024-09-10T23:38:43.534353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:14.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65578,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":630,"num_read_kb":383,"num_write":172,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":196426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286063,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":417996,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1070583,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103214,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":418210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":418108,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":1010733,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":417599,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":1009885,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":418568,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417910,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":480178,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":477988,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":418870,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:40:07.604 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T23:40:07.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:40:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/3728464929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a0103aa0 msgr2=0x7fc6a0103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/3728464929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a0103aa0 0x7fc6a0103e80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc690009ca0 tx=0x7fc69002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/3728464929 shutdown_connections 2024-09-10T23:40:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/3728464929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a010d050 0x7fc6a010f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/3728464929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6a01044a0 0x7fc6a010ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/3728464929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a0103aa0 0x7fc6a0103e80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/3728464929 >> 172.21.15.16:0/3728464929 conn(0x7fc6a00fd610 msgr2=0x7fc6a00ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/3728464929 shutdown_connections 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/3728464929 wait complete. 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.743+0000 7fc6a5a9b640 1 Processor -- start 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc6a5a9b640 1 -- start start 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc6a5a9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0103aa0 0x7fc6a0101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc6a5a9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6a01044a0 0x7fc6a0101e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc6a5a9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a010d050 0x7fc6a01023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc6a5a9b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0112ce0 con 0x7fc6a010d050 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc6a5a9b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0112b60 con 0x7fc6a01044a0 2024-09-10T23:40:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc6a5a9b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0112e60 con 0x7fc6a0103aa0 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a010d050 0x7fc6a01023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a010d050 0x7fc6a01023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47366/0 (socket says 172.21.15.16:47366) 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 -- 172.21.15.16:0/1365470720 learned_addr learned my addr 172.21.15.16:0/1365470720 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69f7fe640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0103aa0 0x7fc6a0101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69effd640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6a01044a0 0x7fc6a0101e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 -- 172.21.15.16:0/1365470720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0103aa0 msgr2=0x7fc6a0101920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0103aa0 0x7fc6a0101920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 -- 172.21.15.16:0/1365470720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6a01044a0 msgr2=0x7fc6a0101e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6a01044a0 0x7fc6a0101e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 -- 172.21.15.16:0/1365470720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a01a7650 con 0x7fc6a010d050 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.744+0000 7fc69ffff640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a010d050 0x7fc6a01023a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc69800d750 tx=0x7fc69800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.745+0000 7fc69cff9640 1 -- 172.21.15.16:0/1365470720 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698017070 con 0x7fc6a010d050 2024-09-10T23:40:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.745+0000 7fc69cff9640 1 -- 172.21.15.16:0/1365470720 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6980054d0 con 0x7fc6a010d050 2024-09-10T23:40:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.745+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a01a7940 con 0x7fc6a010d050 2024-09-10T23:40:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.745+0000 7fc69cff9640 1 -- 172.21.15.16:0/1365470720 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698004c60 con 0x7fc6a010d050 2024-09-10T23:40:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.745+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a01a7ee0 con 0x7fc6a010d050 2024-09-10T23:40:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.746+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a0103e80 con 0x7fc6a010d050 2024-09-10T23:40:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.747+0000 7fc69cff9640 1 -- 172.21.15.16:0/1365470720 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fc698004e00 con 0x7fc6a010d050 2024-09-10T23:40:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.749+0000 7fc69cff9640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6880b53b0 0x7fc6880b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.749+0000 7fc69f7fe640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6880b53b0 0x7fc6880b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.749+0000 7fc69cff9640 1 -- 172.21.15.16:0/1365470720 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc6980e5ab0 con 0x7fc6a010d050 2024-09-10T23:40:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.749+0000 7fc69f7fe640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6880b53b0 0x7fc6880b7870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc690000f80 tx=0x7fc690005ef0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:07.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.751+0000 7fc69cff9640 1 -- 172.21.15.16:0/1365470720 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc6980ac930 con 0x7fc6a010d050 2024-09-10T23:40:07.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.936+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6a0063590 con 0x7fc6880b53b0 2024-09-10T23:40:07.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.940+0000 7fc69cff9640 1 -- 172.21.15.16:0/1365470720 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259071 (secure 0 0 0) 0x7fc6a0063590 con 0x7fc6880b53b0 2024-09-10T23:40:07.943 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:07.945 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-10T23:40:07.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6880b53b0 msgr2=0x7fc6880b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6880b53b0 0x7fc6880b7870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc690000f80 tx=0x7fc690005ef0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a010d050 msgr2=0x7fc6a01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a010d050 0x7fc6a01023a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc69800d750 tx=0x7fc69800dc10 comp rx=0 tx=0).stop 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 shutdown_connections 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6a010d050 0x7fc6a01023a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6880b53b0 0x7fc6880b7870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6a01044a0 0x7fc6a0101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 --2- 172.21.15.16:0/1365470720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6a0103aa0 0x7fc6a0101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 >> 172.21.15.16:0/1365470720 conn(0x7fc6a00fd610 msgr2=0x7fc6a00fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 shutdown_connections 2024-09-10T23:40:07.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:07.943+0000 7fc6a5a9b640 1 -- 172.21.15.16:0/1365470720 wait complete. 2024-09-10T23:40:07.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:07 smithi016 ceph-mon[30855]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:40:07.954 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:07 smithi016 ceph-mon[30855]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:07.955 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-10T23:40:06.447649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656180,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":711,"num_read_kb":452,"num_write":297,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384528,"kb_used_data":10320,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124557296,"statfs":{"total":1151940427776,"available":1151546671104,"internally_reserved":0,"allocated":10567680,"data_stored":6976628,"data_compressed":178827,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002699"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841669+0000","last_change":"2024-09-10T23:38:12.217637+0000","last_active":"2024-09-10T23:39:42.841669+0000","last_peered":"2024-09-10T23:39:42.841669+0000","last_clean":"2024-09-10T23:39:42.841669+0000","last_became_active":"2024-09-10T23:38:12.217260+0000","last_became_peered":"2024-09-10T23:38:12.217260+0000","last_unstale":"2024-09-10T23:39:42.841669+0000","last_undegraded":"2024-09-10T23:39:42.841669+0000","last_fullsized":"2024-09-10T23:39:42.841669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.774575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.831938+0000","last_change":"2024-09-10T23:38:12.217114+0000","last_active":"2024-09-10T23:39:42.831938+0000","last_peered":"2024-09-10T23:39:42.831938+0000","last_clean":"2024-09-10T23:39:42.831938+0000","last_became_active":"2024-09-10T23:38:12.216836+0000","last_became_peered":"2024-09-10T23:38:12.216836+0000","last_unstale":"2024-09-10T23:39:42.831938+0000","last_undegraded":"2024-09-10T23:39:42.831938+0000","last_fullsized":"2024-09-10T23:39:42.831938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:55.023668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835068+0000","last_change":"2024-09-10T23:38:12.219046+0000","last_active":"2024-09-10T23:39:42.835068+0000","last_peered":"2024-09-10T23:39:42.835068+0000","last_clean":"2024-09-10T23:39:42.835068+0000","last_became_active":"2024-09-10T23:38:12.218348+0000","last_became_peered":"2024-09-10T23:38:12.218348+0000","last_unstale":"2024-09-10T23:39:42.835068+0000","last_undegraded":"2024-09-10T23:39:42.835068+0000","last_fullsized":"2024-09-10T23:39:42.835068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:07.419364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828772+0000","last_change":"2024-09-10T23:38:12.219211+0000","last_active":"2024-09-10T23:39:42.828772+0000","last_peered":"2024-09-10T23:39:42.828772+0000","last_clean":"2024-09-10T23:39:42.828772+0000","last_became_active":"2024-09-10T23:38:12.213452+0000","last_became_peered":"2024-09-10T23:38:12.213452+0000","last_unstale":"2024-09-10T23:39:42.828772+0000","last_undegraded":"2024-09-10T23:39:42.828772+0000","last_fullsized":"2024-09-10T23:39:42.828772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:59.819154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823728+0000","last_change":"2024-09-10T23:38:12.213636+0000","last_active":"2024-09-10T23:39:42.823728+0000","last_peered":"2024-09-10T23:39:42.823728+0000","last_clean":"2024-09-10T23:39:42.823728+0000","last_became_active":"2024-09-10T23:38:12.213309+0000","last_became_peered":"2024-09-10T23:38:12.213309+0000","last_unstale":"2024-09-10T23:39:42.823728+0000","last_undegraded":"2024-09-10T23:39:42.823728+0000","last_fullsized":"2024-09-10T23:39:42.823728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:34.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825688+0000","last_change":"2024-09-10T23:38:12.215995+0000","last_active":"2024-09-10T23:39:42.825688+0000","last_peered":"2024-09-10T23:39:42.825688+0000","last_clean":"2024-09-10T23:39:42.825688+0000","last_became_active":"2024-09-10T23:38:12.215601+0000","last_became_peered":"2024-09-10T23:38:12.215601+0000","last_unstale":"2024-09-10T23:39:42.825688+0000","last_undegraded":"2024-09-10T23:39:42.825688+0000","last_fullsized":"2024-09-10T23:39:42.825688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:24.770551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836251+0000","last_change":"2024-09-10T23:38:12.226337+0000","last_active":"2024-09-10T23:39:42.836251+0000","last_peered":"2024-09-10T23:39:42.836251+0000","last_clean":"2024-09-10T23:39:42.836251+0000","last_became_active":"2024-09-10T23:38:12.225953+0000","last_became_peered":"2024-09-10T23:38:12.225953+0000","last_unstale":"2024-09-10T23:39:42.836251+0000","last_undegraded":"2024-09-10T23:39:42.836251+0000","last_fullsized":"2024-09-10T23:39:42.836251+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:27.044867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.824994+0000","last_change":"2024-09-10T23:38:12.219682+0000","last_active":"2024-09-10T23:39:42.824994+0000","last_peered":"2024-09-10T23:39:42.824994+0000","last_clean":"2024-09-10T23:39:42.824994+0000","last_became_active":"2024-09-10T23:38:12.218596+0000","last_became_peered":"2024-09-10T23:38:12.218596+0000","last_unstale":"2024-09-10T23:39:42.824994+0000","last_undegraded":"2024-09-10T23:39:42.824994+0000","last_fullsized":"2024-09-10T23:39:42.824994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:33.011117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840934+0000","last_change":"2024-09-10T23:38:12.223114+0000","last_active":"2024-09-10T23:39:42.840934+0000","last_peered":"2024-09-10T23:39:42.840934+0000","last_clean":"2024-09-10T23:39:42.840934+0000","last_became_active":"2024-09-10T23:38:12.222748+0000","last_became_peered":"2024-09-10T23:38:12.222748+0000","last_unstale":"2024-09-10T23:39:42.840934+0000","last_undegraded":"2024-09-10T23:39:42.840934+0000","last_fullsized":"2024-09-10T23:39:42.840934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:38.384821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835460+0000","last_change":"2024-09-10T23:38:12.225061+0000","last_active":"2024-09-10T23:39:42.835460+0000","last_peered":"2024-09-10T23:39:42.835460+0000","last_clean":"2024-09-10T23:39:42.835460+0000","last_became_active":"2024-09-10T23:38:12.224730+0000","last_became_peered":"2024-09-10T23:38:12.224730+0000","last_unstale":"2024-09-10T23:39:42.835460+0000","last_undegraded":"2024-09-10T23:39:42.835460+0000","last_fullsized":"2024-09-10T23:39:42.835460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:40.343294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840365+0000","last_change":"2024-09-10T23:38:12.219920+0000","last_active":"2024-09-10T23:39:42.840365+0000","last_peered":"2024-09-10T23:39:42.840365+0000","last_clean":"2024-09-10T23:39:42.840365+0000","last_became_active":"2024-09-10T23:38:12.219517+0000","last_became_peered":"2024-09-10T23:38:12.219517+0000","last_unstale":"2024-09-10T23:39:42.840365+0000","last_undegraded":"2024-09-10T23:39:42.840365+0000","last_fullsized":"2024-09-10T23:39:42.840365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:58.686977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828097+0000","last_change":"2024-09-10T23:38:12.219740+0000","last_active":"2024-09-10T23:39:42.828097+0000","last_peered":"2024-09-10T23:39:42.828097+0000","last_clean":"2024-09-10T23:39:42.828097+0000","last_became_active":"2024-09-10T23:38:12.215497+0000","last_became_peered":"2024-09-10T23:38:12.215497+0000","last_unstale":"2024-09-10T23:39:42.828097+0000","last_undegraded":"2024-09-10T23:39:42.828097+0000","last_fullsized":"2024-09-10T23:39:42.828097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:06.503836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.826375+0000","last_change":"2024-09-10T23:38:12.217066+0000","last_active":"2024-09-10T23:39:42.826375+0000","last_peered":"2024-09-10T23:39:42.826375+0000","last_clean":"2024-09-10T23:39:42.826375+0000","last_became_active":"2024-09-10T23:38:12.216758+0000","last_became_peered":"2024-09-10T23:38:12.216758+0000","last_unstale":"2024-09-10T23:39:42.826375+0000","last_undegraded":"2024-09-10T23:39:42.826375+0000","last_fullsized":"2024-09-10T23:39:42.826375+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:53.151946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833516+0000","last_change":"2024-09-10T23:38:12.216584+0000","last_active":"2024-09-10T23:39:42.833516+0000","last_peered":"2024-09-10T23:39:42.833516+0000","last_clean":"2024-09-10T23:39:42.833516+0000","last_became_active":"2024-09-10T23:38:12.216296+0000","last_became_peered":"2024-09-10T23:38:12.216296+0000","last_unstale":"2024-09-10T23:39:42.833516+0000","last_undegraded":"2024-09-10T23:39:42.833516+0000","last_fullsized":"2024-09-10T23:39:42.833516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:11.171984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834463+0000","last_change":"2024-09-10T23:38:43.772225+0000","last_active":"2024-09-10T23:39:42.834463+0000","last_peered":"2024-09-10T23:39:42.834463+0000","last_clean":"2024-09-10T23:39:42.834463+0000","last_became_active":"2024-09-10T23:38:43.771855+0000","last_became_peered":"2024-09-10T23:38:43.771855+0000","last_unstale":"2024-09-10T23:39:42.834463+0000","last_undegraded":"2024-09-10T23:39:42.834463+0000","last_fullsized":"2024-09-10T23:39:42.834463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:14.454340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837082+0000","last_change":"2024-09-10T23:38:12.229957+0000","last_active":"2024-09-10T23:39:42.837082+0000","last_peered":"2024-09-10T23:39:42.837082+0000","last_clean":"2024-09-10T23:39:42.837082+0000","last_became_active":"2024-09-10T23:38:12.229297+0000","last_became_peered":"2024-09-10T23:38:12.229297+0000","last_unstale":"2024-09-10T23:39:42.837082+0000","last_undegraded":"2024-09-10T23:39:42.837082+0000","last_fullsized":"2024-09-10T23:39:42.837082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:54.119455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841682+0000","last_change":"2024-09-10T23:38:12.218345+0000","last_active":"2024-09-10T23:39:42.841682+0000","last_peered":"2024-09-10T23:39:42.841682+0000","last_clean":"2024-09-10T23:39:42.841682+0000","last_became_active":"2024-09-10T23:38:12.218060+0000","last_became_peered":"2024-09-10T23:38:12.218060+0000","last_unstale":"2024-09-10T23:39:42.841682+0000","last_undegraded":"2024-09-10T23:39:42.841682+0000","last_fullsized":"2024-09-10T23:39:42.841682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:00.912757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839948+0000","last_change":"2024-09-10T23:38:12.215025+0000","last_active":"2024-09-10T23:39:42.839948+0000","last_peered":"2024-09-10T23:39:42.839948+0000","last_clean":"2024-09-10T23:39:42.839948+0000","last_became_active":"2024-09-10T23:38:12.214709+0000","last_became_peered":"2024-09-10T23:38:12.214709+0000","last_unstale":"2024-09-10T23:39:42.839948+0000","last_undegraded":"2024-09-10T23:39:42.839948+0000","last_fullsized":"2024-09-10T23:39:42.839948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:00.925426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.831755+0000","last_change":"2024-09-10T23:38:12.215536+0000","last_active":"2024-09-10T23:39:42.831755+0000","last_peered":"2024-09-10T23:39:42.831755+0000","last_clean":"2024-09-10T23:39:42.831755+0000","last_became_active":"2024-09-10T23:38:12.214991+0000","last_became_peered":"2024-09-10T23:38:12.214991+0000","last_unstale":"2024-09-10T23:39:42.831755+0000","last_undegraded":"2024-09-10T23:39:42.831755+0000","last_fullsized":"2024-09-10T23:39:42.831755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:20.059276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823917+0000","last_change":"2024-09-10T23:38:12.224919+0000","last_active":"2024-09-10T23:39:42.823917+0000","last_peered":"2024-09-10T23:39:42.823917+0000","last_clean":"2024-09-10T23:39:42.823917+0000","last_became_active":"2024-09-10T23:38:12.224559+0000","last_became_peered":"2024-09-10T23:38:12.224559+0000","last_unstale":"2024-09-10T23:39:42.823917+0000","last_undegraded":"2024-09-10T23:39:42.823917+0000","last_fullsized":"2024-09-10T23:39:42.823917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:23.373211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837096+0000","last_change":"2024-09-10T23:38:12.216995+0000","last_active":"2024-09-10T23:39:42.837096+0000","last_peered":"2024-09-10T23:39:42.837096+0000","last_clean":"2024-09-10T23:39:42.837096+0000","last_became_active":"2024-09-10T23:38:12.216681+0000","last_became_peered":"2024-09-10T23:38:12.216681+0000","last_unstale":"2024-09-10T23:39:42.837096+0000","last_undegraded":"2024-09-10T23:39:42.837096+0000","last_fullsized":"2024-09-10T23:39:42.837096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:37.987912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839956+0000","last_change":"2024-09-10T23:38:12.221618+0000","last_active":"2024-09-10T23:39:42.839956+0000","last_peered":"2024-09-10T23:39:42.839956+0000","last_clean":"2024-09-10T23:39:42.839956+0000","last_became_active":"2024-09-10T23:38:12.219352+0000","last_became_peered":"2024-09-10T23:38:12.219352+0000","last_unstale":"2024-09-10T23:39:42.839956+0000","last_undegraded":"2024-09-10T23:39:42.839956+0000","last_fullsized":"2024-09-10T23:39:42.839956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:48.604432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828289+0000","last_change":"2024-09-10T23:38:12.221530+0000","last_active":"2024-09-10T23:39:42.828289+0000","last_peered":"2024-09-10T23:39:42.828289+0000","last_clean":"2024-09-10T23:39:42.828289+0000","last_became_active":"2024-09-10T23:38:12.221024+0000","last_became_peered":"2024-09-10T23:38:12.221024+0000","last_unstale":"2024-09-10T23:39:42.828289+0000","last_undegraded":"2024-09-10T23:39:42.828289+0000","last_fullsized":"2024-09-10T23:39:42.828289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:34.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.821792+0000","last_change":"2024-09-10T23:38:12.219990+0000","last_active":"2024-09-10T23:39:42.821792+0000","last_peered":"2024-09-10T23:39:42.821792+0000","last_clean":"2024-09-10T23:39:42.821792+0000","last_became_active":"2024-09-10T23:38:12.219560+0000","last_became_peered":"2024-09-10T23:38:12.219560+0000","last_unstale":"2024-09-10T23:39:42.821792+0000","last_undegraded":"2024-09-10T23:39:42.821792+0000","last_fullsized":"2024-09-10T23:39:42.821792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:28.112467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.822901+0000","last_change":"2024-09-10T23:38:12.225753+0000","last_active":"2024-09-10T23:39:42.822901+0000","last_peered":"2024-09-10T23:39:42.822901+0000","last_clean":"2024-09-10T23:39:42.822901+0000","last_became_active":"2024-09-10T23:38:12.225450+0000","last_became_peered":"2024-09-10T23:38:12.225450+0000","last_unstale":"2024-09-10T23:39:42.822901+0000","last_undegraded":"2024-09-10T23:39:42.822901+0000","last_fullsized":"2024-09-10T23:39:42.822901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:23.478611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828425+0000","last_change":"2024-09-10T23:38:12.216917+0000","last_active":"2024-09-10T23:39:42.828425+0000","last_peered":"2024-09-10T23:39:42.828425+0000","last_clean":"2024-09-10T23:39:42.828425+0000","last_became_active":"2024-09-10T23:38:12.216528+0000","last_became_peered":"2024-09-10T23:38:12.216528+0000","last_unstale":"2024-09-10T23:39:42.828425+0000","last_undegraded":"2024-09-10T23:39:42.828425+0000","last_fullsized":"2024-09-10T23:39:42.828425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:03.902221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825120+0000","last_change":"2024-09-10T23:38:12.219372+0000","last_active":"2024-09-10T23:39:42.825120+0000","last_peered":"2024-09-10T23:39:42.825120+0000","last_clean":"2024-09-10T23:39:42.825120+0000","last_became_active":"2024-09-10T23:38:12.219072+0000","last_became_peered":"2024-09-10T23:38:12.219072+0000","last_unstale":"2024-09-10T23:39:42.825120+0000","last_undegraded":"2024-09-10T23:39:42.825120+0000","last_fullsized":"2024-09-10T23:39:42.825120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:07.842833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834730+0000","last_change":"2024-09-10T23:38:12.224716+0000","last_active":"2024-09-10T23:39:42.834730+0000","last_peered":"2024-09-10T23:39:42.834730+0000","last_clean":"2024-09-10T23:39:42.834730+0000","last_became_active":"2024-09-10T23:38:12.224393+0000","last_became_peered":"2024-09-10T23:38:12.224393+0000","last_unstale":"2024-09-10T23:39:42.834730+0000","last_undegraded":"2024-09-10T23:39:42.834730+0000","last_fullsized":"2024-09-10T23:39:42.834730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.995098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836203+0000","last_change":"2024-09-10T23:38:44.092446+0000","last_active":"2024-09-10T23:39:42.836203+0000","last_peered":"2024-09-10T23:39:42.836203+0000","last_clean":"2024-09-10T23:39:42.836203+0000","last_became_active":"2024-09-10T23:38:44.092027+0000","last_became_peered":"2024-09-10T23:38:44.092027+0000","last_unstale":"2024-09-10T23:39:42.836203+0000","last_undegraded":"2024-09-10T23:39:42.836203+0000","last_fullsized":"2024-09-10T23:39:42.836203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.804237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.834694+0000","last_change":"2024-09-10T23:38:12.214278+0000","last_active":"2024-09-10T23:39:42.834694+0000","last_peered":"2024-09-10T23:39:42.834694+0000","last_clean":"2024-09-10T23:39:42.834694+0000","last_became_active":"2024-09-10T23:38:12.212079+0000","last_became_peered":"2024-09-10T23:38:12.212079+0000","last_unstale":"2024-09-10T23:39:42.834694+0000","last_undegraded":"2024-09-10T23:39:42.834694+0000","last_fullsized":"2024-09-10T23:39:42.834694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:42.716718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833730+0000","last_change":"2024-09-10T23:38:12.214703+0000","last_active":"2024-09-10T23:39:42.833730+0000","last_peered":"2024-09-10T23:39:42.833730+0000","last_clean":"2024-09-10T23:39:42.833730+0000","last_became_active":"2024-09-10T23:38:12.214353+0000","last_became_peered":"2024-09-10T23:38:12.214353+0000","last_unstale":"2024-09-10T23:39:42.833730+0000","last_undegraded":"2024-09-10T23:39:42.833730+0000","last_fullsized":"2024-09-10T23:39:42.833730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:59.004904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832133+0000","last_change":"2024-09-10T23:38:12.223462+0000","last_active":"2024-09-10T23:39:42.832133+0000","last_peered":"2024-09-10T23:39:42.832133+0000","last_clean":"2024-09-10T23:39:42.832133+0000","last_became_active":"2024-09-10T23:38:12.223159+0000","last_became_peered":"2024-09-10T23:38:12.223159+0000","last_unstale":"2024-09-10T23:39:42.832133+0000","last_undegraded":"2024-09-10T23:39:42.832133+0000","last_fullsized":"2024-09-10T23:39:42.832133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:26.587560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.818551+0000","last_change":"2024-09-10T23:38:12.213290+0000","last_active":"2024-09-10T23:39:42.818551+0000","last_peered":"2024-09-10T23:39:42.818551+0000","last_clean":"2024-09-10T23:39:42.818551+0000","last_became_active":"2024-09-10T23:38:12.212999+0000","last_became_peered":"2024-09-10T23:38:12.212999+0000","last_unstale":"2024-09-10T23:39:42.818551+0000","last_undegraded":"2024-09-10T23:39:42.818551+0000","last_fullsized":"2024-09-10T23:39:42.818551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:54.448436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'7","reported_seq":133,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:00.422876+0000","last_change":"2024-09-10T23:38:10.210483+0000","last_active":"2024-09-10T23:40:00.422876+0000","last_peered":"2024-09-10T23:40:00.422876+0000","last_clean":"2024-09-10T23:40:00.422876+0000","last_became_active":"2024-09-10T23:38:10.210108+0000","last_became_peered":"2024-09-10T23:38:10.210108+0000","last_unstale":"2024-09-10T23:40:00.422876+0000","last_undegraded":"2024-09-10T23:40:00.422876+0000","last_fullsized":"2024-09-10T23:40:00.422876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:33.370496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.826119+0000","last_change":"2024-09-10T23:38:43.966800+0000","last_active":"2024-09-10T23:39:42.826119+0000","last_peered":"2024-09-10T23:39:42.826119+0000","last_clean":"2024-09-10T23:39:42.826119+0000","last_became_active":"2024-09-10T23:38:43.966274+0000","last_became_peered":"2024-09-10T23:38:43.966274+0000","last_unstale":"2024-09-10T23:39:42.826119+0000","last_undegraded":"2024-09-10T23:39:42.826119+0000","last_fullsized":"2024-09-10T23:39:42.826119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:02.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.024529+0000","last_change":"2024-09-10T23:38:10.210875+0000","last_active":"2024-09-10T23:38:44.024529+0000","last_peered":"2024-09-10T23:38:44.024529+0000","last_clean":"2024-09-10T23:38:44.024529+0000","last_became_active":"2024-09-10T23:38:10.209254+0000","last_became_peered":"2024-09-10T23:38:10.209254+0000","last_unstale":"2024-09-10T23:38:44.024529+0000","last_undegraded":"2024-09-10T23:38:44.024529+0000","last_fullsized":"2024-09-10T23:38:44.024529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:21.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530747+0000","last_change":"2024-09-10T23:38:10.213483+0000","last_active":"2024-09-10T23:38:43.530747+0000","last_peered":"2024-09-10T23:38:43.530747+0000","last_clean":"2024-09-10T23:38:43.530747+0000","last_became_active":"2024-09-10T23:38:10.213109+0000","last_became_peered":"2024-09-10T23:38:10.213109+0000","last_unstale":"2024-09-10T23:38:43.530747+0000","last_undegraded":"2024-09-10T23:38:43.530747+0000","last_fullsized":"2024-09-10T23:38:43.530747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:03.563548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.827193+0000","last_change":"2024-09-10T23:38:12.217136+0000","last_active":"2024-09-10T23:39:42.827193+0000","last_peered":"2024-09-10T23:39:42.827193+0000","last_clean":"2024-09-10T23:39:42.827193+0000","last_became_active":"2024-09-10T23:38:12.216813+0000","last_became_peered":"2024-09-10T23:38:12.216813+0000","last_unstale":"2024-09-10T23:39:42.827193+0000","last_undegraded":"2024-09-10T23:39:42.827193+0000","last_fullsized":"2024-09-10T23:39:42.827193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:26.184575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536951+0000","last_change":"2024-09-10T23:38:10.209109+0000","last_active":"2024-09-10T23:38:43.536951+0000","last_peered":"2024-09-10T23:38:43.536951+0000","last_clean":"2024-09-10T23:38:43.536951+0000","last_became_active":"2024-09-10T23:38:10.208450+0000","last_became_peered":"2024-09-10T23:38:10.208450+0000","last_unstale":"2024-09-10T23:38:43.536951+0000","last_undegraded":"2024-09-10T23:38:43.536951+0000","last_fullsized":"2024-09-10T23:38:43.536951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:29.453119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.829671+0000","last_change":"2024-09-10T23:38:12.213755+0000","last_active":"2024-09-10T23:39:42.829671+0000","last_peered":"2024-09-10T23:39:42.829671+0000","last_clean":"2024-09-10T23:39:42.829671+0000","last_became_active":"2024-09-10T23:38:12.213454+0000","last_became_peered":"2024-09-10T23:38:12.213454+0000","last_unstale":"2024-09-10T23:39:42.829671+0000","last_undegraded":"2024-09-10T23:39:42.829671+0000","last_fullsized":"2024-09-10T23:39:42.829671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.958053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":127,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:01.423747+0000","last_change":"2024-09-10T23:38:10.209908+0000","last_active":"2024-09-10T23:40:01.423747+0000","last_peered":"2024-09-10T23:40:01.423747+0000","last_clean":"2024-09-10T23:40:01.423747+0000","last_became_active":"2024-09-10T23:38:10.208867+0000","last_became_peered":"2024-09-10T23:38:10.208867+0000","last_unstale":"2024-09-10T23:40:01.423747+0000","last_undegraded":"2024-09-10T23:40:01.423747+0000","last_fullsized":"2024-09-10T23:40:01.423747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:09.239123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836630+0000","last_change":"2024-09-10T23:38:12.224353+0000","last_active":"2024-09-10T23:39:42.836630+0000","last_peered":"2024-09-10T23:39:42.836630+0000","last_clean":"2024-09-10T23:39:42.836630+0000","last_became_active":"2024-09-10T23:38:12.223997+0000","last_became_peered":"2024-09-10T23:38:12.223997+0000","last_unstale":"2024-09-10T23:39:42.836630+0000","last_undegraded":"2024-09-10T23:39:42.836630+0000","last_fullsized":"2024-09-10T23:39:42.836630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:53.092794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091493+0000","last_change":"2024-09-10T23:38:10.207978+0000","last_active":"2024-09-10T23:38:44.091493+0000","last_peered":"2024-09-10T23:38:44.091493+0000","last_clean":"2024-09-10T23:38:44.091493+0000","last_became_active":"2024-09-10T23:38:10.207566+0000","last_became_peered":"2024-09-10T23:38:10.207566+0000","last_unstale":"2024-09-10T23:38:44.091493+0000","last_undegraded":"2024-09-10T23:38:44.091493+0000","last_fullsized":"2024-09-10T23:38:44.091493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:27:00.715005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835254+0000","last_change":"2024-09-10T23:38:43.538619+0000","last_active":"2024-09-10T23:39:42.835254+0000","last_peered":"2024-09-10T23:39:42.835254+0000","last_clean":"2024-09-10T23:39:42.835254+0000","last_became_active":"2024-09-10T23:38:43.537752+0000","last_became_peered":"2024-09-10T23:38:43.537752+0000","last_unstale":"2024-09-10T23:39:42.835254+0000","last_undegraded":"2024-09-10T23:39:42.835254+0000","last_fullsized":"2024-09-10T23:39:42.835254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:08.399537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537358+0000","last_change":"2024-09-10T23:38:10.257254+0000","last_active":"2024-09-10T23:38:43.537358+0000","last_peered":"2024-09-10T23:38:43.537358+0000","last_clean":"2024-09-10T23:38:43.537358+0000","last_became_active":"2024-09-10T23:38:10.256791+0000","last_became_peered":"2024-09-10T23:38:10.256791+0000","last_unstale":"2024-09-10T23:38:43.537358+0000","last_undegraded":"2024-09-10T23:38:43.537358+0000","last_fullsized":"2024-09-10T23:38:43.537358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:35.931873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840987+0000","last_change":"2024-09-10T23:38:12.229295+0000","last_active":"2024-09-10T23:39:42.840987+0000","last_peered":"2024-09-10T23:39:42.840987+0000","last_clean":"2024-09-10T23:39:42.840987+0000","last_became_active":"2024-09-10T23:38:12.228846+0000","last_became_peered":"2024-09-10T23:38:12.228846+0000","last_unstale":"2024-09-10T23:39:42.840987+0000","last_undegraded":"2024-09-10T23:39:42.840987+0000","last_fullsized":"2024-09-10T23:39:42.840987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:15.383624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'32","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:02.984349+0000","last_change":"2024-09-10T23:38:10.203362+0000","last_active":"2024-09-10T23:40:02.984349+0000","last_peered":"2024-09-10T23:40:02.984349+0000","last_clean":"2024-09-10T23:40:02.984349+0000","last_became_active":"2024-09-10T23:38:10.202961+0000","last_became_peered":"2024-09-10T23:38:10.202961+0000","last_unstale":"2024-09-10T23:40:02.984349+0000","last_undegraded":"2024-09-10T23:40:02.984349+0000","last_fullsized":"2024-09-10T23:40:02.984349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:33.580368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60904,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":163,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835801+0000","last_change":"2024-09-10T23:38:12.219094+0000","last_active":"2024-09-10T23:39:42.835801+0000","last_peered":"2024-09-10T23:39:42.835801+0000","last_clean":"2024-09-10T23:39:42.835801+0000","last_became_active":"2024-09-10T23:38:12.218778+0000","last_became_peered":"2024-09-10T23:38:12.218778+0000","last_unstale":"2024-09-10T23:39:42.835801+0000","last_undegraded":"2024-09-10T23:39:42.835801+0000","last_fullsized":"2024-09-10T23:39:42.835801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:59.019756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770789+0000","last_change":"2024-09-10T23:38:10.204204+0000","last_active":"2024-09-10T23:38:43.770789+0000","last_peered":"2024-09-10T23:38:43.770789+0000","last_clean":"2024-09-10T23:38:43.770789+0000","last_became_active":"2024-09-10T23:38:10.203662+0000","last_became_peered":"2024-09-10T23:38:10.203662+0000","last_unstale":"2024-09-10T23:38:43.770789+0000","last_undegraded":"2024-09-10T23:38:43.770789+0000","last_fullsized":"2024-09-10T23:38:43.770789+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:44.243961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.836597+0000","last_change":"2024-09-10T23:38:12.214337+0000","last_active":"2024-09-10T23:39:42.836597+0000","last_peered":"2024-09-10T23:39:42.836597+0000","last_clean":"2024-09-10T23:39:42.836597+0000","last_became_active":"2024-09-10T23:38:12.214024+0000","last_became_peered":"2024-09-10T23:38:12.214024+0000","last_unstale":"2024-09-10T23:39:42.836597+0000","last_undegraded":"2024-09-10T23:39:42.836597+0000","last_fullsized":"2024-09-10T23:39:42.836597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:19.902974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536668+0000","last_change":"2024-09-10T23:38:10.208001+0000","last_active":"2024-09-10T23:38:43.536668+0000","last_peered":"2024-09-10T23:38:43.536668+0000","last_clean":"2024-09-10T23:38:43.536668+0000","last_became_active":"2024-09-10T23:38:10.207656+0000","last_became_peered":"2024-09-10T23:38:10.207656+0000","last_unstale":"2024-09-10T23:38:43.536668+0000","last_undegraded":"2024-09-10T23:38:43.536668+0000","last_fullsized":"2024-09-10T23:38:43.536668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:44.679795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.839998+0000","last_change":"2024-09-10T23:38:12.227780+0000","last_active":"2024-09-10T23:39:42.839998+0000","last_peered":"2024-09-10T23:39:42.839998+0000","last_clean":"2024-09-10T23:39:42.839998+0000","last_became_active":"2024-09-10T23:38:12.227404+0000","last_became_peered":"2024-09-10T23:38:12.227404+0000","last_unstale":"2024-09-10T23:39:42.839998+0000","last_undegraded":"2024-09-10T23:39:42.839998+0000","last_fullsized":"2024-09-10T23:39:42.839998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:58.453685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":135,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:04.428734+0000","last_change":"2024-09-10T23:38:10.214786+0000","last_active":"2024-09-10T23:40:04.428734+0000","last_peered":"2024-09-10T23:40:04.428734+0000","last_clean":"2024-09-10T23:40:04.428734+0000","last_became_active":"2024-09-10T23:38:10.214124+0000","last_became_peered":"2024-09-10T23:38:10.214124+0000","last_unstale":"2024-09-10T23:40:04.428734+0000","last_undegraded":"2024-09-10T23:40:04.428734+0000","last_fullsized":"2024-09-10T23:40:04.428734+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:00.461128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.838449+0000","last_change":"2024-09-10T23:38:12.220507+0000","last_active":"2024-09-10T23:39:42.838449+0000","last_peered":"2024-09-10T23:39:42.838449+0000","last_clean":"2024-09-10T23:39:42.838449+0000","last_became_active":"2024-09-10T23:38:12.220178+0000","last_became_peered":"2024-09-10T23:38:12.220178+0000","last_unstale":"2024-09-10T23:39:42.838449+0000","last_undegraded":"2024-09-10T23:39:42.838449+0000","last_fullsized":"2024-09-10T23:39:42.838449+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:57.656714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531867+0000","last_change":"2024-09-10T23:38:10.256166+0000","last_active":"2024-09-10T23:38:43.531867+0000","last_peered":"2024-09-10T23:38:43.531867+0000","last_clean":"2024-09-10T23:38:43.531867+0000","last_became_active":"2024-09-10T23:38:10.255792+0000","last_became_peered":"2024-09-10T23:38:10.255792+0000","last_unstale":"2024-09-10T23:38:43.531867+0000","last_undegraded":"2024-09-10T23:38:43.531867+0000","last_fullsized":"2024-09-10T23:38:43.531867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:44.621339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.822820+0000","last_change":"2024-09-10T23:38:12.225151+0000","last_active":"2024-09-10T23:39:42.822820+0000","last_peered":"2024-09-10T23:39:42.822820+0000","last_clean":"2024-09-10T23:39:42.822820+0000","last_became_active":"2024-09-10T23:38:12.224748+0000","last_became_peered":"2024-09-10T23:38:12.224748+0000","last_unstale":"2024-09-10T23:39:42.822820+0000","last_undegraded":"2024-09-10T23:39:42.822820+0000","last_fullsized":"2024-09-10T23:39:42.822820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:23.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.543098+0000","last_change":"2024-09-10T23:38:43.542616+0000","last_active":"2024-09-10T23:38:43.543098+0000","last_peered":"2024-09-10T23:38:43.543098+0000","last_clean":"2024-09-10T23:38:43.543098+0000","last_became_active":"2024-09-10T23:38:43.537936+0000","last_became_peered":"2024-09-10T23:38:43.537936+0000","last_unstale":"2024-09-10T23:38:43.543098+0000","last_undegraded":"2024-09-10T23:38:43.543098+0000","last_fullsized":"2024-09-10T23:38:43.543098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:31.390914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825391+0000","last_change":"2024-09-10T23:38:12.225417+0000","last_active":"2024-09-10T23:39:42.825391+0000","last_peered":"2024-09-10T23:39:42.825391+0000","last_clean":"2024-09-10T23:39:42.825391+0000","last_became_active":"2024-09-10T23:38:12.225129+0000","last_became_peered":"2024-09-10T23:38:12.225129+0000","last_unstale":"2024-09-10T23:39:42.825391+0000","last_undegraded":"2024-09-10T23:39:42.825391+0000","last_fullsized":"2024-09-10T23:39:42.825391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:42.935776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.530992+0000","last_change":"2024-09-10T23:38:10.204942+0000","last_active":"2024-09-10T23:38:43.530992+0000","last_peered":"2024-09-10T23:38:43.530992+0000","last_clean":"2024-09-10T23:38:43.530992+0000","last_became_active":"2024-09-10T23:38:10.204568+0000","last_became_peered":"2024-09-10T23:38:10.204568+0000","last_unstale":"2024-09-10T23:38:43.530992+0000","last_undegraded":"2024-09-10T23:38:43.530992+0000","last_fullsized":"2024-09-10T23:38:43.530992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:00.608617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.837848+0000","last_change":"2024-09-10T23:38:12.217411+0000","last_active":"2024-09-10T23:39:42.837848+0000","last_peered":"2024-09-10T23:39:42.837848+0000","last_clean":"2024-09-10T23:39:42.837848+0000","last_became_active":"2024-09-10T23:38:12.216998+0000","last_became_peered":"2024-09-10T23:38:12.216998+0000","last_unstale":"2024-09-10T23:39:42.837848+0000","last_undegraded":"2024-09-10T23:39:42.837848+0000","last_fullsized":"2024-09-10T23:39:42.837848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:12.852239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537386+0000","last_change":"2024-09-10T23:38:10.209596+0000","last_active":"2024-09-10T23:38:43.537386+0000","last_peered":"2024-09-10T23:38:43.537386+0000","last_clean":"2024-09-10T23:38:43.537386+0000","last_became_active":"2024-09-10T23:38:10.209348+0000","last_became_peered":"2024-09-10T23:38:10.209348+0000","last_unstale":"2024-09-10T23:38:43.537386+0000","last_undegraded":"2024-09-10T23:38:43.537386+0000","last_fullsized":"2024-09-10T23:38:43.537386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:30.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833587+0000","last_change":"2024-09-10T23:38:12.224071+0000","last_active":"2024-09-10T23:39:42.833587+0000","last_peered":"2024-09-10T23:39:42.833587+0000","last_clean":"2024-09-10T23:39:42.833587+0000","last_became_active":"2024-09-10T23:38:12.223773+0000","last_became_peered":"2024-09-10T23:38:12.223773+0000","last_unstale":"2024-09-10T23:39:42.833587+0000","last_undegraded":"2024-09-10T23:39:42.833587+0000","last_fullsized":"2024-09-10T23:39:42.833587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:43.412524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.771165+0000","last_change":"2024-09-10T23:38:10.300065+0000","last_active":"2024-09-10T23:38:43.771165+0000","last_peered":"2024-09-10T23:38:43.771165+0000","last_clean":"2024-09-10T23:38:43.771165+0000","last_became_active":"2024-09-10T23:38:10.299624+0000","last_became_peered":"2024-09-10T23:38:10.299624+0000","last_unstale":"2024-09-10T23:38:43.771165+0000","last_undegraded":"2024-09-10T23:38:43.771165+0000","last_fullsized":"2024-09-10T23:38:43.771165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:02.516651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840844+0000","last_change":"2024-09-10T23:38:12.222280+0000","last_active":"2024-09-10T23:39:42.840844+0000","last_peered":"2024-09-10T23:39:42.840844+0000","last_clean":"2024-09-10T23:39:42.840844+0000","last_became_active":"2024-09-10T23:38:12.221644+0000","last_became_peered":"2024-09-10T23:38:12.221644+0000","last_unstale":"2024-09-10T23:39:42.840844+0000","last_undegraded":"2024-09-10T23:39:42.840844+0000","last_fullsized":"2024-09-10T23:39:42.840844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:48.823629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091209+0000","last_change":"2024-09-10T23:36:58.824948+0000","last_active":"2024-09-10T23:38:44.091209+0000","last_peered":"2024-09-10T23:38:44.091209+0000","last_clean":"2024-09-10T23:38:44.091209+0000","last_became_active":"2024-09-10T23:36:58.819334+0000","last_became_peered":"2024-09-10T23:36:58.819334+0000","last_unstale":"2024-09-10T23:38:44.091209+0000","last_undegraded":"2024-09-10T23:38:44.091209+0000","last_fullsized":"2024-09-10T23:38:44.091209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:33:36.806080+0000","last_clean_scrub_stamp":"2024-09-10T23:33:36.806080+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:52.996301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.536800+0000","last_change":"2024-09-10T23:38:10.215224+0000","last_active":"2024-09-10T23:38:43.536800+0000","last_peered":"2024-09-10T23:38:43.536800+0000","last_clean":"2024-09-10T23:38:43.536800+0000","last_became_active":"2024-09-10T23:38:10.214795+0000","last_became_peered":"2024-09-10T23:38:10.214795+0000","last_unstale":"2024-09-10T23:38:43.536800+0000","last_undegraded":"2024-09-10T23:38:43.536800+0000","last_fullsized":"2024-09-10T23:38:43.536800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:26.599793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840106+0000","last_change":"2024-09-10T23:38:43.538480+0000","last_active":"2024-09-10T23:39:42.840106+0000","last_peered":"2024-09-10T23:39:42.840106+0000","last_clean":"2024-09-10T23:39:42.840106+0000","last_became_active":"2024-09-10T23:38:43.538091+0000","last_became_peered":"2024-09-10T23:38:43.538091+0000","last_unstale":"2024-09-10T23:39:42.840106+0000","last_undegraded":"2024-09-10T23:39:42.840106+0000","last_fullsized":"2024-09-10T23:39:42.840106+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:40.890114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091042+0000","last_change":"2024-09-10T23:38:10.212748+0000","last_active":"2024-09-10T23:38:44.091042+0000","last_peered":"2024-09-10T23:38:44.091042+0000","last_clean":"2024-09-10T23:38:44.091042+0000","last_became_active":"2024-09-10T23:38:10.212427+0000","last_became_peered":"2024-09-10T23:38:10.212427+0000","last_unstale":"2024-09-10T23:38:44.091042+0000","last_undegraded":"2024-09-10T23:38:44.091042+0000","last_fullsized":"2024-09-10T23:38:44.091042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:23.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828706+0000","last_change":"2024-09-10T23:38:12.225178+0000","last_active":"2024-09-10T23:39:42.828706+0000","last_peered":"2024-09-10T23:39:42.828706+0000","last_clean":"2024-09-10T23:39:42.828706+0000","last_became_active":"2024-09-10T23:38:12.224860+0000","last_became_peered":"2024-09-10T23:38:12.224860+0000","last_unstale":"2024-09-10T23:39:42.828706+0000","last_undegraded":"2024-09-10T23:39:42.828706+0000","last_fullsized":"2024-09-10T23:39:42.828706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:10.986009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":127,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:40:00.421428+0000","last_change":"2024-09-10T23:38:10.254625+0000","last_active":"2024-09-10T23:40:00.421428+0000","last_peered":"2024-09-10T23:40:00.421428+0000","last_clean":"2024-09-10T23:40:00.421428+0000","last_became_active":"2024-09-10T23:38:10.254259+0000","last_became_peered":"2024-09-10T23:38:10.254259+0000","last_unstale":"2024-09-10T23:40:00.421428+0000","last_undegraded":"2024-09-10T23:40:00.421428+0000","last_fullsized":"2024-09-10T23:40:00.421428+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:46.371999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.833004+0000","last_change":"2024-09-10T23:38:12.217168+0000","last_active":"2024-09-10T23:39:42.833004+0000","last_peered":"2024-09-10T23:39:42.833004+0000","last_clean":"2024-09-10T23:39:42.833004+0000","last_became_active":"2024-09-10T23:38:12.216814+0000","last_became_peered":"2024-09-10T23:38:12.216814+0000","last_unstale":"2024-09-10T23:39:42.833004+0000","last_undegraded":"2024-09-10T23:39:42.833004+0000","last_fullsized":"2024-09-10T23:39:42.833004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:41.494690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:44.091293+0000","last_change":"2024-09-10T23:38:10.207456+0000","last_active":"2024-09-10T23:38:44.091293+0000","last_peered":"2024-09-10T23:38:44.091293+0000","last_clean":"2024-09-10T23:38:44.091293+0000","last_became_active":"2024-09-10T23:38:10.207079+0000","last_became_peered":"2024-09-10T23:38:10.207079+0000","last_unstale":"2024-09-10T23:38:44.091293+0000","last_undegraded":"2024-09-10T23:38:44.091293+0000","last_fullsized":"2024-09-10T23:38:44.091293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:14.631231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.825830+0000","last_change":"2024-09-10T23:38:12.218306+0000","last_active":"2024-09-10T23:39:42.825830+0000","last_peered":"2024-09-10T23:39:42.825830+0000","last_clean":"2024-09-10T23:39:42.825830+0000","last_became_active":"2024-09-10T23:38:12.217981+0000","last_became_peered":"2024-09-10T23:38:12.217981+0000","last_unstale":"2024-09-10T23:39:42.825830+0000","last_undegraded":"2024-09-10T23:39:42.825830+0000","last_fullsized":"2024-09-10T23:39:42.825830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:31.745904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.538159+0000","last_change":"2024-09-10T23:38:43.538061+0000","last_active":"2024-09-10T23:38:43.538159+0000","last_peered":"2024-09-10T23:38:43.538159+0000","last_clean":"2024-09-10T23:38:43.538159+0000","last_became_active":"2024-09-10T23:38:43.537582+0000","last_became_peered":"2024-09-10T23:38:43.537582+0000","last_unstale":"2024-09-10T23:38:43.538159+0000","last_undegraded":"2024-09-10T23:38:43.538159+0000","last_fullsized":"2024-09-10T23:38:43.538159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:15.083698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.818233+0000","last_change":"2024-09-10T23:38:12.214507+0000","last_active":"2024-09-10T23:39:42.818233+0000","last_peered":"2024-09-10T23:39:42.818233+0000","last_clean":"2024-09-10T23:39:42.818233+0000","last_became_active":"2024-09-10T23:38:12.214160+0000","last_became_peered":"2024-09-10T23:38:12.214160+0000","last_unstale":"2024-09-10T23:39:42.818233+0000","last_undegraded":"2024-09-10T23:39:42.818233+0000","last_fullsized":"2024-09-10T23:39:42.818233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:04.623624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532455+0000","last_change":"2024-09-10T23:38:10.256941+0000","last_active":"2024-09-10T23:38:43.532455+0000","last_peered":"2024-09-10T23:38:43.532455+0000","last_clean":"2024-09-10T23:38:43.532455+0000","last_became_active":"2024-09-10T23:38:10.256553+0000","last_became_peered":"2024-09-10T23:38:10.256553+0000","last_unstale":"2024-09-10T23:38:43.532455+0000","last_undegraded":"2024-09-10T23:38:43.532455+0000","last_fullsized":"2024-09-10T23:38:43.532455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:30.813999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828906+0000","last_change":"2024-09-10T23:38:12.221246+0000","last_active":"2024-09-10T23:39:42.828906+0000","last_peered":"2024-09-10T23:39:42.828906+0000","last_clean":"2024-09-10T23:39:42.828906+0000","last_became_active":"2024-09-10T23:38:12.220912+0000","last_became_peered":"2024-09-10T23:38:12.220912+0000","last_unstale":"2024-09-10T23:39:42.828906+0000","last_undegraded":"2024-09-10T23:39:42.828906+0000","last_fullsized":"2024-09-10T23:39:42.828906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:33.918289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'11","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534224+0000","last_change":"2024-09-10T23:38:10.210151+0000","last_active":"2024-09-10T23:38:43.534224+0000","last_peered":"2024-09-10T23:38:43.534224+0000","last_clean":"2024-09-10T23:38:43.534224+0000","last_became_active":"2024-09-10T23:38:10.209832+0000","last_became_peered":"2024-09-10T23:38:10.209832+0000","last_unstale":"2024-09-10T23:38:43.534224+0000","last_undegraded":"2024-09-10T23:38:43.534224+0000","last_fullsized":"2024-09-10T23:38:43.534224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:52.728298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.835750+0000","last_change":"2024-09-10T23:38:12.218256+0000","last_active":"2024-09-10T23:39:42.835750+0000","last_peered":"2024-09-10T23:39:42.835750+0000","last_clean":"2024-09-10T23:39:42.835750+0000","last_became_active":"2024-09-10T23:38:12.217853+0000","last_became_peered":"2024-09-10T23:38:12.217853+0000","last_unstale":"2024-09-10T23:39:42.835750+0000","last_undegraded":"2024-09-10T23:39:42.835750+0000","last_fullsized":"2024-09-10T23:39:42.835750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:14.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.537082+0000","last_change":"2024-09-10T23:38:10.300017+0000","last_active":"2024-09-10T23:38:43.537082+0000","last_peered":"2024-09-10T23:38:43.537082+0000","last_clean":"2024-09-10T23:38:43.537082+0000","last_became_active":"2024-09-10T23:38:10.299733+0000","last_became_peered":"2024-09-10T23:38:10.299733+0000","last_unstale":"2024-09-10T23:38:43.537082+0000","last_undegraded":"2024-09-10T23:38:43.537082+0000","last_fullsized":"2024-09-10T23:38:43.537082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:12.193043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832436+0000","last_change":"2024-09-10T23:38:12.212818+0000","last_active":"2024-09-10T23:39:42.832436+0000","last_peered":"2024-09-10T23:39:42.832436+0000","last_clean":"2024-09-10T23:39:42.832436+0000","last_became_active":"2024-09-10T23:38:12.212502+0000","last_became_peered":"2024-09-10T23:38:12.212502+0000","last_unstale":"2024-09-10T23:39:42.832436+0000","last_undegraded":"2024-09-10T23:39:42.832436+0000","last_fullsized":"2024-09-10T23:39:42.832436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:26.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.531972+0000","last_change":"2024-09-10T23:38:10.256366+0000","last_active":"2024-09-10T23:38:43.531972+0000","last_peered":"2024-09-10T23:38:43.531972+0000","last_clean":"2024-09-10T23:38:43.531972+0000","last_became_active":"2024-09-10T23:38:10.256056+0000","last_became_peered":"2024-09-10T23:38:10.256056+0000","last_unstale":"2024-09-10T23:38:43.531972+0000","last_undegraded":"2024-09-10T23:38:43.531972+0000","last_fullsized":"2024-09-10T23:38:43.531972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:00.612373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.793751+0000","last_change":"2024-09-10T23:38:12.224629+0000","last_active":"2024-09-10T23:39:42.793751+0000","last_peered":"2024-09-10T23:39:42.793751+0000","last_clean":"2024-09-10T23:39:42.793751+0000","last_became_active":"2024-09-10T23:38:12.224018+0000","last_became_peered":"2024-09-10T23:38:12.224018+0000","last_unstale":"2024-09-10T23:39:42.793751+0000","last_undegraded":"2024-09-10T23:39:42.793751+0000","last_fullsized":"2024-09-10T23:39:42.793751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:44.067489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965400+0000","last_change":"2024-09-10T23:38:10.203395+0000","last_active":"2024-09-10T23:38:43.965400+0000","last_peered":"2024-09-10T23:38:43.965400+0000","last_clean":"2024-09-10T23:38:43.965400+0000","last_became_active":"2024-09-10T23:38:10.203067+0000","last_became_peered":"2024-09-10T23:38:10.203067+0000","last_unstale":"2024-09-10T23:38:43.965400+0000","last_undegraded":"2024-09-10T23:38:43.965400+0000","last_fullsized":"2024-09-10T23:38:43.965400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:46.398322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.828373+0000","last_change":"2024-09-10T23:38:12.223207+0000","last_active":"2024-09-10T23:39:42.828373+0000","last_peered":"2024-09-10T23:39:42.828373+0000","last_clean":"2024-09-10T23:39:42.828373+0000","last_became_active":"2024-09-10T23:38:12.222841+0000","last_became_peered":"2024-09-10T23:38:12.222841+0000","last_unstale":"2024-09-10T23:39:42.828373+0000","last_undegraded":"2024-09-10T23:39:42.828373+0000","last_fullsized":"2024-09-10T23:39:42.828373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:26.674983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.770702+0000","last_change":"2024-09-10T23:38:10.210479+0000","last_active":"2024-09-10T23:38:43.770702+0000","last_peered":"2024-09-10T23:38:43.770702+0000","last_clean":"2024-09-10T23:38:43.770702+0000","last_became_active":"2024-09-10T23:38:10.210124+0000","last_became_peered":"2024-09-10T23:38:10.210124+0000","last_unstale":"2024-09-10T23:38:43.770702+0000","last_undegraded":"2024-09-10T23:38:43.770702+0000","last_fullsized":"2024-09-10T23:38:43.770702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:39.017091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.816318+0000","last_change":"2024-09-10T23:38:12.214748+0000","last_active":"2024-09-10T23:39:42.816318+0000","last_peered":"2024-09-10T23:39:42.816318+0000","last_clean":"2024-09-10T23:39:42.816318+0000","last_became_active":"2024-09-10T23:38:12.214431+0000","last_became_peered":"2024-09-10T23:38:12.214431+0000","last_unstale":"2024-09-10T23:39:42.816318+0000","last_undegraded":"2024-09-10T23:39:42.816318+0000","last_fullsized":"2024-09-10T23:39:42.816318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:02.092876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532097+0000","last_change":"2024-09-10T23:38:10.214134+0000","last_active":"2024-09-10T23:38:43.532097+0000","last_peered":"2024-09-10T23:38:43.532097+0000","last_clean":"2024-09-10T23:38:43.532097+0000","last_became_active":"2024-09-10T23:38:10.213690+0000","last_became_peered":"2024-09-10T23:38:10.213690+0000","last_unstale":"2024-09-10T23:38:43.532097+0000","last_undegraded":"2024-09-10T23:38:43.532097+0000","last_fullsized":"2024-09-10T23:38:43.532097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:19.369755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840926+0000","last_change":"2024-09-10T23:38:12.218254+0000","last_active":"2024-09-10T23:39:42.840926+0000","last_peered":"2024-09-10T23:39:42.840926+0000","last_clean":"2024-09-10T23:39:42.840926+0000","last_became_active":"2024-09-10T23:38:12.217937+0000","last_became_peered":"2024-09-10T23:38:12.217937+0000","last_unstale":"2024-09-10T23:39:42.840926+0000","last_undegraded":"2024-09-10T23:39:42.840926+0000","last_fullsized":"2024-09-10T23:39:42.840926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:57.080088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.840222+0000","last_change":"2024-09-10T23:38:43.537716+0000","last_active":"2024-09-10T23:39:42.840222+0000","last_peered":"2024-09-10T23:39:42.840222+0000","last_clean":"2024-09-10T23:39:42.840222+0000","last_became_active":"2024-09-10T23:38:43.537357+0000","last_became_peered":"2024-09-10T23:38:43.537357+0000","last_unstale":"2024-09-10T23:39:42.840222+0000","last_undegraded":"2024-09-10T23:39:42.840222+0000","last_fullsized":"2024-09-10T23:39:42.840222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:59.812000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532282+0000","last_change":"2024-09-10T23:38:10.215022+0000","last_active":"2024-09-10T23:38:43.532282+0000","last_peered":"2024-09-10T23:38:43.532282+0000","last_clean":"2024-09-10T23:38:43.532282+0000","last_became_active":"2024-09-10T23:38:10.214678+0000","last_became_peered":"2024-09-10T23:38:10.214678+0000","last_unstale":"2024-09-10T23:38:43.532282+0000","last_undegraded":"2024-09-10T23:38:43.532282+0000","last_fullsized":"2024-09-10T23:38:43.532282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:20.592052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.841698+0000","last_change":"2024-09-10T23:38:12.230449+0000","last_active":"2024-09-10T23:39:42.841698+0000","last_peered":"2024-09-10T23:39:42.841698+0000","last_clean":"2024-09-10T23:39:42.841698+0000","last_became_active":"2024-09-10T23:38:12.228939+0000","last_became_peered":"2024-09-10T23:38:12.228939+0000","last_unstale":"2024-09-10T23:39:42.841698+0000","last_undegraded":"2024-09-10T23:39:42.841698+0000","last_fullsized":"2024-09-10T23:39:42.841698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:45.495207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.532292+0000","last_change":"2024-09-10T23:38:10.209586+0000","last_active":"2024-09-10T23:38:43.532292+0000","last_peered":"2024-09-10T23:38:43.532292+0000","last_clean":"2024-09-10T23:38:43.532292+0000","last_became_active":"2024-09-10T23:38:10.209211+0000","last_became_peered":"2024-09-10T23:38:10.209211+0000","last_unstale":"2024-09-10T23:38:43.532292+0000","last_undegraded":"2024-09-10T23:38:43.532292+0000","last_fullsized":"2024-09-10T23:38:43.532292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:29.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.832321+0000","last_change":"2024-09-10T23:38:12.219795+0000","last_active":"2024-09-10T23:39:42.832321+0000","last_peered":"2024-09-10T23:39:42.832321+0000","last_clean":"2024-09-10T23:39:42.832321+0000","last_became_active":"2024-09-10T23:38:12.219318+0000","last_became_peered":"2024-09-10T23:38:12.219318+0000","last_unstale":"2024-09-10T23:39:42.832321+0000","last_undegraded":"2024-09-10T23:39:42.832321+0000","last_fullsized":"2024-09-10T23:39:42.832321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:12.732264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.965952+0000","last_change":"2024-09-10T23:38:10.255508+0000","last_active":"2024-09-10T23:38:43.965952+0000","last_peered":"2024-09-10T23:38:43.965952+0000","last_clean":"2024-09-10T23:38:43.965952+0000","last_became_active":"2024-09-10T23:38:10.255202+0000","last_became_peered":"2024-09-10T23:38:10.255202+0000","last_unstale":"2024-09-10T23:38:43.965952+0000","last_undegraded":"2024-09-10T23:38:43.965952+0000","last_fullsized":"2024-09-10T23:38:43.965952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:09.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:39:42.823314+0000","last_change":"2024-09-10T23:38:12.222345+0000","last_active":"2024-09-10T23:39:42.823314+0000","last_peered":"2024-09-10T23:39:42.823314+0000","last_clean":"2024-09-10T23:39:42.823314+0000","last_became_active":"2024-09-10T23:38:12.220593+0000","last_became_peered":"2024-09-10T23:38:12.220593+0000","last_unstale":"2024-09-10T23:39:42.823314+0000","last_undegraded":"2024-09-10T23:39:42.823314+0000","last_fullsized":"2024-09-10T23:39:42.823314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:11.193965+0000","last_clean_scrub_stamp":"2024-09-10T23:38:11.193965+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:00.909046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T23:38:43.534353+0000","last_change":"2024-09-10T23:38:10.210071+0000","last_active":"2024-09-10T23:38:43.534353+0000","last_peered":"2024-09-10T23:38:43.534353+0000","last_clean":"2024-09-10T23:38:43.534353+0000","last_became_active":"2024-09-10T23:38:10.209778+0000","last_became_peered":"2024-09-10T23:38:10.209778+0000","last_unstale":"2024-09-10T23:38:43.534353+0000","last_undegraded":"2024-09-10T23:38:43.534353+0000","last_fullsized":"2024-09-10T23:38:43.534353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:38:09.187241+0000","last_clean_scrub_stamp":"2024-09-10T23:38:09.187241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:14.211369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65578,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":630,"num_read_kb":383,"num_write":172,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":196426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286063,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":417996,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1070583,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103214,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":418210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":418108,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":1010733,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":417599,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":1009885,"data_compressed":42176,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":418568,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417910,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":480178,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":477988,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":418870,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34746,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36365,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:40:07.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:40:08.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:07 smithi066 ceph-mon[34761]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:40:08.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:07 smithi066 ceph-mon[34761]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:08.251 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:08.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:07 smithi071 ceph-mon[35018]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:40:08.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:07 smithi071 ceph-mon[35018]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 -- 172.21.15.16:0/2057645061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd950108060 msgr2=0x7fd95010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 --2- 172.21.15.16:0/2057645061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd950108060 0x7fd95010e860 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd948009ca0 tx=0x7fd94802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 -- 172.21.15.16:0/2057645061 shutdown_connections 2024-09-10T23:40:08.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 --2- 172.21.15.16:0/2057645061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd950108060 0x7fd95010e860 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 --2- 172.21.15.16:0/2057645061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9501076e0 0x7fd950107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 --2- 172.21.15.16:0/2057645061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd950101cd0 0x7fd9501020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 -- 172.21.15.16:0/2057645061 >> 172.21.15.16:0/2057645061 conn(0x7fd9500fd700 msgr2=0x7fd9500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 -- 172.21.15.16:0/2057645061 shutdown_connections 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.764+0000 7fd957929640 1 -- 172.21.15.16:0/2057645061 wait complete. 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 Processor -- start 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 -- start start 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd950101cd0 0x7fd950199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9501076e0 0x7fd950199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd950108060 0x7fd95019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd950112e40 con 0x7fd9501076e0 2024-09-10T23:40:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd950112cc0 con 0x7fd950108060 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd957929640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd950112fc0 con 0x7fd950101cd0 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9501076e0 0x7fd950199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9501076e0 0x7fd950199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47388/0 (socket says 172.21.15.16:47388) 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 -- 172.21.15.16:0/1650798939 learned_addr learned my addr 172.21.15.16:0/1650798939 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd9556c5640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd950101cd0 0x7fd950199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd955ec6640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd950108060 0x7fd95019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 -- 172.21.15.16:0/1650798939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd950101cd0 msgr2=0x7fd950199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd950101cd0 0x7fd950199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 -- 172.21.15.16:0/1650798939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd950108060 msgr2=0x7fd95019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd950108060 0x7fd95019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd954ec4640 1 -- 172.21.15.16:0/1650798939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95019f3e0 con 0x7fd9501076e0 2024-09-10T23:40:08.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.765+0000 7fd955ec6640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd950108060 0x7fd95019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.766+0000 7fd954ec4640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9501076e0 0x7fd950199870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b4a0 tx=0x7fd94400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.766+0000 7fd94e7fc640 1 -- 172.21.15.16:0/1650798939 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944014070 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.766+0000 7fd94e7fc640 1 -- 172.21.15.16:0/1650798939 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd944010ac0 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.766+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95019f6d0 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.766+0000 7fd94e7fc640 1 -- 172.21.15.16:0/1650798939 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944017c30 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.766+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9501a5d90 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.767+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9501020b0 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.768+0000 7fd94e7fc640 1 -- 172.21.15.16:0/1650798939 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fd944010610 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.769+0000 7fd94e7fc640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd9380b5330 0x7fd9380b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.769+0000 7fd9556c5640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd9380b5330 0x7fd9380b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.769+0000 7fd94e7fc640 1 -- 172.21.15.16:0/1650798939 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd9440e56a0 con 0x7fd9501076e0 2024-09-10T23:40:08.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.769+0000 7fd9556c5640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd9380b5330 0x7fd9380b77f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd940005fd0 tx=0x7fd94000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.772+0000 7fd94e7fc640 1 -- 172.21.15.16:0/1650798939 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd9440ac440 con 0x7fd9501076e0 2024-09-10T23:40:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:08 smithi016 ceph-mon[30855]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:08 smithi016 ceph-mon[30855]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:08.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.996+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd95019a460 con 0x7fd9501076e0 2024-09-10T23:40:08.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.997+0000 7fd94e7fc640 1 -- 172.21.15.16:0/1650798939 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fd9440abd40 con 0x7fd9501076e0 2024-09-10T23:40:08.998 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:08.998 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:40:08.998 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:40:09.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd9380b5330 msgr2=0x7fd9380b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:09.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd9380b5330 0x7fd9380b77f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd940005fd0 tx=0x7fd94000b390 comp rx=0 tx=0).stop 2024-09-10T23:40:09.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9501076e0 msgr2=0x7fd950199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:09.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9501076e0 0x7fd950199870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b4a0 tx=0x7fd94400b960 comp rx=0 tx=0).stop 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 shutdown_connections 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd9380b5330 0x7fd9380b77f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd950108060 0x7fd95019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9501076e0 0x7fd950199870 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 --2- 172.21.15.16:0/1650798939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd950101cd0 0x7fd950199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 >> 172.21.15.16:0/1650798939 conn(0x7fd9500fd700 msgr2=0x7fd9500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 shutdown_connections 2024-09-10T23:40:09.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:08.999+0000 7fd957929640 1 -- 172.21.15.16:0/1650798939 wait complete. 2024-09-10T23:40:09.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:08 smithi066 ceph-mon[34761]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:09.053 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:08 smithi066 ceph-mon[34761]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:09.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:08 smithi071 ceph-mon[35018]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:09.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:08 smithi071 ceph-mon[35018]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:40:09.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:40:10.037 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:10.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:09 smithi071 ceph-mon[35018]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T23:40:10.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:09 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1650798939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:10.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:09 smithi066 ceph-mon[34761]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T23:40:10.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:09 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1650798939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:10.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:09 smithi016 ceph-mon[30855]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T23:40:10.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:09 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1650798939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:10.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 -- 172.21.15.16:0/1810234589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70109150 msgr2=0x7ffb7010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:10.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 --2- 172.21.15.16:0/1810234589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70109150 0x7ffb7010f950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009900 tx=0x7ffb6802a410 comp rx=0 tx=0).stop 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 -- 172.21.15.16:0/1810234589 shutdown_connections 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 --2- 172.21.15.16:0/1810234589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb70109150 0x7ffb7010f950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 --2- 172.21.15.16:0/1810234589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb701087d0 0x7ffb70108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 --2- 172.21.15.16:0/1810234589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb70102dc0 0x7ffb701031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 -- 172.21.15.16:0/1810234589 >> 172.21.15.16:0/1810234589 conn(0x7ffb700fe830 msgr2=0x7ffb70100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 -- 172.21.15.16:0/1810234589 shutdown_connections 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.525+0000 7ffb7531c640 1 -- 172.21.15.16:0/1810234589 wait complete. 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 Processor -- start 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 -- start start 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb70102dc0 0x7ffb7019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb701087d0 0x7ffb7019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:10.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb70109150 0x7ffb701a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70112e10 con 0x7ffb701087d0 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70112c90 con 0x7ffb70102dc0 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb7531c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70112f90 con 0x7ffb70109150 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb6e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb701087d0 0x7ffb7019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb6e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb701087d0 0x7ffb7019b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47410/0 (socket says 172.21.15.16:47410) 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb6e7fc640 1 -- 172.21.15.16:0/2344863044 learned_addr learned my addr 172.21.15.16:0/2344863044 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb6effd640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb70102dc0 0x7ffb7019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb6f7fe640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb70109150 0x7ffb701a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb6e7fc640 1 -- 172.21.15.16:0/2344863044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb70109150 msgr2=0x7ffb701a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.526+0000 7ffb6e7fc640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb70109150 0x7ffb701a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb6e7fc640 1 -- 172.21.15.16:0/2344863044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb70102dc0 msgr2=0x7ffb7019b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb6e7fc640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb70102dc0 0x7ffb7019b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb6e7fc640 1 -- 172.21.15.16:0/2344863044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb701a1530 con 0x7ffb701087d0 2024-09-10T23:40:10.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb6e7fc640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb701087d0 0x7ffb7019b9c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400e9f0 tx=0x7ffb6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:10.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb57fff640 1 -- 172.21.15.16:0/2344863044 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400cd80 con 0x7ffb701087d0 2024-09-10T23:40:10.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb57fff640 1 -- 172.21.15.16:0/2344863044 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb640108e0 con 0x7ffb701087d0 2024-09-10T23:40:10.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb701a1820 con 0x7ffb701087d0 2024-09-10T23:40:10.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb57fff640 1 -- 172.21.15.16:0/2344863044 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64018980 con 0x7ffb701087d0 2024-09-10T23:40:10.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.527+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb701a7ee0 con 0x7ffb701087d0 2024-09-10T23:40:10.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.528+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb701031a0 con 0x7ffb701087d0 2024-09-10T23:40:10.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.530+0000 7ffb57fff640 1 -- 172.21.15.16:0/2344863044 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7ffb64010430 con 0x7ffb701087d0 2024-09-10T23:40:10.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.531+0000 7ffb57fff640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffb580b5330 0x7ffb580b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:10.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.532+0000 7ffb6effd640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffb580b5330 0x7ffb580b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.532+0000 7ffb57fff640 1 -- 172.21.15.16:0/2344863044 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ffb640e64c0 con 0x7ffb701087d0 2024-09-10T23:40:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.532+0000 7ffb6effd640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffb580b5330 0x7ffb580b77f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb60009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:10.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.534+0000 7ffb57fff640 1 -- 172.21.15.16:0/2344863044 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffb640acc70 con 0x7ffb701087d0 2024-09-10T23:40:10.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.722+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb7019c5b0 con 0x7ffb701087d0 2024-09-10T23:40:10.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.724+0000 7ffb57fff640 1 -- 172.21.15.16:0/2344863044 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22944 (secure 0 0 0) 0x7ffb640b16a0 con 0x7ffb701087d0 2024-09-10T23:40:10.725 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:10.725 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":77,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:38:43.527822+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffb580b5330 msgr2=0x7ffb580b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffb580b5330 0x7ffb580b77f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb60009500 comp rx=0 tx=0).stop 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb701087d0 msgr2=0x7ffb7019b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb701087d0 0x7ffb7019b9c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400e9f0 tx=0x7ffb6400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 shutdown_connections 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb70109150 0x7ffb701a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb701087d0 0x7ffb7019b9c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffb580b5330 0x7ffb580b77f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 --2- 172.21.15.16:0/2344863044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffb70102dc0 0x7ffb7019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 >> 172.21.15.16:0/2344863044 conn(0x7ffb700fe830 msgr2=0x7ffb70104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 shutdown_connections 2024-09-10T23:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:10.726+0000 7ffb7531c640 1 -- 172.21.15.16:0/2344863044 wait complete. 2024-09-10T23:40:10.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:10 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2344863044' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:40:11.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:10 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2344863044' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:40:11.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:10 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2344863044' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:40:11.530 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T23:40:11.530 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T23:40:11.539 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:40:11.540 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:40:11.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-10T23:40:11.540 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T23:40:11.540 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:40:11.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:40:11.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/2695501570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c681086f0 msgr2=0x7f6c68108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/2695501570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c681086f0 0x7f6c68108b30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009900 tx=0x7f6c5802a410 comp rx=0 tx=0).stop 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/2695501570 shutdown_connections 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/2695501570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c68109070 0x7f6c6810f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/2695501570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c681086f0 0x7f6c68108b30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/2695501570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c6806ac10 0x7f6c6806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/2695501570 >> 172.21.15.16:0/2695501570 conn(0x7f6c68077660 msgr2=0x7f6c68077a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/2695501570 shutdown_connections 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/2695501570 wait complete. 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 Processor -- start 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- start start 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c6806ac10 0x7f6c68101e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c681086f0 0x7f6c681023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c68109070 0x7f6c681028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c68112cc0 con 0x7f6c68109070 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c68112b40 con 0x7f6c6806ac10 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.650+0000 7f6c6ecd4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c68112e40 con 0x7f6c681086f0 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c68109070 0x7f6c681028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c68109070 0x7f6c681028e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47440/0 (socket says 172.21.15.16:47440) 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 -- 172.21.15.16:0/22015895 learned_addr learned my addr 172.21.15.16:0/22015895 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6ca70640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c6806ac10 0x7f6c68101e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c67fff640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c681086f0 0x7f6c681023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 -- 172.21.15.16:0/22015895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c681086f0 msgr2=0x7f6c681023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c681086f0 0x7f6c681023a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 -- 172.21.15.16:0/22015895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c6806ac10 msgr2=0x7f6c68101e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:11.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c6806ac10 0x7f6c68101e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 -- 172.21.15.16:0/22015895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c681a76f0 con 0x7f6c68109070 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6ca70640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c6806ac10 0x7f6c68101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6d271640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c68109070 0x7f6c681028e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000eb10 tx=0x7f6c6000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c65ffb640 1 -- 172.21.15.16:0/22015895 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60004b20 con 0x7f6c68109070 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c681a79e0 con 0x7f6c68109070 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c65ffb640 1 -- 172.21.15.16:0/22015895 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c60004cc0 con 0x7f6c68109070 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.651+0000 7f6c65ffb640 1 -- 172.21.15.16:0/22015895 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60010670 con 0x7f6c68109070 2024-09-10T23:40:11.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.652+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c681a7eb0 con 0x7f6c68109070 2024-09-10T23:40:11.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.653+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6806aff0 con 0x7f6c68109070 2024-09-10T23:40:11.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.654+0000 7f6c65ffb640 1 -- 172.21.15.16:0/22015895 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f6c60005020 con 0x7f6c68109070 2024-09-10T23:40:11.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.654+0000 7f6c65ffb640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c540b5330 0x7f6c540b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:11.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.655+0000 7f6c6ca70640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c540b5330 0x7f6c540b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:11.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.655+0000 7f6c65ffb640 1 -- 172.21.15.16:0/22015895 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6c600e6220 con 0x7f6c68109070 2024-09-10T23:40:11.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.655+0000 7f6c6ca70640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c540b5330 0x7f6c540b77f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c50005d00 tx=0x7f6c5000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:11.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.659+0000 7f6c65ffb640 1 -- 172.21.15.16:0/22015895 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6c600ad020 con 0x7f6c68109070 2024-09-10T23:40:11.790 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:11 smithi016 ceph-mon[30855]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T23:40:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:11.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:11.876+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f6c68063590 con 0x7f6c540b5330 2024-09-10T23:40:12.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.024+0000 7f6c65ffb640 1 -- 172.21.15.16:0/22015895 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6c68063590 con 0x7f6c540b5330 2024-09-10T23:40:12.025 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path / 2024-09-10T23:40:12.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.026+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c540b5330 msgr2=0x7f6c540b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.026+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c540b5330 0x7f6c540b77f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c50005d00 tx=0x7f6c5000b410 comp rx=0 tx=0).stop 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.026+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c68109070 msgr2=0x7f6c681028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.026+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c68109070 0x7f6c681028e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000eb10 tx=0x7f6c6000c2d0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 shutdown_connections 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c68109070 0x7f6c681028e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c681086f0 0x7f6c681023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6c540b5330 0x7f6c540b77f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 --2- 172.21.15.16:0/22015895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c6806ac10 0x7f6c68101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 >> 172.21.15.16:0/22015895 conn(0x7f6c68077660 msgr2=0x7f6c681067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 shutdown_connections 2024-09-10T23:40:12.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.027+0000 7f6c6ecd4640 1 -- 172.21.15.16:0/22015895 wait complete. 2024-09-10T23:40:12.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-10T23:40:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:11 smithi066 ceph-mon[34761]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T23:40:12.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.148+0000 7f4bee247640 1 -- 172.21.15.16:0/397435976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 msgr2=0x7f4be8104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 --2- 172.21.15.16:0/397435976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be8104000 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8009900 tx=0x7f4bd802a410 comp rx=0 tx=0).stop 2024-09-10T23:40:12.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 -- 172.21.15.16:0/397435976 shutdown_connections 2024-09-10T23:40:12.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 --2- 172.21.15.16:0/397435976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4be810d070 0x7f4be810f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 --2- 172.21.15.16:0/397435976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be8104540 0x7f4be810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 --2- 172.21.15.16:0/397435976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be8104000 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 -- 172.21.15.16:0/397435976 >> 172.21.15.16:0/397435976 conn(0x7f4be80fd690 msgr2=0x7f4be80ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 -- 172.21.15.16:0/397435976 shutdown_connections 2024-09-10T23:40:12.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 -- 172.21.15.16:0/397435976 wait complete. 2024-09-10T23:40:12.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 Processor -- start 2024-09-10T23:40:12.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.149+0000 7f4bee247640 1 -- start start 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be81018c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be8104540 0x7f4be8101e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4be810d070 0x7f4be8102340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4be8112d00 con 0x7f4be8103c20 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4be8112b80 con 0x7f4be810d070 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4be8112e80 con 0x7f4be8104540 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be81018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be81018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47476/0 (socket says 172.21.15.16:47476) 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 -- 172.21.15.16:0/3552059971 learned_addr learned my addr 172.21.15.16:0/3552059971 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be6ffd640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be8104540 0x7f4be8101e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be7fff640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4be810d070 0x7f4be8102340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 -- 172.21.15.16:0/3552059971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be8104540 msgr2=0x7f4be8101e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be8104540 0x7f4be8101e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 -- 172.21.15.16:0/3552059971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4be810d070 msgr2=0x7f4be8102340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4be810d070 0x7f4be8102340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 -- 172.21.15.16:0/3552059971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be81a76d0 con 0x7f4be8103c20 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be77fe640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be81018c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8005940 tx=0x7f4bd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be4ff9640 1 -- 172.21.15.16:0/3552059971 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd803f030 con 0x7f4be8103c20 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be4ff9640 1 -- 172.21.15.16:0/3552059971 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bd8003aa0 con 0x7f4be8103c20 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4be4ff9640 1 -- 172.21.15.16:0/3552059971 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8035070 con 0x7f4be8103c20 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 -- 172.21.15.16:0/3552059971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be81a7960 con 0x7f4be8103c20 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.150+0000 7f4bee247640 1 -- 172.21.15.16:0/3552059971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be81a7e50 con 0x7f4be8103c20 2024-09-10T23:40:12.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.151+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc8005290 con 0x7f4be8103c20 2024-09-10T23:40:12.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.154+0000 7f4be4ff9640 1 -- 172.21.15.16:0/3552059971 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f4bd803bcc0 con 0x7f4be8103c20 2024-09-10T23:40:12.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.154+0000 7f4be4ff9640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4bd00b5330 0x7f4bd00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.154+0000 7f4be4ff9640 1 -- 172.21.15.16:0/3552059971 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4bd8106930 con 0x7f4be8103c20 2024-09-10T23:40:12.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.155+0000 7f4be6ffd640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4bd00b5330 0x7f4bd00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.155+0000 7f4be6ffd640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4bd00b5330 0x7f4bd00b77f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4be81033b0 tx=0x7f4bdc00b2e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.157+0000 7f4be4ff9640 1 -- 172.21.15.16:0/3552059971 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4bd80cd730 con 0x7f4be8103c20 2024-09-10T23:40:12.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:11 smithi071 ceph-mon[35018]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.306+0000 7f97b28ec640 1 -- 172.21.15.16:0/3822306316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 msgr2=0x7f97ac10cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.306+0000 7f97b28ec640 1 --2- 172.21.15.16:0/3822306316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac10cb70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009900 tx=0x7f97a002a410 comp rx=0 tx=0).stop 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.306+0000 7f97b28ec640 1 -- 172.21.15.16:0/3822306316 shutdown_connections 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.306+0000 7f97b28ec640 1 --2- 172.21.15.16:0/3822306316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97ac10d140 0x7f97ac10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.306+0000 7f97b28ec640 1 --2- 172.21.15.16:0/3822306316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac10cb70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.306+0000 7f97b28ec640 1 --2- 172.21.15.16:0/3822306316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ac103b90 0x7f97ac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.307+0000 7f97b28ec640 1 -- 172.21.15.16:0/3822306316 >> 172.21.15.16:0/3822306316 conn(0x7f97ac0fd700 msgr2=0x7f97ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.307+0000 7f97b28ec640 1 -- 172.21.15.16:0/3822306316 shutdown_connections 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.307+0000 7f97b28ec640 1 -- 172.21.15.16:0/3822306316 wait complete. 2024-09-10T23:40:12.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.307+0000 7f97b28ec640 1 Processor -- start 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.307+0000 7f97b28ec640 1 -- start start 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.307+0000 7f97b28ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97ac103b90 0x7f97ac101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97b28ec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97b28ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ac10d140 0x7f97ac102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97b28ec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac112d60 con 0x7f97ac104590 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97b28ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac112be0 con 0x7f97ac103b90 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97b28ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac112ee0 con 0x7f97ac10d140 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac101f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47496/0 (socket says 172.21.15.16:47496) 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 -- 172.21.15.16:0/1875262763 learned_addr learned my addr 172.21.15.16:0/1875262763 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97abfff640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97ac103b90 0x7f97ac101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97b0e89640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ac10d140 0x7f97ac102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 -- 172.21.15.16:0/1875262763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ac10d140 msgr2=0x7f97ac102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ac10d140 0x7f97ac102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 -- 172.21.15.16:0/1875262763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97ac103b90 msgr2=0x7f97ac101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97ac103b90 0x7f97ac101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 -- 172.21.15.16:0/1875262763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac1a76b0 con 0x7f97ac104590 2024-09-10T23:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac101f50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f97a0005940 tx=0x7f97a00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97a97fa640 1 -- 172.21.15.16:0/1875262763 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a003f030 con 0x7f97ac104590 2024-09-10T23:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97a97fa640 1 -- 172.21.15.16:0/1875262763 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97a00044c0 con 0x7f97ac104590 2024-09-10T23:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.308+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac1a7940 con 0x7f97ac104590 2024-09-10T23:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.309+0000 7f97a97fa640 1 -- 172.21.15.16:0/1875262763 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0035070 con 0x7f97ac104590 2024-09-10T23:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.309+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac1a7e70 con 0x7f97ac104590 2024-09-10T23:40:12.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.311+0000 7f97b4cc1740 1 Processor -- start 2024-09-10T23:40:12.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.311+0000 7f97b4cc1740 1 -- start start 2024-09-10T23:40:12.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc15250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc17b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564b0cb7fe60 con 0x564b0cc15790 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b0cb6f290 con 0x564b0cc08ee0 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564b0cb730a0 con 0x564b0cc09800 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97abfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc15250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc092c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:41638/0 (socket says 172.21.15.16:41638) 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 -- 172.21.15.16:0/130117805 learned_addr learned my addr 172.21.15.16:0/130117805 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97a97fa640 1 -- 172.21.15.16:0/1875262763 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f97a003ba20 con 0x7f97ac104590 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc17b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 -- 172.21.15.16:0/130117805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 msgr2=0x564b0cc15250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc15250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 -- 172.21.15.16:0/130117805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 msgr2=0x564b0cc17b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc17b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97b0e89640 1 -- 172.21.15.16:0/130117805 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0c8cd930 con 0x564b0cc08ee0 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.312+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc17b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.313+0000 7f97b0e89640 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc092c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009f50 tx=0x7f97a40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d86ae711467420 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.313+0000 7f97927fc640 1 -- 172.21.15.16:0/130117805 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a4004d20 con 0x564b0cc08ee0 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.313+0000 7f97927fc640 1 -- 172.21.15.16:0/130117805 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97a4004050 con 0x564b0cc08ee0 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.313+0000 7f97927fc640 1 -- 172.21.15.16:0/130117805 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a4005280 con 0x564b0cc08ee0 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.313+0000 7f97a97fa640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97940b5430 0x7f97940b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.313+0000 7f97abfff640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97940b5430 0x7f97940b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.313+0000 7f97a97fa640 1 -- 172.21.15.16:0/1875262763 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f97a01062d0 con 0x7f97ac104590 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 -- 172.21.15.16:0/130117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 msgr2=0x564b0cc092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc092c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009f50 tx=0x7f97a40118d0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 -- 172.21.15.16:0/130117805 shutdown_connections 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc17b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc15250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/130117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc092c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 -- 172.21.15.16:0/130117805 >> 172.21.15.16:0/130117805 conn(0x564b0cc06d10 msgr2=0x564b0cc07eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 -- 172.21.15.16:0/130117805 shutdown_connections 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97abfff640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97940b5430 0x7f97940b78f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x564b0cc0c060 tx=0x7f979c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 -- 172.21.15.16:0/130117805 wait complete. 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.314+0000 7f97b4cc1740 1 -- start start 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 1 Processor -- start 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc12700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc12c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc15790 0x564b0cc13180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564b0c9d0890 con 0x564b0cc09800 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b0cb09d40 con 0x564b0cc08ee0 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564b0cc18440 con 0x564b0cc15790 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b4cc1740 10 client.0 _ll_register_callbacks cb 0x564b0cb6dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc12c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc12c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47520/0 (socket says 172.21.15.16:47520) 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97ab7fe640 1 -- 172.21.15.16:0/668687583 learned_addr learned my addr 172.21.15.16:0/668687583 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97abfff640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc12700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.315+0000 7f97b0e89640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc15790 0x564b0cc13180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97abfff640 1 -- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc15790 msgr2=0x564b0cc13180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97abfff640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc15790 0x564b0cc13180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97abfff640 1 -- 172.21.15.16:0/668687583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 msgr2=0x564b0cc12c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97abfff640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc12c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97abfff640 1 -- 172.21.15.16:0/668687583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0cc21820 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc12c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97abfff640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc12700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f979c012cb0 tx=0x7f979c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8cc833192441226 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f978b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f978b7fe640 1 -- 172.21.15.16:0/668687583 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c02e060 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f978b7fe640 1 -- 172.21.15.16:0/668687583 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f979c018030 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97a4004050 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f978b7fe640 1 -- 172.21.15.16:0/668687583 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f979c01ed20 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.316+0000 7f97b4cc1740 10 client.25070 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564b0cc241a0 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f978b7fe640 1 -- 172.21.15.16:0/668687583 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97a4004050 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f978b7fe640 1 -- 172.21.15.16:0/668687583 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f979c01c3a0 con 0x564b0cc08ee0 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97b4cc1740 10 client.25070 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97b4cc1740 10 client.25070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97b4cc1740 20 client.25070 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc25660 0x564b0cc27ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97b4cc1740 4 client.25070 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b0cb81db0 con 0x564b0cc25660 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.317+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc25660 0x564b0cc27ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.318+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc25660 0x564b0cc27ab0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4d7cffc75d3bf4d server_cookie=d069659b2d791612 in_seq=0 out_seq=0 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.318+0000 7f978b7fe640 10 client.25070 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.318+0000 7f978b7fe640 1 -- 172.21.15.16:0/668687583 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b0cb81db0 con 0x564b0cc25660 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.318+0000 7f978b7fe640 10 client.25070 handle_command_reply: tid=0 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.318+0000 7f97b4cc1740 1 client.25070 shutdown 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 msgr2=0x564b0cc12700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc12700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f979c012cb0 tx=0x7f979c004730 comp rx=0 tx=0).stop 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 shutdown_connections 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc25660 0x564b0cc27ab0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc15790 0x564b0cc13180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc12c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/668687583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc12700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 >> 172.21.15.16:0/668687583 conn(0x564b0cc06d10 msgr2=0x564b0cc05f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f978b7fe640 0 client.25070 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 shutdown_connections 2024-09-10T23:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 1 -- 172.21.15.16:0/668687583 wait complete. 2024-09-10T23:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.319+0000 7f97b4cc1740 20 client.25070 trim_cache size 0 max 16384 2024-09-10T23:40:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.354+0000 7f97b4cc1740 1 Processor -- start 2024-09-10T23:40:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.354+0000 7f97b4cc1740 1 -- start start 2024-09-10T23:40:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc14440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc12c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc13140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1b3040 con 0x564b0cc15790 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1b0910 con 0x564b0cc08ee0 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1ae760 con 0x564b0cc09800 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b0e89640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc13140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc12c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b0e89640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc13140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47530/0 (socket says 172.21.15.16:47530) 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97b0e89640 1 -- 172.21.15.16:0/774718743 learned_addr learned my addr 172.21.15.16:0/774718743 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97abfff640 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc14440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97ab7fe640 1 -- 172.21.15.16:0/774718743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 msgr2=0x564b0cc14440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc14440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97ab7fe640 1 -- 172.21.15.16:0/774718743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 msgr2=0x564b0cc13140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc13140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97ab7fe640 1 -- 172.21.15.16:0/774718743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0cc10c00 con 0x564b0cc09800 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97abfff640 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc14440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.355+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc12c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97a00cc9b0 tx=0x7f97a003b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f63963b88d599 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f9791ffb640 1 -- 172.21.15.16:0/774718743 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0105040 con 0x564b0cc09800 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f9791ffb640 1 -- 172.21.15.16:0/774718743 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97a0106040 con 0x564b0cc09800 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f9791ffb640 1 -- 172.21.15.16:0/774718743 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0049040 con 0x564b0cc09800 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 -- 172.21.15.16:0/774718743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 msgr2=0x564b0cc12c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc12c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97a00cc9b0 tx=0x7f97a003b4f0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 -- 172.21.15.16:0/774718743 shutdown_connections 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc15790 0x564b0cc13140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc09800 0x564b0cc12c00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/774718743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc08ee0 0x564b0cc14440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 -- 172.21.15.16:0/774718743 >> 172.21.15.16:0/774718743 conn(0x564b0cc06d10 msgr2=0x564b0cc13d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 -- 172.21.15.16:0/774718743 shutdown_connections 2024-09-10T23:40:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.356+0000 7f97b4cc1740 1 -- 172.21.15.16:0/774718743 wait complete. 2024-09-10T23:40:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 -- start start 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 Processor -- start 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc08ee0 0x564b0cc19680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc19bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc15790 0x564b0cc1a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1aedd0 con 0x564b0cc09800 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1b0240 con 0x564b0cc15790 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1af4a0 con 0x564b0cc08ee0 2024-09-10T23:40:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b4cc1740 10 client.0 _ll_register_callbacks cb 0x7f979c009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc19bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc19bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47546/0 (socket says 172.21.15.16:47546) 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97ab7fe640 1 -- 172.21.15.16:0/4040306259 learned_addr learned my addr 172.21.15.16:0/4040306259 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97abfff640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc08ee0 0x564b0cc19680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.357+0000 7f97b0e89640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc15790 0x564b0cc1a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97ab7fe640 1 -- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc08ee0 msgr2=0x564b0cc19680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc08ee0 0x564b0cc19680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97ab7fe640 1 -- 172.21.15.16:0/4040306259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc15790 msgr2=0x564b0cc1a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc15790 0x564b0cc1a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97ab7fe640 1 -- 172.21.15.16:0/4040306259 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0cc91600 con 0x564b0cc09800 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97abfff640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc08ee0 0x564b0cc19680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97ab7fe640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc19bc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f97a0032af0 tx=0x7f97a00ccaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d374ac04d3c3b1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f978b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f978b7fe640 1 -- 172.21.15.16:0/4040306259 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0105050 con 0x564b0cc09800 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f978b7fe640 1 -- 172.21.15.16:0/4040306259 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f97a0003cf0 con 0x564b0cc09800 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97a0106040 con 0x564b0cc09800 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f978b7fe640 1 -- 172.21.15.16:0/4040306259 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97a0049040 con 0x564b0cc09800 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97b4cc1740 10 client.15414 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564b0cc928b0 con 0x564b0cc09800 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.358+0000 7f978b7fe640 1 -- 172.21.15.16:0/4040306259 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97a0106040 con 0x564b0cc09800 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f978b7fe640 1 -- 172.21.15.16:0/4040306259 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f97a00d5a70 con 0x564b0cc09800 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97b4cc1740 10 client.15414 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97b4cc1740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97b4cc1740 20 client.15414 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc92f40 0x564b0cc95360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97b4cc1740 4 client.15414 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564b0cb7d860 con 0x564b0cc92f40 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97abfff640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc92f40 0x564b0cc95360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f97abfff640 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc92f40 0x564b0cc95360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15476882b11f9659 server_cookie=bc78c0f1c5a66a78 in_seq=0 out_seq=0 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.359+0000 7f978b7fe640 10 client.15414 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f978b7fe640 1 -- 172.21.15.16:0/4040306259 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b0cb7d860 con 0x564b0cc92f40 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f978b7fe640 10 client.15414 handle_command_reply: tid=0 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 client.15414 shutdown 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 msgr2=0x564b0cc19bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc19bc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f97a0032af0 tx=0x7f97a00ccaa0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 shutdown_connections 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564b0cc92f40 0x564b0cc95360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b0cc15790 0x564b0cc1a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564b0cc09800 0x564b0cc19bc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 --2- 172.21.15.16:0/4040306259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b0cc08ee0 0x564b0cc19680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 >> 172.21.15.16:0/4040306259 conn(0x564b0cc06d10 msgr2=0x564b0cc20ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f978b7fe640 0 client.15414 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 shutdown_connections 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 1 -- 172.21.15.16:0/4040306259 wait complete. 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.361+0000 7f97b4cc1740 20 client.15414 trim_cache size 0 max 16384 2024-09-10T23:40:12.367 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:40:12.368 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:40:12.368 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21", 2024-09-10T23:40:12.368 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:40:12.368 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:40:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97940b5430 msgr2=0x7f97940b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97940b5430 0x7f97940b78f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x564b0cc0c060 tx=0x7f979c005f90 comp rx=0 tx=0).stop 2024-09-10T23:40:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 msgr2=0x7f97ac101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac101f50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f97a0005940 tx=0x7f97a00040c0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 shutdown_connections 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97ac10d140 0x7f97ac102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97ac104590 0x7f97ac101f50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f97940b5430 0x7f97940b78f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 --2- 172.21.15.16:0/1875262763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97ac103b90 0x7f97ac101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 >> 172.21.15.16:0/1875262763 conn(0x7f97ac0fd700 msgr2=0x7f97ac0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 shutdown_connections 2024-09-10T23:40:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.362+0000 7f97b28ec640 1 -- 172.21.15.16:0/1875262763 wait complete. 2024-09-10T23:40:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.397+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f4bc8000c60 con 0x7f4bd00b5330 2024-09-10T23:40:12.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.455+0000 7f4be4ff9640 1 -- 172.21.15.16:0/3552059971 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f4bc8000c60 con 0x7f4bd00b5330 2024-09-10T23:40:12.456 INFO:teuthology.orchestra.run.smithi016.stdout:Retention added to path / 2024-09-10T23:40:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4bd00b5330 msgr2=0x7f4bd00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4bd00b5330 0x7f4bd00b77f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4be81033b0 tx=0x7f4bdc00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 msgr2=0x7f4be81018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be81018c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8005940 tx=0x7f4bd8004270 comp rx=0 tx=0).stop 2024-09-10T23:40:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 shutdown_connections 2024-09-10T23:40:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4bd00b5330 0x7f4bd00b77f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4be810d070 0x7f4be8102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4be8104540 0x7f4be8101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 --2- 172.21.15.16:0/3552059971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4be8103c20 0x7f4be81018c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 >> 172.21.15.16:0/3552059971 conn(0x7f4be80fd690 msgr2=0x7f4be80fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 shutdown_connections 2024-09-10T23:40:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.457+0000 7f4bce7fc640 1 -- 172.21.15.16:0/3552059971 wait complete. 2024-09-10T23:40:12.469 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T23:40:12.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 -- 172.21.15.16:0/3251314668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 msgr2=0x7f023810f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3251314668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023810f870 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0230009ca0 tx=0x7f023002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 -- 172.21.15.16:0/3251314668 shutdown_connections 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3251314668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023810f870 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3251314668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02381086f0 0x7f0238108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3251314668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f023806ac10 0x7f023806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 -- 172.21.15.16:0/3251314668 >> 172.21.15.16:0/3251314668 conn(0x7f0238077660 msgr2=0x7f0238077a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 -- 172.21.15.16:0/3251314668 shutdown_connections 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.573+0000 7f023e6cd640 1 -- 172.21.15.16:0/3251314668 wait complete. 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 Processor -- start 2024-09-10T23:40:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 -- start start 2024-09-10T23:40:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f023806ac10 0x7f0238199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02381086f0 0x7f02381996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0238112d30 con 0x7f0238109070 2024-09-10T23:40:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0238112bb0 con 0x7f023806ac10 2024-09-10T23:40:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023e6cd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0238112eb0 con 0x7f02381086f0 2024-09-10T23:40:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023cc6a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023cc6a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023819ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47570/0 (socket says 172.21.15.16:47570) 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f023cc6a640 1 -- 172.21.15.16:0/3732209675 learned_addr learned my addr 172.21.15.16:0/3732209675 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f02377fe640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02381086f0 0x7f02381996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.574+0000 7f0237fff640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f023806ac10 0x7f0238199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023cc6a640 1 -- 172.21.15.16:0/3732209675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02381086f0 msgr2=0x7f02381996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023cc6a640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02381086f0 0x7f02381996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023cc6a640 1 -- 172.21.15.16:0/3732209675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f023806ac10 msgr2=0x7f0238199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023cc6a640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f023806ac10 0x7f0238199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023cc6a640 1 -- 172.21.15.16:0/3732209675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023819f230 con 0x7f0238109070 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023cc6a640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023819ea60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0230005cc0 tx=0x7f023002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f02357fa640 1 -- 172.21.15.16:0/3732209675 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230003bf0 con 0x7f0238109070 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023819f4c0 con 0x7f0238109070 2024-09-10T23:40:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f02357fa640 1 -- 172.21.15.16:0/3732209675 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0230003d90 con 0x7f0238109070 2024-09-10T23:40:12.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f02357fa640 1 -- 172.21.15.16:0/3732209675 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023002fb20 con 0x7f0238109070 2024-09-10T23:40:12.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.575+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02381a5be0 con 0x7f0238109070 2024-09-10T23:40:12.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.576+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f023806aff0 con 0x7f0238109070 2024-09-10T23:40:12.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.579+0000 7f02357fa640 1 -- 172.21.15.16:0/3732209675 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f0230004580 con 0x7f0238109070 2024-09-10T23:40:12.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.579+0000 7f02357fa640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f02200b5330 0x7f02200b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.580+0000 7f0237fff640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f02200b5330 0x7f02200b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.580+0000 7f02357fa640 1 -- 172.21.15.16:0/3732209675 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f0230107160 con 0x7f0238109070 2024-09-10T23:40:12.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.580+0000 7f0237fff640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f02200b5330 0x7f02200b77f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f022800bbe0 tx=0x7f022800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.582+0000 7f02357fa640 1 -- 172.21.15.16:0/3732209675 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f02300cdf60 con 0x7f0238109070 2024-09-10T23:40:12.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.791+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0238104c30 con 0x7f02200b5330 2024-09-10T23:40:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.799+0000 7f02357fa640 1 -- 172.21.15.16:0/3732209675 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f0238104c30 con 0x7f02200b5330 2024-09-10T23:40:12.800 INFO:teuthology.orchestra.run.smithi016.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T23:40:11", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.803+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f02200b5330 msgr2=0x7f02200b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.803+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f02200b5330 0x7f02200b77f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f022800bbe0 tx=0x7f022800b390 comp rx=0 tx=0).stop 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.803+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 msgr2=0x7f023819ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.803+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023819ea60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0230005cc0 tx=0x7f023002f380 comp rx=0 tx=0).stop 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 shutdown_connections 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0238109070 0x7f023819ea60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02381086f0 0x7f02381996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f02200b5330 0x7f02200b77f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 --2- 172.21.15.16:0/3732209675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f023806ac10 0x7f0238199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 >> 172.21.15.16:0/3732209675 conn(0x7f0238077660 msgr2=0x7f0238104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 shutdown_connections 2024-09-10T23:40:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.804+0000 7f023e6cd640 1 -- 172.21.15.16:0/3732209675 wait complete. 2024-09-10T23:40:12.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 -- 172.21.15.16:0/1331205079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c109080 msgr2=0x7f471c10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 --2- 172.21.15.16:0/1331205079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c109080 0x7f471c10f880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4714009ca0 tx=0x7f471402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 -- 172.21.15.16:0/1331205079 shutdown_connections 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 --2- 172.21.15.16:0/1331205079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c109080 0x7f471c10f880 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 --2- 172.21.15.16:0/1331205079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f471c108700 0x7f471c108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 --2- 172.21.15.16:0/1331205079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f471c102d00 0x7f471c1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 -- 172.21.15.16:0/1331205079 >> 172.21.15.16:0/1331205079 conn(0x7f471c0fe720 msgr2=0x7f471c100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 -- 172.21.15.16:0/1331205079 shutdown_connections 2024-09-10T23:40:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 -- 172.21.15.16:0/1331205079 wait complete. 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.925+0000 7f4721f24640 1 Processor -- start 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f4721f24640 1 -- start start 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f4721f24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c102d00 0x7f471c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f4721f24640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f471c108700 0x7f471c199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f4721f24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f471c109080 0x7f471c19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f4721f24640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f471c112d40 con 0x7f471c102d00 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f4721f24640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f471c112bc0 con 0x7f471c109080 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f4721f24640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f471c112ec0 con 0x7f471c108700 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c102d00 0x7f471c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c102d00 0x7f471c1991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47592/0 (socket says 172.21.15.16:47592) 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 -- 172.21.15.16:0/2248383502 learned_addr learned my addr 172.21.15.16:0/2248383502 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471affd640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f471c108700 0x7f471c199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 -- 172.21.15.16:0/2248383502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f471c108700 msgr2=0x7f471c199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471bfff640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f471c109080 0x7f471c19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f471c108700 0x7f471c199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 -- 172.21.15.16:0/2248383502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f471c109080 msgr2=0x7f471c19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f471c109080 0x7f471c19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 -- 172.21.15.16:0/2248383502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c19f280 con 0x7f471c102d00 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471bfff640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f471c109080 0x7f471c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.926+0000 7f471b7fe640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c102d00 0x7f471c1991e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f470c00e9f0 tx=0x7f470c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.927+0000 7f4718ff9640 1 -- 172.21.15.16:0/2248383502 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c00cd80 con 0x7f471c102d00 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.927+0000 7f4718ff9640 1 -- 172.21.15.16:0/2248383502 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470c0054d0 con 0x7f471c102d00 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.927+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471c19f570 con 0x7f471c102d00 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.927+0000 7f4718ff9640 1 -- 172.21.15.16:0/2248383502 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c010690 con 0x7f471c102d00 2024-09-10T23:40:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.927+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f471c1a5c30 con 0x7f471c102d00 2024-09-10T23:40:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.928+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f471c1030e0 con 0x7f471c102d00 2024-09-10T23:40:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.929+0000 7f4718ff9640 1 -- 172.21.15.16:0/2248383502 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f470c004e30 con 0x7f471c102d00 2024-09-10T23:40:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.930+0000 7f4718ff9640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47040b5440 0x7f47040b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.930+0000 7f471affd640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47040b5440 0x7f47040b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.930+0000 7f4718ff9640 1 -- 172.21.15.16:0/2248383502 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f470c0e64f0 con 0x7f471c102d00 2024-09-10T23:40:12.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.930+0000 7f471affd640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47040b5440 0x7f47040b7900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f471c1082a0 tx=0x7f4710005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:12.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:12.933+0000 7f4718ff9640 1 -- 172.21.15.16:0/2248383502 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f470c056220 con 0x7f471c102d00 2024-09-10T23:40:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:12 smithi016 ceph-mon[30855]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:12 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:40:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:12 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:12 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:40:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:12 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:13.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:12 smithi066 ceph-mon[34761]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:13.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:12 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:40:13.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:12 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:13.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:12 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:40:13.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:12 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:13.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.144+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f471c063590 con 0x7f47040b5440 2024-09-10T23:40:13.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:40:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.152+0000 7f4718ff9640 1 -- 172.21.15.16:0/2248383502 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f471c063590 con 0x7f47040b5440 2024-09-10T23:40:13.153 INFO:teuthology.orchestra.run.smithi016.stdout:/ 1m 6m3h 2024-09-10T23:40:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47040b5440 msgr2=0x7f47040b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47040b5440 0x7f47040b7900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f471c1082a0 tx=0x7f4710005f90 comp rx=0 tx=0).stop 2024-09-10T23:40:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c102d00 msgr2=0x7f471c1991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c102d00 0x7f471c1991e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f470c00e9f0 tx=0x7f470c00edf0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 shutdown_connections 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47040b5440 0x7f47040b7900 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f471c109080 0x7f471c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f471c108700 0x7f471c199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 --2- 172.21.15.16:0/2248383502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f471c102d00 0x7f471c1991e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 >> 172.21.15.16:0/2248383502 conn(0x7f471c0fe720 msgr2=0x7f471c100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 shutdown_connections 2024-09-10T23:40:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.154+0000 7f4721f24640 1 -- 172.21.15.16:0/2248383502 wait complete. 2024-09-10T23:40:13.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-10T23:40:13.235 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-10T23:40:13.245 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T23:40:13.259 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:40:13.259 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T23:40:13.259 INFO:tasks.workunit:timeout=3h 2024-09-10T23:40:13.259 INFO:tasks.workunit:cleanup=True 2024-09-10T23:40:13.259 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:40:13.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:12 smithi071 ceph-mon[35018]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:13.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:12 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:40:13.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:12 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:13.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:12 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:40:13.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:12 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-10 23:38:32.540840808 +0000 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-10 23:38:32.540840808 +0000 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-10 23:40:03.012380137 +0000 2024-09-10T23:40:13.291 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-10 23:38:32.540840808 +0000 2024-09-10T23:40:13.291 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T23:40:13.292 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T23:40:13.366 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:40:13.406 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:13.422 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 -- 172.21.15.16:0/3978046684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70109150 msgr2=0x7f2c7010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 --2- 172.21.15.16:0/3978046684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70109150 0x7f2c7010f950 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009900 tx=0x7f2c6802a410 comp rx=0 tx=0).stop 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 -- 172.21.15.16:0/3978046684 shutdown_connections 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 --2- 172.21.15.16:0/3978046684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70109150 0x7f2c7010f950 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 --2- 172.21.15.16:0/3978046684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c701087d0 0x7f2c70108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 --2- 172.21.15.16:0/3978046684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c70102dc0 0x7f2c701031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 -- 172.21.15.16:0/3978046684 >> 172.21.15.16:0/3978046684 conn(0x7f2c700fe830 msgr2=0x7f2c70100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:13.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 -- 172.21.15.16:0/3978046684 shutdown_connections 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.938+0000 7f2c757ef640 1 -- 172.21.15.16:0/3978046684 wait complete. 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 Processor -- start 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 -- start start 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70102dc0 0x7f2c70199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c701087d0 0x7f2c701997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c70109150 0x7f2c7019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2c70112dd0 con 0x7f2c70102dc0 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2c70112c50 con 0x7f2c70109150 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c757ef640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c70112f50 con 0x7f2c701087d0 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70102dc0 0x7f2c70199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70102dc0 0x7f2c70199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42172/0 (socket says 172.21.15.16:42172) 2024-09-10T23:40:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.939+0000 7f2c6effd640 1 -- 172.21.15.16:0/2847264729 learned_addr learned my addr 172.21.15.16:0/2847264729 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c70109150 0x7f2c7019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6e7fc640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c701087d0 0x7f2c701997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6effd640 1 -- 172.21.15.16:0/2847264729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c701087d0 msgr2=0x7f2c701997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6effd640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c701087d0 0x7f2c701997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6effd640 1 -- 172.21.15.16:0/2847264729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c70109150 msgr2=0x7f2c7019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6effd640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c70109150 0x7f2c7019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6effd640 1 -- 172.21.15.16:0/2847264729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7019f310 con 0x7f2c70102dc0 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c6effd640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70102dc0 0x7f2c70199260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000ebc0 tx=0x7f2c6000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c67fff640 1 -- 172.21.15.16:0/2847264729 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60010630 con 0x7f2c70102dc0 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c67fff640 1 -- 172.21.15.16:0/2847264729 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c60010c80 con 0x7f2c70102dc0 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7019f600 con 0x7f2c70102dc0 2024-09-10T23:40:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c67fff640 1 -- 172.21.15.16:0/2847264729 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60018b60 con 0x7f2c70102dc0 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.940+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c701a5cc0 con 0x7f2c70102dc0 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c67fff640 1 -- 172.21.15.16:0/2847264729 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f2c600107d0 con 0x7f2c70102dc0 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 Processor -- start 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 -- start start 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a54860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a63120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5560299cae50 con 0x556029a60d30 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5560299ba280 con 0x556029a54480 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.943+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5560299be090 con 0x556029a54da0 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a63120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a63120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42178/0 (socket says 172.21.15.16:42178) 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6e7fc640 1 -- 172.21.15.16:0/1252661436 learned_addr learned my addr 172.21.15.16:0/1252661436 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a54860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6effd640 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c67fff640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2c5c0b53c0 0x7f2c5c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 -- 172.21.15.16:0/1252661436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 msgr2=0x556029a607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 -- 172.21.15.16:0/1252661436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 msgr2=0x556029a63120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a63120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 -- 172.21.15.16:0/1252661436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556029718650 con 0x556029a54480 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c67fff640 1 -- 172.21.15.16:0/2847264729 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2c600e6500 con 0x7f2c70102dc0 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2c5c0b53c0 0x7f2c5c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a54860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c68005940 tx=0x7f2c68032ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867c09235889e29b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c657fa640 1 -- 172.21.15.16:0/1252661436 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68035040 con 0x556029a54480 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2c5c0b53c0 0x7f2c5c0b7880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2c68046000 tx=0x7f2c68047000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c657fa640 1 -- 172.21.15.16:0/1252661436 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c680318c0 con 0x556029a54480 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.944+0000 7f2c657fa640 1 -- 172.21.15.16:0/1252661436 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68004e20 con 0x556029a54480 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 -- 172.21.15.16:0/1252661436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 msgr2=0x556029a54860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a54860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c68005940 tx=0x7f2c68032ba0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 -- 172.21.15.16:0/1252661436 shutdown_connections 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a63120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/1252661436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a54860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 -- 172.21.15.16:0/1252661436 >> 172.21.15.16:0/1252661436 conn(0x556029a522b0 msgr2=0x556029a53450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 -- 172.21.15.16:0/1252661436 shutdown_connections 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.945+0000 7f2c77bc4740 1 -- 172.21.15.16:0/1252661436 wait complete. 2024-09-10T23:40:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 -- start start 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 Processor -- start 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a5db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a5e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55602981b700 con 0x556029a60d30 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556029955110 con 0x556029a54480 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556029a639b0 con 0x556029a54da0 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c77bc4740 10 client.0 _ll_register_callbacks cb 0x55602996e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a5e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a5e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42186/0 (socket says 172.21.15.16:42186) 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 -- 172.21.15.16:0/846151032 learned_addr learned my addr 172.21.15.16:0/846151032 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6e7fc640 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a5db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 -- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 msgr2=0x556029a5db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a5db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 -- 172.21.15.16:0/846151032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 msgr2=0x556029a606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.946+0000 7f2c6f7fe640 1 -- 172.21.15.16:0/846151032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556029982c40 con 0x556029a60d30 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a5e200 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c68031a90 tx=0x7f2c68004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851fe93d4f95f6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c567fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c567fc640 1 -- 172.21.15.16:0/846151032 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68057030 con 0x556029a60d30 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c567fc640 1 -- 172.21.15.16:0/846151032 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2c6804c040 con 0x556029a60d30 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c680318c0 con 0x556029a60d30 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c567fc640 1 -- 172.21.15.16:0/846151032 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2c68050690 con 0x556029a60d30 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556029a6f3c0 con 0x556029a60d30 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c567fc640 1 -- 172.21.15.16:0/846151032 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c680318c0 con 0x556029a60d30 2024-09-10T23:40:13.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c567fc640 1 -- 172.21.15.16:0/846151032 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2c6803ca80 con 0x556029a60d30 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 20 client.15438 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029a70710 0x556029a72b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 4 client.15438 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.947+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560299ccda0 con 0x556029a70710 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.948+0000 7f2c6effd640 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029a70710 0x556029a72b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.948+0000 7f2c6effd640 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029a70710 0x556029a72b00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed7256c42577265a server_cookie=6243dc622165875e in_seq=0 out_seq=0 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.948+0000 7f2c567fc640 10 client.15438 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c567fc640 1 -- 172.21.15.16:0/846151032 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560299ccda0 con 0x556029a70710 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c567fc640 10 client.15438 handle_command_reply: tid=0 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 client.15438 shutdown 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 msgr2=0x556029a5e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a5e200 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c68031a90 tx=0x7f2c68004950 comp rx=0 tx=0).stop 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 shutdown_connections 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029a70710 0x556029a72b00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a60d30 0x556029a5e200 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a5db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/846151032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54480 0x556029a606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 >> 172.21.15.16:0/846151032 conn(0x556029a522b0 msgr2=0x556029a57e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c567fc640 0 client.15438 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 shutdown_connections 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 1 -- 172.21.15.16:0/846151032 wait complete. 2024-09-10T23:40:13.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.949+0000 7f2c77bc4740 20 client.15438 trim_cache size 0 max 16384 2024-09-10T23:40:13.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 Processor -- start 2024-09-10T23:40:13.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 -- start start 2024-09-10T23:40:13.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a6cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54da0 0x556029a62120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a60d30 0x556029a62660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2c701b0e50 con 0x556029a54480 2024-09-10T23:40:13.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2c701ae720 con 0x556029a54da0 2024-09-10T23:40:13.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c701ac570 con 0x556029a60d30 2024-09-10T23:40:13.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a6cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a6cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42194/0 (socket says 172.21.15.16:42194) 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c6effd640 1 -- 172.21.15.16:0/3396342813 learned_addr learned my addr 172.21.15.16:0/3396342813 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.967+0000 7f2c6e7fc640 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54da0 0x556029a62120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a60d30 0x556029a62660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6effd640 1 -- 172.21.15.16:0/3396342813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a60d30 msgr2=0x556029a62660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6effd640 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a60d30 0x556029a62660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6effd640 1 -- 172.21.15.16:0/3396342813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54da0 msgr2=0x556029a62120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6effd640 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54da0 0x556029a62120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6effd640 1 -- 172.21.15.16:0/3396342813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556029a52d30 con 0x556029a54480 2024-09-10T23:40:13.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a60d30 0x556029a62660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c6effd640 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a6cc50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ac7a0 tx=0x7f2c6000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5645cfc32980781b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c64ff9640 1 -- 172.21.15.16:0/3396342813 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600a8210 con 0x556029a54480 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c64ff9640 1 -- 172.21.15.16:0/3396342813 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c60018420 con 0x556029a54480 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.968+0000 7f2c64ff9640 1 -- 172.21.15.16:0/3396342813 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600b6030 con 0x556029a54480 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 -- 172.21.15.16:0/3396342813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 msgr2=0x556029a6cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a6cc50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ac7a0 tx=0x7f2c6000cf90 comp rx=0 tx=0).stop 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 -- 172.21.15.16:0/3396342813 shutdown_connections 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a60d30 0x556029a62660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a54da0 0x556029a62120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/3396342813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a6cc50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 -- 172.21.15.16:0/3396342813 >> 172.21.15.16:0/3396342813 conn(0x556029a522b0 msgr2=0x556029a58d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:13.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 -- 172.21.15.16:0/3396342813 shutdown_connections 2024-09-10T23:40:13.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 -- 172.21.15.16:0/3396342813 wait complete. 2024-09-10T23:40:13.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 -- start start 2024-09-10T23:40:13.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 Processor -- start 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a71770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.969+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a71cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c77bc4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a60d30 0x556029a721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2c701acbe0 con 0x556029a54480 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2c701ae050 con 0x556029a60d30 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c77bc4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c701ad2b0 con 0x556029a54da0 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c77bc4740 10 client.0 _ll_register_callbacks cb 0x7f2c68049020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a71770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a71770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42206/0 (socket says 172.21.15.16:42206) 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 -- 172.21.15.16:0/884688812 learned_addr learned my addr 172.21.15.16:0/884688812 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:13.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6f7fe640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a60d30 0x556029a721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6e7fc640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a71cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 -- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 msgr2=0x556029a71cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a71cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 -- 172.21.15.16:0/884688812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a60d30 msgr2=0x556029a721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a60d30 0x556029a721f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 -- 172.21.15.16:0/884688812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556029a4d940 con 0x556029a54480 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6e7fc640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a71cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c6effd640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a71770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000efe0 tx=0x7f2c600099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fd6575dc2d2ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c567fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c567fc640 1 -- 172.21.15.16:0/884688812 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600a8210 con 0x556029a54480 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5560299c8850 con 0x556029a54480 2024-09-10T23:40:13.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c567fc640 1 -- 172.21.15.16:0/884688812 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2c600e62f0 con 0x556029a54480 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c567fc640 1 -- 172.21.15.16:0/884688812 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2c600ac5b0 con 0x556029a54480 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.970+0000 7f2c77bc4740 10 client.15444 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556029ae1830 con 0x556029a54480 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c567fc640 1 -- 172.21.15.16:0/884688812 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5560299c8850 con 0x556029a54480 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c567fc640 1 -- 172.21.15.16:0/884688812 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2c600a83f0 con 0x556029a54480 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c77bc4740 10 client.15444 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c77bc4740 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c77bc4740 20 client.15444 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029ae1fd0 0x556029ae43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c77bc4740 4 client.15444 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560299c5c80 con 0x556029ae1fd0 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.971+0000 7f2c6e7fc640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029ae1fd0 0x556029ae43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:13.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c6e7fc640 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029ae1fd0 0x556029ae43f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=912328faf224a9f9 server_cookie=e9b0be2bfe6b3e90 in_seq=0 out_seq=0 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c567fc640 10 client.15444 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c567fc640 1 -- 172.21.15.16:0/884688812 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x5560299c5c80 con 0x556029ae1fd0 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c567fc640 10 client.15444 handle_command_reply: tid=0 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 client.15444 shutdown 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 msgr2=0x556029a71770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a71770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000efe0 tx=0x7f2c600099b0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 shutdown_connections 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556029ae1fd0 0x556029ae43f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556029a60d30 0x556029a721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556029a54da0 0x556029a71cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 --2- 172.21.15.16:0/884688812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556029a54480 0x556029a71770 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c567fc640 0 client.15444 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:13.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 >> 172.21.15.16:0/884688812 conn(0x556029a522b0 msgr2=0x556029a50bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:13.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 shutdown_connections 2024-09-10T23:40:13.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 1 -- 172.21.15.16:0/884688812 wait complete. 2024-09-10T23:40:13.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.972+0000 7f2c77bc4740 20 client.15444 trim_cache size 0 max 16384 2024-09-10T23:40:13.980 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:40:13.980 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:40:13.980 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21", 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:40:13.981 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:40:13.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:40:13.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:40:13.982 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:40:13.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2c5c0b53c0 msgr2=0x7f2c5c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2c5c0b53c0 0x7f2c5c0b7880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2c68046000 tx=0x7f2c68047000 comp rx=0 tx=0).stop 2024-09-10T23:40:13.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70102dc0 msgr2=0x7f2c70199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70102dc0 0x7f2c70199260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000ebc0 tx=0x7f2c6000c6a0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 shutdown_connections 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2c5c0b53c0 0x7f2c5c0b7880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c70109150 0x7f2c7019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c701087d0 0x7f2c701997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 --2- 172.21.15.16:0/2847264729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c70102dc0 0x7f2c70199260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 >> 172.21.15.16:0/2847264729 conn(0x7f2c700fe830 msgr2=0x7f2c70100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 shutdown_connections 2024-09-10T23:40:13.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:13.973+0000 7f2c757ef640 1 -- 172.21.15.16:0/2847264729 wait complete. 2024-09-10T23:40:14.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:13 smithi066 ceph-mon[34761]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:13 smithi066 ceph-mon[34761]: pgmap v320: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 91 KiB/s wr, 29 op/s 2024-09-10T23:40:14.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:13 smithi066 ceph-mon[34761]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:13 smithi066 ceph-mon[34761]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-10T23:40:14.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:13 smithi066 ceph-mon[34761]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:13 smithi016 ceph-mon[30855]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:13 smithi016 ceph-mon[30855]: pgmap v320: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 91 KiB/s wr, 29 op/s 2024-09-10T23:40:14.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:13 smithi016 ceph-mon[30855]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:13 smithi016 ceph-mon[30855]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-10T23:40:14.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:13 smithi016 ceph-mon[30855]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:13 smithi071 ceph-mon[35018]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:13 smithi071 ceph-mon[35018]: pgmap v320: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 91 KiB/s wr, 29 op/s 2024-09-10T23:40:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:13 smithi071 ceph-mon[35018]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:13 smithi071 ceph-mon[35018]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-10T23:40:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:13 smithi071 ceph-mon[35018]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:40:14.935 INFO:tasks.cephfs.filesystem:scrub status for tag:1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21 - {'path': '/', 'tag': '1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21', 'options': 'recursive,force'} 2024-09-10T23:40:16.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:15 smithi066 ceph-mon[34761]: pgmap v321: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 91 KiB/s wr, 29 op/s 2024-09-10T23:40:16.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:15 smithi016 ceph-mon[30855]: pgmap v321: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 91 KiB/s wr, 29 op/s 2024-09-10T23:40:16.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:15 smithi071 ceph-mon[35018]: pgmap v321: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 91 KiB/s wr, 29 op/s 2024-09-10T23:40:18.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:17 smithi016 ceph-mon[30855]: pgmap v322: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 91 KiB/s wr, 28 op/s 2024-09-10T23:40:18.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:17 smithi071 ceph-mon[35018]: pgmap v322: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 91 KiB/s wr, 28 op/s 2024-09-10T23:40:18.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:17 smithi066 ceph-mon[34761]: pgmap v322: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 91 KiB/s wr, 28 op/s 2024-09-10T23:40:20.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:19 smithi016 ceph-mon[30855]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-10T23:40:20.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:19 smithi071 ceph-mon[35018]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-10T23:40:20.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:19 smithi066 ceph-mon[34761]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-10T23:40:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:21 smithi016 ceph-mon[30855]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-10T23:40:22.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:21 smithi071 ceph-mon[35018]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-10T23:40:22.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:21 smithi066 ceph-mon[34761]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-10T23:40:23.171 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:22 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:40:23.202 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:22 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:40:23.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:22 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:40:23.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:23 smithi016 ceph-mon[30855]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-10T23:40:23.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:23 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:40:24.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:23 smithi071 ceph-mon[35018]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-10T23:40:24.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:23 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:40:24.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:23 smithi066 ceph-mon[34761]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-10T23:40:24.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:23 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 30 op/s 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:40:25.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 30 op/s 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:40:25.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 30 op/s 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:40:25.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:40:27.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:27 smithi071 ceph-mon[35018]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-10T23:40:27.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:27 smithi066 ceph-mon[34761]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-10T23:40:27.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:27 smithi016 ceph-mon[30855]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-10T23:40:29.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:29 smithi071 ceph-mon[35018]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-09-10T23:40:29.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:29 smithi066 ceph-mon[34761]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-09-10T23:40:29.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:29 smithi016 ceph-mon[30855]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-09-10T23:40:31.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:31 smithi071 ceph-mon[35018]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:31.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:31 smithi066 ceph-mon[34761]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:31.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:31 smithi016 ceph-mon[30855]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:33.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:33 smithi071 ceph-mon[35018]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:40:33.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:33 smithi016 ceph-mon[30855]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:40:33.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:33 smithi066 ceph-mon[34761]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:40:35.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:35 smithi071 ceph-mon[35018]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:40:35.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:35 smithi066 ceph-mon[34761]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:40:35.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:35 smithi016 ceph-mon[30855]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:40:37.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:37 smithi071 ceph-mon[35018]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:40:37.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:37 smithi066 ceph-mon[34761]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:40:37.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:37 smithi016 ceph-mon[30855]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:40:39.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:39 smithi066 ceph-mon[34761]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:40:39.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:39 smithi016 ceph-mon[30855]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:40:40.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:39 smithi071 ceph-mon[35018]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:40:41.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:41 smithi066 ceph-mon[34761]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:41.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:41 smithi016 ceph-mon[30855]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:42.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:41 smithi071 ceph-mon[35018]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:40:43.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:43 smithi066 ceph-mon[34761]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:40:43.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:43 smithi016 ceph-mon[30855]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:40:44.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:43 smithi071 ceph-mon[35018]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:40:44.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:40:45.225 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:45.645 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:45 smithi016 ceph-mon[30855]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:40:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 -- 172.21.15.16:0/2492911287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4107640 msgr2=0x7efff410de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 --2- 172.21.15.16:0/2492911287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4107640 0x7efff410de20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7effec009ca0 tx=0x7effec02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 -- 172.21.15.16:0/2492911287 shutdown_connections 2024-09-10T23:40:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 --2- 172.21.15.16:0/2492911287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4107640 0x7efff410de20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 --2- 172.21.15.16:0/2492911287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff4106ca0 0x7efff4107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 --2- 172.21.15.16:0/2492911287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 0x7efff4101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 -- 172.21.15.16:0/2492911287 >> 172.21.15.16:0/2492911287 conn(0x7efff40fd2f0 msgr2=0x7efff40ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 -- 172.21.15.16:0/2492911287 shutdown_connections 2024-09-10T23:40:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.779+0000 7efff8ba2640 1 -- 172.21.15.16:0/2492911287 wait complete. 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.780+0000 7efff8ba2640 1 Processor -- start 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.780+0000 7efff8ba2640 1 -- start start 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff8ba2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 0x7efff4197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff8ba2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4106ca0 0x7efff4197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff8ba2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff4107640 0x7efff419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff8ba2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efff4111240 con 0x7efff4107640 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff8ba2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efff41110c0 con 0x7efff4106ca0 2024-09-10T23:40:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff8ba2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efff41113c0 con 0x7efff41012a0 2024-09-10T23:40:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 0x7efff4197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 0x7efff4197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:56216/0 (socket says 172.21.15.16:56216) 2024-09-10T23:40:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff37fe640 1 -- 172.21.15.16:0/4044119979 learned_addr learned my addr 172.21.15.16:0/4044119979 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff2ffd640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4106ca0 0x7efff4197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.781+0000 7efff3fff640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff4107640 0x7efff419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.782+0000 7efff37fe640 1 -- 172.21.15.16:0/4044119979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4106ca0 msgr2=0x7efff4197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.782+0000 7efff37fe640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4106ca0 0x7efff4197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.782+0000 7efff37fe640 1 -- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff4107640 msgr2=0x7efff419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.782+0000 7efff37fe640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff4107640 0x7efff419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.782+0000 7efff37fe640 1 -- 172.21.15.16:0/4044119979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff419d700 con 0x7efff41012a0 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.782+0000 7efff3fff640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff4107640 0x7efff419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.782+0000 7efff37fe640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 0x7efff4197650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7effe4010a10 tx=0x7effe4010e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.783+0000 7efff0ff9640 1 -- 172.21.15.16:0/4044119979 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe400eda0 con 0x7efff41012a0 2024-09-10T23:40:45.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.783+0000 7efff0ff9640 1 -- 172.21.15.16:0/4044119979 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe40054d0 con 0x7efff41012a0 2024-09-10T23:40:45.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.783+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff419d9f0 con 0x7efff41012a0 2024-09-10T23:40:45.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.783+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff406a220 con 0x7efff41012a0 2024-09-10T23:40:45.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.783+0000 7efff0ff9640 1 -- 172.21.15.16:0/4044119979 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4012480 con 0x7efff41012a0 2024-09-10T23:40:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 Processor -- start 2024-09-10T23:40:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efff0ff9640 1 -- 172.21.15.16:0/4044119979 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7effe400f040 con 0x7efff41012a0 2024-09-10T23:40:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 -- start start 2024-09-10T23:40:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdc7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdda700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55927cd3de50 con 0x55927cdc7f70 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55927cd2d280 con 0x55927cdc7650 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efffc1d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55927cd31090 con 0x55927cdd8310 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efff3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdc7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efff3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdc7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:37134/0 (socket says 172.21.15.16:37134) 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.787+0000 7efff3fff640 1 -- 172.21.15.16:0/835956619 learned_addr learned my addr 172.21.15.16:0/835956619 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff37fe640 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff3fff640 1 -- 172.21.15.16:0/835956619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 msgr2=0x55927cdda700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff3fff640 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdda700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff3fff640 1 -- 172.21.15.16:0/835956619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 msgr2=0x55927cdd7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff3fff640 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff3fff640 1 -- 172.21.15.16:0/835956619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927ca8b650 con 0x55927cdc7650 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff37fe640 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff0ff9640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effdc0b5560 0x7effdc0b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.788+0000 7efff3fff640 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdc7a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7effec033040 tx=0x7effec02f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9e6f71f6d3b597c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.789+0000 7efff0ff9640 1 -- 172.21.15.16:0/4044119979 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7effe40e5cd0 con 0x7efff41012a0 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.789+0000 7effd9ffb640 1 -- 172.21.15.16:0/835956619 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec049070 con 0x55927cdc7650 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.789+0000 7effd9ffb640 1 -- 172.21.15.16:0/835956619 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effec036040 con 0x55927cdc7650 2024-09-10T23:40:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.789+0000 7effd9ffb640 1 -- 172.21.15.16:0/835956619 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec004040 con 0x55927cdc7650 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.789+0000 7efff37fe640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effdc0b5560 0x7effdc0b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 -- 172.21.15.16:0/835956619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 msgr2=0x55927cdc7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdc7a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7effec033040 tx=0x7effec02f310 comp rx=0 tx=0).stop 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efff37fe640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effdc0b5560 0x7effdc0b7a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7effe40109e0 tx=0x7effe4009310 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 -- 172.21.15.16:0/835956619 shutdown_connections 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdda700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 --2- 172.21.15.16:0/835956619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdc7a30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 -- 172.21.15.16:0/835956619 >> 172.21.15.16:0/835956619 conn(0x55927cdc5480 msgr2=0x55927cdc6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:45.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 -- 172.21.15.16:0/835956619 shutdown_connections 2024-09-10T23:40:45.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.790+0000 7efffc1d9740 1 -- 172.21.15.16:0/835956619 wait complete. 2024-09-10T23:40:45.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.791+0000 7efffc1d9740 1 -- start start 2024-09-10T23:40:45.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.791+0000 7efffc1d9740 1 Processor -- start 2024-09-10T23:40:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.791+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7650 0x55927cdd7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.791+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7f70 0x55927cdd4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdd5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efffc1d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55927cb8e700 con 0x55927cdc7650 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efffc1d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55927ccc8110 con 0x55927cdc7f70 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efffc1d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55927cddaf60 con 0x55927cdd8310 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7650 0x55927cdd7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7650 0x55927cdd7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54680/0 (socket says 172.21.15.16:54680) 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 -- 172.21.15.16:0/4095108944 learned_addr learned my addr 172.21.15.16:0/4095108944 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff2ffd640 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7f70 0x55927cdd4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdd5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efffc1d9740 10 client.0 _ll_register_callbacks cb 0x55927cce1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 -- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 msgr2=0x55927cdd5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdd5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 -- 172.21.15.16:0/4095108944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7f70 msgr2=0x55927cdd4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7f70 0x55927cdd4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 -- 172.21.15.16:0/4095108944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927ccf5c40 con 0x55927cdc7650 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effec036040 con 0x55927cdc7650 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7efff3fff640 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7650 0x55927cdd7b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7effec009ca0 tx=0x7effec003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcec878625f01fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.792+0000 7effd2ffd640 10 client.15453 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.793+0000 7effd2ffd640 1 -- 172.21.15.16:0/4095108944 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec05b020 con 0x55927cdc7650 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.793+0000 7effd2ffd640 1 -- 172.21.15.16:0/4095108944 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7effec057b10 con 0x55927cdc7650 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.793+0000 7effd2ffd640 1 -- 172.21.15.16:0/4095108944 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effec049050 con 0x55927cdc7650 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.793+0000 7efffc1d9740 10 client.15453 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.793+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55927cdcd980 con 0x55927cdc7650 2024-09-10T23:40:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7effd2ffd640 1 -- 172.21.15.16:0/4095108944 <== mon.0 v2:172.21.15.16:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7effec02faa0 con 0x55927cdc7650 2024-09-10T23:40:45.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7efffc1d9740 10 client.15453 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:45.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7efffc1d9740 10 client.15453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7efffc1d9740 20 client.15453 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7efffc1d9740 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927cdced30 0x55927cdd11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7efffc1d9740 4 client.15453 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55927cd3fda0 con 0x55927cdced30 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.794+0000 7efff2ffd640 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927cdced30 0x55927cdd11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.795+0000 7efff2ffd640 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927cdced30 0x55927cdd11f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f52aee87567c1749 server_cookie=a195dd5b659a403d in_seq=0 out_seq=0 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.795+0000 7effd2ffd640 10 client.15453 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.795+0000 7effd2ffd640 1 -- 172.21.15.16:0/4095108944 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55927cd3fda0 con 0x55927cdced30 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.795+0000 7effd2ffd640 10 client.15453 handle_command_reply: tid=0 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.795+0000 7efffc1d9740 1 client.15453 shutdown 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7650 msgr2=0x55927cdd7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7650 0x55927cdd7b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7effec009ca0 tx=0x7effec003b20 comp rx=0 tx=0).stop 2024-09-10T23:40:45.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 shutdown_connections 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927cdced30 0x55927cdd11f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdd5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7f70 0x55927cdd4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 --2- 172.21.15.16:0/4095108944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7650 0x55927cdd7b30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 >> 172.21.15.16:0/4095108944 conn(0x55927cdc5480 msgr2=0x55927cdcb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7effd2ffd640 0 client.15453 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 shutdown_connections 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 1 -- 172.21.15.16:0/4095108944 wait complete. 2024-09-10T23:40:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.796+0000 7efffc1d9740 20 client.15453 trim_cache size 0 max 16384 2024-09-10T23:40:45.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:45 smithi066 ceph-mon[34761]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:40:45.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 Processor -- start 2024-09-10T23:40:45.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 -- start start 2024-09-10T23:40:45.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdd2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdc3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7effe0010f90 con 0x55927cdc7f70 2024-09-10T23:40:45.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7effe000e860 con 0x55927cdc7650 2024-09-10T23:40:45.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efffc1d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effe000c6b0 con 0x55927cdd8310 2024-09-10T23:40:45.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efff2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efff2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54682/0 (socket says 172.21.15.16:54682) 2024-09-10T23:40:45.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.832+0000 7efff2ffd640 1 -- 172.21.15.16:0/3839843173 learned_addr learned my addr 172.21.15.16:0/3839843173 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff3fff640 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdc3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff3fff640 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdd2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff2ffd640 1 -- 172.21.15.16:0/3839843173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 msgr2=0x55927cdc3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff2ffd640 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdc3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff2ffd640 1 -- 172.21.15.16:0/3839843173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 msgr2=0x55927cdd2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff2ffd640 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdd2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff2ffd640 1 -- 172.21.15.16:0/3839843173 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927cdc52b0 con 0x55927cdc7f70 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7efff2ffd640 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd6cc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55927cdc7600 tx=0x7effe8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aaf56416fe7546 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7effd97fa640 1 -- 172.21.15.16:0/3839843173 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe8009cb0 con 0x55927cdc7f70 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7effd97fa640 1 -- 172.21.15.16:0/3839843173 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe8009e50 con 0x55927cdc7f70 2024-09-10T23:40:45.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.833+0000 7effd97fa640 1 -- 172.21.15.16:0/3839843173 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe801c420 con 0x55927cdc7f70 2024-09-10T23:40:45.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.834+0000 7efffc1d9740 1 -- 172.21.15.16:0/3839843173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 msgr2=0x55927cdd6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.834+0000 7efffc1d9740 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd6cc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55927cdc7600 tx=0x7effe8010800 comp rx=0 tx=0).stop 2024-09-10T23:40:45.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.834+0000 7efffc1d9740 1 -- 172.21.15.16:0/3839843173 shutdown_connections 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.834+0000 7efffc1d9740 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdd8310 0x55927cdc3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.834+0000 7efffc1d9740 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cdd6cc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.834+0000 7efffc1d9740 1 --2- 172.21.15.16:0/3839843173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdc7650 0x55927cdd2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.834+0000 7efffc1d9740 1 -- 172.21.15.16:0/3839843173 >> 172.21.15.16:0/3839843173 conn(0x55927cdc5480 msgr2=0x55927cdd65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.835+0000 7efffc1d9740 1 -- 172.21.15.16:0/3839843173 shutdown_connections 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.835+0000 7efffc1d9740 1 -- 172.21.15.16:0/3839843173 wait complete. 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.835+0000 7efffc1d9740 1 -- start start 2024-09-10T23:40:45.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.835+0000 7efffc1d9740 1 Processor -- start 2024-09-10T23:40:45.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdc7650 0x55927cde9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cde9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efffc1d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdd8310 0x55927cdea380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efffc1d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7effe000cd20 con 0x55927cdc7f70 2024-09-10T23:40:45.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efffc1d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7effe000e190 con 0x55927cdd8310 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efffc1d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effe000d3f0 con 0x55927cdc7650 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efffc1d9740 10 client.0 _ll_register_callbacks cb 0x7effec047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efff2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cde9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efff2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cde9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54686/0 (socket says 172.21.15.16:54686) 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.836+0000 7efff2ffd640 1 -- 172.21.15.16:0/1387806471 learned_addr learned my addr 172.21.15.16:0/1387806471 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff3fff640 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdc7650 0x55927cde9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff3fff640 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdd8310 0x55927cdea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff2ffd640 1 -- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdc7650 msgr2=0x55927cde9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff2ffd640 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdc7650 0x55927cde9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff2ffd640 1 -- 172.21.15.16:0/1387806471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdd8310 msgr2=0x55927cdea380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff2ffd640 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdd8310 0x55927cdea380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff2ffd640 1 -- 172.21.15.16:0/1387806471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927ce4fbb0 con 0x55927cdc7f70 2024-09-10T23:40:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efff2ffd640 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cde9e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7effe8003b00 tx=0x7effe8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcce58f1eb2cfeef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:45.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7effd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:40:45.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7effd2ffd640 1 -- 172.21.15.16:0/1387806471 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe8009cb0 con 0x55927cdc7f70 2024-09-10T23:40:45.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7effd2ffd640 1 -- 172.21.15.16:0/1387806471 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7effe8003c00 con 0x55927cdc7f70 2024-09-10T23:40:45.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.837+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe8009e50 con 0x55927cdc7f70 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7effd2ffd640 1 -- 172.21.15.16:0/1387806471 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effe8003e00 con 0x55927cdc7f70 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 10 client.15459 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55927ce50ec0 con 0x55927cdc7f70 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7effd2ffd640 1 -- 172.21.15.16:0/1387806471 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe8009e50 con 0x55927cdc7f70 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7effd2ffd640 1 -- 172.21.15.16:0/1387806471 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7effe802eb20 con 0x55927cdc7f70 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 10 client.15459 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 20 client.15459 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927ce514e0 0x55927ce53900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 4 client.15459 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.838+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55927cd3b850 con 0x55927ce514e0 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.839+0000 7efff3fff640 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927ce514e0 0x55927ce53900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.839+0000 7effd2ffd640 10 client.15459 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.839+0000 7efff3fff640 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927ce514e0 0x55927ce53900 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39cc6689cd8f007a server_cookie=81c5be00b3657e4d in_seq=0 out_seq=0 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7effd2ffd640 1 -- 172.21.15.16:0/1387806471 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55927cd3b850 con 0x55927ce514e0 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7effd2ffd640 10 client.15459 handle_command_reply: tid=0 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 client.15459 shutdown 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 msgr2=0x55927cde9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cde9e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7effe8003b00 tx=0x7effe8003820 comp rx=0 tx=0).stop 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 shutdown_connections 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55927ce514e0 0x55927ce53900 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7effd2ffd640 0 client.15459 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:45.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55927cdd8310 0x55927cdea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55927cdc7f70 0x55927cde9e40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 --2- 172.21.15.16:0/1387806471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55927cdc7650 0x55927cde9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.840+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 >> 172.21.15.16:0/1387806471 conn(0x55927cdc5480 msgr2=0x55927cdd6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:45.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.841+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 shutdown_connections 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.841+0000 7efffc1d9740 1 -- 172.21.15.16:0/1387806471 wait complete. 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.841+0000 7efffc1d9740 20 client.15459 trim_cache size 0 max 16384 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:40:45.844 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:40:45.845 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:40:45.845 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:40:45.845 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:40:45.845 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:40:45.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:40:45.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:40:45.845 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effdc0b5560 msgr2=0x7effdc0b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effdc0b5560 0x7effdc0b7a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7effe40109e0 tx=0x7effe4009310 comp rx=0 tx=0).stop 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 msgr2=0x7efff4197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 0x7efff4197650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7effe4010a10 tx=0x7effe4010e10 comp rx=0 tx=0).stop 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 shutdown_connections 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff4107640 0x7efff419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7effdc0b5560 0x7effdc0b7a20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efff4106ca0 0x7efff4197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 --2- 172.21.15.16:0/4044119979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efff41012a0 0x7efff4197650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.842+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 >> 172.21.15.16:0/4044119979 conn(0x7efff40fd2f0 msgr2=0x7efff4104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.843+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 shutdown_connections 2024-09-10T23:40:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:45.843+0000 7efff8ba2640 1 -- 172.21.15.16:0/4044119979 wait complete. 2024-09-10T23:40:46.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:45 smithi071 ceph-mon[35018]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:40:46.755 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:40:46.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:40:47.119 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 -- 172.21.15.16:0/2711464580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 msgr2=0x7fb3e01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 --2- 172.21.15.16:0/2711464580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e01031a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009900 tx=0x7fb3d002a410 comp rx=0 tx=0).stop 2024-09-10T23:40:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 -- 172.21.15.16:0/2711464580 shutdown_connections 2024-09-10T23:40:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 --2- 172.21.15.16:0/2711464580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e0109150 0x7fb3e010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 --2- 172.21.15.16:0/2711464580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e01087d0 0x7fb3e0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 --2- 172.21.15.16:0/2711464580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e01031a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 -- 172.21.15.16:0/2711464580 >> 172.21.15.16:0/2711464580 conn(0x7fb3e00fe870 msgr2=0x7fb3e0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 -- 172.21.15.16:0/2711464580 shutdown_connections 2024-09-10T23:40:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.656+0000 7fb3e59d3640 1 -- 172.21.15.16:0/2711464580 wait complete. 2024-09-10T23:40:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.657+0000 7fb3e59d3640 1 Processor -- start 2024-09-10T23:40:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.657+0000 7fb3e59d3640 1 -- start start 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3e59d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e0076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3e59d3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e01087d0 0x7fb3e00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3e59d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e0109150 0x7fb3e0075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3e59d3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e0112e10 con 0x7fb3e0102dc0 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3e59d3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e0112c90 con 0x7fb3e0109150 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3e59d3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e0112f90 con 0x7fb3e01087d0 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e0076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e0076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54690/0 (socket says 172.21.15.16:54690) 2024-09-10T23:40:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 -- 172.21.15.16:0/3321035944 learned_addr learned my addr 172.21.15.16:0/3321035944 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3d7fff640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e01087d0 0x7fb3e00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3df7fe640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e0109150 0x7fb3e0075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 -- 172.21.15.16:0/3321035944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e01087d0 msgr2=0x7fb3e00754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e01087d0 0x7fb3e00754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 -- 172.21.15.16:0/3321035944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e0109150 msgr2=0x7fb3e0075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e0109150 0x7fb3e0075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3deffd640 1 -- 172.21.15.16:0/3321035944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e01abcc0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.658+0000 7fb3df7fe640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e0109150 0x7fb3e0075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.659+0000 7fb3deffd640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e0076f50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0005940 tx=0x7fb3d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.659+0000 7fb3e49d1640 1 -- 172.21.15.16:0/3321035944 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d003f030 con 0x7fb3e0102dc0 2024-09-10T23:40:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.659+0000 7fb3e59d3640 1 -- 172.21.15.16:0/3321035944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e01abe90 con 0x7fb3e0102dc0 2024-09-10T23:40:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.659+0000 7fb3e49d1640 1 -- 172.21.15.16:0/3321035944 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3d0003aa0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.659+0000 7fb3e49d1640 1 -- 172.21.15.16:0/3321035944 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0035070 con 0x7fb3e0102dc0 2024-09-10T23:40:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.659+0000 7fb3e59d3640 1 -- 172.21.15.16:0/3321035944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e01ac2e0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.660+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e01031a0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.663+0000 7fb3e49d1640 1 -- 172.21.15.16:0/3321035944 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7fb3d00035f0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.663+0000 7fb3e49d1640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc0b5440 0x7fb3cc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.664+0000 7fb3e49d1640 1 -- 172.21.15.16:0/3321035944 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb3d01069b0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.664+0000 7fb3d7fff640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc0b5440 0x7fb3cc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.665+0000 7fb3d7fff640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc0b5440 0x7fb3cc0b7900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3e019d230 tx=0x7fb3c8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:47.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.669+0000 7fb3e49d1640 1 -- 172.21.15.16:0/3321035944 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3d00cd5f0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:47 smithi066 ceph-mon[34761]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:40:47.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.896+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3e0063d50 con 0x7fb3e0102dc0 2024-09-10T23:40:47.897 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:47 smithi016 ceph-mon[30855]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:40:47.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.897+0000 7fb3e49d1640 1 -- 172.21.15.16:0/3321035944 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fb3d00ccef0 con 0x7fb3e0102dc0 2024-09-10T23:40:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:47.898 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:40:47.899 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:40:47.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.899+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc0b5440 msgr2=0x7fb3cc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:47.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.899+0000 7fb3d67fc640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc0b5440 0x7fb3cc0b7900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3e019d230 tx=0x7fb3c8005f90 comp rx=0 tx=0).stop 2024-09-10T23:40:47.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.899+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 msgr2=0x7fb3e0076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:47.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.899+0000 7fb3d67fc640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e0076f50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0005940 tx=0x7fb3d0004270 comp rx=0 tx=0).stop 2024-09-10T23:40:47.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 shutdown_connections 2024-09-10T23:40:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb3cc0b5440 0x7fb3cc0b7900 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3e0109150 0x7fb3e0075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3e01087d0 0x7fb3e00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 --2- 172.21.15.16:0/3321035944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3e0102dc0 0x7fb3e0076f50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 >> 172.21.15.16:0/3321035944 conn(0x7fb3e00fe870 msgr2=0x7fb3e0100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 shutdown_connections 2024-09-10T23:40:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:47.900+0000 7fb3d67fc640 1 -- 172.21.15.16:0/3321035944 wait complete. 2024-09-10T23:40:48.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:47 smithi071 ceph-mon[35018]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:40:48.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:40:48.684 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:48 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3321035944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:48.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:48 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3321035944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:48.929 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:49.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:48 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3321035944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:40:49.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.427+0000 7ff906c0e640 1 -- 172.21.15.16:0/3846552293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff900108020 msgr2=0x7ff90010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.427+0000 7ff906c0e640 1 --2- 172.21.15.16:0/3846552293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff900108020 0x7ff90010e820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009ca0 tx=0x7ff8f802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 -- 172.21.15.16:0/3846552293 shutdown_connections 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 --2- 172.21.15.16:0/3846552293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff900108020 0x7ff90010e820 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 --2- 172.21.15.16:0/3846552293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9001076a0 0x7ff900107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 --2- 172.21.15.16:0/3846552293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 0x7ff900102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 -- 172.21.15.16:0/3846552293 >> 172.21.15.16:0/3846552293 conn(0x7ff9000fd700 msgr2=0x7ff9000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 -- 172.21.15.16:0/3846552293 shutdown_connections 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 -- 172.21.15.16:0/3846552293 wait complete. 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 Processor -- start 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.428+0000 7ff906c0e640 1 -- start start 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff906c0e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 0x7ff900113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff906c0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9001076a0 0x7ff900112440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 0x7ff900113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 0x7ff900113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54718/0 (socket says 172.21.15.16:54718) 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff906c0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900108020 0x7ff900112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9001076a0 0x7ff900112440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff9049aa640 1 -- 172.21.15.16:0/244457395 learned_addr learned my addr 172.21.15.16:0/244457395 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff900111ce0 con 0x7ff900101c90 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff900111b60 con 0x7ff900108020 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff900111e60 con 0x7ff9001076a0 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff9051ab640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900108020 0x7ff900112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff8fffff640 1 -- 172.21.15.16:0/244457395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900108020 msgr2=0x7ff900112a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff8fffff640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900108020 0x7ff900112a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff8fffff640 1 -- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 msgr2=0x7ff900113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff8fffff640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 0x7ff900113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff8fffff640 1 -- 172.21.15.16:0/244457395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9001a77e0 con 0x7ff9001076a0 2024-09-10T23:40:49.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff9051ab640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900108020 0x7ff900112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.429+0000 7ff9049aa640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 0x7ff900113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.430+0000 7ff8fffff640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9001076a0 0x7ff900112440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e9f0 tx=0x7ff8ec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.430+0000 7ff8fdffb640 1 -- 172.21.15.16:0/244457395 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00ccc0 con 0x7ff9001076a0 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.430+0000 7ff8fdffb640 1 -- 172.21.15.16:0/244457395 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8ec0108e0 con 0x7ff9001076a0 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.430+0000 7ff8fdffb640 1 -- 172.21.15.16:0/244457395 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec018880 con 0x7ff9001076a0 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.431+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9001a79b0 con 0x7ff9001076a0 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.431+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9001a7e70 con 0x7ff9001076a0 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 Processor -- start 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 -- start start 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceef4d0 0x5627cceef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccefb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff8fdffb640 1 -- 172.21.15.16:0/244457395 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7ff8ec010430 con 0x7ff9001076a0 2024-09-10T23:40:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627ccefbd80 0x5627ccefe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5627cce65ea0 con 0x5627cceefdf0 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5627cce552d0 con 0x5627ccefbd80 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff908fe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5627cce590e0 con 0x5627cceef4d0 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627ccefbd80 0x5627ccefe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccefb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccefb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54724/0 (socket says 172.21.15.16:54724) 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.434+0000 7ff9049aa640 1 -- 172.21.15.16:0/3052349368 learned_addr learned my addr 172.21.15.16:0/3052349368 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff9049aa640 1 -- 172.21.15.16:0/3052349368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceef4d0 msgr2=0x5627cceef8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff9049aa640 1 --2- 172.21.15.16:0/3052349368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceef4d0 0x5627cceef8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff9049aa640 1 -- 172.21.15.16:0/3052349368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627ccefbd80 msgr2=0x5627ccefe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff9049aa640 1 --2- 172.21.15.16:0/3052349368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627ccefbd80 0x5627ccefe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff9049aa640 1 -- 172.21.15.16:0/3052349368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ccbb3650 con 0x5627cceefdf0 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff9049aa640 1 --2- 172.21.15.16:0/3052349368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccefb840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009fd0 tx=0x7ff8f4011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3062393c409436 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff8eaffd640 1 -- 172.21.15.16:0/3052349368 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f401e070 con 0x5627cceefdf0 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff8eaffd640 1 -- 172.21.15.16:0/3052349368 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8f400fba0 con 0x5627cceefdf0 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff8eaffd640 1 -- 172.21.15.16:0/3052349368 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4019c50 con 0x5627cceefdf0 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.435+0000 7ff8fdffb640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8f00b53c0 0x7ff8f00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.436+0000 7ff8fdffb640 1 -- 172.21.15.16:0/244457395 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff8ec0e6310 con 0x7ff9001076a0 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.436+0000 7ff9051ab640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8f00b53c0 0x7ff8f00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.436+0000 7ff908fe3740 1 -- 172.21.15.16:0/3052349368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 msgr2=0x5627ccefb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.436+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3052349368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccefb840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009fd0 tx=0x7ff8f4011ae0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.436+0000 7ff9051ab640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8f00b53c0 0x7ff8f00b7880 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006010 tx=0x7ff8f8009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 -- 172.21.15.16:0/3052349368 shutdown_connections 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3052349368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627ccefbd80 0x5627ccefe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3052349368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccefb840 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3052349368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceef4d0 0x5627cceef8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 -- 172.21.15.16:0/3052349368 >> 172.21.15.16:0/3052349368 conn(0x5627cceed300 msgr2=0x5627cceee4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 -- 172.21.15.16:0/3052349368 shutdown_connections 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 -- 172.21.15.16:0/3052349368 wait complete. 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 -- start start 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.437+0000 7ff908fe3740 1 Processor -- start 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccefb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceefdf0 0x5627ccef8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627ccefbd80 0x5627ccef8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff908fe3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5627cccb6700 con 0x5627ccefbd80 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff908fe3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5627ccdf0160 con 0x5627cceef4d0 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff908fe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5627ccefea00 con 0x5627cceefdf0 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff908fe3740 10 client.0 _ll_register_callbacks cb 0x5627cce099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccefb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccefb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:37210/0 (socket says 172.21.15.16:37210) 2024-09-10T23:40:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff9049aa640 1 -- 172.21.15.16:0/3600836188 learned_addr learned my addr 172.21.15.16:0/3600836188 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.438+0000 7ff9051ab640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627ccefbd80 0x5627ccef8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff8fffff640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceefdf0 0x5627ccef8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff9049aa640 1 -- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceefdf0 msgr2=0x5627ccef8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff9049aa640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceefdf0 0x5627ccef8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff9049aa640 1 -- 172.21.15.16:0/3600836188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627ccefbd80 msgr2=0x5627ccef8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff9049aa640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627ccefbd80 0x5627ccef8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff9049aa640 1 -- 172.21.15.16:0/3600836188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627cce1dc90 con 0x5627cceef4d0 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff8fffff640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceefdf0 0x5627ccef8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff9051ab640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627ccefbd80 0x5627ccef8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff9049aa640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccefb5f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4000c00 tx=0x7ff8f4009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6f78bc8f03b588 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff8dffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff8dffff640 1 -- 172.21.15.16:0/3600836188 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f401e040 con 0x5627cceef4d0 2024-09-10T23:40:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8f400fba0 con 0x5627cceef4d0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff8dffff640 1 -- 172.21.15.16:0/3600836188 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff8f400f6f0 con 0x5627cceef4d0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff8dffff640 1 -- 172.21.15.16:0/3600836188 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8f400f930 con 0x5627cceef4d0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff908fe3740 10 client.25124 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.439+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627ccf0a310 con 0x5627cceef4d0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff8dffff640 1 -- 172.21.15.16:0/3600836188 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8f400fba0 con 0x5627cceef4d0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff8dffff640 1 -- 172.21.15.16:0/3600836188 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff8f4021070 con 0x5627cceef4d0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff908fe3740 10 client.25124 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff908fe3740 10 client.25124 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff908fe3740 20 client.25124 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf0baa0 0x5627ccf0df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff908fe3740 4 client.25124 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.440+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627cce67df0 con 0x5627ccf0baa0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.441+0000 7ff8fffff640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf0baa0 0x5627ccf0df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.442+0000 7ff8dffff640 10 client.25124 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.442+0000 7ff8fffff640 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf0baa0 0x5627ccf0df00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63f88b5115246734 server_cookie=8453225d4a9fd928 in_seq=0 out_seq=0 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff8dffff640 1 -- 172.21.15.16:0/3600836188 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627cce67df0 con 0x5627ccf0baa0 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff8dffff640 10 client.25124 handle_command_reply: tid=0 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 client.25124 shutdown 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 msgr2=0x5627ccefb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccefb5f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4000c00 tx=0x7ff8f4009eb0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 shutdown_connections 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf0baa0 0x5627ccf0df00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627ccefbd80 0x5627ccef8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627cceefdf0 0x5627ccef8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff8dffff640 0 client.25124 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 --2- 172.21.15.16:0/3600836188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccefb5f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 >> 172.21.15.16:0/3600836188 conn(0x5627cceed300 msgr2=0x5627ccef2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:49.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 shutdown_connections 2024-09-10T23:40:49.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.443+0000 7ff908fe3740 1 -- 172.21.15.16:0/3600836188 wait complete. 2024-09-10T23:40:49.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.444+0000 7ff908fe3740 20 client.25124 trim_cache size 0 max 16384 2024-09-10T23:40:49.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.457+0000 7ff908fe3740 1 Processor -- start 2024-09-10T23:40:49.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.457+0000 7ff908fe3740 1 -- start start 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.457+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceef4d0 0x5627cceec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.457+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceefdf0 0x5627ccef5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.457+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccef6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff908fe3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b3110 con 0x5627cceef4d0 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff908fe3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b09e0 con 0x5627cceefdf0 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff908fe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001ae830 con 0x5627ccefbd80 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceef4d0 0x5627cceec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceef4d0 0x5627cceec310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54750/0 (socket says 172.21.15.16:54750) 2024-09-10T23:40:49.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 -- 172.21.15.16:0/1585829219 learned_addr learned my addr 172.21.15.16:0/1585829219 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff8fffff640 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceefdf0 0x5627ccef5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9051ab640 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccef6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 -- 172.21.15.16:0/1585829219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 msgr2=0x5627ccef6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccef6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 -- 172.21.15.16:0/1585829219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceefdf0 msgr2=0x5627ccef5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceefdf0 0x5627ccef5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 -- 172.21.15.16:0/1585829219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ccee8de0 con 0x5627cceef4d0 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff8fffff640 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceefdf0 0x5627ccef5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:49.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff9049aa640 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceef4d0 0x5627cceec310 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff8f402d040 tx=0x7ff8f4009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b9a23d6fb0b404 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:49.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.458+0000 7ff8ea7fc640 1 -- 172.21.15.16:0/1585829219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f401e070 con 0x5627cceef4d0 2024-09-10T23:40:49.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff8ea7fc640 1 -- 172.21.15.16:0/1585829219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8f40054f0 con 0x5627cceef4d0 2024-09-10T23:40:49.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff8ea7fc640 1 -- 172.21.15.16:0/1585829219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4004660 con 0x5627cceef4d0 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff908fe3740 1 -- 172.21.15.16:0/1585829219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceef4d0 msgr2=0x5627cceec310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff908fe3740 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceef4d0 0x5627cceec310 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff8f402d040 tx=0x7ff8f4009550 comp rx=0 tx=0).stop 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff908fe3740 1 -- 172.21.15.16:0/1585829219 shutdown_connections 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff908fe3740 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccef6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff908fe3740 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceefdf0 0x5627ccef5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff908fe3740 1 --2- 172.21.15.16:0/1585829219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceef4d0 0x5627cceec310 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.459+0000 7ff908fe3740 1 -- 172.21.15.16:0/1585829219 >> 172.21.15.16:0/1585829219 conn(0x5627cceed300 msgr2=0x5627cceebc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.460+0000 7ff908fe3740 1 -- 172.21.15.16:0/1585829219 shutdown_connections 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.460+0000 7ff908fe3740 1 -- 172.21.15.16:0/1585829219 wait complete. 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.460+0000 7ff908fe3740 1 -- start start 2024-09-10T23:40:49.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.460+0000 7ff908fe3740 1 Processor -- start 2024-09-10T23:40:49.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.460+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccf11630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.460+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccf11b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.460+0000 7ff908fe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccf120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff908fe3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001aeea0 con 0x5627cceefdf0 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff908fe3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001b0310 con 0x5627cceef4d0 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff908fe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001af570 con 0x5627ccefbd80 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccf11b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccf11b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54760/0 (socket says 172.21.15.16:54760) 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 -- 172.21.15.16:0/361518155 learned_addr learned my addr 172.21.15.16:0/361518155 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff908fe3740 10 client.0 _ll_register_callbacks cb 0x7ff8f401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:49.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff9051ab640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccf120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff9049aa640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccf11630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 -- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 msgr2=0x5627ccf120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccf120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 -- 172.21.15.16:0/361518155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 msgr2=0x5627ccf11630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccf11630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 -- 172.21.15.16:0/361518155 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ccf80140 con 0x5627cceefdf0 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff9051ab640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccf120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8fffff640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccf11b70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0e3c30 tx=0x7ff8ec010870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00f8c65b95a3dce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.461+0000 7ff8dffff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff8dffff640 1 -- 172.21.15.16:0/361518155 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0ac680 con 0x5627cceefdf0 2024-09-10T23:40:49.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff8dffff640 1 -- 172.21.15.16:0/361518155 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff8ec0a8b20 con 0x5627cceefdf0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8f40054f0 con 0x5627cceefdf0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff8dffff640 1 -- 172.21.15.16:0/361518155 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8ec0ac020 con 0x5627cceefdf0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff908fe3740 10 client.15483 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627ccf81440 con 0x5627cceefdf0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff8dffff640 1 -- 172.21.15.16:0/361518155 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8f40054f0 con 0x5627cceefdf0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff8dffff640 1 -- 172.21.15.16:0/361518155 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff8ec0adbe0 con 0x5627cceefdf0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff908fe3740 10 client.15483 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.462+0000 7ff908fe3740 10 client.15483 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.463+0000 7ff908fe3740 20 client.15483 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.463+0000 7ff908fe3740 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf81bc0 0x5627ccf83fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.463+0000 7ff908fe3740 4 client.15483 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.463+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5627cce638a0 con 0x5627ccf81bc0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.463+0000 7ff9049aa640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf81bc0 0x5627ccf83fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:49.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.463+0000 7ff8dffff640 10 client.15483 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:40:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.463+0000 7ff9049aa640 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf81bc0 0x5627ccf83fe0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=887e111e7735e5de server_cookie=1cc2804c57e09ac4 in_seq=0 out_seq=0 2024-09-10T23:40:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff8dffff640 1 -- 172.21.15.16:0/361518155 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5627cce638a0 con 0x5627ccf81bc0 2024-09-10T23:40:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff8dffff640 10 client.15483 handle_command_reply: tid=0 2024-09-10T23:40:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 client.15483 shutdown 2024-09-10T23:40:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 msgr2=0x5627ccf11b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccf11b70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0e3c30 tx=0x7ff8ec010870 comp rx=0 tx=0).stop 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 shutdown_connections 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5627ccf81bc0 0x5627ccf83fe0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627ccefbd80 0x5627ccf120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627cceefdf0 0x5627ccf11b70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 --2- 172.21.15.16:0/361518155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627cceef4d0 0x5627ccf11630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 >> 172.21.15.16:0/361518155 conn(0x5627cceed300 msgr2=0x5627cceec420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff8dffff640 0 client.15483 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 shutdown_connections 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 1 -- 172.21.15.16:0/361518155 wait complete. 2024-09-10T23:40:49.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.464+0000 7ff908fe3740 20 client.15483 trim_cache size 0 max 16384 2024-09-10T23:40:49.470 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:40:49.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8f00b53c0 msgr2=0x7ff8f00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8f00b53c0 0x7ff8f00b7880 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006010 tx=0x7ff8f8009360 comp rx=0 tx=0).stop 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9001076a0 msgr2=0x7ff900112440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9001076a0 0x7ff900112440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e9f0 tx=0x7ff8ec00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 shutdown_connections 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8f00b53c0 0x7ff8f00b7880 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900108020 0x7ff900112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9001076a0 0x7ff900112440 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 --2- 172.21.15.16:0/244457395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff900101c90 0x7ff900113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.465+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 >> 172.21.15.16:0/244457395 conn(0x7ff9000fd700 msgr2=0x7ff90006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.466+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 shutdown_connections 2024-09-10T23:40:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:49.466+0000 7ff906c0e640 1 -- 172.21.15.16:0/244457395 wait complete. 2024-09-10T23:40:49.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:49 smithi016 ceph-mon[30855]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:40:49.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:49 smithi066 ceph-mon[34761]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:40:50.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:49 smithi071 ceph-mon[35018]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T23:40:50.400 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:40:50.712 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.325+0000 7f4401412640 1 -- 172.21.15.16:0/3301589774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc0754c0 msgr2=0x7f43fc0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.325+0000 7f4401412640 1 --2- 172.21.15.16:0/3301589774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc0754c0 0x7f43fc0758a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009900 tx=0x7f43ec02a410 comp rx=0 tx=0).stop 2024-09-10T23:40:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.325+0000 7f4401412640 1 -- 172.21.15.16:0/3301589774 shutdown_connections 2024-09-10T23:40:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.325+0000 7f4401412640 1 --2- 172.21.15.16:0/3301589774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43fc10f3d0 0x7f43fc1117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.325+0000 7f4401412640 1 --2- 172.21.15.16:0/3301589774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43fc075de0 0x7f43fc10ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.325+0000 7f4401412640 1 --2- 172.21.15.16:0/3301589774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc0754c0 0x7f43fc0758a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.325+0000 7f4401412640 1 -- 172.21.15.16:0/3301589774 >> 172.21.15.16:0/3301589774 conn(0x7f43fc0fe870 msgr2=0x7f43fc100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.326+0000 7f4401412640 1 -- 172.21.15.16:0/3301589774 shutdown_connections 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.326+0000 7f4401412640 1 -- 172.21.15.16:0/3301589774 wait complete. 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.326+0000 7f4401412640 1 Processor -- start 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f4401412640 1 -- start start 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f4401412640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43fc0754c0 0x7f43fc19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f4401412640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43fc075de0 0x7f43fc19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f4401412640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc10f3d0 0x7f43fc1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f4401412640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc114fc0 con 0x7f43fc10f3d0 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f4401412640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc114e40 con 0x7f43fc075de0 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f4401412640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc115140 con 0x7f43fc0754c0 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43fc075de0 0x7f43fc19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43fc075de0 0x7f43fc19ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:37270/0 (socket says 172.21.15.16:37270) 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f43fa7fc640 1 -- 172.21.15.16:0/3446747986 learned_addr learned my addr 172.21.15.16:0/3446747986 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f43faffd640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43fc0754c0 0x7f43fc19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.327+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc10f3d0 0x7f43fc1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43fb7fe640 1 -- 172.21.15.16:0/3446747986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43fc0754c0 msgr2=0x7f43fc19b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43fc0754c0 0x7f43fc19b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43fb7fe640 1 -- 172.21.15.16:0/3446747986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43fc075de0 msgr2=0x7f43fc19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43fc075de0 0x7f43fc19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43fb7fe640 1 -- 172.21.15.16:0/3446747986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc1a15c0 con 0x7f43fc10f3d0 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43faffd640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43fc0754c0 0x7f43fc19b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc10f3d0 0x7f43fc1a0df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f43fc06c1a0 tx=0x7f43f400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.328+0000 7f43e3fff640 1 -- 172.21.15.16:0/3446747986 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4004d20 con 0x7f43fc10f3d0 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.329+0000 7f43e3fff640 1 -- 172.21.15.16:0/3446747986 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f4005020 con 0x7f43fc10f3d0 2024-09-10T23:40:51.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.329+0000 7f43e3fff640 1 -- 172.21.15.16:0/3446747986 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f40116b0 con 0x7f43fc10f3d0 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.329+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc1a18b0 con 0x7f43fc10f3d0 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.329+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1a7f70 con 0x7f43fc10f3d0 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.332+0000 7f43e3fff640 1 -- 172.21.15.16:0/3446747986 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f43f4022060 con 0x7f43fc10f3d0 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.332+0000 7f43e3fff640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f43e40b5440 0x7f43e40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f43e3fff640 1 -- 172.21.15.16:0/3446747986 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f43f40e57f0 con 0x7f43fc10f3d0 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f43faffd640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f43e40b5440 0x7f43e40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 Processor -- start 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 -- start start 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16bb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f1b1625ea0 con 0x55f1b16bb9a0 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f1b16152d0 con 0x55f1b16afa10 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f44037e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f1b16190e0 con 0x55f1b16af0f0 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.333+0000 7f43faffd640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f43e40b5440 0x7f43e40b7900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43ec031440 tx=0x7f43ec005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54800/0 (socket says 172.21.15.16:54800) 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 -- 172.21.15.16:0/4075792040 learned_addr learned my addr 172.21.15.16:0/4075792040 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fa7fc640 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16bb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43faffd640 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 -- 172.21.15.16:0/4075792040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 msgr2=0x55f1b16af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 -- 172.21.15.16:0/4075792040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 msgr2=0x55f1b16bb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:51.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16bb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 -- 172.21.15.16:0/4075792040 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b1373650 con 0x55f1b16bb9a0 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16bdd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f43f40abb40 tx=0x7f43f40a7e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5027d6a50e5bd383 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.334+0000 7f43e17fa640 1 -- 172.21.15.16:0/4075792040 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f401f030 con 0x55f1b16bb9a0 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.335+0000 7f43e17fa640 1 -- 172.21.15.16:0/4075792040 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f40b0870 con 0x55f1b16bb9a0 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.335+0000 7f43e17fa640 1 -- 172.21.15.16:0/4075792040 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f40ab300 con 0x55f1b16bb9a0 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.335+0000 7f44037e7740 1 -- 172.21.15.16:0/4075792040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 msgr2=0x55f1b16bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.335+0000 7f44037e7740 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16bdd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f43f40abb40 tx=0x7f43f40a7e10 comp rx=0 tx=0).stop 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 -- 172.21.15.16:0/4075792040 shutdown_connections 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16bdd90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16bb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 --2- 172.21.15.16:0/4075792040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 -- 172.21.15.16:0/4075792040 >> 172.21.15.16:0/4075792040 conn(0x55f1b16acf20 msgr2=0x55f1b16ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 -- 172.21.15.16:0/4075792040 shutdown_connections 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 -- 172.21.15.16:0/4075792040 wait complete. 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 -- start start 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.336+0000 7f44037e7740 1 Processor -- start 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f44037e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f44037e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16b8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f44037e7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f44037e7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f1b1476700 con 0x55f1b16bb9a0 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f44037e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f1b15b0160 con 0x55f1b16afa10 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f44037e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f1b16be620 con 0x55f1b16af0f0 2024-09-10T23:40:51.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f44037e7740 10 client.0 _ll_register_callbacks cb 0x55f1b15c99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54806/0 (socket says 172.21.15.16:54806) 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 -- 172.21.15.16:0/333228500 learned_addr learned my addr 172.21.15.16:0/333228500 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43faffd640 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 -- 172.21.15.16:0/333228500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 msgr2=0x55f1b16bb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16bb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 -- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 msgr2=0x55f1b16b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16b8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.337+0000 7f43fb7fe640 1 -- 172.21.15.16:0/333228500 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b15ddc90 con 0x55f1b16bb9a0 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f43fa7fc640 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b8d40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f43f40ac000 tx=0x7f43f400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2960ea4a8de886c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:51.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f43deff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f43deff5640 1 -- 172.21.15.16:0/333228500 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f401f040 con 0x55f1b16bb9a0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f43deff5640 1 -- 172.21.15.16:0/333228500 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f43f40ab2a0 con 0x55f1b16bb9a0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43f40b0870 con 0x55f1b16bb9a0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f43deff5640 1 -- 172.21.15.16:0/333228500 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f43f40054d0 con 0x55f1b16bb9a0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f44037e7740 10 client.15495 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.338+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1b16d2790 con 0x55f1b16bb9a0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f43deff5640 1 -- 172.21.15.16:0/333228500 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f40b0870 con 0x55f1b16bb9a0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f43deff5640 1 -- 172.21.15.16:0/333228500 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f43f400f040 con 0x55f1b16bb9a0 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f44037e7740 10 client.15495 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f44037e7740 10 client.15495 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f44037e7740 20 client.15495 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:51.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f44037e7740 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b16d5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f44037e7740 4 client.15495 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1b1627df0 con 0x55f1b16d3b80 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.339+0000 7f43faffd640 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b16d5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.340+0000 7f43deff5640 10 client.15495 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.340+0000 7f43faffd640 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b16d5f70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=54afd5c8f53b0491 server_cookie=9923ca1294c24979 in_seq=0 out_seq=0 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f43deff5640 1 -- 172.21.15.16:0/333228500 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1b1627df0 con 0x55f1b16d3b80 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f43deff5640 10 client.15495 handle_command_reply: tid=0 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 client.15495 shutdown 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 msgr2=0x55f1b16b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b8d40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f43f40ac000 tx=0x7f43f400cd80 comp rx=0 tx=0).stop 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 shutdown_connections 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b16d5f70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f43deff5640 0 client.15495 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:40:51.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b8d40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16afa10 0x55f1b16b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 --2- 172.21.15.16:0/333228500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16bb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 >> 172.21.15.16:0/333228500 conn(0x55f1b16acf20 msgr2=0x55f1b16b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:51.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 shutdown_connections 2024-09-10T23:40:51.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 1 -- 172.21.15.16:0/333228500 wait complete. 2024-09-10T23:40:51.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.341+0000 7f44037e7740 20 client.15495 trim_cache size 0 max 16384 2024-09-10T23:40:51.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 Processor -- start 2024-09-10T23:40:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 -- start start 2024-09-10T23:40:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16ade30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc1aed30 con 0x55f1b16afa10 2024-09-10T23:40:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc1ac600 con 0x55f1b16bb9a0 2024-09-10T23:40:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f44037e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc1aa470 con 0x55f1b16af0f0 2024-09-10T23:40:51.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54810/0 (socket says 172.21.15.16:54810) 2024-09-10T23:40:51.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f43fa7fc640 1 -- 172.21.15.16:0/3903761004 learned_addr learned my addr 172.21.15.16:0/3903761004 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:51.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.368+0000 7f43faffd640 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43faffd640 1 -- 172.21.15.16:0/3903761004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 msgr2=0x55f1b16ade30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:40:51.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43faffd640 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16ade30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43faffd640 1 -- 172.21.15.16:0/3903761004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 msgr2=0x55f1b16b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43faffd640 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43faffd640 1 -- 172.21.15.16:0/3903761004 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b16b6c10 con 0x55f1b16af0f0 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43fa7fc640 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43faffd640 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16b6f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009230 tx=0x7f43ec040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df0eef389ebec6c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.369+0000 7f43e0ff9640 1 -- 172.21.15.16:0/3903761004 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec056020 con 0x55f1b16af0f0 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.370+0000 7f43e0ff9640 1 -- 172.21.15.16:0/3903761004 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43ec004380 con 0x55f1b16af0f0 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.370+0000 7f44037e7740 1 -- 172.21.15.16:0/3903761004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 msgr2=0x55f1b16b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f43e0ff9640 1 -- 172.21.15.16:0/3903761004 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec035040 con 0x55f1b16af0f0 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16b6f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009230 tx=0x7f43ec040000 comp rx=0 tx=0).stop 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 -- 172.21.15.16:0/3903761004 shutdown_connections 2024-09-10T23:40:51.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 --2- 172.21.15.16:0/3903761004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16b6f90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 -- 172.21.15.16:0/3903761004 >> 172.21.15.16:0/3903761004 conn(0x55f1b16acf20 msgr2=0x55f1b16b86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:51.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 -- 172.21.15.16:0/3903761004 shutdown_connections 2024-09-10T23:40:51.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 -- 172.21.15.16:0/3903761004 wait complete. 2024-09-10T23:40:51.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 -- start start 2024-09-10T23:40:51.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.371+0000 7f44037e7740 1 Processor -- start 2024-09-10T23:40:51.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f44037e7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16d95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f44037e7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f44037e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f44037e7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc1aaac0 con 0x55f1b16afa10 2024-09-10T23:40:51.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f44037e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc1abf30 con 0x55f1b16bb9a0 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f44037e7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc1ab190 con 0x55f1b16af0f0 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f44037e7740 10 client.0 _ll_register_callbacks cb 0x7f43f0009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f43faffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16d95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f43fb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f43faffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16d95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:56360/0 (socket says 172.21.15.16:56360) 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f43faffd640 1 -- 172.21.15.16:0/3626274716 learned_addr learned my addr 172.21.15.16:0/3626274716 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f43fb7fe640 1 -- 172.21.15.16:0/3626274716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 msgr2=0x55f1b16d95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.372+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16d95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43fb7fe640 1 -- 172.21.15.16:0/3626274716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 msgr2=0x55f1b16b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43fb7fe640 1 -- 172.21.15.16:0/3626274716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b16b6020 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43fb7fe640 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43f40aae60 tx=0x7f43f40ab500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240fc07ffc0fcd4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43deff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43deff5640 1 -- 172.21.15.16:0/3626274716 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f401f070 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec004380 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43deff5640 1 -- 172.21.15.16:0/3626274716 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f43f40b1a00 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f43deff5640 1 -- 172.21.15.16:0/3626274716 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f43f40a8490 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f44037e7740 10 client.25145 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.373+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1b16b6020 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f43deff5640 1 -- 172.21.15.16:0/3626274716 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43ec004380 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f43deff5640 1 -- 172.21.15.16:0/3626274716 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f43f40cd070 con 0x55f1b16bb9a0 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f44037e7740 10 client.25145 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f44037e7740 10 client.25145 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:40:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f44037e7740 20 client.25145 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f44037e7740 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b1742a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f44037e7740 4 client.25145 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1b16238a0 con 0x55f1b16d3b80 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.374+0000 7f43faffd640 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b1742a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f43faffd640 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b1742a30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfb0eab491419b34 server_cookie=c48dac27d00f5405 in_seq=0 out_seq=0 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f43deff5640 10 client.25145 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f43deff5640 1 -- 172.21.15.16:0/3626274716 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1b16238a0 con 0x55f1b16d3b80 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f43deff5640 10 client.25145 handle_command_reply: tid=0 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 client.25145 shutdown 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 msgr2=0x55f1b16b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43f40aae60 tx=0x7f43f40ab500 comp rx=0 tx=0).stop 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 shutdown_connections 2024-09-10T23:40:51.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f1b16d3b80 0x55f1b1742a30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b16bb9a0 0x55f1b16b5980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b16afa10 0x55f1b16b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 --2- 172.21.15.16:0/3626274716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1b16af0f0 0x55f1b16d95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 >> 172.21.15.16:0/3626274716 conn(0x55f1b16acf20 msgr2=0x55f1b16b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f43deff5640 0 client.25145 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.375+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 shutdown_connections 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.376+0000 7f44037e7740 1 -- 172.21.15.16:0/3626274716 wait complete. 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.376+0000 7f44037e7740 20 client.25145 trim_cache size 0 max 16384 2024-09-10T23:40:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:40:51.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f43e40b5440 msgr2=0x7f43e40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f43e40b5440 0x7f43e40b7900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43ec031440 tx=0x7f43ec005b50 comp rx=0 tx=0).stop 2024-09-10T23:40:51.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc10f3d0 msgr2=0x7f43fc1a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:51.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc10f3d0 0x7f43fc1a0df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f43fc06c1a0 tx=0x7f43f400edd0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 shutdown_connections 2024-09-10T23:40:51.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43fc10f3d0 0x7f43fc1a0df0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f43e40b5440 0x7f43e40b7900 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43fc075de0 0x7f43fc19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 --2- 172.21.15.16:0/3446747986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43fc0754c0 0x7f43fc19b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:51.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.377+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 >> 172.21.15.16:0/3446747986 conn(0x7f43fc0fe870 msgr2=0x7f43fc0ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:51.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.378+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 shutdown_connections 2024-09-10T23:40:51.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:51.378+0000 7f4401412640 1 -- 172.21.15.16:0/3446747986 wait complete. 2024-09-10T23:40:51.540 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:51 smithi016 ceph-mon[30855]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T23:40:51.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:51 smithi066 ceph-mon[34761]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T23:40:52.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:51 smithi071 ceph-mon[35018]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T23:40:52.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:40:52.473 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:53.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 -- 172.21.15.16:0/3176782185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d01076d0 msgr2=0x7f64d0107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 --2- 172.21.15.16:0/3176782185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d01076d0 0x7f64d0107b10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009900 tx=0x7f64c002a410 comp rx=0 tx=0).stop 2024-09-10T23:40:53.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 -- 172.21.15.16:0/3176782185 shutdown_connections 2024-09-10T23:40:53.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 --2- 172.21.15.16:0/3176782185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64d0108050 0x7f64d010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 --2- 172.21.15.16:0/3176782185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d01076d0 0x7f64d0107b10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 --2- 172.21.15.16:0/3176782185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64d0101cc0 0x7f64d01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 -- 172.21.15.16:0/3176782185 >> 172.21.15.16:0/3176782185 conn(0x7f64d00fd770 msgr2=0x7f64d00ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 -- 172.21.15.16:0/3176782185 shutdown_connections 2024-09-10T23:40:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.079+0000 7f64d72a5640 1 -- 172.21.15.16:0/3176782185 wait complete. 2024-09-10T23:40:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.081+0000 7f64d72a5640 1 Processor -- start 2024-09-10T23:40:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.081+0000 7f64d72a5640 1 -- start start 2024-09-10T23:40:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.081+0000 7f64d72a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64d0101cc0 0x7f64d019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.081+0000 7f64d72a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64d01076d0 0x7f64d019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d5041640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64d0101cc0 0x7f64d019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d72a5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d0108050 0x7f64d01993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d5041640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64d0101cc0 0x7f64d019eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:37312/0 (socket says 172.21.15.16:37312) 2024-09-10T23:40:53.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d5041640 1 -- 172.21.15.16:0/276398561 learned_addr learned my addr 172.21.15.16:0/276398561 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:53.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d5842640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d0108050 0x7f64d01993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d4840640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64d01076d0 0x7f64d019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64d0111d60 con 0x7f64d0108050 2024-09-10T23:40:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64d0111be0 con 0x7f64d0101cc0 2024-09-10T23:40:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.082+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64d0111ee0 con 0x7f64d01076d0 2024-09-10T23:40:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64d5842640 1 -- 172.21.15.16:0/276398561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64d01076d0 msgr2=0x7f64d019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64d5842640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64d01076d0 0x7f64d019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64d5842640 1 -- 172.21.15.16:0/276398561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64d0101cc0 msgr2=0x7f64d019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64d5842640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64d0101cc0 0x7f64d019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64d5842640 1 -- 172.21.15.16:0/276398561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d0199ca0 con 0x7f64d0108050 2024-09-10T23:40:53.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64d5842640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d0108050 0x7f64d01993e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f64c800e940 tx=0x7f64c800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:53.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64c67fc640 1 -- 172.21.15.16:0/276398561 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c8004d20 con 0x7f64d0108050 2024-09-10T23:40:53.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.083+0000 7f64c67fc640 1 -- 172.21.15.16:0/276398561 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64c8005020 con 0x7f64d0108050 2024-09-10T23:40:53.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.084+0000 7f64c67fc640 1 -- 172.21.15.16:0/276398561 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c80116d0 con 0x7f64d0108050 2024-09-10T23:40:53.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.084+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d0199ed0 con 0x7f64d0108050 2024-09-10T23:40:53.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.085+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d01a5d20 con 0x7f64d0108050 2024-09-10T23:40:53.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.089+0000 7f64d967a740 1 Processor -- start 2024-09-10T23:40:53.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.089+0000 7f64c67fc640 1 -- 172.21.15.16:0/276398561 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f64c800f040 con 0x7f64d0108050 2024-09-10T23:40:53.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.089+0000 7f64d967a740 1 -- start start 2024-09-10T23:40:53.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d967a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb44b70 0x556c7eb44f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d967a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d967a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb5e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d967a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556c7eabdea0 con 0x556c7eb54490 2024-09-10T23:40:53.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d967a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c7eaad2d0 con 0x556c7eb44b70 2024-09-10T23:40:53.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d967a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556c7eab10e0 con 0x556c7eb54e10 2024-09-10T23:40:53.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb44b70 0x556c7eb44f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb44b70 0x556c7eb44f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:37326/0 (socket says 172.21.15.16:37326) 2024-09-10T23:40:53.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 -- 172.21.15.16:0/358983561 learned_addr learned my addr 172.21.15.16:0/358983561 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:53.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb5e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 -- 172.21.15.16:0/358983561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 msgr2=0x556c7eb5e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:53.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb5e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 -- 172.21.15.16:0/358983561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 msgr2=0x556c7eb548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:53.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64d4840640 1 -- 172.21.15.16:0/358983561 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7e80b650 con 0x556c7eb44b70 2024-09-10T23:40:53.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.090+0000 7f64c67fc640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f64bc0b5310 0x7f64bc0b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.091+0000 7f64c67fc640 1 -- 172.21.15.16:0/276398561 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f64c80e5d90 con 0x7f64d0108050 2024-09-10T23:40:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.091+0000 7f64d4840640 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb44b70 0x556c7eb44f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009230 tx=0x7f64c0005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db5b6d613190ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.091+0000 7f64d5041640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f64bc0b5310 0x7f64bc0b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.091+0000 7f64bb7fe640 1 -- 172.21.15.16:0/358983561 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0035030 con 0x556c7eb44b70 2024-09-10T23:40:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.092+0000 7f64d5041640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f64bc0b5310 0x7f64bc0b77d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009810 tx=0x7f64cc0097a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.092+0000 7f64bb7fe640 1 -- 172.21.15.16:0/358983561 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64c0003de0 con 0x556c7eb44b70 2024-09-10T23:40:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.092+0000 7f64bb7fe640 1 -- 172.21.15.16:0/358983561 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c003db90 con 0x556c7eb44b70 2024-09-10T23:40:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 -- 172.21.15.16:0/358983561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb44b70 msgr2=0x556c7eb44f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb44b70 0x556c7eb44f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009230 tx=0x7f64c0005780 comp rx=0 tx=0).stop 2024-09-10T23:40:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 -- 172.21.15.16:0/358983561 shutdown_connections 2024-09-10T23:40:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb5e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 --2- 172.21.15.16:0/358983561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb44b70 0x556c7eb44f50 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009230 tx=0x7f64c0005780 comp rx=0 tx=0).stop 2024-09-10T23:40:53.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 -- 172.21.15.16:0/358983561 >> 172.21.15.16:0/358983561 conn(0x556c7eb47090 msgr2=0x556c7eb47470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:53.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 -- 172.21.15.16:0/358983561 shutdown_connections 2024-09-10T23:40:53.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.093+0000 7f64d967a740 1 -- 172.21.15.16:0/358983561 wait complete. 2024-09-10T23:40:53.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.094+0000 7f64d967a740 1 -- start start 2024-09-10T23:40:53.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.094+0000 7f64d967a740 1 Processor -- start 2024-09-10T23:40:53.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d967a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d967a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb5c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d967a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 0x556c7eb68180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d967a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556c7e90e700 con 0x556c7eb54490 2024-09-10T23:40:53.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d967a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c7ea48160 con 0x556c7eb54e10 2024-09-10T23:40:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d967a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556c7eb5ee90 con 0x556c7eb5c720 2024-09-10T23:40:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d4840640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb5c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d967a740 10 client.0 _ll_register_callbacks cb 0x556c7ea619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d4840640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb5c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:37332/0 (socket says 172.21.15.16:37332) 2024-09-10T23:40:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d4840640 1 -- 172.21.15.16:0/2110736155 learned_addr learned my addr 172.21.15.16:0/2110736155 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:53.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.095+0000 7f64d5842640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 0x556c7eb68180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d5041640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d4840640 1 -- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 msgr2=0x556c7eb68180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:53.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d4840640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 0x556c7eb68180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d4840640 1 -- 172.21.15.16:0/2110736155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 msgr2=0x556c7eb5bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:53.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d4840640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d4840640 1 -- 172.21.15.16:0/2110736155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7ea75c90 con 0x556c7eb54e10 2024-09-10T23:40:53.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d5041640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:53.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64d4840640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb5c1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64c0031440 tx=0x7f64c00043f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55cb608d5f33b001 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:53.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.096+0000 7f64b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:40:53.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.097+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2110736155 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0050070 con 0x556c7eb54e10 2024-09-10T23:40:53.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.097+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64c0003de0 con 0x556c7eb54e10 2024-09-10T23:40:53.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.097+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2110736155 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f64c00316a0 con 0x556c7eb54e10 2024-09-10T23:40:53.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.097+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2110736155 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64c005c050 con 0x556c7eb54e10 2024-09-10T23:40:53.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.097+0000 7f64d967a740 10 client.25157 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:53.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.097+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c7eb6ad80 con 0x556c7eb54e10 2024-09-10T23:40:53.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.097+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2110736155 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64c0003de0 con 0x556c7eb54e10 2024-09-10T23:40:53.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2110736155 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f64c003d680 con 0x556c7eb54e10 2024-09-10T23:40:53.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64d967a740 10 client.25157 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:53.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64d967a740 10 client.25157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:53.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64d967a740 20 client.25157 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:53.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64d967a740 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7eb6c1e0 0x556c7eb6e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64d967a740 4 client.25157 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:53.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c7eabfdf0 con 0x556c7eb6c1e0 2024-09-10T23:40:53.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.098+0000 7f64d5041640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7eb6c1e0 0x556c7eb6e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.099+0000 7f64d5041640 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7eb6c1e0 0x556c7eb6e650 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=757c9744376d880f server_cookie=933347d64a97ea0a in_seq=0 out_seq=0 2024-09-10T23:40:53.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.099+0000 7f64b8ff9640 10 client.25157 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:53.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.099+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2110736155 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c7eabfdf0 con 0x556c7eb6c1e0 2024-09-10T23:40:53.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.099+0000 7f64b8ff9640 10 client.25157 handle_command_reply: tid=0 2024-09-10T23:40:53.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 client.25157 shutdown 2024-09-10T23:40:53.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 msgr2=0x556c7eb5c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb5c1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64c0031440 tx=0x7f64c00043f0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 shutdown_connections 2024-09-10T23:40:53.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7eb6c1e0 0x556c7eb6e650 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 0x556c7eb68180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb5c1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 --2- 172.21.15.16:0/2110736155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64b8ff9640 0 client.25157 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 >> 172.21.15.16:0/2110736155 conn(0x556c7eb47090 msgr2=0x556c7eb56dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 shutdown_connections 2024-09-10T23:40:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.100+0000 7f64d967a740 1 -- 172.21.15.16:0/2110736155 wait complete. 2024-09-10T23:40:53.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.101+0000 7f64d967a740 20 client.25157 trim_cache size 0 max 16384 2024-09-10T23:40:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 Processor -- start 2024-09-10T23:40:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 -- start start 2024-09-10T23:40:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb68080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 0x556c7eb685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d5041640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64d01ae970 con 0x556c7eb54490 2024-09-10T23:40:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64d01ac240 con 0x556c7eb54e10 2024-09-10T23:40:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d967a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64d01aa090 con 0x556c7eb5c720 2024-09-10T23:40:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d5041640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54866/0 (socket says 172.21.15.16:54866) 2024-09-10T23:40:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.127+0000 7f64d5041640 1 -- 172.21.15.16:0/1909126041 learned_addr learned my addr 172.21.15.16:0/1909126041 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64d4840640 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb68080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64d5041640 1 -- 172.21.15.16:0/1909126041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 msgr2=0x556c7eb685c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:40:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64d5041640 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 0x556c7eb685c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64d5041640 1 -- 172.21.15.16:0/1909126041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 msgr2=0x556c7eb68080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64d5041640 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb68080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64d5041640 1 -- 172.21.15.16:0/1909126041 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7eb57550 con 0x556c7eb54490 2024-09-10T23:40:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64d5041640 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5b190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005d70 tx=0x7f64cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c313613b5291b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64baffd640 1 -- 172.21.15.16:0/1909126041 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc02b040 con 0x556c7eb54490 2024-09-10T23:40:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64baffd640 1 -- 172.21.15.16:0/1909126041 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64cc01be50 con 0x556c7eb54490 2024-09-10T23:40:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.128+0000 7f64baffd640 1 -- 172.21.15.16:0/1909126041 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc028470 con 0x556c7eb54490 2024-09-10T23:40:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.129+0000 7f64d967a740 1 -- 172.21.15.16:0/1909126041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 msgr2=0x556c7eb5b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.129+0000 7f64d967a740 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5b190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005d70 tx=0x7f64cc014000 comp rx=0 tx=0).stop 2024-09-10T23:40:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 -- 172.21.15.16:0/1909126041 shutdown_connections 2024-09-10T23:40:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb5c720 0x556c7eb685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54e10 0x556c7eb68080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 --2- 172.21.15.16:0/1909126041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb54490 0x556c7eb5b190 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 -- 172.21.15.16:0/1909126041 >> 172.21.15.16:0/1909126041 conn(0x556c7eb47090 msgr2=0x556c7eb5a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 -- 172.21.15.16:0/1909126041 shutdown_connections 2024-09-10T23:40:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 -- 172.21.15.16:0/1909126041 wait complete. 2024-09-10T23:40:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 -- start start 2024-09-10T23:40:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.130+0000 7f64d967a740 1 Processor -- start 2024-09-10T23:40:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d967a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54490 0x556c7eb74490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d967a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d967a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb5c720 0x556c7eb64620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d967a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64d01aa700 con 0x556c7eb5c720 2024-09-10T23:40:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d967a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64d01abb70 con 0x556c7eb54490 2024-09-10T23:40:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d967a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64d01aadd0 con 0x556c7eb54e10 2024-09-10T23:40:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d5041640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54490 0x556c7eb74490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:56402/0 (socket says 172.21.15.16:56402) 2024-09-10T23:40:53.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 -- 172.21.15.16:0/2118822014 learned_addr learned my addr 172.21.15.16:0/2118822014 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:53.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d967a740 10 client.0 _ll_register_callbacks cb 0x7f64c0004230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:53.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 -- 172.21.15.16:0/2118822014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54490 msgr2=0x556c7eb74490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:53.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54490 0x556c7eb74490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 -- 172.21.15.16:0/2118822014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb5c720 msgr2=0x556c7eb64620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:53.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb5c720 0x556c7eb64620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.131+0000 7f64d4840640 1 -- 172.21.15.16:0/2118822014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7eb64c60 con 0x556c7eb54e10 2024-09-10T23:40:53.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64d4840640 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb640e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64c0006010 tx=0x7f64c0005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e6f33a07391d7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:53.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:40:53.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2118822014 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0065060 con 0x556c7eb54e10 2024-09-10T23:40:53.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2118822014 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f64c003d450 con 0x556c7eb54e10 2024-09-10T23:40:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64cc01be50 con 0x556c7eb54e10 2024-09-10T23:40:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2118822014 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64c0035070 con 0x556c7eb54e10 2024-09-10T23:40:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64d967a740 10 client.25234 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.132+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c7ebd90f0 con 0x556c7eb54e10 2024-09-10T23:40:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.133+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2118822014 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64c0003e70 con 0x556c7eb54e10 2024-09-10T23:40:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2118822014 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f64c00048a0 con 0x556c7eb54e10 2024-09-10T23:40:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64d967a740 10 client.25234 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64d967a740 10 client.25234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64d967a740 20 client.25234 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64d967a740 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7ebd9650 0x556c7ebdba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64d967a740 4 client.25234 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:40:53.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f64cc01be50 con 0x556c7ebd9650 2024-09-10T23:40:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.134+0000 7f64d5041640 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7ebd9650 0x556c7ebdba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64b8ff9640 10 client.25234 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d5041640 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7ebd9650 0x556c7ebdba70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5124c924c7916d87 server_cookie=1f8dbd89a6f6c9e9 in_seq=0 out_seq=0 2024-09-10T23:40:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64b8ff9640 1 -- 172.21.15.16:0/2118822014 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f64cc01be50 con 0x556c7ebd9650 2024-09-10T23:40:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64b8ff9640 10 client.25234 handle_command_reply: tid=0 2024-09-10T23:40:53.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 client.25234 shutdown 2024-09-10T23:40:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 msgr2=0x556c7eb640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb640e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64c0006010 tx=0x7f64c0005850 comp rx=0 tx=0).stop 2024-09-10T23:40:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 shutdown_connections 2024-09-10T23:40:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x556c7ebd9650 0x556c7ebdba70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c7eb5c720 0x556c7eb64620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c7eb54e10 0x556c7eb640e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.135+0000 7f64d967a740 1 --2- 172.21.15.16:0/2118822014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c7eb54490 0x556c7eb74490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.136+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 >> 172.21.15.16:0/2118822014 conn(0x556c7eb47090 msgr2=0x556c7eb53480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.136+0000 7f64b8ff9640 0 client.25234 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.136+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 shutdown_connections 2024-09-10T23:40:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.136+0000 7f64d967a740 1 -- 172.21.15.16:0/2118822014 wait complete. 2024-09-10T23:40:53.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.136+0000 7f64d967a740 20 client.25234 trim_cache size 0 max 16384 2024-09-10T23:40:53.155 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:40:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f64bc0b5310 msgr2=0x7f64bc0b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f64bc0b5310 0x7f64bc0b77d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009810 tx=0x7f64cc0097a0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d0108050 msgr2=0x7f64d01993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d0108050 0x7f64d01993e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f64c800e940 tx=0x7f64c800ee00 comp rx=0 tx=0).stop 2024-09-10T23:40:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 shutdown_connections 2024-09-10T23:40:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d0108050 0x7f64d01993e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64d01076d0 0x7f64d019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f64bc0b5310 0x7f64bc0b77d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 --2- 172.21.15.16:0/276398561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64d0101cc0 0x7f64d019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 >> 172.21.15.16:0/276398561 conn(0x7f64d00fd770 msgr2=0x7f64d006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:53.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 shutdown_connections 2024-09-10T23:40:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:53.137+0000 7f64d72a5640 1 -- 172.21.15.16:0/276398561 wait complete. 2024-09-10T23:40:53.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:53 smithi066 ceph-mon[34761]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:40:53.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:53 smithi071 ceph-mon[35018]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:40:53.911 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:53 smithi016 ceph-mon[30855]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:40:54.943 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:40:54.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:40:55.310 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:55.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:55 smithi016 ceph-mon[30855]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:40:55.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:55 smithi066 ceph-mon[34761]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:40:55.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 -- 172.21.15.16:0/2480329548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668104560 msgr2=0x7f366810cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 --2- 172.21.15.16:0/2480329548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668104560 0x7f366810cb40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3658009900 tx=0x7f365802a410 comp rx=0 tx=0).stop 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 -- 172.21.15.16:0/2480329548 shutdown_connections 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 --2- 172.21.15.16:0/2480329548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 0x7f366810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 --2- 172.21.15.16:0/2480329548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668104560 0x7f366810cb40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 --2- 172.21.15.16:0/2480329548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3668103b60 0x7f3668103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 -- 172.21.15.16:0/2480329548 >> 172.21.15.16:0/2480329548 conn(0x7f36680fd770 msgr2=0x7f36680ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 -- 172.21.15.16:0/2480329548 shutdown_connections 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.837+0000 7f3670487640 1 -- 172.21.15.16:0/2480329548 wait complete. 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 Processor -- start 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 -- start start 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668103b60 0x7f3668199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3668104560 0x7f36681997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 0x7f366819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3668112d90 con 0x7f366810d110 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3668112c10 con 0x7f3668103b60 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f3670487640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3668112f10 con 0x7f3668104560 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f366ea24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 0x7f366819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f366e223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668103b60 0x7f3668199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.838+0000 7f366ea24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 0x7f366819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57280/0 (socket says 172.21.15.16:57280) 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366ea24640 1 -- 172.21.15.16:0/4245927097 learned_addr learned my addr 172.21.15.16:0/4245927097 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366da22640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3668104560 0x7f36681997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366ea24640 1 -- 172.21.15.16:0/4245927097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3668104560 msgr2=0x7f36681997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366ea24640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3668104560 0x7f36681997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366ea24640 1 -- 172.21.15.16:0/4245927097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668103b60 msgr2=0x7f3668199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366ea24640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668103b60 0x7f3668199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366ea24640 1 -- 172.21.15.16:0/4245927097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366819f310 con 0x7f366810d110 2024-09-10T23:40:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f366ea24640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 0x7f366819eb40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f366000eb10 tx=0x7f366000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f365f7fe640 1 -- 172.21.15.16:0/4245927097 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660004b20 con 0x7f366810d110 2024-09-10T23:40:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.839+0000 7f365f7fe640 1 -- 172.21.15.16:0/4245927097 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3660004cc0 con 0x7f366810d110 2024-09-10T23:40:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.840+0000 7f365f7fe640 1 -- 172.21.15.16:0/4245927097 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660010670 con 0x7f366810d110 2024-09-10T23:40:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.840+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366819f600 con 0x7f366810d110 2024-09-10T23:40:55.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.840+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36681a5cc0 con 0x7f366810d110 2024-09-10T23:40:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.843+0000 7f367285c740 1 Processor -- start 2024-09-10T23:40:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f365f7fe640 1 -- 172.21.15.16:0/4245927097 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f3660005000 con 0x7f366810d110 2024-09-10T23:40:55.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f367285c740 1 -- start start 2024-09-10T23:40:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f367285c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f500460d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f367285c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f5004712b0 0x55f5004716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f367285c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f50047a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f367285c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f5003d9e60 con 0x55f500460960 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f367285c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f5003c9290 con 0x55f5004712b0 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f367285c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f5003cd0a0 con 0x55f500471c30 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f366e223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f5004712b0 0x55f5004716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f366e223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f5004712b0 0x55f5004716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:48704/0 (socket says 172.21.15.16:48704) 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f366e223640 1 -- 172.21.15.16:0/1409297580 learned_addr learned my addr 172.21.15.16:0/1409297580 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.844+0000 7f366da22640 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f500460d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366da22640 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f50047a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366e223640 1 -- 172.21.15.16:0/1409297580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 msgr2=0x55f50047a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366e223640 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f50047a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366e223640 1 -- 172.21.15.16:0/1409297580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 msgr2=0x55f500460d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366e223640 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f500460d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366e223640 1 -- 172.21.15.16:0/1409297580 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f500127930 con 0x55f5004712b0 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366da22640 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f50047a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f365f7fe640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36540b53c0 0x7f36540b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.845+0000 7f366e223640 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f5004712b0 0x55f5004716f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3664009cf0 tx=0x7f3664011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a50e800e246713 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.846+0000 7f365f7fe640 1 -- 172.21.15.16:0/4245927097 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f36600e6530 con 0x7f366810d110 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.846+0000 7f365cff9640 1 -- 172.21.15.16:0/1409297580 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664004230 con 0x55f5004712b0 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.846+0000 7f366da22640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36540b53c0 0x7f36540b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.846+0000 7f365cff9640 1 -- 172.21.15.16:0/1409297580 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36640043d0 con 0x55f5004712b0 2024-09-10T23:40:55.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.846+0000 7f365cff9640 1 -- 172.21.15.16:0/1409297580 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664019880 con 0x55f5004712b0 2024-09-10T23:40:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 -- 172.21.15.16:0/1409297580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f5004712b0 msgr2=0x55f5004716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f5004712b0 0x55f5004716f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3664009cf0 tx=0x7f3664011810 comp rx=0 tx=0).stop 2024-09-10T23:40:55.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f366da22640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36540b53c0 0x7f36540b7880 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3658031440 tx=0x7f36580058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 -- 172.21.15.16:0/1409297580 shutdown_connections 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f50047a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f5004712b0 0x55f5004716f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 --2- 172.21.15.16:0/1409297580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f500460d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 -- 172.21.15.16:0/1409297580 >> 172.21.15.16:0/1409297580 conn(0x55f500462e80 msgr2=0x55f500463260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 -- 172.21.15.16:0/1409297580 shutdown_connections 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.847+0000 7f367285c740 1 -- 172.21.15.16:0/1409297580 wait complete. 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 -- start start 2024-09-10T23:40:55.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 Processor -- start 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f50047a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f5004712b0 0x55f500477910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f500477fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f50022a890 con 0x55f5004712b0 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f500363d40 con 0x55f500460960 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f50047ad30 con 0x55f500471c30 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f367285c740 10 client.0 _ll_register_callbacks cb 0x55f5003c7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f366da22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f5004712b0 0x55f500477910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f366e223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f50047a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f366e223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f50047a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:48710/0 (socket says 172.21.15.16:48710) 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.848+0000 7f366e223640 1 -- 172.21.15.16:0/1488038822 learned_addr learned my addr 172.21.15.16:0/1488038822 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366ea24640 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f500477fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366e223640 1 -- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 msgr2=0x55f500477fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366e223640 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f500477fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366e223640 1 -- 172.21.15.16:0/1488038822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f5004712b0 msgr2=0x55f500477910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366e223640 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f5004712b0 0x55f500477910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366e223640 1 -- 172.21.15.16:0/1488038822 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f500484080 con 0x55f500460960 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366da22640 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f5004712b0 0x55f500477910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f366e223640 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f50047a4c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3664000c00 tx=0x7f3664003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a74ab73597606ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:55.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f3651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f3651ffb640 1 -- 172.21.15.16:0/1488038822 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664027070 con 0x55f500460960 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.849+0000 7f3651ffb640 1 -- 172.21.15.16:0/1488038822 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f3664005240 con 0x55f500460960 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.850+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36640043d0 con 0x55f500460960 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.850+0000 7f3651ffb640 1 -- 172.21.15.16:0/1488038822 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3664031050 con 0x55f500460960 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.850+0000 7f367285c740 10 client.25175 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.850+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f500486860 con 0x55f500460960 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.850+0000 7f3651ffb640 1 -- 172.21.15.16:0/1488038822 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36640043d0 con 0x55f500460960 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.850+0000 7f3651ffb640 1 -- 172.21.15.16:0/1488038822 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3664004b70 con 0x55f500460960 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.850+0000 7f367285c740 10 client.25175 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:55.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f367285c740 10 client.25175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:55.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f367285c740 20 client.25175 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:55.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f367285c740 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f500487cc0 0x55f50048a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f367285c740 4 client.25175 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:55.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5003dbdb0 con 0x55f500487cc0 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f366da22640 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f500487cc0 0x55f50048a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f3651ffb640 10 client.25175 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.851+0000 7f366da22640 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f500487cc0 0x55f50048a0b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69d2f1c508b366bd server_cookie=c057cdc907b2ace3 in_seq=0 out_seq=0 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f3651ffb640 1 -- 172.21.15.16:0/1488038822 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f5003dbdb0 con 0x55f500487cc0 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f3651ffb640 10 client.25175 handle_command_reply: tid=0 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 client.25175 shutdown 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 msgr2=0x55f50047a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f50047a4c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3664000c00 tx=0x7f3664003820 comp rx=0 tx=0).stop 2024-09-10T23:40:55.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 shutdown_connections 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f500487cc0 0x55f50048a0b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f500471c30 0x55f500477fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f5004712b0 0x55f500477910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 --2- 172.21.15.16:0/1488038822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f50047a4c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 >> 172.21.15.16:0/1488038822 conn(0x55f500462e80 msgr2=0x55f50045ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.852+0000 7f3651ffb640 0 client.25175 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.853+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 shutdown_connections 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.853+0000 7f367285c740 1 -- 172.21.15.16:0/1488038822 wait complete. 2024-09-10T23:40:55.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.853+0000 7f367285c740 20 client.25175 trim_cache size 0 max 16384 2024-09-10T23:40:55.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.887+0000 7f367285c740 1 Processor -- start 2024-09-10T23:40:55.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.887+0000 7f367285c740 1 -- start start 2024-09-10T23:40:55.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f367285c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f5004778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f367285c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f5004702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f367285c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500471c30 0x55f5004761b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f366e223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f5004778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f367285c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36681aec20 con 0x55f500471c30 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f367285c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36681ac4f0 con 0x55f500460960 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f366ea24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500471c30 0x55f5004761b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f366ea24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500471c30 0x55f5004761b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57308/0 (socket says 172.21.15.16:57308) 2024-09-10T23:40:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f366ea24640 1 -- 172.21.15.16:0/2152628526 learned_addr learned my addr 172.21.15.16:0/2152628526 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:55.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f367285c740 1 -- 172.21.15.16:0/2152628526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36681aa360 con 0x55f5004712b0 2024-09-10T23:40:55.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.888+0000 7f366da22640 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f5004702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366da22640 1 -- 172.21.15.16:0/2152628526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 msgr2=0x55f5004778e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366da22640 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f5004778e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366da22640 1 -- 172.21.15.16:0/2152628526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500471c30 msgr2=0x55f5004761b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366da22640 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500471c30 0x55f5004761b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366da22640 1 -- 172.21.15.16:0/2152628526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f50047a830 con 0x55f5004712b0 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366ea24640 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500471c30 0x55f5004761b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366e223640 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f5004778e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f366da22640 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f5004702a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3658009230 tx=0x7f3658041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22899682e3caeff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.889+0000 7f3653fff640 1 -- 172.21.15.16:0/2152628526 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658058070 con 0x55f5004712b0 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.890+0000 7f3653fff640 1 -- 172.21.15.16:0/2152628526 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36580054f0 con 0x55f5004712b0 2024-09-10T23:40:55.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.890+0000 7f3653fff640 1 -- 172.21.15.16:0/2152628526 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658035050 con 0x55f5004712b0 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 -- 172.21.15.16:0/2152628526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 msgr2=0x55f5004702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f5004702a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3658009230 tx=0x7f3658041000 comp rx=0 tx=0).stop 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 -- 172.21.15.16:0/2152628526 shutdown_connections 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500471c30 0x55f5004761b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f5004702a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 --2- 172.21.15.16:0/2152628526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500460960 0x55f5004778e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 -- 172.21.15.16:0/2152628526 >> 172.21.15.16:0/2152628526 conn(0x55f500462e80 msgr2=0x55f500489cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 -- 172.21.15.16:0/2152628526 shutdown_connections 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 -- 172.21.15.16:0/2152628526 wait complete. 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.891+0000 7f367285c740 1 -- start start 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.892+0000 7f367285c740 1 Processor -- start 2024-09-10T23:40:55.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.892+0000 7f367285c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f50047fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.892+0000 7f366e223640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f50047fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.892+0000 7f366e223640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f50047fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57322/0 (socket says 172.21.15.16:57322) 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.892+0000 7f366e223640 1 -- 172.21.15.16:0/2954883713 learned_addr learned my addr 172.21.15.16:0/2954883713 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.892+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f500480530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.892+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500471c30 0x55f50047afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.893+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36681aa9b0 con 0x55f500460960 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.893+0000 7f366da22640 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f500480530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.893+0000 7f366ea24640 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500471c30 0x55f50047afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.893+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36681abe20 con 0x55f500471c30 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.893+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36681ab080 con 0x55f5004712b0 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.893+0000 7f367285c740 10 client.0 _ll_register_callbacks cb 0x7f3664009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f366ea24640 1 -- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 msgr2=0x55f500480530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f366ea24640 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f500480530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f366ea24640 1 -- 172.21.15.16:0/2954883713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 msgr2=0x55f50047fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f366ea24640 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f50047fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f366ea24640 1 -- 172.21.15.16:0/2954883713 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f500480ba0 con 0x55f500471c30 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f366ea24640 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500471c30 0x55f50047afa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36600ac7d0 tx=0x7f3660005610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f462a7b6205a696c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f3651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.894+0000 7f3651ffb640 1 -- 172.21.15.16:0/2954883713 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36600ac5e0 con 0x55f500471c30 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.895+0000 7f3651ffb640 1 -- 172.21.15.16:0/2954883713 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f36600a8040 con 0x55f500471c30 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.895+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36580054f0 con 0x55f500471c30 2024-09-10T23:40:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.895+0000 7f3651ffb640 1 -- 172.21.15.16:0/2954883713 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f36600ad1d0 con 0x55f500471c30 2024-09-10T23:40:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.895+0000 7f367285c740 10 client.25178 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.895+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f5004f4e70 con 0x55f500471c30 2024-09-10T23:40:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.895+0000 7f3651ffb640 1 -- 172.21.15.16:0/2954883713 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36600acad0 con 0x55f500471c30 2024-09-10T23:40:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.896+0000 7f3651ffb640 1 -- 172.21.15.16:0/2954883713 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f36600e61d0 con 0x55f500471c30 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.896+0000 7f367285c740 10 client.25178 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.896+0000 7f367285c740 10 client.25178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.896+0000 7f367285c740 20 client.25178 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.896+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f5004f55d0 0x55f5004f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.896+0000 7f367285c740 4 client.25178 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.896+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f36580054f0 con 0x55f5004f55d0 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.897+0000 7f366e223640 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f5004f55d0 0x55f5004f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.897+0000 7f366e223640 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f5004f55d0 0x55f5004f79f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa9aacfb97494ba server_cookie=f39c1f484f26f07a in_seq=0 out_seq=0 2024-09-10T23:40:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.897+0000 7f3651ffb640 10 client.25178 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.899+0000 7f3651ffb640 1 -- 172.21.15.16:0/2954883713 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f36580054f0 con 0x55f5004f55d0 2024-09-10T23:40:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.899+0000 7f3651ffb640 10 client.25178 handle_command_reply: tid=0 2024-09-10T23:40:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.899+0000 7f367285c740 1 client.25178 shutdown 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500471c30 msgr2=0x55f50047afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500471c30 0x55f50047afa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36600ac7d0 tx=0x7f3660005610 comp rx=0 tx=0).stop 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 shutdown_connections 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55f5004f55d0 0x55f5004f79f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f500471c30 0x55f50047afa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f5004712b0 0x55f500480530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 --2- 172.21.15.16:0/2954883713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f500460960 0x55f50047fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 >> 172.21.15.16:0/2954883713 conn(0x55f500462e80 msgr2=0x55f50045f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f3651ffb640 0 client.25178 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 shutdown_connections 2024-09-10T23:40:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.901+0000 7f367285c740 1 -- 172.21.15.16:0/2954883713 wait complete. 2024-09-10T23:40:55.905 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:40:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:40:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "98d86a4c-6edc-4306-8e2e-ff62ec168211", 2024-09-10T23:40:55.905 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:40:55.905 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.902+0000 7f367285c740 20 client.25178 trim_cache size 0 max 16384 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.902+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36540b53c0 msgr2=0x7f36540b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.902+0000 7f3670487640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36540b53c0 0x7f36540b7880 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3658031440 tx=0x7f36580058b0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.903+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 msgr2=0x7f366819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.903+0000 7f3670487640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 0x7f366819eb40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f366000eb10 tx=0x7f366000c2d0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.904+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 shutdown_connections 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.904+0000 7f3670487640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f366810d110 0x7f366819eb40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.904+0000 7f3670487640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3668104560 0x7f36681997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.904+0000 7f3670487640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f36540b53c0 0x7f36540b7880 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.904+0000 7f3670487640 1 --2- 172.21.15.16:0/4245927097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3668103b60 0x7f3668199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:55.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.904+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 >> 172.21.15.16:0/4245927097 conn(0x7f36680fd770 msgr2=0x7f36680fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:55.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.905+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 shutdown_connections 2024-09-10T23:40:55.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:55.905+0000 7f3670487640 1 -- 172.21.15.16:0/4245927097 wait complete. 2024-09-10T23:40:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:55 smithi071 ceph-mon[35018]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:40:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:56 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:40:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:56 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:56 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:40:56.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:56 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:56.821 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:56 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:40:56.821 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:56 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:56.822 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:56 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:40:56.822 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:56 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:56.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:40:57.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:56 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:40:57.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:56 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:57.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:56 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:40:57.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:56 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:40:57.136 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 -- 172.21.15.16:0/650157024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9304101890 msgr2=0x7f9304101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 --2- 172.21.15.16:0/650157024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9304101890 0x7f9304101c70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009900 tx=0x7f92f402a480 comp rx=0 tx=0).stop 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 -- 172.21.15.16:0/650157024 shutdown_connections 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 --2- 172.21.15.16:0/650157024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f930410f440 0x7f9304111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 --2- 172.21.15.16:0/650157024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93041021b0 0x7f930410ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 --2- 172.21.15.16:0/650157024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9304101890 0x7f9304101c70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 -- 172.21.15.16:0/650157024 >> 172.21.15.16:0/650157024 conn(0x7f93040fd700 msgr2=0x7f93040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.688+0000 7f9309bf7640 1 -- 172.21.15.16:0/650157024 shutdown_connections 2024-09-10T23:40:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.689+0000 7f9309bf7640 1 -- 172.21.15.16:0/650157024 wait complete. 2024-09-10T23:40:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.690+0000 7f9309bf7640 1 Processor -- start 2024-09-10T23:40:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.690+0000 7f9309bf7640 1 -- start start 2024-09-10T23:40:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.690+0000 7f9309bf7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9304101890 0x7f930419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9309bf7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93041021b0 0x7f930419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f93037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9304101890 0x7f930419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9309bf7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f930410f440 0x7f93041a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9302ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93041021b0 0x7f930419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9302ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93041021b0 0x7f930419ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57350/0 (socket says 172.21.15.16:57350) 2024-09-10T23:40:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9302ffd640 1 -- 172.21.15.16:0/135832686 learned_addr learned my addr 172.21.15.16:0/135832686 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9304114f50 con 0x7f93041021b0 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9304114dd0 con 0x7f9304101890 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93041150d0 con 0x7f930410f440 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f9303fff640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f930410f440 0x7f93041a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.691+0000 7f93037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9304101890 0x7f930419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:48736/0 (socket says 172.21.15.16:48736) 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.692+0000 7f9302ffd640 1 -- 172.21.15.16:0/135832686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f930410f440 msgr2=0x7f93041a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.692+0000 7f9302ffd640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f930410f440 0x7f93041a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.692+0000 7f9302ffd640 1 -- 172.21.15.16:0/135832686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9304101890 msgr2=0x7f930419b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.692+0000 7f9302ffd640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9304101890 0x7f930419b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.692+0000 7f9302ffd640 1 -- 172.21.15.16:0/135832686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93041a15f0 con 0x7f93041021b0 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.692+0000 7f9302ffd640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93041021b0 0x7f930419ba80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f92f800d950 tx=0x7f92f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.692+0000 7f9300ff9640 1 -- 172.21.15.16:0/135832686 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8017070 con 0x7f93041021b0 2024-09-10T23:40:57.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.693+0000 7f9300ff9640 1 -- 172.21.15.16:0/135832686 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f8009c30 con 0x7f93041021b0 2024-09-10T23:40:57.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.693+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93041a18e0 con 0x7f93041021b0 2024-09-10T23:40:57.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.693+0000 7f9300ff9640 1 -- 172.21.15.16:0/135832686 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f800f620 con 0x7f93041021b0 2024-09-10T23:40:57.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.693+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93041a7fa0 con 0x7f93041021b0 2024-09-10T23:40:57.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.695+0000 7f930bfcc740 1 Processor -- start 2024-09-10T23:40:57.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f930bfcc740 1 -- start start 2024-09-10T23:40:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1a480 0x55ef81a1a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1ada0 0x55ef81a2f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a31930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f930bfcc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ef81990e50 con 0x55ef81a1ada0 2024-09-10T23:40:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f930bfcc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ef81980280 con 0x55ef81a2f540 2024-09-10T23:40:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f930bfcc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef81984090 con 0x55ef81a1a480 2024-09-10T23:40:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f93037fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1ada0 0x55ef81a2f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f9303fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1a480 0x55ef81a1a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f9303fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1a480 0x55ef81a1a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:52940/0 (socket says 172.21.15.16:52940) 2024-09-10T23:40:57.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.696+0000 7f9303fff640 1 -- 172.21.15.16:0/999059186 learned_addr learned my addr 172.21.15.16:0/999059186 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:57.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.697+0000 7f9300ff9640 1 -- 172.21.15.16:0/135832686 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f92f8010460 con 0x7f93041021b0 2024-09-10T23:40:57.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.697+0000 7f93037fe640 1 -- 172.21.15.16:0/999059186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1a480 msgr2=0x55ef81a1a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:57.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.697+0000 7f93037fe640 1 --2- 172.21.15.16:0/999059186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1a480 0x55ef81a1a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.697+0000 7f93037fe640 1 -- 172.21.15.16:0/999059186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 msgr2=0x55ef81a31930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:40:57.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.697+0000 7f93037fe640 1 --2- 172.21.15.16:0/999059186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a31930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.697+0000 7f93037fe640 1 -- 172.21.15.16:0/999059186 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef816de650 con 0x55ef81a1ada0 2024-09-10T23:40:57.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.697+0000 7f93037fe640 1 --2- 172.21.15.16:0/999059186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1ada0 0x55ef81a2f000 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009230 tx=0x7f92f4032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb157b96b2796cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:57.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.698+0000 7f92e9ffb640 1 -- 172.21.15.16:0/999059186 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4040070 con 0x55ef81a1ada0 2024-09-10T23:40:57.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.698+0000 7f92e9ffb640 1 -- 172.21.15.16:0/999059186 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f4004030 con 0x55ef81a1ada0 2024-09-10T23:40:57.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.698+0000 7f9300ff9640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f92ec0b54c0 0x7f92ec0b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.698+0000 7f9303fff640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f92ec0b54c0 0x7f92ec0b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.698+0000 7f9300ff9640 1 -- 172.21.15.16:0/135832686 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f92f80e5a20 con 0x7f93041021b0 2024-09-10T23:40:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f92e9ffb640 1 -- 172.21.15.16:0/999059186 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4035040 con 0x55ef81a1ada0 2024-09-10T23:40:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f930bfcc740 1 -- 172.21.15.16:0/999059186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1ada0 msgr2=0x55ef81a2f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f930bfcc740 1 --2- 172.21.15.16:0/999059186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1ada0 0x55ef81a2f000 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009230 tx=0x7f92f4032bd0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f9303fff640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f92ec0b54c0 0x7f92ec0b7980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92fc005f40 tx=0x7f92fc0096c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f930bfcc740 1 -- 172.21.15.16:0/999059186 shutdown_connections 2024-09-10T23:40:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f930bfcc740 1 --2- 172.21.15.16:0/999059186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a31930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f930bfcc740 1 --2- 172.21.15.16:0/999059186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1ada0 0x55ef81a2f000 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f930bfcc740 1 --2- 172.21.15.16:0/999059186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1a480 0x55ef81a1a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.699+0000 7f930bfcc740 1 -- 172.21.15.16:0/999059186 >> 172.21.15.16:0/999059186 conn(0x55ef81a182b0 msgr2=0x55ef81a19450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.700+0000 7f930bfcc740 1 -- 172.21.15.16:0/999059186 shutdown_connections 2024-09-10T23:40:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.700+0000 7f930bfcc740 1 -- 172.21.15.16:0/999059186 wait complete. 2024-09-10T23:40:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.700+0000 7f930bfcc740 1 -- start start 2024-09-10T23:40:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.700+0000 7f930bfcc740 1 Processor -- start 2024-09-10T23:40:57.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a2ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a2c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a2c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f930bfcc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ef817e1700 con 0x55ef81a2f540 2024-09-10T23:40:57.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f930bfcc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ef8191b110 con 0x55ef81a1a480 2024-09-10T23:40:57.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f930bfcc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef81a32200 con 0x55ef81a1ada0 2024-09-10T23:40:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f930bfcc740 10 client.0 _ll_register_callbacks cb 0x55ef81934990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f93037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a2ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f9303fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a2c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f9302ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a2c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f9302ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a2c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:52954/0 (socket says 172.21.15.16:52954) 2024-09-10T23:40:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.701+0000 7f9302ffd640 1 -- 172.21.15.16:0/3378817300 learned_addr learned my addr 172.21.15.16:0/3378817300 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f9302ffd640 1 -- 172.21.15.16:0/3378817300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 msgr2=0x55ef81a2ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f9302ffd640 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a2ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f9302ffd640 1 -- 172.21.15.16:0/3378817300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 msgr2=0x55ef81a2c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f9302ffd640 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a2c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f9302ffd640 1 -- 172.21.15.16:0/3378817300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef81948c40 con 0x55ef81a1ada0 2024-09-10T23:40:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f9303fff640 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a2c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f9302ffd640 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a2c180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92f80abd10 tx=0x7f92f80a84b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=674986e4fb49df63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f92e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:40:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3378817300 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8020070 con 0x55ef81a1ada0 2024-09-10T23:40:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f4004030 con 0x55ef81a1ada0 2024-09-10T23:40:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3378817300 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f92f80ab470 con 0x55ef81a1ada0 2024-09-10T23:40:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.702+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3378817300 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92f8009de0 con 0x55ef81a1ada0 2024-09-10T23:40:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 10 client.25261 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef81a3db00 con 0x55ef81a1ada0 2024-09-10T23:40:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3378817300 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f4004030 con 0x55ef81a1ada0 2024-09-10T23:40:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3378817300 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f92f80a7960 con 0x55ef81a1ada0 2024-09-10T23:40:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 10 client.25261 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 10 client.25261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 20 client.25261 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81a3f410 0x55ef81a41830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 4 client.25261 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:40:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef81992da0 con 0x55ef81a3f410 2024-09-10T23:40:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.703+0000 7f93037fe640 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81a3f410 0x55ef81a41830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.704+0000 7f92e2ffd640 10 client.25261 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.704+0000 7f93037fe640 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81a3f410 0x55ef81a41830 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d18d2187cca3f2 server_cookie=bd339abf991dcac4 in_seq=0 out_seq=0 2024-09-10T23:40:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.704+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3378817300 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef81992da0 con 0x55ef81a3f410 2024-09-10T23:40:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.704+0000 7f92e2ffd640 10 client.25261 handle_command_reply: tid=0 2024-09-10T23:40:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 client.25261 shutdown 2024-09-10T23:40:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 msgr2=0x55ef81a2c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a2c180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92f80abd10 tx=0x7f92f80a84b0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 shutdown_connections 2024-09-10T23:40:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81a3f410 0x55ef81a41830 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a2c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a2c180 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3378817300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a2ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 >> 172.21.15.16:0/3378817300 conn(0x55ef81a182b0 msgr2=0x55ef81a1de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f92e2ffd640 0 client.25261 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 shutdown_connections 2024-09-10T23:40:57.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 1 -- 172.21.15.16:0/3378817300 wait complete. 2024-09-10T23:40:57.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.705+0000 7f930bfcc740 20 client.25261 trim_cache size 0 max 16384 2024-09-10T23:40:57.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.740+0000 7f930bfcc740 1 Processor -- start 2024-09-10T23:40:57.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.740+0000 7f930bfcc740 1 -- start start 2024-09-10T23:40:57.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.740+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a19240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.740+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a19780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.740+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a47120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f93037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a19240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f9303fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a47120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f93037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a19240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:48770/0 (socket says 172.21.15.16:48770) 2024-09-10T23:40:57.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f930bfcc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f93041aed20 con 0x55ef81a2f540 2024-09-10T23:40:57.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f93037fe640 1 -- 172.21.15.16:0/581049838 learned_addr learned my addr 172.21.15.16:0/581049838 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:57.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f9302ffd640 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a19780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f930bfcc740 1 -- 172.21.15.16:0/581049838 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f93041ac5f0 con 0x55ef81a1a480 2024-09-10T23:40:57.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f930bfcc740 1 -- 172.21.15.16:0/581049838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93041aa440 con 0x55ef81a1ada0 2024-09-10T23:40:57.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.741+0000 7f9302ffd640 1 -- 172.21.15.16:0/581049838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 msgr2=0x55ef81a19240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:57.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f9302ffd640 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a19240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f9302ffd640 1 -- 172.21.15.16:0/581049838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 msgr2=0x55ef81a47120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:57.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f9302ffd640 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a47120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f9302ffd640 1 -- 172.21.15.16:0/581049838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef81a180e0 con 0x55ef81a1ada0 2024-09-10T23:40:57.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f9303fff640 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a47120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:40:57.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f9302ffd640 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a19780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92f80a9280 tx=0x7f92f8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=205d255a850ac028 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:57.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f92e97fa640 1 -- 172.21.15.16:0/581049838 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8020070 con 0x55ef81a1ada0 2024-09-10T23:40:57.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f92e97fa640 1 -- 172.21.15.16:0/581049838 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f80b0a40 con 0x55ef81a1ada0 2024-09-10T23:40:57.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.742+0000 7f92e97fa640 1 -- 172.21.15.16:0/581049838 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f80ab010 con 0x55ef81a1ada0 2024-09-10T23:40:57.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.743+0000 7f930bfcc740 1 -- 172.21.15.16:0/581049838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 msgr2=0x55ef81a19780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.743+0000 7f930bfcc740 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a19780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92f80a9280 tx=0x7f92f8000bc0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.743+0000 7f930bfcc740 1 -- 172.21.15.16:0/581049838 shutdown_connections 2024-09-10T23:40:57.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.743+0000 7f930bfcc740 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a2f540 0x55ef81a47120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.743+0000 7f930bfcc740 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a19780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.743+0000 7f930bfcc740 1 --2- 172.21.15.16:0/581049838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a1a480 0x55ef81a19240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.743+0000 7f930bfcc740 1 -- 172.21.15.16:0/581049838 >> 172.21.15.16:0/581049838 conn(0x55ef81a182b0 msgr2=0x55ef81a31230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:57.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.744+0000 7f930bfcc740 1 -- 172.21.15.16:0/581049838 shutdown_connections 2024-09-10T23:40:57.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.744+0000 7f930bfcc740 1 -- 172.21.15.16:0/581049838 wait complete. 2024-09-10T23:40:57.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.744+0000 7f930bfcc740 1 -- start start 2024-09-10T23:40:57.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.744+0000 7f930bfcc740 1 Processor -- start 2024-09-10T23:40:57.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1a480 0x55ef81a37d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a46dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f930bfcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a47360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f930bfcc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f93041aaab0 con 0x55ef81a1a480 2024-09-10T23:40:57.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f930bfcc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f93041abf20 con 0x55ef81a2f540 2024-09-10T23:40:57.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f930bfcc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93041ab180 con 0x55ef81a1ada0 2024-09-10T23:40:57.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f930bfcc740 10 client.0 _ll_register_callbacks cb 0x7f92f80abde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:40:57.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f9302ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a46dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f9303fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a47360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f9303fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a47360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:48780/0 (socket says 172.21.15.16:48780) 2024-09-10T23:40:57.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f9303fff640 1 -- 172.21.15.16:0/3167296470 learned_addr learned my addr 172.21.15.16:0/3167296470 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:57.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f93037fe640 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1a480 0x55ef81a37d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f9303fff640 1 -- 172.21.15.16:0/3167296470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 msgr2=0x55ef81a46dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:57.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f9303fff640 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a46dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.745+0000 7f9303fff640 1 -- 172.21.15.16:0/3167296470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1a480 msgr2=0x55ef81a37d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:40:57.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f9303fff640 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1a480 0x55ef81a37d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f9303fff640 1 -- 172.21.15.16:0/3167296470 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef81a47b90 con 0x55ef81a2f540 2024-09-10T23:40:57.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f93037fe640 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1a480 0x55ef81a37d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:40:57.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f9303fff640 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a47360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92fc010d20 tx=0x7f92fc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=481de760260c5252 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:57.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f92e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:40:57.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3167296470 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc02e060 con 0x55ef81a2f540 2024-09-10T23:40:57.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3167296470 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f92fc01ebb0 con 0x55ef81a2f540 2024-09-10T23:40:57.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.746+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f80b0a40 con 0x55ef81a2f540 2024-09-10T23:40:57.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3167296470 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92fc01edf0 con 0x55ef81a2f540 2024-09-10T23:40:57.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 10 client.25193 fetch_fsmap learned FSMap version 25 2024-09-10T23:40:57.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef81aac440 con 0x55ef81a2f540 2024-09-10T23:40:57.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3167296470 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f80b0a40 con 0x55ef81a2f540 2024-09-10T23:40:57.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3167296470 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f92fc0046a0 con 0x55ef81a2f540 2024-09-10T23:40:57.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 10 client.25193 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:40:57.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 10 client.25193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:40:57.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 20 client.25193 populate_metadata read hostname 'smithi016' 2024-09-10T23:40:57.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81aacbf0 0x55ef81aaf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:57.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 4 client.25193 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:40:57.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.747+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ef8198e850 con 0x55ef81aacbf0 2024-09-10T23:40:57.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.748+0000 7f93037fe640 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81aacbf0 0x55ef81aaf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:57.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.748+0000 7f92e2ffd640 10 client.25193 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:57.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.748+0000 7f93037fe640 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81aacbf0 0x55ef81aaf010 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb25ff7e8ad5c67 server_cookie=3dcc137bcaf6d888 in_seq=0 out_seq=0 2024-09-10T23:40:57.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.748+0000 7f92e2ffd640 1 -- 172.21.15.16:0/3167296470 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55ef8198e850 con 0x55ef81aacbf0 2024-09-10T23:40:57.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.748+0000 7f92e2ffd640 10 client.25193 handle_command_reply: tid=0 2024-09-10T23:40:57.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.748+0000 7f930bfcc740 1 client.25193 shutdown 2024-09-10T23:40:57.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 msgr2=0x55ef81a47360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a47360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92fc010d20 tx=0x7f92fc004a40 comp rx=0 tx=0).stop 2024-09-10T23:40:57.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 shutdown_connections 2024-09-10T23:40:57.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55ef81aacbf0 0x55ef81aaf010 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f92e2ffd640 0 client.25193 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:40:57.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef81a2f540 0x55ef81a47360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef81a1ada0 0x55ef81a46dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 --2- 172.21.15.16:0/3167296470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef81a1a480 0x55ef81a37d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 >> 172.21.15.16:0/3167296470 conn(0x55ef81a182b0 msgr2=0x55ef81a2d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:57.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 shutdown_connections 2024-09-10T23:40:57.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 1 -- 172.21.15.16:0/3167296470 wait complete. 2024-09-10T23:40:57.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.749+0000 7f930bfcc740 20 client.25193 trim_cache size 0 max 16384 2024-09-10T23:40:57.766 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:40:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:40:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:40:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:40:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:40:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:40:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:40:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:40:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:40:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:40:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:40:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:40:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:40:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:40:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:40:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:40:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:40:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:40:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:40:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:40:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:40:57.769 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:40:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f92ec0b54c0 msgr2=0x7f92ec0b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f92ec0b54c0 0x7f92ec0b7980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92fc005f40 tx=0x7f92fc0096c0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93041021b0 msgr2=0x7f930419ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93041021b0 0x7f930419ba80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f92f800d950 tx=0x7f92f800de10 comp rx=0 tx=0).stop 2024-09-10T23:40:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 shutdown_connections 2024-09-10T23:40:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f930410f440 0x7f93041a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93041021b0 0x7f930419ba80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f92ec0b54c0 0x7f92ec0b7980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 --2- 172.21.15.16:0/135832686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9304101890 0x7f930419b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.750+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 >> 172.21.15.16:0/135832686 conn(0x7f93040fd700 msgr2=0x7f93040ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.751+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 shutdown_connections 2024-09-10T23:40:57.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:57.751+0000 7f9309bf7640 1 -- 172.21.15.16:0/135832686 wait complete. 2024-09-10T23:40:57.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:57 smithi066 ceph-mon[34761]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-10T23:40:57.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:57 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:40:57.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:57 smithi016 ceph-mon[30855]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-10T23:40:57.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:57 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:40:58.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:57 smithi071 ceph-mon[35018]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-10T23:40:58.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:57 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:40:58.489 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:40:58.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:40:58.887 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:40:59.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.436+0000 7fcfe2122640 1 -- 172.21.15.16:0/1411902941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc10d110 msgr2=0x7fcfdc10f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:59.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.436+0000 7fcfe2122640 1 --2- 172.21.15.16:0/1411902941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc10d110 0x7fcfdc10f570 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009ca0 tx=0x7fcfd402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.436+0000 7fcfe2122640 1 -- 172.21.15.16:0/1411902941 shutdown_connections 2024-09-10T23:40:59.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.436+0000 7fcfe2122640 1 --2- 172.21.15.16:0/1411902941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc10d110 0x7fcfdc10f570 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.437+0000 7fcfe2122640 1 --2- 172.21.15.16:0/1411902941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfdc1045d0 0x7fcfdc10cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.437+0000 7fcfe2122640 1 --2- 172.21.15.16:0/1411902941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc103cb0 0x7fcfdc104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.437+0000 7fcfe2122640 1 -- 172.21.15.16:0/1411902941 >> 172.21.15.16:0/1411902941 conn(0x7fcfdc0fd6f0 msgr2=0x7fcfdc0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:59.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.437+0000 7fcfe2122640 1 -- 172.21.15.16:0/1411902941 shutdown_connections 2024-09-10T23:40:59.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.437+0000 7fcfe2122640 1 -- 172.21.15.16:0/1411902941 wait complete. 2024-09-10T23:40:59.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 Processor -- start 2024-09-10T23:40:59.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 -- start start 2024-09-10T23:40:59.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc103cb0 0x7fcfdc199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:59.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfdc1045d0 0x7fcfdc199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc10d110 0x7fcfdc19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc112d80 con 0x7fcfdc103cb0 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc112c00 con 0x7fcfdc10d110 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfe2122640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc112f00 con 0x7fcfdc1045d0 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfdb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc103cb0 0x7fcfdc199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfdb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc103cb0 0x7fcfdc199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57398/0 (socket says 172.21.15.16:57398) 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfdb7fe640 1 -- 172.21.15.16:0/2905937802 learned_addr learned my addr 172.21.15.16:0/2905937802 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfdaffd640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfdc1045d0 0x7fcfdc199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:59.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.438+0000 7fcfdbfff640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc10d110 0x7fcfdc19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.439+0000 7fcfdb7fe640 1 -- 172.21.15.16:0/2905937802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfdc1045d0 msgr2=0x7fcfdc199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.439+0000 7fcfdb7fe640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfdc1045d0 0x7fcfdc199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.439+0000 7fcfdb7fe640 1 -- 172.21.15.16:0/2905937802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc10d110 msgr2=0x7fcfdc19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.439+0000 7fcfdb7fe640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc10d110 0x7fcfdc19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.439+0000 7fcfdb7fe640 1 -- 172.21.15.16:0/2905937802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc19f2e0 con 0x7fcfdc103cb0 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.439+0000 7fcfdb7fe640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc103cb0 0x7fcfdc199230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0058c0 tx=0x7fcfcc007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.439+0000 7fcfd8ff9640 1 -- 172.21.15.16:0/2905937802 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc007d90 con 0x7fcfdc103cb0 2024-09-10T23:40:59.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.440+0000 7fcfd8ff9640 1 -- 172.21.15.16:0/2905937802 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfcc013020 con 0x7fcfdc103cb0 2024-09-10T23:40:59.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.440+0000 7fcfd8ff9640 1 -- 172.21.15.16:0/2905937802 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc01e680 con 0x7fcfdc103cb0 2024-09-10T23:40:59.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.440+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc19f5d0 con 0x7fcfdc103cb0 2024-09-10T23:40:59.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.440+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc101840 con 0x7fcfdc103cb0 2024-09-10T23:40:59.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.441+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfdc06bb90 con 0x7fcfdc103cb0 2024-09-10T23:40:59.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.443+0000 7fcfd8ff9640 1 -- 172.21.15.16:0/2905937802 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7fcfcc0134f0 con 0x7fcfdc103cb0 2024-09-10T23:40:59.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.444+0000 7fcfd8ff9640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcfc40b5440 0x7fcfc40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:40:59.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.444+0000 7fcfdaffd640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcfc40b5440 0x7fcfc40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:40:59.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.445+0000 7fcfdaffd640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcfc40b5440 0x7fcfc40b7900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc10f660 tx=0x7fcfd0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:40:59.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.445+0000 7fcfd8ff9640 1 -- 172.21.15.16:0/2905937802 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fcfcc0ed8d0 con 0x7fcfdc103cb0 2024-09-10T23:40:59.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.448+0000 7fcfd8ff9640 1 -- 172.21.15.16:0/2905937802 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcfcc05c220 con 0x7fcfdc103cb0 2024-09-10T23:40:59.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:40:59 smithi016 ceph-mon[30855]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T23:40:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.868+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfdc104090 con 0x7fcfdc103cb0 2024-09-10T23:40:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.869+0000 7fcfd8ff9640 1 -- 172.21.15.16:0/2905937802 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fcfcc0b4570 con 0x7fcfdc103cb0 2024-09-10T23:40:59.870 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:40:59.870 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:40:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:40:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcfc40b5440 msgr2=0x7fcfc40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcfc40b5440 0x7fcfc40b7900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc10f660 tx=0x7fcfd0005f90 comp rx=0 tx=0).stop 2024-09-10T23:40:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc103cb0 msgr2=0x7fcfdc199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc103cb0 0x7fcfdc199230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0058c0 tx=0x7fcfcc007590 comp rx=0 tx=0).stop 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 shutdown_connections 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fcfc40b5440 0x7fcfc40b7900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfdc10d110 0x7fcfdc19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfdc1045d0 0x7fcfdc199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 --2- 172.21.15.16:0/2905937802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfdc103cb0 0x7fcfdc199230 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 >> 172.21.15.16:0/2905937802 conn(0x7fcfdc0fd6f0 msgr2=0x7fcfdc0fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.871+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 shutdown_connections 2024-09-10T23:40:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:40:59.872+0000 7fcfe2122640 1 -- 172.21.15.16:0/2905937802 wait complete. 2024-09-10T23:41:00.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:40:59 smithi071 ceph-mon[35018]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T23:41:00.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:40:59 smithi066 ceph-mon[34761]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T23:41:00.550 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:41:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:41:00.466+0000 7f9e812ed640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:41:00.550 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:41:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:41:00.466+0000 7f9e812ed640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:41:00.550 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:41:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:41:00.466+0000 7f9e812ed640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:41:00.550 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:41:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:41:00.466+0000 7f9e812ed640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:41:00.550 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:41:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:41:00.466+0000 7f9e812ed640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:41:00.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:41:00.883 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:00.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:00 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2905937802' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:41:01.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:00 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2905937802' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:41:01.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:00 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2905937802' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:41:01.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.419+0000 7f21bfc62640 1 -- 172.21.15.16:0/1361844446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b810d800 msgr2=0x7f21b810dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.419+0000 7f21bfc62640 1 --2- 172.21.15.16:0/1361844446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b810d800 0x7f21b810dbe0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009900 tx=0x7f21b402a410 comp rx=0 tx=0).stop 2024-09-10T23:41:01.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.419+0000 7f21bfc62640 1 -- 172.21.15.16:0/1361844446 shutdown_connections 2024-09-10T23:41:01.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.419+0000 7f21bfc62640 1 --2- 172.21.15.16:0/1361844446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21b8113b40 0x7f21b811a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.419+0000 7f21bfc62640 1 --2- 172.21.15.16:0/1361844446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b81131c0 0x7f21b8113600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.419+0000 7f21bfc62640 1 --2- 172.21.15.16:0/1361844446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b810d800 0x7f21b810dbe0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.419+0000 7f21bfc62640 1 -- 172.21.15.16:0/1361844446 >> 172.21.15.16:0/1361844446 conn(0x7f21b806dce0 msgr2=0x7f21b806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:01.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.420+0000 7f21bfc62640 1 -- 172.21.15.16:0/1361844446 shutdown_connections 2024-09-10T23:41:01.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.420+0000 7f21bfc62640 1 -- 172.21.15.16:0/1361844446 wait complete. 2024-09-10T23:41:01.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.420+0000 7f21bfc62640 1 Processor -- start 2024-09-10T23:41:01.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bfc62640 1 -- start start 2024-09-10T23:41:01.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bfc62640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21b810d800 0x7f21b81a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bfc62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b81131c0 0x7f21b81a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bfc62640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8113b40 0x7f21b81a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21be1ff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8113b40 0x7f21b81a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bd1fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b81131c0 0x7f21b81a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21b810d800 0x7f21b81a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bd1fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b81131c0 0x7f21b81a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:53024/0 (socket says 172.21.15.16:53024) 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21b810d800 0x7f21b81a3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:48812/0 (socket says 172.21.15.16:48812) 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21be1ff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8113b40 0x7f21b81a9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57426/0 (socket says 172.21.15.16:57426) 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bd1fd640 1 -- 172.21.15.16:0/140159177 learned_addr learned my addr 172.21.15.16:0/140159177 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f21b811d760 con 0x7f21b8113b40 2024-09-10T23:41:01.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f21b811d5e0 con 0x7f21b810d800 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.421+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21b811d8e0 con 0x7f21b81131c0 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.422+0000 7f21be1ff640 1 -- 172.21.15.16:0/140159177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b81131c0 msgr2=0x7f21b81a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.422+0000 7f21be1ff640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b81131c0 0x7f21b81a41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.422+0000 7f21be1ff640 1 -- 172.21.15.16:0/140159177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21b810d800 msgr2=0x7f21b81a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.422+0000 7f21be1ff640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21b810d800 0x7f21b81a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.422+0000 7f21be1ff640 1 -- 172.21.15.16:0/140159177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b81a9d40 con 0x7f21b8113b40 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.422+0000 7f21be1ff640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8113b40 0x7f21b81a9570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21b000dc70 tx=0x7f21b000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.423+0000 7f21aeffd640 1 -- 172.21.15.16:0/140159177 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0003970 con 0x7f21b8113b40 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.423+0000 7f21aeffd640 1 -- 172.21.15.16:0/140159177 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21b0004030 con 0x7f21b8113b40 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.423+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b81aa030 con 0x7f21b8113b40 2024-09-10T23:41:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.423+0000 7f21aeffd640 1 -- 172.21.15.16:0/140159177 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00106c0 con 0x7f21b8113b40 2024-09-10T23:41:01.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.424+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b81b06f0 con 0x7f21b8113b40 2024-09-10T23:41:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.427+0000 7f21aeffd640 1 -- 172.21.15.16:0/140159177 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f21b0010860 con 0x7f21b8113b40 2024-09-10T23:41:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.427+0000 7f21c2037740 1 Processor -- start 2024-09-10T23:41:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.428+0000 7f21aeffd640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f21a40b5440 0x7f21a40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.428+0000 7f21aeffd640 1 -- 172.21.15.16:0/140159177 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f21b00e3210 con 0x7f21b8113b40 2024-09-10T23:41:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21c2037740 1 -- start start 2024-09-10T23:41:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f21a40b5440 0x7f21a40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21c2037740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21c2037740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21c2037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21c2037740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55967f65fea0 con 0x55967f6e94d0 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21c2037740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55967f64f2d0 con 0x55967f6f5d80 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21c2037740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55967f6530e0 con 0x55967f6e9df0 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6e98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57432/0 (socket says 172.21.15.16:57432) 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21bd9fe640 1 -- 172.21.15.16:0/3241179259 learned_addr learned my addr 172.21.15.16:0/3241179259 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:01.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.429+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f21a40b5440 0x7f21a40b7900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f21b8110720 tx=0x7f21a8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd9fe640 1 -- 172.21.15.16:0/3241179259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 msgr2=0x55967f6f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21be1ff640 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd9fe640 1 -- 172.21.15.16:0/3241179259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 msgr2=0x55967f6f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd9fe640 1 -- 172.21.15.16:0/3241179259 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55967f3ad650 con 0x55967f6e94d0 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.430+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6e98b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009900 tx=0x7f21b4032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0430bb6a27ce1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.431+0000 7f21a3fff640 1 -- 172.21.15.16:0/3241179259 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b403f070 con 0x55967f6e94d0 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.431+0000 7f21a3fff640 1 -- 172.21.15.16:0/3241179259 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21b4032e40 con 0x55967f6e94d0 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.431+0000 7f21a3fff640 1 -- 172.21.15.16:0/3241179259 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4035070 con 0x55967f6e94d0 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 -- 172.21.15.16:0/3241179259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 msgr2=0x55967f6e98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6e98b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009900 tx=0x7f21b4032b90 comp rx=0 tx=0).stop 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 -- 172.21.15.16:0/3241179259 shutdown_connections 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 --2- 172.21.15.16:0/3241179259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6e98b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 -- 172.21.15.16:0/3241179259 >> 172.21.15.16:0/3241179259 conn(0x55967f6e7300 msgr2=0x55967f6e84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:01.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 -- 172.21.15.16:0/3241179259 shutdown_connections 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 -- 172.21.15.16:0/3241179259 wait complete. 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.432+0000 7f21c2037740 1 -- start start 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 1 Processor -- start 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55967f4b0700 con 0x55967f6e94d0 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55967f5ea160 con 0x55967f6f5d80 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55967f6f89a0 con 0x55967f6e9df0 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.433+0000 7f21c2037740 10 client.0 _ll_register_callbacks cb 0x55967f6039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57446/0 (socket says 172.21.15.16:57446) 2024-09-10T23:41:01.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd9fe640 1 -- 172.21.15.16:0/1524884202 learned_addr learned my addr 172.21.15.16:0/1524884202 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21be1ff640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd1fd640 1 -- 172.21.15.16:0/1524884202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 msgr2=0x55967f6f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd1fd640 1 -- 172.21.15.16:0/1524884202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 msgr2=0x55967f6f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd1fd640 1 -- 172.21.15.16:0/1524884202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55967f617c90 con 0x55967f6e9df0 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f2a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21a8011ca0 tx=0x7f21a8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa00e9919c0359e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.434+0000 7f21a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.435+0000 7f21a17fa640 1 -- 172.21.15.16:0/1524884202 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8029060 con 0x55967f6e9df0 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.435+0000 7f21a17fa640 1 -- 172.21.15.16:0/1524884202 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f21a8009de0 con 0x55967f6e9df0 2024-09-10T23:41:01.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.435+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55967f661df0 con 0x55967f6e9df0 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.435+0000 7f21a17fa640 1 -- 172.21.15.16:0/1524884202 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21a801a890 con 0x55967f6e9df0 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.435+0000 7f21c2037740 10 client.25288 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.435+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55967f704240 con 0x55967f6e9df0 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.435+0000 7f21a17fa640 1 -- 172.21.15.16:0/1524884202 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55967f661df0 con 0x55967f6e9df0 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.436+0000 7f21a17fa640 1 -- 172.21.15.16:0/1524884202 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21a8023070 con 0x55967f6e9df0 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.436+0000 7f21c2037740 10 client.25288 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.436+0000 7f21c2037740 10 client.25288 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.436+0000 7f21c2037740 20 client.25288 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.436+0000 7f21c2037740 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f707bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.436+0000 7f21c2037740 4 client.25288 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.436+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55967f65d8a0 con 0x55967f705750 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.437+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f707bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.437+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f707bc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81c9dfeb51f24b9a server_cookie=609a71ef74f3e76b in_seq=0 out_seq=0 2024-09-10T23:41:01.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.437+0000 7f21a17fa640 10 client.25288 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.438+0000 7f21a17fa640 1 -- 172.21.15.16:0/1524884202 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55967f65d8a0 con 0x55967f705750 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.438+0000 7f21a17fa640 10 client.25288 handle_command_reply: tid=0 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.438+0000 7f21c2037740 1 client.25288 shutdown 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.438+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 msgr2=0x55967f6f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.438+0000 7f21c2037740 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f2a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21a8011ca0 tx=0x7f21a8004730 comp rx=0 tx=0).stop 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 shutdown_connections 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f707bc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21a17fa640 0 client.25288 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6f5d80 0x55967f6f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6f2a60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 --2- 172.21.15.16:0/1524884202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 >> 172.21.15.16:0/1524884202 conn(0x55967f6e7300 msgr2=0x55967f6ece70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 shutdown_connections 2024-09-10T23:41:01.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 1 -- 172.21.15.16:0/1524884202 wait complete. 2024-09-10T23:41:01.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.439+0000 7f21c2037740 20 client.25288 trim_cache size 0 max 16384 2024-09-10T23:41:01.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.466+0000 7f21c2037740 1 Processor -- start 2024-09-10T23:41:01.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.466+0000 7f21c2037740 1 -- start start 2024-09-10T23:41:01.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.467+0000 7f21c2037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e94d0 0x55967f6f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.467+0000 7f21c2037740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6e2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.467+0000 7f21c2037740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6f5d80 0x55967f6f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.467+0000 7f21c2037740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81bb8d0 con 0x55967f6f5d80 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.467+0000 7f21c2037740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81b91a0 con 0x55967f6e94d0 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21c2037740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81b6ff0 con 0x55967f6e9df0 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6f5d80 0x55967f6f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6f5d80 0x55967f6f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57448/0 (socket says 172.21.15.16:57448) 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 -- 172.21.15.16:0/1023054313 learned_addr learned my addr 172.21.15.16:0/1023054313 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e94d0 0x55967f6f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 -- 172.21.15.16:0/1023054313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 msgr2=0x55967f6e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 -- 172.21.15.16:0/1023054313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e94d0 msgr2=0x55967f6f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e94d0 0x55967f6f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21be1ff640 1 -- 172.21.15.16:0/1023054313 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55967f6e7d80 con 0x55967f6f5d80 2024-09-10T23:41:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.468+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e94d0 0x55967f6f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:01.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.469+0000 7f21be1ff640 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6f5d80 0x55967f6f47a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21b00a8ee0 tx=0x7f21b00048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf0010cf7ed68e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.469+0000 7f21a37fe640 1 -- 172.21.15.16:0/1023054313 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0014070 con 0x55967f6f5d80 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.469+0000 7f21a37fe640 1 -- 172.21.15.16:0/1023054313 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21b00ab780 con 0x55967f6f5d80 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.469+0000 7f21a37fe640 1 -- 172.21.15.16:0/1023054313 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00ea060 con 0x55967f6f5d80 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.470+0000 7f21c2037740 1 -- 172.21.15.16:0/1023054313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6f5d80 msgr2=0x55967f6f47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.470+0000 7f21c2037740 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6f5d80 0x55967f6f47a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21b00a8ee0 tx=0x7f21b00048d0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.470+0000 7f21c2037740 1 -- 172.21.15.16:0/1023054313 shutdown_connections 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.470+0000 7f21c2037740 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6f5d80 0x55967f6f47a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.470+0000 7f21c2037740 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6e9df0 0x55967f6e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.470+0000 7f21c2037740 1 --2- 172.21.15.16:0/1023054313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e94d0 0x55967f6f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.470+0000 7f21c2037740 1 -- 172.21.15.16:0/1023054313 >> 172.21.15.16:0/1023054313 conn(0x55967f6e7300 msgr2=0x55967f6f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:01.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.471+0000 7f21c2037740 1 -- 172.21.15.16:0/1023054313 shutdown_connections 2024-09-10T23:41:01.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.471+0000 7f21c2037740 1 -- 172.21.15.16:0/1023054313 wait complete. 2024-09-10T23:41:01.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.471+0000 7f21c2037740 1 -- start start 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.472+0000 7f21c2037740 1 Processor -- start 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.472+0000 7f21c2037740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.472+0000 7f21c2037740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e9df0 0x55967f6fe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21c2037740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6f5d80 0x55967f6fac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21bd9fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6fdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57458/0 (socket says 172.21.15.16:57458) 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e9df0 0x55967f6fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21bd9fe640 1 -- 172.21.15.16:0/2092753275 learned_addr learned my addr 172.21.15.16:0/2092753275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81b7660 con 0x55967f6e94d0 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81b8ad0 con 0x55967f6e9df0 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81b7d30 con 0x55967f6f5d80 2024-09-10T23:41:01.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21be1ff640 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6f5d80 0x55967f6fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.473+0000 7f21c2037740 10 client.0 _ll_register_callbacks cb 0x7f21a8005ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21bd9fe640 1 -- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6f5d80 msgr2=0x55967f6fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6f5d80 0x55967f6fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21bd9fe640 1 -- 172.21.15.16:0/2092753275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e9df0 msgr2=0x55967f6fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e9df0 0x55967f6fe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21bd9fe640 1 -- 172.21.15.16:0/2092753275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55967f6fe880 con 0x55967f6e94d0 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21bd9fe640 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6fdc30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009690 tx=0x7f21b4031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a348563139af49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:01.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:01.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21a17fa640 1 -- 172.21.15.16:0/2092753275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b405a060 con 0x55967f6e94d0 2024-09-10T23:41:01.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21a17fa640 1 -- 172.21.15.16:0/2092753275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f21b40046c0 con 0x55967f6e94d0 2024-09-10T23:41:01.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.474+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21b00ab780 con 0x55967f6e94d0 2024-09-10T23:41:01.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21a17fa640 1 -- 172.21.15.16:0/2092753275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21b403f040 con 0x55967f6e94d0 2024-09-10T23:41:01.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21c2037740 10 client.15576 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55967f772bf0 con 0x55967f6e94d0 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21a17fa640 1 -- 172.21.15.16:0/2092753275 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21b00ab780 con 0x55967f6e94d0 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21a17fa640 1 -- 172.21.15.16:0/2092753275 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21b4032510 con 0x55967f6e94d0 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21c2037740 10 client.15576 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21c2037740 10 client.15576 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21c2037740 20 client.15576 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.475+0000 7f21c2037740 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f774f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.476+0000 7f21c2037740 4 client.15576 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.476+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55967f65acd0 con 0x55967f705750 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.476+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f774f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.476+0000 7f21bd1fd640 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f774f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=37141d3436c30a79 server_cookie=7419cc69c31113fa in_seq=0 out_seq=0 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.476+0000 7f21a17fa640 10 client.15576 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:01.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.477+0000 7f21a17fa640 1 -- 172.21.15.16:0/2092753275 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55967f65acd0 con 0x55967f705750 2024-09-10T23:41:01.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.477+0000 7f21a17fa640 10 client.15576 handle_command_reply: tid=0 2024-09-10T23:41:01.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.477+0000 7f21c2037740 1 client.15576 shutdown 2024-09-10T23:41:01.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.478+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 msgr2=0x55967f6fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.478+0000 7f21c2037740 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6fdc30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009690 tx=0x7f21b4031d40 comp rx=0 tx=0).stop 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 shutdown_connections 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55967f705750 0x55967f774f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55967f6f5d80 0x55967f6fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21a17fa640 0 client.15576 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55967f6e9df0 0x55967f6fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 --2- 172.21.15.16:0/2092753275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55967f6e94d0 0x55967f6fdc30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 >> 172.21.15.16:0/2092753275 conn(0x55967f6e7300 msgr2=0x55967f6f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 shutdown_connections 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 1 -- 172.21.15.16:0/2092753275 wait complete. 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.479+0000 7f21c2037740 20 client.15576 trim_cache size 0 max 16384 2024-09-10T23:41:01.481 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:41:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f21a40b5440 msgr2=0x7f21a40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f21a40b5440 0x7f21a40b7900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f21b8110720 tx=0x7f21a8005f90 comp rx=0 tx=0).stop 2024-09-10T23:41:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8113b40 msgr2=0x7f21b81a9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8113b40 0x7f21b81a9570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21b000dc70 tx=0x7f21b000b630 comp rx=0 tx=0).stop 2024-09-10T23:41:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 shutdown_connections 2024-09-10T23:41:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8113b40 0x7f21b81a9570 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b81131c0 0x7f21b81a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f21a40b5440 0x7f21a40b7900 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 --2- 172.21.15.16:0/140159177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21b810d800 0x7f21b81a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 >> 172.21.15.16:0/140159177 conn(0x7f21b806dce0 msgr2=0x7f21b8111130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 shutdown_connections 2024-09-10T23:41:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:01.480+0000 7f21bfc62640 1 -- 172.21.15.16:0/140159177 wait complete. 2024-09-10T23:41:01.577 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:01 smithi016 ceph-mon[30855]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:41:02.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:01 smithi071 ceph-mon[35018]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:41:02.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:01 smithi066 ceph-mon[34761]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:41:02.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:41:02.538 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:02.845 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:02 smithi016 ceph-mon[30855]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-10T23:41:03.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:02 smithi071 ceph-mon[35018]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-10T23:41:03.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:02 smithi066 ceph-mon[34761]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-10T23:41:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 -- 172.21.15.16:0/570054657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 msgr2=0x7fd39410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/570054657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39410e820 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009ca0 tx=0x7fd38c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 -- 172.21.15.16:0/570054657 shutdown_connections 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/570054657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39410e820 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/570054657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3941076a0 0x7fd394107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/570054657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd394101c90 0x7fd394102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 -- 172.21.15.16:0/570054657 >> 172.21.15.16:0/570054657 conn(0x7fd3940fd700 msgr2=0x7fd3940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 -- 172.21.15.16:0/570054657 shutdown_connections 2024-09-10T23:41:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.090+0000 7fd39b2fd640 1 -- 172.21.15.16:0/570054657 wait complete. 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.091+0000 7fd39b2fd640 1 Processor -- start 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.091+0000 7fd39b2fd640 1 -- start start 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39b2fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd394101c90 0x7fd394199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39b2fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3941076a0 0x7fd394199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39b2fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39b2fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111d30 con 0x7fd394108020 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57472/0 (socket says 172.21.15.16:57472) 2024-09-10T23:41:03.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 -- 172.21.15.16:0/2657794961 learned_addr learned my addr 172.21.15.16:0/2657794961 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:03.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111bb0 con 0x7fd394101c90 2024-09-10T23:41:03.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111eb0 con 0x7fd3941076a0 2024-09-10T23:41:03.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd398898640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3941076a0 0x7fd394199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd399099640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd394101c90 0x7fd394199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 -- 172.21.15.16:0/2657794961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3941076a0 msgr2=0x7fd394199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3941076a0 0x7fd394199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 -- 172.21.15.16:0/2657794961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd394101c90 msgr2=0x7fd394199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd394101c90 0x7fd394199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd39989a640 1 -- 172.21.15.16:0/2657794961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39419f2f0 con 0x7fd394108020 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.092+0000 7fd398898640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3941076a0 0x7fd394199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.093+0000 7fd399099640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd394101c90 0x7fd394199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.093+0000 7fd39989a640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39419eb20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009430 tx=0x7fd38c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:03.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.093+0000 7fd38a7fc640 1 -- 172.21.15.16:0/2657794961 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c003b70 con 0x7fd394108020 2024-09-10T23:41:03.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.093+0000 7fd38a7fc640 1 -- 172.21.15.16:0/2657794961 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd38c003d10 con 0x7fd394108020 2024-09-10T23:41:03.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.093+0000 7fd38a7fc640 1 -- 172.21.15.16:0/2657794961 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c02fa00 con 0x7fd394108020 2024-09-10T23:41:03.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.093+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39419f580 con 0x7fd394108020 2024-09-10T23:41:03.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.094+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3940fdae0 con 0x7fd394108020 2024-09-10T23:41:03.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.098+0000 7fd39d6d2740 1 Processor -- start 2024-09-10T23:41:03.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd38a7fc640 1 -- 172.21.15.16:0/2657794961 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd38c004580 con 0x7fd394108020 2024-09-10T23:41:03.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd39d6d2740 1 -- start start 2024-09-10T23:41:03.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 0x55f29ad2a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad36460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad38d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f29aca0ea0 con 0x55f29ad369a0 2024-09-10T23:41:03.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f29ac902d0 con 0x55f29ad2aa10 2024-09-10T23:41:03.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.099+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f29ac940e0 con 0x55f29ad2a0f0 2024-09-10T23:41:03.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad38d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd399099640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad36460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad38d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57474/0 (socket says 172.21.15.16:57474) 2024-09-10T23:41:03.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 -- 172.21.15.16:0/79453239 learned_addr learned my addr 172.21.15.16:0/79453239 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:03.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 -- 172.21.15.16:0/79453239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 msgr2=0x55f29ad2a4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:41:03.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 0x55f29ad2a4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 -- 172.21.15.16:0/79453239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 msgr2=0x55f29ad36460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:03.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad36460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd398898640 1 -- 172.21.15.16:0/79453239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29a9ee650 con 0x55f29ad369a0 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.100+0000 7fd399099640 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad36460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.101+0000 7fd38a7fc640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3800b98e0 0x7fd3800bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.101+0000 7fd398898640 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad38d90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd384011510 tx=0x7fd3840119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bb106e577bb2c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.101+0000 7fd38a7fc640 1 -- 172.21.15.16:0/2657794961 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd38c1071e0 con 0x7fd394108020 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.101+0000 7fd37f7fe640 1 -- 172.21.15.16:0/79453239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38401e070 con 0x55f29ad369a0 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.101+0000 7fd37f7fe640 1 -- 172.21.15.16:0/79453239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3840035f0 con 0x55f29ad369a0 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.101+0000 7fd37f7fe640 1 -- 172.21.15.16:0/79453239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38400f820 con 0x55f29ad369a0 2024-09-10T23:41:03.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.101+0000 7fd399099640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3800b98e0 0x7fd3800bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 -- 172.21.15.16:0/79453239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 msgr2=0x55f29ad38d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd399099640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3800b98e0 0x7fd3800bbda0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd390005fd0 tx=0x7fd3900093d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad38d90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd384011510 tx=0x7fd3840119d0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 -- 172.21.15.16:0/79453239 shutdown_connections 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad38d90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad36460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/79453239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 0x55f29ad2a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 -- 172.21.15.16:0/79453239 >> 172.21.15.16:0/79453239 conn(0x55f29ad27f20 msgr2=0x55f29ad290c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 -- 172.21.15.16:0/79453239 shutdown_connections 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.102+0000 7fd39d6d2740 1 -- 172.21.15.16:0/79453239 wait complete. 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.103+0000 7fd39d6d2740 1 -- start start 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.103+0000 7fd39d6d2740 1 Processor -- start 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad2a0f0 0x55f29ad36300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad33750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd399099640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad2a0f0 0x55f29ad36300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd399099640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad2a0f0 0x55f29ad36300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57478/0 (socket says 172.21.15.16:57478) 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd399099640 1 -- 172.21.15.16:0/3598236563 learned_addr learned my addr 172.21.15.16:0/3598236563 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad369a0 0x55f29ad33dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f29aaf1700 con 0x55f29ad2a0f0 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd398898640 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad33750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f29ac2b160 con 0x55f29ad2aa10 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.104+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f29ad39620 con 0x55f29ad369a0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd399099640 1 -- 172.21.15.16:0/3598236563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad369a0 msgr2=0x55f29ad33dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd399099640 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad369a0 0x55f29ad33dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd399099640 1 -- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 msgr2=0x55f29ad33750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd399099640 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad33750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd399099640 1 -- 172.21.15.16:0/3598236563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f29ac58c90 con 0x55f29ad2a0f0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd399099640 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad2a0f0 0x55f29ad36300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd3900126b0 tx=0x7fd390004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2704141bdd788dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd39d6d2740 10 client.0 _ll_register_callbacks cb 0x55f29ac449e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd37cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd37cff9640 1 -- 172.21.15.16:0/3598236563 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390023070 con 0x55f29ad2a0f0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd37cff9640 1 -- 172.21.15.16:0/3598236563 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd3900119f0 con 0x55f29ad2a0f0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3840035f0 con 0x55f29ad2a0f0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd37cff9640 1 -- 172.21.15.16:0/3598236563 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd39002f050 con 0x55f29ad2a0f0 2024-09-10T23:41:03.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd39d6d2740 10 client.15588 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.105+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55f29ad4d710 con 0x55f29ad2a0f0 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd37cff9640 1 -- 172.21.15.16:0/3598236563 <== mon.0 v2:172.21.15.16:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd39000f040 con 0x55f29ad2a0f0 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd39d6d2740 10 client.15588 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd39d6d2740 10 client.15588 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd39d6d2740 20 client.15588 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29ad51020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd39d6d2740 4 client.15588 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f29aca2df0 con 0x55f29ad4eb80 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.106+0000 7fd398898640 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29ad51020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.107+0000 7fd37cff9640 10 client.15588 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:03.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.107+0000 7fd398898640 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29ad51020 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ccb5836f0ebd2d8e server_cookie=da04defb83869752 in_seq=0 out_seq=0 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd37cff9640 1 -- 172.21.15.16:0/3598236563 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f29aca2df0 con 0x55f29ad4eb80 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd37cff9640 10 client.15588 handle_command_reply: tid=0 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 client.15588 shutdown 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad2a0f0 msgr2=0x55f29ad36300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad2a0f0 0x55f29ad36300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd3900126b0 tx=0x7fd390004730 comp rx=0 tx=0).stop 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 shutdown_connections 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29ad51020 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad369a0 0x55f29ad33dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd37cff9640 0 client.15588 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:03.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad33750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/3598236563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad2a0f0 0x55f29ad36300 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 >> 172.21.15.16:0/3598236563 conn(0x55f29ad27f20 msgr2=0x55f29ad2da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:03.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 shutdown_connections 2024-09-10T23:41:03.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 1 -- 172.21.15.16:0/3598236563 wait complete. 2024-09-10T23:41:03.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.108+0000 7fd39d6d2740 20 client.15588 trim_cache size 0 max 16384 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.135+0000 7fd39d6d2740 1 Processor -- start 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.135+0000 7fd39d6d2740 1 -- start start 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.135+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2a0f0 0x55f29ad4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.135+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2aa10 0x55f29ad35490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad37d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941aeb50 con 0x55f29ad369a0 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941ac420 con 0x55f29ad2a0f0 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941aa290 con 0x55f29ad2aa10 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2aa10 0x55f29ad35490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd39989a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad37d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2aa10 0x55f29ad35490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:53112/0 (socket says 172.21.15.16:53112) 2024-09-10T23:41:03.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 -- 172.21.15.16:0/1067605803 learned_addr learned my addr 172.21.15.16:0/1067605803 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:03.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 -- 172.21.15.16:0/1067605803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2a0f0 msgr2=0x55f29ad4b140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:41:03.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd399099640 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2a0f0 0x55f29ad4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2a0f0 0x55f29ad4b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 -- 172.21.15.16:0/1067605803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 msgr2=0x55f29ad37d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:03.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad37d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd398898640 1 -- 172.21.15.16:0/1067605803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f29ad33500 con 0x55f29ad2aa10 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.136+0000 7fd39989a640 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad37d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.137+0000 7fd398898640 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2aa10 0x55f29ad35490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd384005010 tx=0x7fd384003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14a25c3b0c4b80e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.137+0000 7fd37effd640 1 -- 172.21.15.16:0/1067605803 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38401e040 con 0x55f29ad2aa10 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.137+0000 7fd37effd640 1 -- 172.21.15.16:0/1067605803 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd384029070 con 0x55f29ad2aa10 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.137+0000 7fd37effd640 1 -- 172.21.15.16:0/1067605803 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38400f5c0 con 0x55f29ad2aa10 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 -- 172.21.15.16:0/1067605803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2aa10 msgr2=0x55f29ad35490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2aa10 0x55f29ad35490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd384005010 tx=0x7fd384003f90 comp rx=0 tx=0).stop 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 -- 172.21.15.16:0/1067605803 shutdown_connections 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad37d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2aa10 0x55f29ad35490 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/1067605803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2a0f0 0x55f29ad4b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 -- 172.21.15.16:0/1067605803 >> 172.21.15.16:0/1067605803 conn(0x55f29ad27f20 msgr2=0x55f29ad34d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 -- 172.21.15.16:0/1067605803 shutdown_connections 2024-09-10T23:41:03.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 -- 172.21.15.16:0/1067605803 wait complete. 2024-09-10T23:41:03.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.138+0000 7fd39d6d2740 1 -- start start 2024-09-10T23:41:03.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 1 Processor -- start 2024-09-10T23:41:03.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 0x55f29ad471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad476f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad42160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941aa8e0 con 0x55f29ad369a0 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941abd50 con 0x55f29ad2aa10 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941aafb0 con 0x55f29ad2a0f0 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39d6d2740 10 client.0 _ll_register_callbacks cb 0x7fd390016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39989a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad42160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39989a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad42160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57504/0 (socket says 172.21.15.16:57504) 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd39989a640 1 -- 172.21.15.16:0/375010059 learned_addr learned my addr 172.21.15.16:0/375010059 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd398898640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.139+0000 7fd399099640 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 0x55f29ad471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39989a640 1 -- 172.21.15.16:0/375010059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 msgr2=0x55f29ad471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:03.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39989a640 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 0x55f29ad471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39989a640 1 -- 172.21.15.16:0/375010059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 msgr2=0x55f29ad476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:03.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39989a640 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39989a640 1 -- 172.21.15.16:0/375010059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f29ad47e80 con 0x55f29ad369a0 2024-09-10T23:41:03.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39989a640 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad42160 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd38c104a40 tx=0x7fd38c0cd0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f7a5941b51eb40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd37cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd37cff9640 1 -- 172.21.15.16:0/375010059 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0d69c0 con 0x55f29ad369a0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd37cff9640 1 -- 172.21.15.16:0/375010059 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd38c004b40 con 0x55f29ad369a0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd384029070 con 0x55f29ad369a0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd37cff9640 1 -- 172.21.15.16:0/375010059 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd38c0cd1d0 con 0x55f29ad369a0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39d6d2740 10 client.15594 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.140+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f29adbc120 con 0x55f29ad369a0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd37cff9640 1 -- 172.21.15.16:0/375010059 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd38c0cddc0 con 0x55f29ad369a0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd37cff9640 1 -- 172.21.15.16:0/375010059 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd38c02fba0 con 0x55f29ad369a0 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd39d6d2740 10 client.15594 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd39d6d2740 10 client.15594 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:41:03.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd39d6d2740 20 client.15594 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:03.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29adbe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:03.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd39d6d2740 4 client.15594 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:41:03.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd384029070 con 0x55f29ad4eb80 2024-09-10T23:41:03.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.141+0000 7fd399099640 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29adbe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:03.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.143+0000 7fd399099640 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29adbe8b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3dd2bdc0b6055f81 server_cookie=d20d5e068efde954 in_seq=0 out_seq=0 2024-09-10T23:41:03.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.143+0000 7fd37cff9640 10 client.15594 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:03.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.143+0000 7fd37cff9640 1 -- 172.21.15.16:0/375010059 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd384029070 con 0x55f29ad4eb80 2024-09-10T23:41:03.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.143+0000 7fd37cff9640 10 client.15594 handle_command_reply: tid=0 2024-09-10T23:41:03.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.143+0000 7fd39d6d2740 1 client.15594 shutdown 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 msgr2=0x55f29ad42160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad42160 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd38c104a40 tx=0x7fd38c0cd0d0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 shutdown_connections 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55f29ad4eb80 0x55f29adbe8b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd37cff9640 0 client.15594 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f29ad369a0 0x55f29ad42160 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f29ad2aa10 0x55f29ad476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 --2- 172.21.15.16:0/375010059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f29ad2a0f0 0x55f29ad471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 >> 172.21.15.16:0/375010059 conn(0x55f29ad27f20 msgr2=0x55f29ad355a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 shutdown_connections 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 1 -- 172.21.15.16:0/375010059 wait complete. 2024-09-10T23:41:03.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.144+0000 7fd39d6d2740 20 client.15594 trim_cache size 0 max 16384 2024-09-10T23:41:03.148 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:41:03.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3800b98e0 msgr2=0x7fd3800bbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3800b98e0 0x7fd3800bbda0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd390005fd0 tx=0x7fd3900093d0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 msgr2=0x7fd39419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39419eb20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009430 tx=0x7fd38c0317c0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 shutdown_connections 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd394108020 0x7fd39419eb20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3941076a0 0x7fd394199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3800b98e0 0x7fd3800bbda0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 --2- 172.21.15.16:0/2657794961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd394101c90 0x7fd394199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 >> 172.21.15.16:0/2657794961 conn(0x7fd3940fd700 msgr2=0x7fd39406aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.145+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 shutdown_connections 2024-09-10T23:41:03.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:03.146+0000 7fd39b2fd640 1 -- 172.21.15.16:0/2657794961 wait complete. 2024-09-10T23:41:03.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:03 smithi016 ceph-mon[30855]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:41:03.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:41:04.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:03 smithi071 ceph-mon[35018]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:41:04.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:03 smithi066 ceph-mon[34761]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:41:04.234 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:04.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 -- 172.21.15.16:0/4191410779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a410d0e0 msgr2=0x7fa5a410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 --2- 172.21.15.16:0/4191410779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a410d0e0 0x7fa5a410f550 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009ca0 tx=0x7fa59c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 -- 172.21.15.16:0/4191410779 shutdown_connections 2024-09-10T23:41:04.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 --2- 172.21.15.16:0/4191410779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a410d0e0 0x7fa5a410f550 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 --2- 172.21.15.16:0/4191410779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a4104530 0x7fa5a410cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 --2- 172.21.15.16:0/4191410779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5a4103b30 0x7fa5a4103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 -- 172.21.15.16:0/4191410779 >> 172.21.15.16:0/4191410779 conn(0x7fa5a40fd700 msgr2=0x7fa5a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 -- 172.21.15.16:0/4191410779 shutdown_connections 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.731+0000 7fa5aab82640 1 -- 172.21.15.16:0/4191410779 wait complete. 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 Processor -- start 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 -- start start 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5a4103b30 0x7fa5a4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a4104530 0x7fa5a41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a410d0e0 0x7fa5a419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4112da0 con 0x7fa5a4104530 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4112c20 con 0x7fa5a410d0e0 2024-09-10T23:41:04.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5aab82640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4112f20 con 0x7fa5a4103b30 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a4104530 0x7fa5a41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a4104530 0x7fa5a41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43054/0 (socket says 172.21.15.16:43054) 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5a3fff640 1 -- 172.21.15.16:0/2304652899 learned_addr learned my addr 172.21.15.16:0/2304652899 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5a911f640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a410d0e0 0x7fa5a419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.732+0000 7fa5a891e640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5a4103b30 0x7fa5a4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a3fff640 1 -- 172.21.15.16:0/2304652899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5a4103b30 msgr2=0x7fa5a4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5a4103b30 0x7fa5a4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a3fff640 1 -- 172.21.15.16:0/2304652899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a410d0e0 msgr2=0x7fa5a419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a410d0e0 0x7fa5a419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a3fff640 1 -- 172.21.15.16:0/2304652899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a419f340 con 0x7fa5a4104530 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a911f640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a410d0e0 0x7fa5a419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a4104530 0x7fa5a41997d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa59400b4a0 tx=0x7fa59400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a1ffb640 1 -- 172.21.15.16:0/2304652899 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594014070 con 0x7fa5a4104530 2024-09-10T23:41:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a419f630 con 0x7fa5a4104530 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a1ffb640 1 -- 172.21.15.16:0/2304652899 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa594010ac0 con 0x7fa5a4104530 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5a1ffb640 1 -- 172.21.15.16:0/2304652899 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594017c30 con 0x7fa5a4104530 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.733+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a41a5ec0 con 0x7fa5a4104530 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 Processor -- start 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 -- start start 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41bb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b8d4121ea0 con 0x55b8d41ab0f0 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b8d41112d0 con 0x55b8d41bbdb0 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.736+0000 7fa5acf57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b8d41150e0 con 0x55b8d41aba10 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a1ffb640 1 -- 172.21.15.16:0/2304652899 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa594010610 con 0x7fa5a4104530 2024-09-10T23:41:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43068/0 (socket says 172.21.15.16:43068) 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 -- 172.21.15.16:0/1257399532 learned_addr learned my addr 172.21.15.16:0/1257399532 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a891e640 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41bb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 -- 172.21.15.16:0/1257399532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 msgr2=0x55b8d41bb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41bb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 -- 172.21.15.16:0/1257399532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 msgr2=0x55b8d41be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 -- 172.21.15.16:0/1257399532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d3e6f650 con 0x55b8d41ab0f0 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa5a911f640 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41ab4d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031ba0 tx=0x7fa59c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f80ad9af40aeef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa59affd640 1 -- 172.21.15.16:0/1257399532 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c031710 con 0x55b8d41ab0f0 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa59affd640 1 -- 172.21.15.16:0/1257399532 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa59c040070 con 0x55b8d41ab0f0 2024-09-10T23:41:04.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.737+0000 7fa59affd640 1 -- 172.21.15.16:0/1257399532 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0047a0 con 0x55b8d41ab0f0 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5a1ffb640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5900b5450 0x7fa5900b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5a891e640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5900b5450 0x7fa5900b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5a1ffb640 1 -- 172.21.15.16:0/2304652899 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa5940e5840 con 0x7fa5a4104530 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 -- 172.21.15.16:0/1257399532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 msgr2=0x55b8d41ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5a891e640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5900b5450 0x7fa5900b7910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b8d41aabd0 tx=0x7fa58c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41ab4d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031ba0 tx=0x7fa59c009a20 comp rx=0 tx=0).stop 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 -- 172.21.15.16:0/1257399532 shutdown_connections 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41bb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1257399532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41ab4d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 -- 172.21.15.16:0/1257399532 >> 172.21.15.16:0/1257399532 conn(0x55b8d41a8f20 msgr2=0x55b8d41aa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 -- 172.21.15.16:0/1257399532 shutdown_connections 2024-09-10T23:41:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.738+0000 7fa5acf57740 1 -- 172.21.15.16:0/1257399532 wait complete. 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 -- start start 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 Processor -- start 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41bb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41bbdb0 0x55b8d41b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b8d3f72700 con 0x55b8d41bbdb0 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b8d40ac160 con 0x55b8d41ab0f0 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b8d41bea00 con 0x55b8d41aba10 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.739+0000 7fa5acf57740 10 client.0 _ll_register_callbacks cb 0x55b8d40c59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41bbdb0 0x55b8d41b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a891e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a891e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41bb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:60320/0 (socket says 172.21.15.16:60320) 2024-09-10T23:41:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41bbdb0 0x55b8d41b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43080/0 (socket says 172.21.15.16:43080) 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a891e640 1 -- 172.21.15.16:0/1608763046 learned_addr learned my addr 172.21.15.16:0/1608763046 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 -- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 msgr2=0x55b8d41b8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41b8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 -- 172.21.15.16:0/1608763046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 msgr2=0x55b8d41bb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41bb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 -- 172.21.15.16:0/1608763046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d40d9c90 con 0x55b8d41bbdb0 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a891e640 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41bb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5a911f640 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41bbdb0 0x55b8d41b91b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031b70 tx=0x7fa59c031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb044d71c2e285fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa583fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa583fff640 1 -- 172.21.15.16:0/1608763046 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c054060 con 0x55b8d41bbdb0 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa583fff640 1 -- 172.21.15.16:0/1608763046 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa59c003d80 con 0x55b8d41bbdb0 2024-09-10T23:41:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.740+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa59c040070 con 0x55b8d41bbdb0 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa583fff640 1 -- 172.21.15.16:0/1608763046 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa59c009540 con 0x55b8d41bbdb0 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 10 client.15606 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b8d41ca3c0 con 0x55b8d41bbdb0 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa583fff640 1 -- 172.21.15.16:0/1608763046 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa59c040070 con 0x55b8d41bbdb0 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa583fff640 1 -- 172.21.15.16:0/1608763046 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa59c04e030 con 0x55b8d41bbdb0 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 10 client.15606 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 20 client.15606 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d41cb710 0x55b8d41cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 4 client.15606 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8d4123df0 con 0x55b8d41cb710 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.741+0000 7fa5a891e640 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d41cb710 0x55b8d41cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.742+0000 7fa583fff640 10 client.15606 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:04.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.742+0000 7fa5a891e640 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d41cb710 0x55b8d41cdb00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae9486e4780efb4 server_cookie=32a31e4f1ba9e713 in_seq=0 out_seq=0 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa583fff640 1 -- 172.21.15.16:0/1608763046 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8d4123df0 con 0x55b8d41cb710 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa583fff640 10 client.15606 handle_command_reply: tid=0 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 client.15606 shutdown 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41bbdb0 msgr2=0x55b8d41b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41bbdb0 0x55b8d41b91b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031b70 tx=0x7fa59c031740 comp rx=0 tx=0).stop 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 shutdown_connections 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d41cb710 0x55b8d41cdb00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41bbdb0 0x55b8d41b91b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41b8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa583fff640 0 client.15606 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 --2- 172.21.15.16:0/1608763046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41bb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 >> 172.21.15.16:0/1608763046 conn(0x55b8d41a8f20 msgr2=0x55b8d41aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 shutdown_connections 2024-09-10T23:41:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 1 -- 172.21.15.16:0/1608763046 wait complete. 2024-09-10T23:41:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.743+0000 7fa5acf57740 20 client.15606 trim_cache size 0 max 16384 2024-09-10T23:41:04.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 Processor -- start 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 -- start start 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41aed00 con 0x55b8d41ab0f0 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41ac5d0 con 0x55b8d41bbdb0 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5acf57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41aa440 con 0x55b8d41aba10 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5a891e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5a891e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43088/0 (socket says 172.21.15.16:43088) 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.757+0000 7fa5a891e640 1 -- 172.21.15.16:0/423231275 learned_addr learned my addr 172.21.15.16:0/423231275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a911f640 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a891e640 1 -- 172.21.15.16:0/423231275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 msgr2=0x55b8d41a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a891e640 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a891e640 1 -- 172.21.15.16:0/423231275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 msgr2=0x55b8d41aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a891e640 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a891e640 1 -- 172.21.15.16:0/423231275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d41ab840 con 0x55b8d41ab0f0 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa5a891e640 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41c7cd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0039c0 tx=0x7fa58c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc2668428a99da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa59a7fc640 1 -- 172.21.15.16:0/423231275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c01ea10 con 0x55b8d41ab0f0 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa59a7fc640 1 -- 172.21.15.16:0/423231275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa58c0054d0 con 0x55b8d41ab0f0 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.758+0000 7fa59a7fc640 1 -- 172.21.15.16:0/423231275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c004c00 con 0x55b8d41ab0f0 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 -- 172.21.15.16:0/423231275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 msgr2=0x55b8d41c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41c7cd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0039c0 tx=0x7fa58c004610 comp rx=0 tx=0).stop 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 -- 172.21.15.16:0/423231275 shutdown_connections 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41bbdb0 0x55b8d41aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41aba10 0x55b8d41a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 --2- 172.21.15.16:0/423231275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41ab0f0 0x55b8d41c7cd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 -- 172.21.15.16:0/423231275 >> 172.21.15.16:0/423231275 conn(0x55b8d41a8f20 msgr2=0x55b8d41a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 -- 172.21.15.16:0/423231275 shutdown_connections 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 -- 172.21.15.16:0/423231275 wait complete. 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.759+0000 7fa5acf57740 1 -- start start 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 1 Processor -- start 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41aba10 0x55b8d41cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41bbdb0 0x55b8d41cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41aaa90 con 0x55b8d41aba10 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41abf00 con 0x55b8d41ab0f0 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41ab160 con 0x55b8d41bbdb0 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5acf57740 10 client.0 _ll_register_callbacks cb 0x7fa58c00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41aba10 0x55b8d41cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41aba10 0x55b8d41cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43090/0 (socket says 172.21.15.16:43090) 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5a3fff640 1 -- 172.21.15.16:0/233950764 learned_addr learned my addr 172.21.15.16:0/233950764 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5a891e640 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.760+0000 7fa5a911f640 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41bbdb0 0x55b8d41cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5a3fff640 1 -- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41bbdb0 msgr2=0x55b8d41cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41bbdb0 0x55b8d41cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5a3fff640 1 -- 172.21.15.16:0/233950764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 msgr2=0x55b8d41cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5a3fff640 1 -- 172.21.15.16:0/233950764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d4237380 con 0x55b8d41aba10 2024-09-10T23:41:04.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5a3fff640 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41aba10 0x55b8d41cf100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa5940aba20 tx=0x7fa594010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d21f4e72c6098e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa583fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa583fff640 1 -- 172.21.15.16:0/233950764 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59401e040 con 0x55b8d41aba10 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa583fff640 1 -- 172.21.15.16:0/233950764 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa5940a7f90 con 0x55b8d41aba10 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa58c0054d0 con 0x55b8d41aba10 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa583fff640 1 -- 172.21.15.16:0/233950764 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa5940d2020 con 0x55b8d41aba10 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5acf57740 10 client.15612 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b8d42386e0 con 0x55b8d41aba10 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.761+0000 7fa583fff640 1 -- 172.21.15.16:0/233950764 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa58c0054d0 con 0x55b8d41aba10 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa583fff640 1 -- 172.21.15.16:0/233950764 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa5940b4e20 con 0x55b8d41aba10 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5acf57740 10 client.15612 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5acf57740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5acf57740 20 client.15612 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:04.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5acf57740 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d4238e60 0x55b8d423b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5acf57740 4 client.15612 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8d411f8a0 con 0x55b8d4238e60 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5a891e640 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d4238e60 0x55b8d423b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa583fff640 10 client.15612 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.762+0000 7fa5a891e640 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d4238e60 0x55b8d423b280 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb75790fccec02b2 server_cookie=b9cae7bf8940c79f in_seq=0 out_seq=0 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa583fff640 1 -- 172.21.15.16:0/233950764 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8d411f8a0 con 0x55b8d4238e60 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa583fff640 10 client.15612 handle_command_reply: tid=0 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 client.15612 shutdown 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41aba10 msgr2=0x55b8d41cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41aba10 0x55b8d41cf100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa5940aba20 tx=0x7fa594010f90 comp rx=0 tx=0).stop 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 shutdown_connections 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b8d4238e60 0x55b8d423b280 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8d41bbdb0 0x55b8d41cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8d41aba10 0x55b8d41cf100 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 --2- 172.21.15.16:0/233950764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8d41ab0f0 0x55b8d41cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 >> 172.21.15.16:0/233950764 conn(0x55b8d41a8f20 msgr2=0x55b8d41aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:04.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa583fff640 0 client.15612 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:04.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 shutdown_connections 2024-09-10T23:41:04.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 1 -- 172.21.15.16:0/233950764 wait complete. 2024-09-10T23:41:04.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.763+0000 7fa5acf57740 20 client.15612 trim_cache size 0 max 16384 2024-09-10T23:41:04.776 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:41:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5900b5450 msgr2=0x7fa5900b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5900b5450 0x7fa5900b7910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b8d41aabd0 tx=0x7fa58c00b390 comp rx=0 tx=0).stop 2024-09-10T23:41:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a4104530 msgr2=0x7fa5a41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a4104530 0x7fa5a41997d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa59400b4a0 tx=0x7fa59400b960 comp rx=0 tx=0).stop 2024-09-10T23:41:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 shutdown_connections 2024-09-10T23:41:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5900b5450 0x7fa5900b7910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a410d0e0 0x7fa5a419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5a4104530 0x7fa5a41997d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 --2- 172.21.15.16:0/2304652899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5a4103b30 0x7fa5a4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 >> 172.21.15.16:0/2304652899 conn(0x7fa5a40fd700 msgr2=0x7fa5a40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 shutdown_connections 2024-09-10T23:41:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:04.764+0000 7fa5aab82640 1 -- 172.21.15.16:0/2304652899 wait complete. 2024-09-10T23:41:05.800 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:05 smithi016 ceph-mon[30855]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:41:05.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:05 smithi066 ceph-mon[34761]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:41:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:05 smithi071 ceph-mon[35018]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-10T23:41:06.996 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 96% (11663/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T23:41:07.112 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:41:07.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:41:07.375 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:07.552 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-10T23:41:07.553 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-09-10T23:41:07.554 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-10T23:41:07.554 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T23:41:07.554 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-10T23:41:07.556 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:41:07.558 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T23:41:07.632 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T23:41:07.635 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:41:07.635 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T23:41:07.749 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:07 smithi016 ceph-mon[30855]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-10T23:41:08.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:07 smithi071 ceph-mon[35018]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-10T23:41:08.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:07 smithi066 ceph-mon[34761]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 -- 172.21.15.16:0/3140326156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 msgr2=0x7fb5a010eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 --2- 172.21.15.16:0/3140326156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a010eee0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb590009900 tx=0x7fb59002a480 comp rx=0 tx=0).stop 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 -- 172.21.15.16:0/3140326156 shutdown_connections 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 --2- 172.21.15.16:0/3140326156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a010f420 0x7fb5a0111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 --2- 172.21.15.16:0/3140326156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a010eee0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 --2- 172.21.15.16:0/3140326156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a0101870 0x7fb5a0101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 -- 172.21.15.16:0/3140326156 >> 172.21.15.16:0/3140326156 conn(0x7fb5a00fd720 msgr2=0x7fb5a00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 -- 172.21.15.16:0/3140326156 shutdown_connections 2024-09-10T23:41:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.010+0000 7fb5a8280640 1 -- 172.21.15.16:0/3140326156 wait complete. 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 Processor -- start 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 -- start start 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a0101870 0x7fb5a019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a010f420 0x7fb5a01a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0114f80 con 0x7fb5a0102190 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0114e00 con 0x7fb5a010f420 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a8280640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0115100 con 0x7fb5a0101870 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a581b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a581b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43110/0 (socket says 172.21.15.16:43110) 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a581b640 1 -- 172.21.15.16:0/694486906 learned_addr learned my addr 172.21.15.16:0/694486906 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a681d640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a010f420 0x7fb5a01a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.011+0000 7fb5a601c640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a0101870 0x7fb5a019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a581b640 1 -- 172.21.15.16:0/694486906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a0101870 msgr2=0x7fb5a019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a581b640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a0101870 0x7fb5a019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a581b640 1 -- 172.21.15.16:0/694486906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a010f420 msgr2=0x7fb5a01a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a581b640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a010f420 0x7fb5a01a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a581b640 1 -- 172.21.15.16:0/694486906 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a01a14e0 con 0x7fb5a0102190 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a581b640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a019b970 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb590005940 tx=0x7fb590004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5977fe640 1 -- 172.21.15.16:0/694486906 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59003f030 con 0x7fb5a0102190 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5977fe640 1 -- 172.21.15.16:0/694486906 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb590003aa0 con 0x7fb5a0102190 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a01a1770 con 0x7fb5a0102190 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5977fe640 1 -- 172.21.15.16:0/694486906 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590035070 con 0x7fb5a0102190 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.012+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a01a7e90 con 0x7fb5a0102190 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5977fe640 1 -- 172.21.15.16:0/694486906 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb59003bcc0 con 0x7fb5a0102190 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 Processor -- start 2024-09-10T23:41:08.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 -- start start 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c93250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c95b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563ea2bfde60 con 0x563ea2c87800 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563ea2bed290 con 0x563ea2c86ee0 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5aa655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563ea2bf10a0 con 0x563ea2c93790 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5a601c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c93250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5a601c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c93250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43122/0 (socket says 172.21.15.16:43122) 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5a601c640 1 -- 172.21.15.16:0/826021494 learned_addr learned my addr 172.21.15.16:0/826021494 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.015+0000 7fb5a681d640 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a581b640 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c95b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a601c640 1 -- 172.21.15.16:0/826021494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 msgr2=0x563ea2c95b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a601c640 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c95b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a601c640 1 -- 172.21.15.16:0/826021494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 msgr2=0x563ea2c872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a601c640 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c872c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a601c640 1 -- 172.21.15.16:0/826021494 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea294b930 con 0x563ea2c87800 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5977fe640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb58c0b5450 0x7fb58c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a601c640 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c93250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00cc90 tx=0x7fb59c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a429fd0ef3f34d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5a681d640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb58c0b5450 0x7fb58c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb5977fe640 1 -- 172.21.15.16:0/694486906 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb590106980 con 0x7fb5a0102190 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb594de6640 1 -- 172.21.15.16:0/826021494 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c014070 con 0x563ea2c87800 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb594de6640 1 -- 172.21.15.16:0/826021494 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c0047a0 con 0x563ea2c87800 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.016+0000 7fb594de6640 1 -- 172.21.15.16:0/826021494 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0106b0 con 0x563ea2c87800 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 -- 172.21.15.16:0/826021494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 msgr2=0x563ea2c93250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c93250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00cc90 tx=0x7fb59c00e720 comp rx=0 tx=0).stop 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5a681d640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb58c0b5450 0x7fb58c0b7910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb598005fd0 tx=0x7fb598009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 -- 172.21.15.16:0/826021494 shutdown_connections 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c95b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c93250 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 --2- 172.21.15.16:0/826021494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 -- 172.21.15.16:0/826021494 >> 172.21.15.16:0/826021494 conn(0x563ea2c84d10 msgr2=0x563ea2c85eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 -- 172.21.15.16:0/826021494 shutdown_connections 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 -- 172.21.15.16:0/826021494 wait complete. 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.017+0000 7fb5aa655740 1 -- start start 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 1 Processor -- start 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c90780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c87800 0x563ea2c90cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c93790 0x563ea2c91200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563ea2a4e890 con 0x563ea2c93790 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563ea2b87d40 con 0x563ea2c86ee0 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563ea2c96440 con 0x563ea2c87800 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5aa655740 10 client.0 _ll_register_callbacks cb 0x563ea2bebc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c93790 0x563ea2c91200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c93790 0x563ea2c91200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43134/0 (socket says 172.21.15.16:43134) 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 -- 172.21.15.16:0/3822119045 learned_addr learned my addr 172.21.15.16:0/3822119045 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a601c640 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c90780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a581b640 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c87800 0x563ea2c90cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 -- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c87800 msgr2=0x563ea2c90cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c87800 0x563ea2c90cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 -- 172.21.15.16:0/3822119045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 msgr2=0x563ea2c90780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c90780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.018+0000 7fb5a681d640 1 -- 172.21.15.16:0/3822119045 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea2c9f840 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5a681d640 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c93790 0x563ea2c91200 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb5980099c0 tx=0x7fb598004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1919b6db6a3afaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb589ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb589ffb640 1 -- 172.21.15.16:0/3822119045 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598004b20 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb589ffb640 1 -- 172.21.15.16:0/3822119045 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb598004cc0 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb59c0047a0 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb589ffb640 1 -- 172.21.15.16:0/3822119045 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb59800f7d0 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 10 client.15624 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563ea2ca2250 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb589ffb640 1 -- 172.21.15.16:0/3822119045 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c0047a0 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb589ffb640 1 -- 172.21.15.16:0/3822119045 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb598026070 con 0x563ea2c93790 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 10 client.15624 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:08.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 20 client.15624 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2ca37b0 0x563ea2ca5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 4 client.15624 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.019+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ea2bffdb0 con 0x563ea2ca37b0 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.020+0000 7fb5a601c640 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2ca37b0 0x563ea2ca5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.020+0000 7fb5a601c640 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2ca37b0 0x563ea2ca5ba0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26f61f2e351a388f server_cookie=d9d9177f8fca794d in_seq=0 out_seq=0 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.020+0000 7fb589ffb640 10 client.15624 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb589ffb640 1 -- 172.21.15.16:0/3822119045 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ea2bffdb0 con 0x563ea2ca37b0 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb589ffb640 10 client.15624 handle_command_reply: tid=0 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 client.15624 shutdown 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c93790 msgr2=0x563ea2c91200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c93790 0x563ea2c91200 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb5980099c0 tx=0x7fb598004ab0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 shutdown_connections 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2ca37b0 0x563ea2ca5ba0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c93790 0x563ea2c91200 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c87800 0x563ea2c90cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb589ffb640 0 client.15624 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 --2- 172.21.15.16:0/3822119045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c90780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 >> 172.21.15.16:0/3822119045 conn(0x563ea2c84d10 msgr2=0x563ea2c83f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 shutdown_connections 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 1 -- 172.21.15.16:0/3822119045 wait complete. 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.021+0000 7fb5aa655740 20 client.15624 trim_cache size 0 max 16384 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 Processor -- start 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 -- start start 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c90e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c8d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c8ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01b3050 con 0x563ea2c87800 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01b0920 con 0x563ea2c86ee0 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5aa655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01ae770 con 0x563ea2c93790 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5a581b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c8d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5a581b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c8d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43144/0 (socket says 172.21.15.16:43144) 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.039+0000 7fb5a581b640 1 -- 172.21.15.16:0/4147576408 learned_addr learned my addr 172.21.15.16:0/4147576408 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb5a581b640 1 -- 172.21.15.16:0/4147576408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 msgr2=0x563ea2c8ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb5a581b640 1 --2- 172.21.15.16:0/4147576408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c8ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb5a581b640 1 -- 172.21.15.16:0/4147576408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 msgr2=0x563ea2c90e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb5a581b640 1 --2- 172.21.15.16:0/4147576408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c90e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb5a581b640 1 -- 172.21.15.16:0/4147576408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea2c85790 con 0x563ea2c87800 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb5a581b640 1 --2- 172.21.15.16:0/4147576408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c8d990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb5900ccdf0 tx=0x7fb59002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a8af2bea668df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:08.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb58bfff640 1 -- 172.21.15.16:0/4147576408 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590049040 con 0x563ea2c87800 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb58bfff640 1 -- 172.21.15.16:0/4147576408 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5900cc970 con 0x563ea2c87800 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.040+0000 7fb58bfff640 1 -- 172.21.15.16:0/4147576408 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900d1940 con 0x563ea2c87800 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- 172.21.15.16:0/4147576408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 msgr2=0x563ea2c8d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 --2- 172.21.15.16:0/4147576408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c8d990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb5900ccdf0 tx=0x7fb59002a480 comp rx=0 tx=0).stop 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- 172.21.15.16:0/4147576408 shutdown_connections 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 --2- 172.21.15.16:0/4147576408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c8ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 --2- 172.21.15.16:0/4147576408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c8d990 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 --2- 172.21.15.16:0/4147576408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c90e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- 172.21.15.16:0/4147576408 >> 172.21.15.16:0/4147576408 conn(0x563ea2c84d10 msgr2=0x563ea2c906f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- 172.21.15.16:0/4147576408 shutdown_connections 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- 172.21.15.16:0/4147576408 wait complete. 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- start start 2024-09-10T23:41:08.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 Processor -- start 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c9bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c980a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c985e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01aede0 con 0x563ea2c87800 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01b0250 con 0x563ea2c86ee0 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01af4b0 con 0x563ea2c93790 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5aa655740 10 client.0 _ll_register_callbacks cb 0x7fb598009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.041+0000 7fb5a581b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43146/0 (socket says 172.21.15.16:43146) 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 -- 172.21.15.16:0/1779281740 learned_addr learned my addr 172.21.15.16:0/1779281740 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a601c640 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c9bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 -- 172.21.15.16:0/1779281740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 msgr2=0x563ea2c985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 -- 172.21.15.16:0/1779281740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 msgr2=0x563ea2c9bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c9bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 -- 172.21.15.16:0/1779281740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea2c98b50 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5a581b640 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c980a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5900ccb60 tx=0x7fb590104640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bf2e944a1c39fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb589ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb589ffb640 1 -- 172.21.15.16:0/1779281740 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900b8020 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb589ffb640 1 -- 172.21.15.16:0/1779281740 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb5900cd0c0 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5900cc970 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb589ffb640 1 -- 172.21.15.16:0/1779281740 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5900cc5d0 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5aa655740 10 client.15630 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563ea2d114a0 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.042+0000 7fb589ffb640 1 -- 172.21.15.16:0/1779281740 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5900cc970 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb589ffb640 1 -- 172.21.15.16:0/1779281740 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5900d5f60 con 0x563ea2c87800 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5aa655740 10 client.15630 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5aa655740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5aa655740 20 client.15630 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5aa655740 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2d119d0 0x563ea2d13dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5aa655740 4 client.15630 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563ea2bfb860 con 0x563ea2d119d0 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5a601c640 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2d119d0 0x563ea2d13dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb5a601c640 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2d119d0 0x563ea2d13dc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98c9abef5d49a9ff server_cookie=6924e17ec40e9e29 in_seq=0 out_seq=0 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.043+0000 7fb589ffb640 10 client.15630 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb589ffb640 1 -- 172.21.15.16:0/1779281740 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563ea2bfb860 con 0x563ea2d119d0 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb589ffb640 10 client.15630 handle_command_reply: tid=0 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 client.15630 shutdown 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 msgr2=0x563ea2c980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c980a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5900ccb60 tx=0x7fb590104640 comp rx=0 tx=0).stop 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "baece9df-456d-49dd-97ef-4dda3c1d83f8", 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 shutdown_connections 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x563ea2d119d0 0x563ea2d13dc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ea2c93790 0x563ea2c985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563ea2c87800 0x563ea2c980a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 --2- 172.21.15.16:0/1779281740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea2c86ee0 0x563ea2c9bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 >> 172.21.15.16:0/1779281740 conn(0x563ea2c84d10 msgr2=0x563ea2c8a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb589ffb640 0 client.15630 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 shutdown_connections 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 1 -- 172.21.15.16:0/1779281740 wait complete. 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.045+0000 7fb5aa655740 20 client.15630 trim_cache size 0 max 16384 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb58c0b5450 msgr2=0x7fb58c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb58c0b5450 0x7fb58c0b7910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb598005fd0 tx=0x7fb598009500 comp rx=0 tx=0).stop 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 msgr2=0x7fb5a019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a019b970 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb590005940 tx=0x7fb590004270 comp rx=0 tx=0).stop 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 shutdown_connections 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb58c0b5450 0x7fb58c0b7910 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a010f420 0x7fb5a01a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5a0102190 0x7fb5a019b970 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 --2- 172.21.15.16:0/694486906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a0101870 0x7fb5a019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 >> 172.21.15.16:0/694486906 conn(0x7fb5a00fd720 msgr2=0x7fb5a0111640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 shutdown_connections 2024-09-10T23:41:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:08.046+0000 7fb5a8280640 1 -- 172.21.15.16:0/694486906 wait complete. 2024-09-10T23:41:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:08 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:41:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:08 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:08 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:41:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:08 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:09.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:08 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:41:09.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:08 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:09.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:08 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:41:09.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:08 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:09.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:08 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:41:09.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:08 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:09.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:08 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:41:09.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:08 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:09.268 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:41:09.468 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T23:41:09.541 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:09.558 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T23:41:09.600 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T23:41:09.602 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:41:09.602 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T23:41:09.644 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T23:41:09.648 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:41:09.648 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T23:41:09.665 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-09-10T23:41:09.667 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-09-10T23:41:09.667 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-09-10T23:41:09.728 INFO:tasks.workunit.client.0.smithi016.stdout:test large (16MB) dio write 2024-09-10T23:41:09.728 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo 'test large (16MB) dio write' 2024-09-10T23:41:09.728 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-09-10T23:41:09.798 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-09-10T23:41:09.798 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-09-10T23:41:09.799 INFO:tasks.workunit.client.0.smithi016.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0685911 s, 245 MB/s 2024-09-10T23:41:09.799 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo OK 2024-09-10T23:41:09.800 INFO:tasks.workunit.client.0.smithi016.stdout:OK 2024-09-10T23:41:09.800 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:41:09.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:41:09.862 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:09 smithi016 ceph-mon[30855]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T23:41:09.895 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-09-10T23:41:09.896 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-09-10T23:41:10.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:09 smithi071 ceph-mon[35018]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T23:41:10.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:09 smithi066 ceph-mon[34761]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T23:41:10.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 -- 172.21.15.16:0/639008126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c1087d0 msgr2=0x7fc86c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 --2- 172.21.15.16:0/639008126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c1087d0 0x7fc86c108c10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009900 tx=0x7fc85c02a410 comp rx=0 tx=0).stop 2024-09-10T23:41:10.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 -- 172.21.15.16:0/639008126 shutdown_connections 2024-09-10T23:41:10.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 --2- 172.21.15.16:0/639008126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc86c109150 0x7fc86c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 --2- 172.21.15.16:0/639008126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c1087d0 0x7fc86c108c10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 --2- 172.21.15.16:0/639008126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc86c102dc0 0x7fc86c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 -- 172.21.15.16:0/639008126 >> 172.21.15.16:0/639008126 conn(0x7fc86c0fe830 msgr2=0x7fc86c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 -- 172.21.15.16:0/639008126 shutdown_connections 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 -- 172.21.15.16:0/639008126 wait complete. 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.055+0000 7fc873a1b640 1 Processor -- start 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc873a1b640 1 -- start start 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc873a1b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc86c102dc0 0x7fc86c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc873a1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc86c1087d0 0x7fc86c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc873a1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c109150 0x7fc86c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc873a1b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c112da0 con 0x7fc86c109150 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc873a1b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c112c20 con 0x7fc86c102dc0 2024-09-10T23:41:10.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc873a1b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c112f20 con 0x7fc86c1087d0 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c109150 0x7fc86c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc86c1087d0 0x7fc86c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c109150 0x7fc86c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43162/0 (socket says 172.21.15.16:43162) 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 -- 172.21.15.16:0/1427343102 learned_addr learned my addr 172.21.15.16:0/1427343102 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc86c102dc0 0x7fc86c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 -- 172.21.15.16:0/1427343102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc86c1087d0 msgr2=0x7fc86c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc86c1087d0 0x7fc86c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 -- 172.21.15.16:0/1427343102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc86c102dc0 msgr2=0x7fc86c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc86c102dc0 0x7fc86c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 -- 172.21.15.16:0/1427343102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86c1a7670 con 0x7fc86c109150 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc870fb6640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc86c1087d0 0x7fc86c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.056+0000 7fc871fb8640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c109150 0x7fc86c075f20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc86400eaa0 tx=0x7fc86400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.057+0000 7fc8627fc640 1 -- 172.21.15.16:0/1427343102 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86400cdb0 con 0x7fc86c109150 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.057+0000 7fc8627fc640 1 -- 172.21.15.16:0/1427343102 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc864005020 con 0x7fc86c109150 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.057+0000 7fc8627fc640 1 -- 172.21.15.16:0/1427343102 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8640116d0 con 0x7fc86c109150 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.057+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86c1a7960 con 0x7fc86c109150 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.057+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86c1a7e70 con 0x7fc86c109150 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.060+0000 7fc875df0740 1 Processor -- start 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc8627fc640 1 -- 172.21.15.16:0/1427343102 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc86400f040 con 0x7fc86c109150 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc875df0740 1 -- start start 2024-09-10T23:41:10.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc875df0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f0f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc875df0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f1b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc875df0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f1e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc875df0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562155e85e50 con 0x562155f1bd30 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc875df0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562155e75280 con 0x562155f0fda0 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc875df0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562155e79090 con 0x562155f0f480 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f1e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f1e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43176/0 (socket says 172.21.15.16:43176) 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc870fb6640 1 -- 172.21.15.16:0/1702396221 learned_addr learned my addr 172.21.15.16:0/1702396221 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc870fb6640 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f0f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.061+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f1b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8717b7640 1 -- 172.21.15.16:0/1702396221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 msgr2=0x562155f0f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f0f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8717b7640 1 -- 172.21.15.16:0/1702396221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 msgr2=0x562155f1e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8627fc640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8580b54d0 0x7fc8580b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f1e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8717b7640 1 -- 172.21.15.16:0/1702396221 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562155bd3650 con 0x562155f0fda0 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc871fb8640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8580b54d0 0x7fc8580b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f1b7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc8680107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab15ff7f361c9464 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8627fc640 1 -- 172.21.15.16:0/1427343102 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc8640e5c70 con 0x7fc86c109150 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8577fe640 1 -- 172.21.15.16:0/1702396221 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86801c680 con 0x562155f0fda0 2024-09-10T23:41:10.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8577fe640 1 -- 172.21.15.16:0/1702396221 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc86800be20 con 0x562155f0fda0 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.062+0000 7fc8577fe640 1 -- 172.21.15.16:0/1702396221 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868011b90 con 0x562155f0fda0 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 -- 172.21.15.16:0/1702396221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 msgr2=0x562155f1b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f1b7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc8680107a0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc871fb8640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8580b54d0 0x7fc8580b7990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc864091fd0 tx=0x7fc864093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 -- 172.21.15.16:0/1702396221 shutdown_connections 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f1e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f1b7f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 --2- 172.21.15.16:0/1702396221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f0f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 -- 172.21.15.16:0/1702396221 >> 172.21.15.16:0/1702396221 conn(0x562155f0d2b0 msgr2=0x562155f0e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:10.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 -- 172.21.15.16:0/1702396221 shutdown_connections 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 -- 172.21.15.16:0/1702396221 wait complete. 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 -- start start 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.063+0000 7fc875df0740 1 Processor -- start 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc875df0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc875df0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f18a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc875df0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f18fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc875df0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562155cd6700 con 0x562155f1bd30 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc875df0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562155e10110 con 0x562155f0fda0 2024-09-10T23:41:10.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc875df0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562155f1e9b0 con 0x562155f0f480 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc875df0740 10 client.0 _ll_register_callbacks cb 0x562155e29990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f18fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:57044/0 (socket says 172.21.15.16:57044) 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 -- 172.21.15.16:0/1204955975 learned_addr learned my addr 172.21.15.16:0/1204955975 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f18a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 -- 172.21.15.16:0/1204955975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 msgr2=0x562155f18a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f18a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 -- 172.21.15.16:0/1204955975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 msgr2=0x562155f18fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f18fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 -- 172.21.15.16:0/1204955975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562155e3dc40 con 0x562155f0f480 2024-09-10T23:41:10.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc870fb6640 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1b5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009230 tx=0x7fc85c005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=990199ec8c3cec5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:10.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.064+0000 7fc854ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:41:10.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc854ff9640 1 -- 172.21.15.16:0/1204955975 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c041070 con 0x562155f0f480 2024-09-10T23:41:10.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc854ff9640 1 -- 172.21.15.16:0/1204955975 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc85c005220 con 0x562155f0f480 2024-09-10T23:41:10.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc86800be20 con 0x562155f0f480 2024-09-10T23:41:10.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc854ff9640 1 -- 172.21.15.16:0/1204955975 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc85c052050 con 0x562155f0f480 2024-09-10T23:41:10.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 10 client.25348 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562155f2a2a0 con 0x562155f0f480 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc854ff9640 1 -- 172.21.15.16:0/1204955975 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc86800be20 con 0x562155f0f480 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc854ff9640 1 -- 172.21.15.16:0/1204955975 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc85c004770 con 0x562155f0f480 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 10 client.25348 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 10 client.25348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 20 client.25348 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f2b750 0x562155f2db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 4 client.25348 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.065+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562155e87da0 con 0x562155f2b750 2024-09-10T23:41:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.066+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f2b750 0x562155f2db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.066+0000 7fc8717b7640 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f2b750 0x562155f2db90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d53c9a22a667a0b0 server_cookie=67a32927733ace78 in_seq=0 out_seq=0 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.066+0000 7fc854ff9640 10 client.25348 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc854ff9640 1 -- 172.21.15.16:0/1204955975 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562155e87da0 con 0x562155f2b750 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc854ff9640 10 client.25348 handle_command_reply: tid=0 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 client.25348 shutdown 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 msgr2=0x562155f1b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1b5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009230 tx=0x7fc85c005bc0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 shutdown_connections 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f2b750 0x562155f2db90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f18fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0fda0 0x562155f18a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc854ff9640 0 client.25348 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 --2- 172.21.15.16:0/1204955975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1b5d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 >> 172.21.15.16:0/1204955975 conn(0x562155f0d2b0 msgr2=0x562155f12e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 shutdown_connections 2024-09-10T23:41:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 1 -- 172.21.15.16:0/1204955975 wait complete. 2024-09-10T23:41:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.067+0000 7fc875df0740 20 client.25348 trim_cache size 0 max 16384 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 Processor -- start 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 -- start start 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0f480 0x562155f0cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0fda0 0x562155f17f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f0e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c1b3090 con 0x562155f1bd30 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c1b0960 con 0x562155f0f480 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc875df0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c1ae7b0 con 0x562155f0fda0 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc8717b7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0fda0 0x562155f17f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f0e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc8717b7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0fda0 0x562155f17f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:57048/0 (socket says 172.21.15.16:57048) 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.085+0000 7fc8717b7640 1 -- 172.21.15.16:0/2596590571 learned_addr learned my addr 172.21.15.16:0/2596590571 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc870fb6640 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0f480 0x562155f0cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc8717b7640 1 -- 172.21.15.16:0/2596590571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0f480 msgr2=0x562155f0cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc8717b7640 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0f480 0x562155f0cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc8717b7640 1 -- 172.21.15.16:0/2596590571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 msgr2=0x562155f0e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc8717b7640 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f0e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc8717b7640 1 -- 172.21.15.16:0/2596590571 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562155f17980 con 0x562155f0fda0 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc8717b7640 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0fda0 0x562155f17f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc86800b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103bbee3c3f42c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc856ffd640 1 -- 172.21.15.16:0/2596590571 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868004020 con 0x562155f0fda0 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc856ffd640 1 -- 172.21.15.16:0/2596590571 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8680054f0 con 0x562155f0fda0 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.086+0000 7fc856ffd640 1 -- 172.21.15.16:0/2596590571 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868004970 con 0x562155f0fda0 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 -- 172.21.15.16:0/2596590571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0fda0 msgr2=0x562155f17f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0fda0 0x562155f17f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc86800b410 comp rx=0 tx=0).stop 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 -- 172.21.15.16:0/2596590571 shutdown_connections 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f1bd30 0x562155f0e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0fda0 0x562155f17f10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 --2- 172.21.15.16:0/2596590571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f0f480 0x562155f0cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 -- 172.21.15.16:0/2596590571 >> 172.21.15.16:0/2596590571 conn(0x562155f0d2b0 msgr2=0x562155f0e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 -- 172.21.15.16:0/2596590571 shutdown_connections 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 -- 172.21.15.16:0/2596590571 wait complete. 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 -- start start 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.087+0000 7fc875df0740 1 Processor -- start 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc875df0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc875df0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f0fda0 0x562155f20530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc875df0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f1bd30 0x562155f97660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc875df0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c1aee20 con 0x562155f0fda0 2024-09-10T23:41:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc875df0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c1b0290 con 0x562155f1bd30 2024-09-10T23:41:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc875df0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c1af4f0 con 0x562155f0f480 2024-09-10T23:41:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc875df0740 10 client.0 _ll_register_callbacks cb 0x7fc85c031930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc8717b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f0fda0 0x562155f20530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:57050/0 (socket says 172.21.15.16:57050) 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 -- 172.21.15.16:0/3645099575 learned_addr learned my addr 172.21.15.16:0/3645099575 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc8717b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f0fda0 0x562155f20530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43194/0 (socket says 172.21.15.16:43194) 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f1bd30 0x562155f97660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 -- 172.21.15.16:0/3645099575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f1bd30 msgr2=0x562155f97660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f1bd30 0x562155f97660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 -- 172.21.15.16:0/3645099575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f0fda0 msgr2=0x562155f20530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f0fda0 0x562155f20530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.088+0000 7fc870fb6640 1 -- 172.21.15.16:0/3645099575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562155f97ba0 con 0x562155f0f480 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc870fb6640 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1fff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009340 tx=0x7fc85c009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05774f25a22f9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc854ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc854ff9640 1 -- 172.21.15.16:0/3645099575 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c041040 con 0x562155f0f480 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc854ff9640 1 -- 172.21.15.16:0/3645099575 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc85c031cc0 con 0x562155f0f480 2024-09-10T23:41:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8680054f0 con 0x562155f0f480 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc854ff9640 1 -- 172.21.15.16:0/3645099575 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc85c035040 con 0x562155f0f480 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc875df0740 10 client.25354 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562155f98e00 con 0x562155f0f480 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc854ff9640 1 -- 172.21.15.16:0/3645099575 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8680054f0 con 0x562155f0f480 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc854ff9640 1 -- 172.21.15.16:0/3645099575 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc85c005170 con 0x562155f0f480 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc875df0740 10 client.25354 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc875df0740 10 client.25354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.089+0000 7fc875df0740 20 client.25354 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc875df0740 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f99410 0x562155f9b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc875df0740 4 client.25354 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562155e83850 con 0x562155f99410 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc8717b7640 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f99410 0x562155f9b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc8717b7640 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f99410 0x562155f9b830 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5691f9a5b924b7f server_cookie=b44b32ac98adb17d in_seq=0 out_seq=0 2024-09-10T23:41:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc854ff9640 10 client.25354 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc854ff9640 1 -- 172.21.15.16:0/3645099575 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x562155e83850 con 0x562155f99410 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc854ff9640 10 client.25354 handle_command_reply: tid=0 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc875df0740 1 client.25354 shutdown 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 msgr2=0x562155f1fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.090+0000 7fc875df0740 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1fff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009340 tx=0x7fc85c009610 comp rx=0 tx=0).stop 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 shutdown_connections 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562155f99410 0x562155f9b830 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562155f1bd30 0x562155f97660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562155f0fda0 0x562155f20530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 --2- 172.21.15.16:0/3645099575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562155f0f480 0x562155f1fff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 >> 172.21.15.16:0/3645099575 conn(0x562155f0d2b0 msgr2=0x562155f1a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc854ff9640 0 client.25354 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 shutdown_connections 2024-09-10T23:41:10.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 1 -- 172.21.15.16:0/3645099575 wait complete. 2024-09-10T23:41:10.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc875df0740 20 client.25354 trim_cache size 0 max 16384 2024-09-10T23:41:10.104 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:41:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:41:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:41:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:41:10.104 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "baece9df-456d-49dd-97ef-4dda3c1d83f8", 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:41:10.106 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:10.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:10.107 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8580b54d0 msgr2=0x7fc8580b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc873a1b640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8580b54d0 0x7fc8580b7990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc864091fd0 tx=0x7fc864093040 comp rx=0 tx=0).stop 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c109150 msgr2=0x7fc86c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.091+0000 7fc873a1b640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c109150 0x7fc86c075f20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc86400eaa0 tx=0x7fc86400ef60 comp rx=0 tx=0).stop 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 shutdown_connections 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc86c109150 0x7fc86c075f20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc86c1087d0 0x7fc86c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8580b54d0 0x7fc8580b7990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 --2- 172.21.15.16:0/1427343102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc86c102dc0 0x7fc86c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:10.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 >> 172.21.15.16:0/1427343102 conn(0x7fc86c0fe830 msgr2=0x7fc86c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:10.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 shutdown_connections 2024-09-10T23:41:10.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:10.092+0000 7fc873a1b640 1 -- 172.21.15.16:0/1427343102 wait complete. 2024-09-10T23:41:10.785 INFO:tasks.cephfs.filesystem:scrub status for tag:baece9df-456d-49dd-97ef-4dda3c1d83f8 - {'path': '/', 'tag': 'baece9df-456d-49dd-97ef-4dda3c1d83f8', 'options': 'recursive,force'} 2024-09-10T23:41:11.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:11 smithi016 ceph-mon[30855]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T23:41:12.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:11 smithi071 ceph-mon[35018]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T23:41:12.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:11 smithi066 ceph-mon[34761]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-10T23:41:12.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:12 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:41:13.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:12 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:41:13.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:12 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:41:13.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:13 smithi016 ceph-mon[30855]: pgmap v350: 97 pgs: 97 active+clean; 18 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 708 op/s 2024-09-10T23:41:14.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:13 smithi071 ceph-mon[35018]: pgmap v350: 97 pgs: 97 active+clean; 18 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 708 op/s 2024-09-10T23:41:14.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:13 smithi066 ceph-mon[34761]: pgmap v350: 97 pgs: 97 active+clean; 18 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 708 op/s 2024-09-10T23:41:15.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:15 smithi016 ceph-mon[30855]: pgmap v351: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 694 op/s 2024-09-10T23:41:16.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:15 smithi071 ceph-mon[35018]: pgmap v351: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 694 op/s 2024-09-10T23:41:16.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:15 smithi066 ceph-mon[34761]: pgmap v351: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 694 op/s 2024-09-10T23:41:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:17 smithi016 ceph-mon[30855]: pgmap v352: 97 pgs: 97 active+clean; 14 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 692 op/s 2024-09-10T23:41:18.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:17 smithi071 ceph-mon[35018]: pgmap v352: 97 pgs: 97 active+clean; 14 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 692 op/s 2024-09-10T23:41:18.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:17 smithi066 ceph-mon[34761]: pgmap v352: 97 pgs: 97 active+clean; 14 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 692 op/s 2024-09-10T23:41:19.001 INFO:tasks.workunit.client.0.smithi016.stdout:.......... 2024-09-10T23:41:20.713 INFO:tasks.workunit.client.0.smithi016.stdout:do_o_direct_reads: SUCCESS 2024-09-10T23:41:20.714 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:19 smithi066 ceph-mon[34761]: pgmap v353: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 2.47k op/s 2024-09-10T23:41:20.715 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:19 smithi071 ceph-mon[35018]: pgmap v353: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 2.47k op/s 2024-09-10T23:41:20.716 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:41:20.716 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:41:20.716 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:19 smithi016 ceph-mon[30855]: pgmap v353: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 2.47k op/s 2024-09-10T23:41:20.758 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-09-10T23:41:20.758 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-09-10T23:41:20.824 INFO:tasks.workunit.client.0.smithi016.stdout:test read from hole 2024-09-10T23:41:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo 'test read from hole' 2024-09-10T23:41:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-09-10T23:41:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:0+0 records in 2024-09-10T23:41:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:0+0 records out 2024-09-10T23:41:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:0 bytes copied, 9.5542e-05 s, 0.0 kB/s 2024-09-10T23:41:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-09-10T23:41:20.829 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records in 2024-09-10T23:41:20.829 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records out 2024-09-10T23:41:20.829 INFO:tasks.workunit.client.0.smithi016.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00159402 s, 642 kB/s 2024-09-10T23:41:20.829 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-09-10T23:41:20.830 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records in 2024-09-10T23:41:20.830 INFO:tasks.workunit.client.0.smithi016.stderr:2+0 records out 2024-09-10T23:41:20.830 INFO:tasks.workunit.client.0.smithi016.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.7876e-05 s, 21.4 MB/s 2024-09-10T23:41:20.830 INFO:tasks.workunit.client.0.smithi016.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-09-10T23:41:20.831 INFO:tasks.workunit.client.0.smithi016.stdout:other thing 2024-09-10T23:41:20.831 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo 'other thing' 2024-09-10T23:41:20.831 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-09-10T23:41:20.832 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-09-10T23:41:20.832 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-09-10T23:41:20.832 INFO:tasks.workunit.client.0.smithi016.stderr:500 bytes copied, 4.8326e-05 s, 10.3 MB/s 2024-09-10T23:41:20.832 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-09-10T23:41:20.842 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records in 2024-09-10T23:41:20.842 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records out 2024-09-10T23:41:20.842 INFO:tasks.workunit.client.0.smithi016.stderr:500 bytes copied, 0.0077836 s, 64.2 kB/s 2024-09-10T23:41:20.842 INFO:tasks.workunit.client.0.smithi016.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-09-10T23:41:20.846 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records in 2024-09-10T23:41:20.846 INFO:tasks.workunit.client.0.smithi016.stderr:0+1 records out 2024-09-10T23:41:20.846 INFO:tasks.workunit.client.0.smithi016.stderr:500 bytes copied, 0.0030603 s, 163 kB/s 2024-09-10T23:41:20.846 INFO:tasks.workunit.client.0.smithi016.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-09-10T23:41:20.847 INFO:tasks.workunit.client.0.smithi016.stdout:OK 2024-09-10T23:41:20.848 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo OK 2024-09-10T23:41:20.848 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:41:20.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:41:20.933 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-09-10T23:41:20.933 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-09-10T23:41:21.008 INFO:tasks.workunit.client.0.smithi016.stdout:writing first 3 bytes of 10k file 2024-09-10T23:41:21.008 INFO:tasks.workunit.client.0.smithi016.stdout:reading O_DIRECT 2024-09-10T23:41:21.009 INFO:tasks.workunit.client.0.smithi016.stdout:got 10000 2024-09-10T23:41:21.009 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:41:21.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:41:21.087 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-09-10T23:41:21.087 DEBUG:teuthology.orchestra.run.smithi016:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-09-10T23:41:21.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:21 smithi016 ceph-mon[30855]: pgmap v354: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 2.47k op/s 2024-09-10T23:41:22.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:21 smithi071 ceph-mon[35018]: pgmap v354: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 2.47k op/s 2024-09-10T23:41:22.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:21 smithi066 ceph-mon[34761]: pgmap v354: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.4 MiB/s wr, 2.47k op/s 2024-09-10T23:41:22.562 INFO:tasks.workunit.client.0.smithi016.stdout:writing pattern 2024-09-10T23:41:22.562 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-09-10T23:41:22.562 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-09-10T23:41:22.563 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:22.564 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:22.567 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:22.569 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:22.579 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:22.579 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:22.579 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:22.580 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:22.581 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:22.583 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:22.585 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:22.586 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:22.592 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:22.593 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:22.594 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:22.595 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:22.599 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:22.599 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:22.602 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:22.603 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-10T23:41:22.604 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:22.606 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:22.606 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:22.606 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:22.606 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:22.615 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:22.616 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:22.617 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:22.618 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:22.619 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:22.621 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:22.621 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:22.630 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:22.631 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:22.634 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:22.635 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:22.635 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:22.635 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:22.635 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:22.635 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:22.637 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:22.637 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:22.637 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:22.637 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:22.638 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:22.640 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:22.641 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:22.642 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:22.643 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:22.649 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:22.649 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:22.649 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:22.650 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-09-10T23:41:22.652 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-09-10T23:41:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:22.655 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:22.667 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:22.669 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:22.670 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:22.671 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:22.679 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:22.679 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:22.679 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:22.679 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:22.680 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:22.682 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:22.683 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:22.684 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:22.688 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:22.689 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:22.690 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:22.691 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:22.692 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:22.694 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:22.694 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:22.694 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:22.694 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:22.694 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:22.694 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:22.701 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:22.704 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:22.704 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:22.704 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:22.704 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:22.704 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:22.704 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-09-10T23:41:22.706 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:22.707 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:22.709 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:22.717 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:22.718 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:22.719 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:22.720 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:22.721 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:22.723 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:22.730 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:22.730 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:22.731 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:22.732 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:22.733 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:22.735 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:22.736 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:22.739 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:22.740 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:22.741 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:22.742 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:22.743 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:22.744 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:22.745 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:22.745 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:22.753 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:22.753 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:22.753 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:22.753 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:22.753 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:22.753 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:22.754 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-09-10T23:41:22.755 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:22.756 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:22.757 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:22.772 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:22.773 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:22.776 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:22.778 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:22.782 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:22.782 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:22.782 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:22.782 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:22.782 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:22.782 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:22.782 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:22.783 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:22.784 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:22.785 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:22.786 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:22.788 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:22.788 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:22.788 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:22.788 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:22.788 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:22.788 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:22.790 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:22.790 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:22.790 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:22.790 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:22.791 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:22.792 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:22.793 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:22.794 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:22.796 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:22.805 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-09-10T23:41:22.806 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-09-10T23:41:22.807 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:22.808 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:22.809 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:22.810 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:22.811 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:22.826 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:22.826 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:22.826 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:22.826 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:22.826 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:22.826 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:22.827 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:22.828 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:22.829 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:22.830 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:22.831 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:22.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:22.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:22.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:22.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:22.832 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:22.836 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:22.837 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:22.838 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:22.839 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:22.840 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:22.841 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:22.844 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:22.844 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:22.845 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:22.848 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:22.849 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:22.850 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-09-10T23:41:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-10T23:41:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-09-10T23:41:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-10T23:41:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-09-10T23:41:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-10T23:41:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-10T23:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:22.864 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:22.865 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:22.866 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:22.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:22.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:22.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:22.867 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:22.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:22.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:22.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:22.880 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:22.881 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:22.882 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:22.885 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:22.886 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:22.886 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:22.886 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:22.886 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:22.886 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:22.889 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:22.893 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:22.894 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:22.895 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:22.898 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:22.899 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:22.900 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:22.901 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:22.902 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-09-10T23:41:22.904 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-10T23:41:22.913 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-09-10T23:41:22.913 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:22.914 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:22.915 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:22.916 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:22.917 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:22.918 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:22.929 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:22.930 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:22.931 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:22.932 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:22.933 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:22.934 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:22.937 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:22.938 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:22.940 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:22.941 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:22.942 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:22.943 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:22.943 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:22.943 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:23.072 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:23.073 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:23.074 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:23.075 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:23.076 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:23.077 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-10T23:41:23.078 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:23.600 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:23.601 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:23.602 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:23.602 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-10T23:41:23.602 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:23.602 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:23.602 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:23.602 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-10T23:41:23.602 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:23.603 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:23.603 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:23.603 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-10T23:41:23.603 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:23.603 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:23.604 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:23.604 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-10T23:41:23.604 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:23.604 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:23.604 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:23.604 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-10T23:41:23.605 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:23.605 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:23.605 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:23.605 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-10T23:41:23.605 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:23.605 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:23.606 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:23.606 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-10T23:41:23.606 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:23.606 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:23.606 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:23.607 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-10T23:41:23.607 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:23.607 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:23.607 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:23.607 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-10T23:41:23.607 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:23.608 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:23.608 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:23.608 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-10T23:41:23.608 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:23.608 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:23.608 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:23.609 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:23.610 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:23.611 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:23.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:23 smithi016 ceph-mon[30855]: pgmap v355: 97 pgs: 97 active+clean; 1.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.4 MiB/s wr, 3.23k op/s 2024-09-10T23:41:24.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:23 smithi071 ceph-mon[35018]: pgmap v355: 97 pgs: 97 active+clean; 1.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.4 MiB/s wr, 3.23k op/s 2024-09-10T23:41:24.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:23 smithi066 ceph-mon[34761]: pgmap v355: 97 pgs: 97 active+clean; 1.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.4 MiB/s wr, 3.23k op/s 2024-09-10T23:41:24.055 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-10T23:41:24.055 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:24.055 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:24.055 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:24.055 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-10T23:41:24.056 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:24.057 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:24.059 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-10T23:41:24.060 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:24.061 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-10T23:41:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:24.063 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:24.063 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:24.063 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-10T23:41:24.063 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:24.063 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:24.063 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:24.063 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-10T23:41:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-10T23:41:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:24.402 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-10T23:41:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-10T23:41:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:24.404 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:24.405 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:24.406 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:24.407 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:24.881 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:24.881 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:24.882 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:24.883 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:24.884 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:24.884 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-10T23:41:24.884 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:24.884 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:24.884 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:24.885 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-10T23:41:24.885 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:24.885 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:24.885 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:24.885 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-10T23:41:24.885 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:24.886 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:24.886 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:24.886 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-10T23:41:24.886 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:24.886 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:24.886 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:24.887 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-10T23:41:24.887 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:24.887 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:24.887 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:24.887 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-10T23:41:24.887 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:24.888 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:24.888 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:24.888 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-10T23:41:24.888 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:24.888 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:24.889 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:24.890 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:24.891 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:25.493 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-10T23:41:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:25.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-10T23:41:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:25.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:25.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:25.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:25.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-10T23:41:25.856 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:25.856 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:25.857 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:25.858 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-10T23:41:25.859 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:25.859 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:25.859 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:25.859 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-10T23:41:25.859 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-10T23:41:25.860 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:25.861 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:25.861 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:25.861 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-10T23:41:25.861 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:25.861 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:25.863 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:25.864 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: pgmap v356: 97 pgs: 97 active+clean; 6.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 373 KiB/s wr, 2.55k op/s 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:25 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: pgmap v356: 97 pgs: 97 active+clean; 6.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 373 KiB/s wr, 2.55k op/s 2024-09-10T23:41:26.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:41:26.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:25 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: pgmap v356: 97 pgs: 97 active+clean; 6.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 373 KiB/s wr, 2.55k op/s 2024-09-10T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:25 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:26.194 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:26.194 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-10T23:41:26.194 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:26.194 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:26.194 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:26.195 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:26.196 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:26.197 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-10T23:41:26.198 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:26.199 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:26.200 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:26.201 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-10T23:41:26.201 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:26.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:26.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:26.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:26.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:26.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:26.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-10T23:41:26.702 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:26.703 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:26.703 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:26.703 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-10T23:41:26.703 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:26.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:26 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:41:26.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:26 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:41:26.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:26 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:27.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:26 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:41:27.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:26 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:41:27.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:26 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:27.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:26 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:41:27.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:26 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:41:27.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:26 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:41:27.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:27.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:27.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-10T23:41:27.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-10T23:41:27.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:27.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-10T23:41:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:27.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-10T23:41:27.130 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-10T23:41:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:27.132 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-10T23:41:27.133 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:27.133 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:27.133 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:27.133 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-10T23:41:27.133 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:27.133 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:27.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:27.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-10T23:41:27.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:27.495 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:27.496 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-10T23:41:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:27.498 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-10T23:41:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:27.500 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-10T23:41:27.501 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:27.502 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:27.502 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:27.837 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-10T23:41:27.837 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:27.838 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-10T23:41:27.840 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-10T23:41:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-10T23:41:28.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:27 smithi016 ceph-mon[30855]: pgmap v357: 97 pgs: 97 active+clean; 114 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 754 KiB/s wr, 2.66k op/s 2024-09-10T23:41:28.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:27 smithi071 ceph-mon[35018]: pgmap v357: 97 pgs: 97 active+clean; 114 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 754 KiB/s wr, 2.66k op/s 2024-09-10T23:41:28.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:27 smithi066 ceph-mon[34761]: pgmap v357: 97 pgs: 97 active+clean; 114 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 754 KiB/s wr, 2.66k op/s 2024-09-10T23:41:28.310 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:28.311 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:28.312 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-10T23:41:28.313 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:28.314 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-10T23:41:28.317 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:28.694 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:28.694 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:28.695 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:28.696 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-10T23:41:28.697 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:28.698 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:28.699 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-10T23:41:28.700 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-10T23:41:28.701 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:29.003 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:29.003 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:29.003 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-10T23:41:29.003 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:29.004 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-10T23:41:29.005 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:29.006 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:29.007 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-10T23:41:29.008 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:29.009 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:29.424 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:29.424 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:29.425 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:29.426 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-10T23:41:29.427 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:29.428 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:29.429 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:29.430 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:29.932 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-10T23:41:29.932 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:29.933 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:29.933 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:29.933 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-10T23:41:29.933 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:29.933 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:29.933 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:29.934 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-10T23:41:29.934 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:29.934 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:29.934 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:29.934 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-10T23:41:29.934 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:29.934 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:29.935 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:29.935 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-10T23:41:29.935 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:29.935 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:29.935 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:29.935 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-10T23:41:29.936 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:29.936 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:29.936 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:29.936 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-10T23:41:29.936 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:29.936 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:29.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:29.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-10T23:41:29.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:29.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:29.937 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:29.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-10T23:41:29.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:29.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:29.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:29.938 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-10T23:41:29.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:29.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:29.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:29.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-10T23:41:29.939 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:29.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:29.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:29.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-10T23:41:29.940 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:29.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:29.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:29.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-10T23:41:29.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:29.941 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:29.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:29.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-10T23:41:29.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:29.942 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:29.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:29.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-10T23:41:29.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:29.943 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:29.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:29.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-10T23:41:29.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:29.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:29.944 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:29.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-10T23:41:29.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:29.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:29.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:29.945 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-10T23:41:29.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:29.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:29.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:29.946 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-10T23:41:29.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:29.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:29.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:29.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-10T23:41:29.947 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:29.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:29.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:29.948 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-10T23:41:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:29 smithi016 ceph-mon[30855]: pgmap v358: 97 pgs: 97 active+clean; 326 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 71 MiB/s rd, 1.2 MiB/s wr, 2.86k op/s 2024-09-10T23:41:30.261 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:30.261 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:30.262 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:30.262 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-10T23:41:30.262 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:30.262 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:30.262 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:30.262 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-10T23:41:30.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:30.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:30.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:30.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-10T23:41:30.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:30.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:30.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:30.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-10T23:41:30.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:30.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:30.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:30.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-10T23:41:30.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:30.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:30.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:30.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-10T23:41:30.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:30.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:30.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:30.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-10T23:41:30.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:30.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:30.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:30.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-10T23:41:30.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:30.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:30.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:30.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-10T23:41:30.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:30.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:30.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:30.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-10T23:41:30.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:30.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:30.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:30.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-10T23:41:30.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:30.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:30.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:30.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-10T23:41:30.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:30.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:30.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:30.270 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-10T23:41:30.270 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:30.270 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:30.270 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:30.270 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-10T23:41:30.270 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:30.271 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:30.271 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:30.271 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-10T23:41:30.271 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:30.271 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:30.271 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-10T23:41:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-10T23:41:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:30.273 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:30.273 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-10T23:41:30.273 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:30.273 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:30.273 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:30.273 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-10T23:41:30.274 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:30.274 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:30.274 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:30.274 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-10T23:41:30.275 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:29 smithi071 ceph-mon[35018]: pgmap v358: 97 pgs: 97 active+clean; 326 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 71 MiB/s rd, 1.2 MiB/s wr, 2.86k op/s 2024-09-10T23:41:30.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:29 smithi066 ceph-mon[34761]: pgmap v358: 97 pgs: 97 active+clean; 326 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 71 MiB/s rd, 1.2 MiB/s wr, 2.86k op/s 2024-09-10T23:41:30.662 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:30.662 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:30.662 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:30.662 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-10T23:41:30.663 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:30.663 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:30.663 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:30.663 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-10T23:41:30.664 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:30.664 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:30.664 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:30.664 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-10T23:41:30.664 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:30.665 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:30.665 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:30.665 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-10T23:41:30.665 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:30.666 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:30.666 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:30.666 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-10T23:41:30.666 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:30.666 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:30.667 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:30.667 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-10T23:41:30.667 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:30.667 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:30.667 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:30.668 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-10T23:41:30.668 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:30.668 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:30.668 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:30.668 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-10T23:41:30.669 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:30.669 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:30.669 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:30.669 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-10T23:41:30.669 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:30.670 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:30.670 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:30.670 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-10T23:41:30.670 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-10T23:41:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:30.672 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:30.672 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-10T23:41:30.672 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:30.672 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:30.672 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:30.673 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-10T23:41:30.673 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:30.673 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:30.673 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:30.673 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-10T23:41:30.674 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:30.674 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:30.674 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:30.674 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-10T23:41:30.674 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:30.675 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:30.675 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:30.675 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-10T23:41:30.675 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:30.675 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:30.676 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:30.676 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-10T23:41:30.676 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:30.676 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:30.676 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:30.676 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-10T23:41:30.676 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:30.677 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:30.677 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:30.677 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-10T23:41:30.677 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:30.677 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:30.677 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:30.678 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-10T23:41:30.678 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:31.123 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:31.123 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:31.123 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-10T23:41:31.124 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:31.125 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-10T23:41:31.126 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:31.127 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-10T23:41:31.128 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:31.129 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:31.618 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-10T23:41:31.619 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:31.620 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:31.623 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:31.624 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:31.922 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-10T23:41:31.922 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:31.922 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:31.922 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:31.922 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:31.923 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:31.924 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-10T23:41:31.925 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:31.926 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:31.927 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:31.928 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-10T23:41:32.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:31 smithi016 ceph-mon[30855]: pgmap v359: 97 pgs: 97 active+clean; 306 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 1.2 MiB/s wr, 1.09k op/s 2024-09-10T23:41:32.262 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:32.263 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:32.264 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:32.265 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-10T23:41:32.266 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-10T23:41:32.267 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:32.268 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:32.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:32.269 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-10T23:41:32.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:31 smithi071 ceph-mon[35018]: pgmap v359: 97 pgs: 97 active+clean; 306 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 1.2 MiB/s wr, 1.09k op/s 2024-09-10T23:41:32.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:31 smithi066 ceph-mon[34761]: pgmap v359: 97 pgs: 97 active+clean; 306 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 73 MiB/s rd, 1.2 MiB/s wr, 1.09k op/s 2024-09-10T23:41:32.733 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:32.734 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-10T23:41:32.735 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:32.736 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:32.737 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-10T23:41:32.738 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-10T23:41:32.739 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:33.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:33.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:33.161 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:33.162 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:33.164 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-10T23:41:33.165 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-10T23:41:33.168 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:33.168 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:33.168 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:33.168 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-10T23:41:33.168 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:33.169 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:33.169 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:33.169 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-10T23:41:33.170 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:33.170 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:33.551 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:33.551 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-10T23:41:33.551 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:33.551 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:33.551 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:33.551 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-10T23:41:33.553 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:33.555 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:33.556 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-10T23:41:33.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:33.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:33.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:33.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-10T23:41:33.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:33.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:33.557 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:33.971 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-10T23:41:33.972 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:33.972 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:33.972 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:33.972 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-10T23:41:33.972 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:33.972 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:33.972 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:33.974 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-10T23:41:33.976 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:33.977 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:33.978 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-10T23:41:33.978 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:33.978 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:33.978 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:33.978 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-10T23:41:34.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:33 smithi016 ceph-mon[30855]: pgmap v360: 97 pgs: 97 active+clean; 207 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 131 MiB/s rd, 1.9 MiB/s wr, 1.30k op/s 2024-09-10T23:41:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:33 smithi071 ceph-mon[35018]: pgmap v360: 97 pgs: 97 active+clean; 207 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 131 MiB/s rd, 1.9 MiB/s wr, 1.30k op/s 2024-09-10T23:41:34.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:33 smithi066 ceph-mon[34761]: pgmap v360: 97 pgs: 97 active+clean; 207 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 131 MiB/s rd, 1.9 MiB/s wr, 1.30k op/s 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:34.453 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:34.454 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:34.455 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:34.456 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:34.457 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:34.459 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:34.459 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-10T23:41:34.809 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:34.809 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:34.809 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:34.809 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-10T23:41:34.810 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:34.810 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:34.810 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:34.810 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-10T23:41:34.810 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:34.810 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:34.811 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:34.811 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-10T23:41:34.811 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:34.811 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:34.811 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:34.811 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-10T23:41:34.812 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:34.812 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:34.812 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:34.812 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-10T23:41:34.812 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:34.812 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-10T23:41:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-10T23:41:34.814 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:34.814 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:34.814 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:34.814 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-10T23:41:34.814 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:34.814 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:34.815 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:34.815 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-10T23:41:34.815 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:34.815 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:34.815 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:34.815 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-10T23:41:34.816 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:34.816 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:34.816 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:34.816 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-10T23:41:34.816 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:34.816 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:34.817 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:34.817 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-10T23:41:34.817 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:34.817 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:34.817 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:34.817 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-10T23:41:34.818 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:34.818 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:34.818 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:34.818 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-10T23:41:34.818 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:34.818 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-10T23:41:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-10T23:41:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-10T23:41:34.821 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:35.117 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-10T23:41:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:35.119 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-10T23:41:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:35.122 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-10T23:41:35.123 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:35.123 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-10T23:41:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:35.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:35.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:35.167 INFO:tasks.workunit.client.0.smithi016.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-10T23:41:35.167 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T23:41:35.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T23:41:35.200 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-09-10T23:41:35.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T23:41:35.557 DEBUG:teuthology.parallel:result is None 2024-09-10T23:41:35.558 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:41:35.593 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T23:41:35.593 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-10T23:41:35.604 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-10T23:41:35.604 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:41:35.604 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:41:35.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-10T23:41:35.661 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-10T23:41:36.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:35 smithi016 ceph-mon[30855]: pgmap v361: 97 pgs: 97 active+clean; 259 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s rd, 1.9 MiB/s wr, 564 op/s 2024-09-10T23:41:36.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:35 smithi071 ceph-mon[35018]: pgmap v361: 97 pgs: 97 active+clean; 259 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s rd, 1.9 MiB/s wr, 564 op/s 2024-09-10T23:41:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:35 smithi066 ceph-mon[34761]: pgmap v361: 97 pgs: 97 active+clean; 259 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s rd, 1.9 MiB/s wr, 564 op/s 2024-09-10T23:41:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:37 smithi016 ceph-mon[30855]: pgmap v362: 97 pgs: 97 active+clean; 243 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 1.7 MiB/s wr, 601 op/s 2024-09-10T23:41:38.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:37 smithi071 ceph-mon[35018]: pgmap v362: 97 pgs: 97 active+clean; 243 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 1.7 MiB/s wr, 601 op/s 2024-09-10T23:41:38.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:37 smithi066 ceph-mon[34761]: pgmap v362: 97 pgs: 97 active+clean; 243 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 1.7 MiB/s wr, 601 op/s 2024-09-10T23:41:40.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:39 smithi016 ceph-mon[30855]: pgmap v363: 97 pgs: 97 active+clean; 83 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 1.8 MiB/s wr, 631 op/s 2024-09-10T23:41:40.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:39 smithi071 ceph-mon[35018]: pgmap v363: 97 pgs: 97 active+clean; 83 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 1.8 MiB/s wr, 631 op/s 2024-09-10T23:41:40.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:39 smithi066 ceph-mon[34761]: pgmap v363: 97 pgs: 97 active+clean; 83 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 173 MiB/s rd, 1.8 MiB/s wr, 631 op/s 2024-09-10T23:41:40.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:41:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:41.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 -- 172.21.15.16:0/3838979318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb650102130 msgr2=0x7fb65010ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 --2- 172.21.15.16:0/3838979318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb650102130 0x7fb65010ed20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb640009900 tx=0x7fb64002a410 comp rx=0 tx=0).stop 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 -- 172.21.15.16:0/3838979318 shutdown_connections 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 --2- 172.21.15.16:0/3838979318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb65010f2f0 0x7fb650111770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 --2- 172.21.15.16:0/3838979318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb650102130 0x7fb65010ed20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 --2- 172.21.15.16:0/3838979318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb650101810 0x7fb650101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 -- 172.21.15.16:0/3838979318 >> 172.21.15.16:0/3838979318 conn(0x7fb650076f50 msgr2=0x7fb650077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 -- 172.21.15.16:0/3838979318 shutdown_connections 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 -- 172.21.15.16:0/3838979318 wait complete. 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 Processor -- start 2024-09-10T23:41:41.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.545+0000 7fb6583df640 1 -- start start 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb6583df640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650101810 0x7fb65019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb6583df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb650102130 0x7fb65019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb6583df640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb65010f2f0 0x7fb6501a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb6583df640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb650114fc0 con 0x7fb65010f2f0 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb6583df640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb650114e40 con 0x7fb650102130 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb6583df640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb650115140 con 0x7fb650101810 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb65010f2f0 0x7fb6501a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb65010f2f0 0x7fb6501a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47394/0 (socket says 172.21.15.16:47394) 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 -- 172.21.15.16:0/2455387905 learned_addr learned my addr 172.21.15.16:0/2455387905 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65617b640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650101810 0x7fb65019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65597a640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb650102130 0x7fb65019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 -- 172.21.15.16:0/2455387905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650101810 msgr2=0x7fb65019b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650101810 0x7fb65019b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 -- 172.21.15.16:0/2455387905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb650102130 msgr2=0x7fb65019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb650102130 0x7fb65019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 -- 172.21.15.16:0/2455387905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6501a15c0 con 0x7fb65010f2f0 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65597a640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb650102130 0x7fb65019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb65697c640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb65010f2f0 0x7fb6501a0df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb64800eaa0 tx=0x7fb64800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:41.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.546+0000 7fb6477fe640 1 -- 172.21.15.16:0/2455387905 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648004d20 con 0x7fb65010f2f0 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.547+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6501a18b0 con 0x7fb65010f2f0 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.547+0000 7fb6477fe640 1 -- 172.21.15.16:0/2455387905 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb648005020 con 0x7fb65010f2f0 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.547+0000 7fb6477fe640 1 -- 172.21.15.16:0/2455387905 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6480116b0 con 0x7fb65010f2f0 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.547+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6501a7ff0 con 0x7fb65010f2f0 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.549+0000 7fb6477fe640 1 -- 172.21.15.16:0/2455387905 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb64800f040 con 0x7fb65010f2f0 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.549+0000 7fb65a7b4740 1 Processor -- start 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.549+0000 7fb65a7b4740 1 -- start start 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00480 0x55d797d00860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d0c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d0f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d797c76e50 con 0x55d797d0cd30 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d797c66280 con 0x55d797d00480 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d797c6a090 con 0x55d797d00da0 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65597a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d0f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65597a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d0f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47400/0 (socket says 172.21.15.16:47400) 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65597a640 1 -- 172.21.15.16:0/3853531595 learned_addr learned my addr 172.21.15.16:0/3853531595 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65617b640 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d0c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65597a640 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00480 0x55d797d00860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65617b640 1 -- 172.21.15.16:0/3853531595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00480 msgr2=0x55d797d00860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65617b640 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00480 0x55d797d00860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65617b640 1 -- 172.21.15.16:0/3853531595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 msgr2=0x55d797d0f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65617b640 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d0f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65617b640 1 -- 172.21.15.16:0/3853531595 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7979c4650 con 0x55d797d00da0 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65597a640 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d0f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb6477fe640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb63c0b5450 0x7fb63c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65617b640 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d0c7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0099a0 tx=0x7fb64c009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b42c9740e64cc1cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.550+0000 7fb65597a640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb63c0b5450 0x7fb63c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb6477fe640 1 -- 172.21.15.16:0/2455387905 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb6480e5ea0 con 0x7fb65010f2f0 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb644de6640 1 -- 172.21.15.16:0/3853531595 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c017070 con 0x55d797d00da0 2024-09-10T23:41:41.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb644de6640 1 -- 172.21.15.16:0/3853531595 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb64c013470 con 0x55d797d00da0 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb644de6640 1 -- 172.21.15.16:0/3853531595 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c012630 con 0x55d797d00da0 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3853531595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 msgr2=0x55d797d0c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb65597a640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb63c0b5450 0x7fb63c0b7910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb6400096c0 tx=0x7fb640031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d0c7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0099a0 tx=0x7fb64c009e60 comp rx=0 tx=0).stop 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3853531595 shutdown_connections 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.551+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d0f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d0c7f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3853531595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00480 0x55d797d00860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3853531595 >> 172.21.15.16:0/3853531595 conn(0x55d797cfe2b0 msgr2=0x55d797cff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3853531595 shutdown_connections 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3853531595 wait complete. 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 -- start start 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 Processor -- start 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00480 0x55d797d0c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00da0 0x55d797d099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d09ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d797ac7700 con 0x55d797d0cd30 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d797c01110 con 0x55d797d00da0 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.552+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d797d0f9b0 con 0x55d797d00480 2024-09-10T23:41:41.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65a7b4740 10 client.0 _ll_register_callbacks cb 0x55d797c1a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65697c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d09ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65617b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00480 0x55d797d0c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65697c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d09ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47416/0 (socket says 172.21.15.16:47416) 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65697c640 1 -- 172.21.15.16:0/872509731 learned_addr learned my addr 172.21.15.16:0/872509731 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65597a640 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00da0 0x55d797d099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65617b640 1 -- 172.21.15.16:0/872509731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00da0 msgr2=0x55d797d099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65617b640 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00da0 0x55d797d099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65617b640 1 -- 172.21.15.16:0/872509731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 msgr2=0x55d797d09ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65617b640 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d09ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65617b640 1 -- 172.21.15.16:0/872509731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d797c2ec40 con 0x55d797d00480 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65697c640 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d09ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65617b640 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00480 0x55d797d0c560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb64c000c00 tx=0x7fb64c013a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab8570a4dd44811 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb639ffb640 1 -- 172.21.15.16:0/872509731 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c017050 con 0x55d797d00480 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb639ffb640 1 -- 172.21.15.16:0/872509731 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb64c01c450 con 0x55d797d00480 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.553+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb64c013470 con 0x55d797d00480 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb639ffb640 1 -- 172.21.15.16:0/872509731 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb64c01c670 con 0x55d797d00480 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 10 client.25366 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:41.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d797d1b2b0 con 0x55d797d00480 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb639ffb640 1 -- 172.21.15.16:0/872509731 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb64c013470 con 0x55d797d00480 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb639ffb640 1 -- 172.21.15.16:0/872509731 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb64c0306a0 con 0x55d797d00480 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 10 client.25366 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 10 client.25366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 20 client.25366 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d1c600 0x55d797d1e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 4 client.25366 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d797c78da0 con 0x55d797d1c600 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.554+0000 7fb65597a640 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d1c600 0x55d797d1e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.555+0000 7fb639ffb640 10 client.25366 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.555+0000 7fb65597a640 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d1c600 0x55d797d1e9f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d6f3c2aedf1c546 server_cookie=e332a9a4997b061 in_seq=0 out_seq=0 2024-09-10T23:41:41.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.555+0000 7fb639ffb640 1 -- 172.21.15.16:0/872509731 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d797c78da0 con 0x55d797d1c600 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.555+0000 7fb639ffb640 10 client.25366 handle_command_reply: tid=0 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 client.25366 shutdown 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00480 msgr2=0x55d797d0c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00480 0x55d797d0c560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb64c000c00 tx=0x7fb64c013a00 comp rx=0 tx=0).stop 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 shutdown_connections 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d1c600 0x55d797d1e9f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d0cd30 0x55d797d09ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb639ffb640 0 client.25366 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d00da0 0x55d797d099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/872509731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00480 0x55d797d0c560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 >> 172.21.15.16:0/872509731 conn(0x55d797cfe2b0 msgr2=0x55d797d03e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 shutdown_connections 2024-09-10T23:41:41.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 1 -- 172.21.15.16:0/872509731 wait complete. 2024-09-10T23:41:41.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.556+0000 7fb65a7b4740 20 client.25366 trim_cache size 0 max 16384 2024-09-10T23:41:41.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 Processor -- start 2024-09-10T23:41:41.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 -- start start 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d09980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797cfd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d06bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501b31a0 con 0x55d797d00480 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501b0a70 con 0x55d797d0cd30 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501ae8c0 con 0x55d797d00da0 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.574+0000 7fb65617b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d09980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d09980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47426/0 (socket says 172.21.15.16:47426) 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 -- 172.21.15.16:0/1003600005 learned_addr learned my addr 172.21.15.16:0/1003600005 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65597a640 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797cfd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 -- 172.21.15.16:0/1003600005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 msgr2=0x55d797cfd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797cfd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 -- 172.21.15.16:0/1003600005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 msgr2=0x55d797d06bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d06bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 -- 172.21.15.16:0/1003600005 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d797cff9e0 con 0x55d797d00480 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65597a640 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797cfd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb65617b640 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d09980 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006aa0 tx=0x7fb64c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3444400c08bf6f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb63bfff640 1 -- 172.21.15.16:0/1003600005 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c017040 con 0x55d797d00480 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb63bfff640 1 -- 172.21.15.16:0/1003600005 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb64c0097f0 con 0x55d797d00480 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.575+0000 7fb63bfff640 1 -- 172.21.15.16:0/1003600005 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c01ccb0 con 0x55d797d00480 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 -- 172.21.15.16:0/1003600005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 msgr2=0x55d797d09980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d09980 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006aa0 tx=0x7fb64c0046c0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 -- 172.21.15.16:0/1003600005 shutdown_connections 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d06bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797cfd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/1003600005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d09980 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 -- 172.21.15.16:0/1003600005 >> 172.21.15.16:0/1003600005 conn(0x55d797cfe2b0 msgr2=0x55d797cfcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 -- 172.21.15.16:0/1003600005 shutdown_connections 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 -- 172.21.15.16:0/1003600005 wait complete. 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 -- start start 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.576+0000 7fb65a7b4740 1 Processor -- start 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d11930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d88220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501aef30 con 0x55d797d00480 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501b03a0 con 0x55d797d0cd30 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501af600 con 0x55d797d00da0 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 10 client.0 _ll_register_callbacks cb 0x7fb640009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d113f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47440/0 (socket says 172.21.15.16:47440) 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 -- 172.21.15.16:0/3329867919 learned_addr learned my addr 172.21.15.16:0/3329867919 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65697c640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d88220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65597a640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d11930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 -- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 msgr2=0x55d797d11930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d11930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 -- 172.21.15.16:0/3329867919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 msgr2=0x55d797d88220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d88220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 -- 172.21.15.16:0/3329867919 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d797d88800 con 0x55d797d00480 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65597a640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d11930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65697c640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d88220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65617b640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d113f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb64c010010 tx=0x7fb64c0308e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ada3f20117f7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb639ffb640 1 -- 172.21.15.16:0/3329867919 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c017070 con 0x55d797d00480 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb639ffb640 1 -- 172.21.15.16:0/3329867919 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb64c0059c0 con 0x55d797d00480 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.577+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb64c0097f0 con 0x55d797d00480 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb639ffb640 1 -- 172.21.15.16:0/3329867919 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb64c005bc0 con 0x55d797d00480 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 10 client.15666 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d797d89a80 con 0x55d797d00480 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb639ffb640 1 -- 172.21.15.16:0/3329867919 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb64c0097f0 con 0x55d797d00480 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb639ffb640 1 -- 172.21.15.16:0/3329867919 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb64c006240 con 0x55d797d00480 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 10 client.15666 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 20 client.15666 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:41.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d8a0f0 0x55d797d8c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 4 client.15666 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d797c74850 con 0x55d797d8a0f0 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.578+0000 7fb65597a640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d8a0f0 0x55d797d8c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65597a640 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d8a0f0 0x55d797d8c510 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d90d64c1187151eb server_cookie=98701aad6e10635 in_seq=0 out_seq=0 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb639ffb640 10 client.15666 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb639ffb640 1 -- 172.21.15.16:0/3329867919 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55d797c74850 con 0x55d797d8a0f0 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb639ffb640 10 client.15666 handle_command_reply: tid=0 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 client.15666 shutdown 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 msgr2=0x55d797d113f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d113f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb64c010010 tx=0x7fb64c0308e0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 shutdown_connections 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d797d8a0f0 0x55d797d8c510 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d797d0cd30 0x55d797d88220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d797d00da0 0x55d797d11930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 --2- 172.21.15.16:0/3329867919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d797d00480 0x55d797d113f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 >> 172.21.15.16:0/3329867919 conn(0x55d797cfe2b0 msgr2=0x55d797d0afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb639ffb640 0 client.15666 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 shutdown_connections 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 1 -- 172.21.15.16:0/3329867919 wait complete. 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.579+0000 7fb65a7b4740 20 client.15666 trim_cache size 0 max 16384 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:41:41.594 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:41:41.595 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:41.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:41.597 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:41.597 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:41:41.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb63c0b5450 msgr2=0x7fb63c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb63c0b5450 0x7fb63c0b7910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb6400096c0 tx=0x7fb640031400 comp rx=0 tx=0).stop 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb65010f2f0 msgr2=0x7fb6501a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb65010f2f0 0x7fb6501a0df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb64800eaa0 tx=0x7fb64800eea0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 shutdown_connections 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb65010f2f0 0x7fb6501a0df0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb63c0b5450 0x7fb63c0b7910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb650102130 0x7fb65019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 --2- 172.21.15.16:0/2455387905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb650101810 0x7fb65019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 >> 172.21.15.16:0/2455387905 conn(0x7fb650076f50 msgr2=0x7fb65010f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 shutdown_connections 2024-09-10T23:41:41.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:41.580+0000 7fb6583df640 1 -- 172.21.15.16:0/2455387905 wait complete. 2024-09-10T23:41:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:41 smithi016 ceph-mon[30855]: pgmap v364: 97 pgs: 97 active+clean; 35 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 440 op/s 2024-09-10T23:41:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:41 smithi071 ceph-mon[35018]: pgmap v364: 97 pgs: 97 active+clean; 35 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 440 op/s 2024-09-10T23:41:42.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:41 smithi066 ceph-mon[34761]: pgmap v364: 97 pgs: 97 active+clean; 35 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 128 MiB/s rd, 1.3 MiB/s wr, 440 op/s 2024-09-10T23:41:42.425 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:41:42.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:41:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.166+0000 7fca50a00640 1 -- 172.21.15.16:0/2505663880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c10cf60 msgr2=0x7fca4c10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.166+0000 7fca50a00640 1 --2- 172.21.15.16:0/2505663880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c10cf60 0x7fca4c10f3c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fca44009ca0 tx=0x7fca4402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 -- 172.21.15.16:0/2505663880 shutdown_connections 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 --2- 172.21.15.16:0/2505663880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c10cf60 0x7fca4c10f3c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 --2- 172.21.15.16:0/2505663880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c104420 0x7fca4c10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 --2- 172.21.15.16:0/2505663880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c103b00 0x7fca4c103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 -- 172.21.15.16:0/2505663880 >> 172.21.15.16:0/2505663880 conn(0x7fca4c0fd560 msgr2=0x7fca4c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 -- 172.21.15.16:0/2505663880 shutdown_connections 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 -- 172.21.15.16:0/2505663880 wait complete. 2024-09-10T23:41:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.167+0000 7fca50a00640 1 Processor -- start 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca50a00640 1 -- start start 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca50a00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c103b00 0x7fca4c198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca50a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c104420 0x7fca4c199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca50a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10cf60 0x7fca4c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca50a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c112c20 con 0x7fca4c104420 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca50a00640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c112aa0 con 0x7fca4c103b00 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca50a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c112da0 con 0x7fca4c10cf60 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c104420 0x7fca4c199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c104420 0x7fca4c199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47450/0 (socket says 172.21.15.16:47450) 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 -- 172.21.15.16:0/1726155632 learned_addr learned my addr 172.21.15.16:0/1726155632 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4ad9d640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c103b00 0x7fca4c198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4b59e640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10cf60 0x7fca4c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 -- 172.21.15.16:0/1726155632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10cf60 msgr2=0x7fca4c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10cf60 0x7fca4c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 -- 172.21.15.16:0/1726155632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c103b00 msgr2=0x7fca4c198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c103b00 0x7fca4c198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 -- 172.21.15.16:0/1726155632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c19f0a0 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.168+0000 7fca4a59c640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c104420 0x7fca4c199530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fca4000d750 tx=0x7fca4000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.169+0000 7fca33fff640 1 -- 172.21.15.16:0/1726155632 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40017070 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.169+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c19f390 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.169+0000 7fca33fff640 1 -- 172.21.15.16:0/1726155632 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca40009cd0 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.169+0000 7fca33fff640 1 -- 172.21.15.16:0/1726155632 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40003b20 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.169+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4c1a5c20 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.170+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca4c06b9d0 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.172+0000 7fca33fff640 1 -- 172.21.15.16:0/1726155632 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fca40003cc0 con 0x7fca4c104420 2024-09-10T23:41:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.173+0000 7fca33fff640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fca340b5500 0x7fca340b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.173+0000 7fca4ad9d640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fca340b5500 0x7fca340b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.173+0000 7fca33fff640 1 -- 172.21.15.16:0/1726155632 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fca400e5ca0 con 0x7fca4c104420 2024-09-10T23:41:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.173+0000 7fca4ad9d640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fca340b5500 0x7fca340b79c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00abe0 tx=0x7fca3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.176+0000 7fca33fff640 1 -- 172.21.15.16:0/1726155632 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca400ac820 con 0x7fca4c104420 2024-09-10T23:41:43.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.401+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca4c103ee0 con 0x7fca4c104420 2024-09-10T23:41:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.402+0000 7fca33fff640 1 -- 172.21.15.16:0/1726155632 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fca400ac120 con 0x7fca4c104420 2024-09-10T23:41:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:41:43.404 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:41:43.404 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:41:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fca340b5500 msgr2=0x7fca340b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fca340b5500 0x7fca340b79c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00abe0 tx=0x7fca3c00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c104420 msgr2=0x7fca4c199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c104420 0x7fca4c199530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fca4000d750 tx=0x7fca4000db50 comp rx=0 tx=0).stop 2024-09-10T23:41:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 shutdown_connections 2024-09-10T23:41:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca4c10cf60 0x7fca4c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c104420 0x7fca4c199530 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fca340b5500 0x7fca340b79c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 --2- 172.21.15.16:0/1726155632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fca4c103b00 0x7fca4c198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 >> 172.21.15.16:0/1726155632 conn(0x7fca4c0fd560 msgr2=0x7fca4c0fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 shutdown_connections 2024-09-10T23:41:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:43.404+0000 7fca50a00640 1 -- 172.21.15.16:0/1726155632 wait complete. 2024-09-10T23:41:44.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:43 smithi016 ceph-mon[30855]: pgmap v365: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 119 MiB/s rd, 1.3 MiB/s wr, 431 op/s 2024-09-10T23:41:44.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:43 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1726155632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:41:44.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:41:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:43 smithi071 ceph-mon[35018]: pgmap v365: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 119 MiB/s rd, 1.3 MiB/s wr, 431 op/s 2024-09-10T23:41:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:43 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1726155632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:41:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:43 smithi066 ceph-mon[34761]: pgmap v365: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 119 MiB/s rd, 1.3 MiB/s wr, 431 op/s 2024-09-10T23:41:44.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:43 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1726155632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:41:44.329 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:44.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 -- 172.21.15.16:0/3748847659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168108060 msgr2=0x7f616810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 --2- 172.21.15.16:0/3748847659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168108060 0x7f616810e860 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6160009900 tx=0x7f616002a410 comp rx=0 tx=0).stop 2024-09-10T23:41:44.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 -- 172.21.15.16:0/3748847659 shutdown_connections 2024-09-10T23:41:44.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 --2- 172.21.15.16:0/3748847659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168108060 0x7f616810e860 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 --2- 172.21.15.16:0/3748847659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61681076e0 0x7f6168107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 --2- 172.21.15.16:0/3748847659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6168101cd0 0x7f61681020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 -- 172.21.15.16:0/3748847659 >> 172.21.15.16:0/3748847659 conn(0x7f61680fd700 msgr2=0x7f61680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 -- 172.21.15.16:0/3748847659 shutdown_connections 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.809+0000 7f616d63a640 1 -- 172.21.15.16:0/3748847659 wait complete. 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 Processor -- start 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 -- start start 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168101cd0 0x7f6168199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61681076e0 0x7f61681997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6168108060 0x7f616819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6168111ce0 con 0x7f6168101cd0 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6168111b60 con 0x7f6168108060 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f616d63a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6168111e60 con 0x7f61681076e0 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168101cd0 0x7f6168199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168101cd0 0x7f6168199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54486/0 (socket says 172.21.15.16:54486) 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.810+0000 7f6166ffd640 1 -- 172.21.15.16:0/4138485565 learned_addr learned my addr 172.21.15.16:0/4138485565 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:44.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f61667fc640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61681076e0 0x7f61681997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f61677fe640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6168108060 0x7f616819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f6166ffd640 1 -- 172.21.15.16:0/4138485565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61681076e0 msgr2=0x7f61681997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f6166ffd640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61681076e0 0x7f61681997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f6166ffd640 1 -- 172.21.15.16:0/4138485565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6168108060 msgr2=0x7f616819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f6166ffd640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6168108060 0x7f616819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f6166ffd640 1 -- 172.21.15.16:0/4138485565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616819f310 con 0x7f6168101cd0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f61677fe640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6168108060 0x7f616819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f6166ffd640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168101cd0 0x7f6168199260 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f615800cce0 tx=0x7f615800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f614ffff640 1 -- 172.21.15.16:0/4138485565 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615800f650 con 0x7f6168101cd0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f614ffff640 1 -- 172.21.15.16:0/4138485565 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f615800fca0 con 0x7f6168101cd0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616819f600 con 0x7f6168101cd0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f614ffff640 1 -- 172.21.15.16:0/4138485565 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6158018b40 con 0x7f6168101cd0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.811+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61681a5cc0 con 0x7f6168101cd0 2024-09-10T23:41:44.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 Processor -- start 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f614ffff640 1 -- 172.21.15.16:0/4138485565 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f615800f7f0 con 0x7f6168101cd0 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 -- start start 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2aa64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cad2a1cea0 con 0x55cad2aa6a10 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cad2a0c2d0 con 0x55cad2aa60f0 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f616fa0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cad2a100e0 con 0x55cad2ab6db0 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54498/0 (socket says 172.21.15.16:54498) 2024-09-10T23:41:44.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 -- 172.21.15.16:0/4052109003 learned_addr learned my addr 172.21.15.16:0/4052109003 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f61667fc640 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f61677fe640 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2aa64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 -- 172.21.15.16:0/4052109003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 msgr2=0x55cad2ab91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 -- 172.21.15.16:0/4052109003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 msgr2=0x55cad2aa64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2aa64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.814+0000 7f6166ffd640 1 -- 172.21.15.16:0/4052109003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad276a650 con 0x55cad2aa6a10 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.815+0000 7f6166ffd640 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab6870 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f61580e3c20 tx=0x7f61580ec7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c91b3b9f148d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.815+0000 7f614d7fa640 1 -- 172.21.15.16:0/4052109003 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580fa070 con 0x55cad2aa6a10 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.815+0000 7f614d7fa640 1 -- 172.21.15.16:0/4052109003 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61580e6df0 con 0x55cad2aa6a10 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.815+0000 7f614d7fa640 1 -- 172.21.15.16:0/4052109003 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580f2950 con 0x55cad2aa6a10 2024-09-10T23:41:44.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.815+0000 7f614ffff640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61500b5450 0x7f61500b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.815+0000 7f61677fe640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61500b5450 0x7f61500b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.815+0000 7f614ffff640 1 -- 172.21.15.16:0/4138485565 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f61580e6530 con 0x7f6168101cd0 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- 172.21.15.16:0/4052109003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 msgr2=0x55cad2ab6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab6870 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f61580e3c20 tx=0x7f61580ec7d0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- 172.21.15.16:0/4052109003 shutdown_connections 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab6870 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 --2- 172.21.15.16:0/4052109003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2aa64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- 172.21.15.16:0/4052109003 >> 172.21.15.16:0/4052109003 conn(0x55cad2aa3f20 msgr2=0x55cad2aa50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f61677fe640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61500b5450 0x7f61500b7910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6160005ab0 tx=0x7f6160005e00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- 172.21.15.16:0/4052109003 shutdown_connections 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- 172.21.15.16:0/4052109003 wait complete. 2024-09-10T23:41:44.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- start start 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 Processor -- start 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2ab6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cad286d700 con 0x55cad2aa60f0 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cad29a7160 con 0x55cad2aa6a10 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f616fa0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cad2ab9a60 con 0x55cad2ab6db0 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.816+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2ab6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.853 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2ab6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54508/0 (socket says 172.21.15.16:54508) 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 -- 172.21.15.16:0/960204428 learned_addr learned my addr 172.21.15.16:0/960204428 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f616fa0f740 10 client.0 _ll_register_callbacks cb 0x55cad29c09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f61667fc640 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f61677fe640 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 -- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 msgr2=0x55cad2ab4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 -- 172.21.15.16:0/960204428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa6a10 msgr2=0x55cad2ab3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 -- 172.21.15.16:0/960204428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad29d4c90 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f6166ffd640 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2ab6650 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f61580ac9a0 tx=0x7f6158007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ba0e2f250ac446 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f614aff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f614aff5640 1 -- 172.21.15.16:0/960204428 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580a9060 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f614aff5640 1 -- 172.21.15.16:0/960204428 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f61580b11b0 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61580e6df0 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f614aff5640 1 -- 172.21.15.16:0/960204428 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61580ac180 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f616fa0f740 10 client.15684 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.817+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cad2ac5360 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f614aff5640 1 -- 172.21.15.16:0/960204428 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61580e6df0 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f614aff5640 1 -- 172.21.15.16:0/960204428 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f61580a8c80 con 0x55cad2aa60f0 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f616fa0f740 10 client.15684 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f616fa0f740 10 client.15684 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f616fa0f740 20 client.15684 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f616fa0f740 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2ac66b0 0x55cad2ac8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f616fa0f740 4 client.15684 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad2a1edf0 con 0x55cad2ac66b0 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.818+0000 7f61667fc640 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2ac66b0 0x55cad2ac8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f614aff5640 10 client.15684 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f61667fc640 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2ac66b0 0x55cad2ac8aa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=370319aa7d086683 server_cookie=a880a0ef078b8c1e in_seq=0 out_seq=0 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f614aff5640 1 -- 172.21.15.16:0/960204428 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cad2a1edf0 con 0x55cad2ac66b0 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f614aff5640 10 client.15684 handle_command_reply: tid=0 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 client.15684 shutdown 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 msgr2=0x55cad2ab6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2ab6650 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f61580ac9a0 tx=0x7f6158007f30 comp rx=0 tx=0).stop 2024-09-10T23:41:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 shutdown_connections 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2ac66b0 0x55cad2ac8aa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2ab4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 --2- 172.21.15.16:0/960204428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2ab6650 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.819+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 >> 172.21.15.16:0/960204428 conn(0x55cad2aa3f20 msgr2=0x55cad2aa9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.820+0000 7f614aff5640 0 client.15684 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.820+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 shutdown_connections 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.820+0000 7f616fa0f740 1 -- 172.21.15.16:0/960204428 wait complete. 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.820+0000 7f616fa0f740 20 client.15684 trim_cache size 0 max 16384 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 Processor -- start 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 -- start start 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2ab3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2aa5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61681aed10 con 0x55cad2aa6a10 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61681ac5e0 con 0x55cad2aa60f0 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.833+0000 7f616fa0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61681aa430 con 0x55cad2ab6db0 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54512/0 (socket says 172.21.15.16:54512) 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 -- 172.21.15.16:0/1986898304 learned_addr learned my addr 172.21.15.16:0/1986898304 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61677fe640 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2aa5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f6166ffd640 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2ab3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 -- 172.21.15.16:0/1986898304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 msgr2=0x55cad2aa5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2aa5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 -- 172.21.15.16:0/1986898304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 msgr2=0x55cad2ab3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2ab3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 -- 172.21.15.16:0/1986898304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad2ab6280 con 0x55cad2aa6a10 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f6166ffd640 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2ab3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f61667fc640 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6168103ce0 tx=0x7f615c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bc84b8886c88b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f614cff9640 1 -- 172.21.15.16:0/1986898304 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c01d470 con 0x55cad2aa6a10 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f614cff9640 1 -- 172.21.15.16:0/1986898304 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f615c01dac0 con 0x55cad2aa6a10 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.834+0000 7f614cff9640 1 -- 172.21.15.16:0/1986898304 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c01cba0 con 0x55cad2aa6a10 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 -- 172.21.15.16:0/1986898304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 msgr2=0x55cad2ab3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6168103ce0 tx=0x7f615c011810 comp rx=0 tx=0).stop 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 -- 172.21.15.16:0/1986898304 shutdown_connections 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2ab6db0 0x55cad2aa5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa6a10 0x55cad2ab3fb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 --2- 172.21.15.16:0/1986898304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2aa60f0 0x55cad2ab3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 -- 172.21.15.16:0/1986898304 >> 172.21.15.16:0/1986898304 conn(0x55cad2aa3f20 msgr2=0x55cad2ab7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:44.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 -- 172.21.15.16:0/1986898304 shutdown_connections 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.835+0000 7f616fa0f740 1 -- 172.21.15.16:0/1986898304 wait complete. 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 -- start start 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 Processor -- start 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2acbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2aa6a10 0x55cad2ac72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2ab6db0 0x55cad2ac7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61681aaaa0 con 0x55cad2aa60f0 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61681abf10 con 0x55cad2ab6db0 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.836+0000 7f616fa0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61681ab170 con 0x55cad2aa6a10 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f616fa0f740 10 client.0 _ll_register_callbacks cb 0x7f61580f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2acbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2acbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54522/0 (socket says 172.21.15.16:54522) 2024-09-10T23:41:44.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 -- 172.21.15.16:0/243378620 learned_addr learned my addr 172.21.15.16:0/243378620 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f61677fe640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2ab6db0 0x55cad2ac7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f61667fc640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2aa6a10 0x55cad2ac72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 -- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2aa6a10 msgr2=0x55cad2ac72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2aa6a10 0x55cad2ac72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 -- 172.21.15.16:0/243378620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2ab6db0 msgr2=0x55cad2ac7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2ab6db0 0x55cad2ac7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 -- 172.21.15.16:0/243378620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad2ac8060 con 0x55cad2aa60f0 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f61667fc640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2aa6a10 0x55cad2ac72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f6166ffd640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2acbe20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f61580a9c80 tx=0x7f61580ad270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7380ce044ca99986 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f614aff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f614aff5640 1 -- 172.21.15.16:0/243378620 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580ac360 con 0x55cad2aa60f0 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f614aff5640 1 -- 172.21.15.16:0/243378620 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f61580b5b10 con 0x55cad2aa60f0 2024-09-10T23:41:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.837+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f615c01dac0 con 0x55cad2aa60f0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f614aff5640 1 -- 172.21.15.16:0/243378620 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61580ac7e0 con 0x55cad2aa60f0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 10 client.15690 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cad2b33160 con 0x55cad2aa60f0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f614aff5640 1 -- 172.21.15.16:0/243378620 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f615c01dac0 con 0x55cad2aa60f0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f614aff5640 1 -- 172.21.15.16:0/243378620 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f615805c200 con 0x55cad2aa60f0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 10 client.15690 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 10 client.15690 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 20 client.15690 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2b336c0 0x55cad2b35ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 4 client.15690 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cad2a1a8a0 con 0x55cad2b336c0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.838+0000 7f61667fc640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2b336c0 0x55cad2b35ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f61667fc640 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2b336c0 0x55cad2b35ae0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11842a4531d5da90 server_cookie=6e32f61f6eaefce3 in_seq=0 out_seq=0 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f614aff5640 10 client.15690 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f614aff5640 1 -- 172.21.15.16:0/243378620 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cad2a1a8a0 con 0x55cad2b336c0 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f614aff5640 10 client.15690 handle_command_reply: tid=0 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 client.15690 shutdown 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 msgr2=0x55cad2acbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2acbe20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f61580a9c80 tx=0x7f61580ad270 comp rx=0 tx=0).stop 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 shutdown_connections 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55cad2b336c0 0x55cad2b35ae0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cad2ab6db0 0x55cad2ac7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cad2aa6a10 0x55cad2ac72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 --2- 172.21.15.16:0/243378620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cad2aa60f0 0x55cad2acbe20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 >> 172.21.15.16:0/243378620 conn(0x55cad2aa3f20 msgr2=0x55cad2aa5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f614aff5640 0 client.15690 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 shutdown_connections 2024-09-10T23:41:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 1 -- 172.21.15.16:0/243378620 wait complete. 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.839+0000 7f616fa0f740 20 client.15690 trim_cache size 0 max 16384 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61500b5450 msgr2=0x7f61500b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61500b5450 0x7f61500b7910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6160005ab0 tx=0x7f6160005e00 comp rx=0 tx=0).stop 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168101cd0 msgr2=0x7f6168199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168101cd0 0x7f6168199260 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f615800cce0 tx=0x7f615800a620 comp rx=0 tx=0).stop 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 shutdown_connections 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f61500b5450 0x7f61500b7910 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6168108060 0x7f616819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61681076e0 0x7f61681997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 --2- 172.21.15.16:0/4138485565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6168101cd0 0x7f6168199260 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 >> 172.21.15.16:0/4138485565 conn(0x7f61680fd700 msgr2=0x7f616806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 shutdown_connections 2024-09-10T23:41:44.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:44.840+0000 7f616d63a640 1 -- 172.21.15.16:0/4138485565 wait complete. 2024-09-10T23:41:45.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:41:45.771 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:46.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:45 smithi016 ceph-mon[30855]: pgmap v366: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 650 KiB/s wr, 228 op/s 2024-09-10T23:41:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:45 smithi071 ceph-mon[35018]: pgmap v366: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 650 KiB/s wr, 228 op/s 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.245+0000 7f4dec2b3640 1 -- 172.21.15.16:0/343913920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de4102dc0 msgr2=0x7f4de41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.245+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/343913920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de4102dc0 0x7f4de41031a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009900 tx=0x7f4de002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 -- 172.21.15.16:0/343913920 shutdown_connections 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/343913920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4de4109150 0x7f4de410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/343913920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de41087d0 0x7f4de4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/343913920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de4102dc0 0x7f4de41031a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 -- 172.21.15.16:0/343913920 >> 172.21.15.16:0/343913920 conn(0x7f4de40fe830 msgr2=0x7f4de4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 -- 172.21.15.16:0/343913920 shutdown_connections 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 -- 172.21.15.16:0/343913920 wait complete. 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 Processor -- start 2024-09-10T23:41:46.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 -- start start 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4de4102dc0 0x7f4de40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de41087d0 0x7f4de40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de4109150 0x7f4de4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.246+0000 7f4dec2b3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4de4112e60 con 0x7f4de41087d0 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4dec2b3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4de4112ce0 con 0x7f4de4102dc0 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4dec2b3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4de4112fe0 con 0x7f4de4109150 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de41087d0 0x7f4de40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de41087d0 0x7f4de40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54536/0 (socket says 172.21.15.16:54536) 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 -- 172.21.15.16:0/3903580334 learned_addr learned my addr 172.21.15.16:0/3903580334 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4dea04f640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4de4102dc0 0x7f4de40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4dea850640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de4109150 0x7f4de4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 -- 172.21.15.16:0/3903580334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de4109150 msgr2=0x7f4de4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de4109150 0x7f4de4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 -- 172.21.15.16:0/3903580334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4de4102dc0 msgr2=0x7f4de40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4de4102dc0 0x7f4de40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 -- 172.21.15.16:0/3903580334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de41a7690 con 0x7f4de41087d0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4dea850640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de4109150 0x7f4de4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4de984e640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de41087d0 0x7f4de40759e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c970 tx=0x7f4dd400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4ddb7fe640 1 -- 172.21.15.16:0/3903580334 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4007bb0 con 0x7f4de41087d0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de41a7980 con 0x7f4de41087d0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4ddb7fe640 1 -- 172.21.15.16:0/3903580334 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dd4007d50 con 0x7f4de41087d0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4ddb7fe640 1 -- 172.21.15.16:0/3903580334 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400f450 con 0x7f4de41087d0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.247+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de41a7ec0 con 0x7f4de41087d0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 Processor -- start 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 -- start start 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4ddb7fe640 1 -- 172.21.15.16:0/3903580334 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4dd4004f20 con 0x7f4de41087d0 2024-09-10T23:41:46.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d394d0 0x5563e1d398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d45840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d45d80 0x5563e1d48170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563e1cafea0 con 0x5563e1d394d0 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5563e1c9f2d0 con 0x5563e1d39df0 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dee688740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5563e1ca30e0 con 0x5563e1d45d80 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dea850640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d394d0 0x5563e1d398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dea850640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d394d0 0x5563e1d398b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54548/0 (socket says 172.21.15.16:54548) 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dea850640 1 -- 172.21.15.16:0/4060947160 learned_addr learned my addr 172.21.15.16:0/4060947160 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.250+0000 7f4dea04f640 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d45840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4de984e640 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d45d80 0x5563e1d48170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dea850640 1 -- 172.21.15.16:0/4060947160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d45d80 msgr2=0x5563e1d48170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dea850640 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d45d80 0x5563e1d48170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dea850640 1 -- 172.21.15.16:0/4060947160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 msgr2=0x5563e1d45840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dea850640 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d45840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dea850640 1 -- 172.21.15.16:0/4060947160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e19fd650 con 0x5563e1d394d0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dea850640 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d394d0 0x5563e1d398b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc008e60 tx=0x7f4ddc00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e8b205ca605309 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4ddb7fe640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4dd00b5450 0x7f4dd00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dd8de6640 1 -- 172.21.15.16:0/4060947160 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc004d20 con 0x5563e1d394d0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dea04f640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4dd00b5450 0x7f4dd00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dd8de6640 1 -- 172.21.15.16:0/4060947160 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ddc00fae0 con 0x5563e1d394d0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4dd8de6640 1 -- 172.21.15.16:0/4060947160 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc005650 con 0x5563e1d394d0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.251+0000 7f4ddb7fe640 1 -- 172.21.15.16:0/3903580334 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4dd40e5d80 con 0x7f4de41087d0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 -- 172.21.15.16:0/4060947160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d394d0 msgr2=0x5563e1d398b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dea04f640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4dd00b5450 0x7f4dd00b7910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4de0000c00 tx=0x7f4de0005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d394d0 0x5563e1d398b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc008e60 tx=0x7f4ddc00d710 comp rx=0 tx=0).stop 2024-09-10T23:41:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 -- 172.21.15.16:0/4060947160 shutdown_connections 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d45d80 0x5563e1d48170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d45840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 --2- 172.21.15.16:0/4060947160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d394d0 0x5563e1d398b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 -- 172.21.15.16:0/4060947160 >> 172.21.15.16:0/4060947160 conn(0x5563e1d37300 msgr2=0x5563e1d384a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 -- 172.21.15.16:0/4060947160 shutdown_connections 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 -- 172.21.15.16:0/4060947160 wait complete. 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.252+0000 7f4dee688740 1 -- start start 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 1 Processor -- start 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d42af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563e1b00700 con 0x5563e1d45d80 2024-09-10T23:41:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5563e1c3a160 con 0x5563e1d39df0 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5563e1d48a00 con 0x5563e1d394d0 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dee688740 10 client.0 _ll_register_callbacks cb 0x5563e1c539e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d43120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54554/0 (socket says 172.21.15.16:54554) 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 -- 172.21.15.16:0/1542936476 learned_addr learned my addr 172.21.15.16:0/1542936476 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4de984e640 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d42af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea04f640 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 -- 172.21.15.16:0/1542936476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 msgr2=0x5563e1d456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 -- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 msgr2=0x5563e1d42af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d42af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.253+0000 7f4dea850640 1 -- 172.21.15.16:0/1542936476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e1c67c90 con 0x5563e1d45d80 2024-09-10T23:41:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dea850640 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d43120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc005270 tx=0x7f4ddc005110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ddcd046007ea59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1542936476 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc027060 con 0x5563e1d45d80 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1542936476 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4ddc004c50 con 0x5563e1d45d80 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ddc00fae0 con 0x5563e1d45d80 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1542936476 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ddc0053d0 con 0x5563e1d45d80 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 10 client.15702 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5563e1d54360 con 0x5563e1d45d80 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1542936476 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ddc00fae0 con 0x5563e1d45d80 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1542936476 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4ddc02c950 con 0x5563e1d45d80 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 10 client.15702 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 10 client.15702 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 20 client.15702 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1d557c0 0x5563e1d57bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 4 client.15702 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.254+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563e1cb1df0 con 0x5563e1d557c0 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.255+0000 7f4dea04f640 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1d557c0 0x5563e1d57bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.255+0000 7f4dea04f640 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1d557c0 0x5563e1d57bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a09ed761b63aab6 server_cookie=77202a8ce5143632 in_seq=0 out_seq=0 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.255+0000 7f4dcdffb640 10 client.15702 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1542936476 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563e1cb1df0 con 0x5563e1d557c0 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dcdffb640 10 client.15702 handle_command_reply: tid=0 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 client.15702 shutdown 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 msgr2=0x5563e1d43120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d43120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc005270 tx=0x7f4ddc005110 comp rx=0 tx=0).stop 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 shutdown_connections 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1d557c0 0x5563e1d57bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d43120 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d39df0 0x5563e1d42af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dcdffb640 0 client.15702 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:46.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 --2- 172.21.15.16:0/1542936476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 >> 172.21.15.16:0/1542936476 conn(0x5563e1d37300 msgr2=0x5563e1d3cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:46.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 shutdown_connections 2024-09-10T23:41:46.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 1 -- 172.21.15.16:0/1542936476 wait complete. 2024-09-10T23:41:46.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.256+0000 7f4dee688740 20 client.15702 trim_cache size 0 max 16384 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 Processor -- start 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 -- start start 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d394d0 0x5563e1d51c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d39df0 0x5563e1d38430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d38970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41b3090 con 0x5563e1d45d80 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41b0960 con 0x5563e1d394d0 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dee688740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41ae7b0 con 0x5563e1d39df0 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dea850640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d38970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dea850640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d38970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54570/0 (socket says 172.21.15.16:54570) 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dea850640 1 -- 172.21.15.16:0/1734379065 learned_addr learned my addr 172.21.15.16:0/1734379065 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4dea04f640 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d394d0 0x5563e1d51c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.270+0000 7f4de984e640 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d39df0 0x5563e1d38430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dea850640 1 -- 172.21.15.16:0/1734379065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d39df0 msgr2=0x5563e1d38430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dea850640 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d39df0 0x5563e1d38430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dea850640 1 -- 172.21.15.16:0/1734379065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d394d0 msgr2=0x5563e1d51c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dea850640 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d394d0 0x5563e1d51c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dea850640 1 -- 172.21.15.16:0/1734379065 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e1d43700 con 0x5563e1d45d80 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dea850640 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d38970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc000f80 tx=0x7f4ddc005180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32a987216552bec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dcffff640 1 -- 172.21.15.16:0/1734379065 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc027070 con 0x5563e1d45d80 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dcffff640 1 -- 172.21.15.16:0/1734379065 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ddc01c070 con 0x5563e1d45d80 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.271+0000 7f4dcffff640 1 -- 172.21.15.16:0/1734379065 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc004c50 con 0x5563e1d45d80 2024-09-10T23:41:46.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- 172.21.15.16:0/1734379065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 msgr2=0x5563e1d38970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d38970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc000f80 tx=0x7f4ddc005180 comp rx=0 tx=0).stop 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- 172.21.15.16:0/1734379065 shutdown_connections 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d45d80 0x5563e1d38970 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d39df0 0x5563e1d38430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 --2- 172.21.15.16:0/1734379065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d394d0 0x5563e1d51c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- 172.21.15.16:0/1734379065 >> 172.21.15.16:0/1734379065 conn(0x5563e1d37300 msgr2=0x5563e1d3dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- 172.21.15.16:0/1734379065 shutdown_connections 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- 172.21.15.16:0/1734379065 wait complete. 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- start start 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 Processor -- start 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d4de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d39df0 0x5563e1d4e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d45d80 0x5563e1d48c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41aee20 con 0x5563e1d39df0 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41b0290 con 0x5563e1d45d80 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.272+0000 7f4dee688740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41af4f0 con 0x5563e1d394d0 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dee688740 10 client.0 _ll_register_callbacks cb 0x7f4de0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d39df0 0x5563e1d4e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d39df0 0x5563e1d4e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54586/0 (socket says 172.21.15.16:54586) 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 -- 172.21.15.16:0/1468907900 learned_addr learned my addr 172.21.15.16:0/1468907900 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dea04f640 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d4de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dea850640 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d45d80 0x5563e1d48c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 -- 172.21.15.16:0/1468907900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 msgr2=0x5563e1d4de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d4de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 -- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d45d80 msgr2=0x5563e1d48c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:46.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d45d80 0x5563e1d48c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 -- 172.21.15.16:0/1468907900 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e1d32990 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4de984e640 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d39df0 0x5563e1d4e3c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40058c0 tx=0x7f4dd40048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a5819e3b2cc4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1468907900 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd401d040 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1468907900 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4dd40b5560 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ddc01c070 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1468907900 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4dd40055f0 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dee688740 10 client.15708 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.273+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5563e1dc2bd0 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1468907900 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ddc01c070 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1468907900 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4dd40a7bb0 con 0x5563e1d39df0 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dee688740 10 client.15708 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:46.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dee688740 10 client.15708 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dee688740 20 client.15708 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dee688740 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1dc3350 0x5563e1dc5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dee688740 4 client.15708 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563e1cad8a0 con 0x5563e1dc3350 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.274+0000 7f4dea04f640 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1dc3350 0x5563e1dc5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dea04f640 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1dc3350 0x5563e1dc5770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=759c9eab24791f50 server_cookie=2d740e6886ec55a1 in_seq=0 out_seq=0 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dcdffb640 10 client.15708 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dcdffb640 1 -- 172.21.15.16:0/1468907900 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563e1cad8a0 con 0x5563e1dc3350 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dcdffb640 10 client.15708 handle_command_reply: tid=0 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 client.15708 shutdown 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d39df0 msgr2=0x5563e1d4e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d39df0 0x5563e1d4e3c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40058c0 tx=0x7f4dd40048d0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 shutdown_connections 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5563e1dc3350 0x5563e1dc5770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563e1d45d80 0x5563e1d48c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563e1d39df0 0x5563e1d4e3c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 --2- 172.21.15.16:0/1468907900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5563e1d394d0 0x5563e1d4de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 >> 172.21.15.16:0/1468907900 conn(0x5563e1d37300 msgr2=0x5563e1d383c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dcdffb640 0 client.15708 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 shutdown_connections 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 1 -- 172.21.15.16:0/1468907900 wait complete. 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.275+0000 7f4dee688740 20 client.15708 trim_cache size 0 max 16384 2024-09-10T23:41:46.291 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:41:46.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4dd00b5450 msgr2=0x7f4dd00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4dd00b5450 0x7f4dd00b7910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4de0000c00 tx=0x7f4de0005a20 comp rx=0 tx=0).stop 2024-09-10T23:41:46.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de41087d0 msgr2=0x7f4de40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:46.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de41087d0 0x7f4de40759e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c970 tx=0x7f4dd400ce30 comp rx=0 tx=0).stop 2024-09-10T23:41:46.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 shutdown_connections 2024-09-10T23:41:46.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4de4109150 0x7f4de4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de41087d0 0x7f4de40759e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4dd00b5450 0x7f4dd00b7910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 --2- 172.21.15.16:0/3903580334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4de4102dc0 0x7f4de40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:46.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 >> 172.21.15.16:0/3903580334 conn(0x7f4de40fe830 msgr2=0x7f4de4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:46.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 shutdown_connections 2024-09-10T23:41:46.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:46.276+0000 7f4dec2b3640 1 -- 172.21.15.16:0/3903580334 wait complete. 2024-09-10T23:41:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:45 smithi066 ceph-mon[34761]: pgmap v366: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 650 KiB/s wr, 228 op/s 2024-09-10T23:41:46.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:41:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:47.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 -- 172.21.15.16:0/266581610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 msgr2=0x7f534c107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 --2- 172.21.15.16:0/266581610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c107be0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5340009900 tx=0x7f534002a410 comp rx=0 tx=0).stop 2024-09-10T23:41:47.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 -- 172.21.15.16:0/266581610 shutdown_connections 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 --2- 172.21.15.16:0/266581610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f534c108120 0x7f534c10e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 --2- 172.21.15.16:0/266581610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c107be0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 --2- 172.21.15.16:0/266581610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f534c102920 0x7f534c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 -- 172.21.15.16:0/266581610 >> 172.21.15.16:0/266581610 conn(0x7f534c076f50 msgr2=0x7f534c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 -- 172.21.15.16:0/266581610 shutdown_connections 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 -- 172.21.15.16:0/266581610 wait complete. 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.711+0000 7f535200e640 1 Processor -- start 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f535200e640 1 -- start start 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f535200e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f534c102920 0x7f534c19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f535200e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f535200e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f534c108120 0x7f534c1a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f535200e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f534c111ca0 con 0x7f534c107780 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f535200e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f534c111b20 con 0x7f534c108120 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f535200e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f534c111e20 con 0x7f534c102920 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c19b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54594/0 (socket says 172.21.15.16:54594) 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 -- 172.21.15.16:0/3301313905 learned_addr learned my addr 172.21.15.16:0/3301313905 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534bfff640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f534c108120 0x7f534c1a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f534c102920 0x7f534c19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 -- 172.21.15.16:0/3301313905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f534c102920 msgr2=0x7f534c19b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f534c102920 0x7f534c19b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 -- 172.21.15.16:0/3301313905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f534c108120 msgr2=0x7f534c1a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f534c108120 0x7f534c1a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534affd640 1 -- 172.21.15.16:0/3301313905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c1a14d0 con 0x7f534c107780 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.712+0000 7f534bfff640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f534c108120 0x7f534c1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.713+0000 7f534affd640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c19b960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5340005940 tx=0x7f53400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.713+0000 7f5348ff9640 1 -- 172.21.15.16:0/3301313905 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534003f030 con 0x7f534c107780 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.713+0000 7f5348ff9640 1 -- 172.21.15.16:0/3301313905 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5340003cb0 con 0x7f534c107780 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.713+0000 7f5348ff9640 1 -- 172.21.15.16:0/3301313905 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340035070 con 0x7f534c107780 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.713+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c1a1760 con 0x7f534c107780 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.713+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c1a7e80 con 0x7f534c107780 2024-09-10T23:41:47.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 Processor -- start 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 -- start start 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273db48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f5348ff9640 1 -- 172.21.15.16:0/3301313905 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f534003bbf0 con 0x7f534c107780 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273db4df0 0x55c273dc0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273dc0d80 0x55c273dc3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c273d2aea0 con 0x55c273db44d0 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c273d1a2d0 con 0x55c273db4df0 2024-09-10T23:41:47.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f53543e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c273d1e0e0 con 0x55c273dc0d80 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f534bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273db48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f534bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273db48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54596/0 (socket says 172.21.15.16:54596) 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f534bfff640 1 -- 172.21.15.16:0/35712253 learned_addr learned my addr 172.21.15.16:0/35712253 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.716+0000 7f534b7fe640 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273db4df0 0x55c273dc0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534affd640 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273dc0d80 0x55c273dc3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534bfff640 1 -- 172.21.15.16:0/35712253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273dc0d80 msgr2=0x55c273dc3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534bfff640 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273dc0d80 0x55c273dc3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534bfff640 1 -- 172.21.15.16:0/35712253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273db4df0 msgr2=0x55c273dc0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534bfff640 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273db4df0 0x55c273dc0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534bfff640 1 -- 172.21.15.16:0/35712253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c273a78650 con 0x55c273db44d0 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534bfff640 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273db48b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5344007f40 tx=0x7f534400e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e461b148042405 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f5331ffb640 1 -- 172.21.15.16:0/35712253 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344014070 con 0x55c273db44d0 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f5331ffb640 1 -- 172.21.15.16:0/35712253 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5344004d20 con 0x55c273db44d0 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f5331ffb640 1 -- 172.21.15.16:0/35712253 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344005520 con 0x55c273db44d0 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f5348ff9640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f53340b54d0 0x7f53340b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f53340b54d0 0x7f53340b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.717+0000 7f5348ff9640 1 -- 172.21.15.16:0/3301313905 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5340106b30 con 0x7f534c107780 2024-09-10T23:41:47.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 -- 172.21.15.16:0/35712253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 msgr2=0x55c273db48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f53340b54d0 0x7f53340b7990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55c273db31e0 tx=0x7f533c00b4d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273db48b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5344007f40 tx=0x7f534400e7e0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 -- 172.21.15.16:0/35712253 shutdown_connections 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273dc0d80 0x55c273dc3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273db4df0 0x55c273dc0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 --2- 172.21.15.16:0/35712253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273db48b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 -- 172.21.15.16:0/35712253 >> 172.21.15.16:0/35712253 conn(0x55c273db2300 msgr2=0x55c273db34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 -- 172.21.15.16:0/35712253 shutdown_connections 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 -- 172.21.15.16:0/35712253 wait complete. 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.718+0000 7f53543e3740 1 -- start start 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 1 Processor -- start 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db44d0 0x55c273dc0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db4df0 0x55c273dbdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c273b7b700 con 0x55c273db4df0 2024-09-10T23:41:47.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c273cb5160 con 0x55c273dc0d80 2024-09-10T23:41:47.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c273dc3a00 con 0x55c273db44d0 2024-09-10T23:41:47.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f53543e3740 10 client.0 _ll_register_callbacks cb 0x55c273cce9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:47.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db4df0 0x55c273dbdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db4df0 0x55c273dbdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54610/0 (socket says 172.21.15.16:54610) 2024-09-10T23:41:47.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 -- 172.21.15.16:0/3556982251 learned_addr learned my addr 172.21.15.16:0/3556982251 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:47.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db44d0 0x55c273dc0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534bfff640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 -- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db44d0 msgr2=0x55c273dc0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db44d0 0x55c273dc0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 -- 172.21.15.16:0/3556982251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 msgr2=0x55c273dbe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 -- 172.21.15.16:0/3556982251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c273ce2c90 con 0x55c273db4df0 2024-09-10T23:41:47.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534bfff640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f534affd640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db4df0 0x55c273dbdae0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5340004650 tx=0x7f53401047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945f6951b67bcb71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.719+0000 7f532affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f532affd640 1 -- 172.21.15.16:0/3556982251 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340049070 con 0x55c273db4df0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f532affd640 1 -- 172.21.15.16:0/3556982251 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f53400cd470 con 0x55c273db4df0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5344004d20 con 0x55c273db4df0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f532affd640 1 -- 172.21.15.16:0/3556982251 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f53400ccde0 con 0x55c273db4df0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 10 client.15720 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c273dcf3f0 con 0x55c273db4df0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f532affd640 1 -- 172.21.15.16:0/3556982251 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5344004d20 con 0x55c273db4df0 2024-09-10T23:41:47.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f532affd640 1 -- 172.21.15.16:0/3556982251 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f53400d6110 con 0x55c273db4df0 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 10 client.15720 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 20 client.15720 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273dd2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 4 client.15720 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.720+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c273d2cdf0 con 0x55c273dd07b0 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.721+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273dd2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.721+0000 7f532affd640 10 client.15720 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.721+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273dd2bc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=265a6c0cdb6e4bc0 server_cookie=a0ff3b102502f4f5 in_seq=0 out_seq=0 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f532affd640 1 -- 172.21.15.16:0/3556982251 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c273d2cdf0 con 0x55c273dd07b0 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f532affd640 10 client.15720 handle_command_reply: tid=0 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 client.15720 shutdown 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db4df0 msgr2=0x55c273dbdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db4df0 0x55c273dbdae0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5340004650 tx=0x7f53401047e0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 shutdown_connections 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273dd2bc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f532affd640 0 client.15720 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db4df0 0x55c273dbdae0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 --2- 172.21.15.16:0/3556982251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db44d0 0x55c273dc0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 >> 172.21.15.16:0/3556982251 conn(0x55c273db2300 msgr2=0x55c273db7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 shutdown_connections 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 1 -- 172.21.15.16:0/3556982251 wait complete. 2024-09-10T23:41:47.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.722+0000 7f53543e3740 20 client.15720 trim_cache size 0 max 16384 2024-09-10T23:41:47.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.735+0000 7f53543e3740 1 Processor -- start 2024-09-10T23:41:47.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f53543e3740 1 -- start start 2024-09-10T23:41:47.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f53543e3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dcccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f53543e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273db1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f53543e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f53543e3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b2fc0 con 0x55c273db44d0 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f53543e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b0890 con 0x55c273dc0d80 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f53543e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1ae6e0 con 0x55c273db4df0 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dcccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dcccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54612/0 (socket says 172.21.15.16:54612) 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 -- 172.21.15.16:0/3788219087 learned_addr learned my addr 172.21.15.16:0/3788219087 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534affd640 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273db1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534bfff640 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 -- 172.21.15.16:0/3788219087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 msgr2=0x55c273db1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273db1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 -- 172.21.15.16:0/3788219087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 msgr2=0x55c273dbacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 -- 172.21.15.16:0/3788219087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c273db8590 con 0x55c273db44d0 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.736+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dcccc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f533c00bee0 tx=0x7f533c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e1eba5eee56ead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53317fa640 1 -- 172.21.15.16:0/3788219087 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c030420 con 0x55c273db44d0 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53317fa640 1 -- 172.21.15.16:0/3788219087 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533c02b030 con 0x55c273db44d0 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53317fa640 1 -- 172.21.15.16:0/3788219087 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c01d660 con 0x55c273db44d0 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 -- 172.21.15.16:0/3788219087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 msgr2=0x55c273dcccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dcccc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f533c00bee0 tx=0x7f533c018000 comp rx=0 tx=0).stop 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 -- 172.21.15.16:0/3788219087 shutdown_connections 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dbacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273db1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 --2- 172.21.15.16:0/3788219087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dcccc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 -- 172.21.15.16:0/3788219087 >> 172.21.15.16:0/3788219087 conn(0x55c273db2300 msgr2=0x55c273db0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 -- 172.21.15.16:0/3788219087 shutdown_connections 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.737+0000 7f53543e3740 1 -- 172.21.15.16:0/3788219087 wait complete. 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 -- start start 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 Processor -- start 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dc92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273dc57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dc5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1aed50 con 0x55c273db44d0 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b01c0 con 0x55c273dc0d80 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1af420 con 0x55c273db4df0 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f53543e3740 10 client.0 _ll_register_callbacks cb 0x7f534003bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:47.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f534b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dc92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f534b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dc92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54616/0 (socket says 172.21.15.16:54616) 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.738+0000 7f534b7fe640 1 -- 172.21.15.16:0/3673798511 learned_addr learned my addr 172.21.15.16:0/3673798511 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534affd640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273dc57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534bfff640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dc5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534b7fe640 1 -- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 msgr2=0x55c273dc57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273dc57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534b7fe640 1 -- 172.21.15.16:0/3673798511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 msgr2=0x55c273dc5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dc5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534b7fe640 1 -- 172.21.15.16:0/3673798511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c273dc6320 con 0x55c273db44d0 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534bfff640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dc5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534affd640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273dc57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f534b7fe640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dc92c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b840 tx=0x7f533c02fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33eb302d5ba3ee35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f532affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f532affd640 1 -- 172.21.15.16:0/3673798511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c02f690 con 0x55c273db44d0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f532affd640 1 -- 172.21.15.16:0/3673798511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f533c02f830 con 0x55c273db44d0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533c02b030 con 0x55c273db44d0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f532affd640 1 -- 172.21.15.16:0/3673798511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f533c005040 con 0x55c273db44d0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f53543e3740 10 client.15726 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.739+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c273e3e540 con 0x55c273db44d0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f532affd640 1 -- 172.21.15.16:0/3673798511 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533c02b030 con 0x55c273db44d0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f532affd640 1 -- 172.21.15.16:0/3673798511 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f533c01fce0 con 0x55c273db44d0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f53543e3740 10 client.15726 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f53543e3740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f53543e3740 20 client.15726 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f53543e3740 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273e40bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f53543e3740 4 client.15726 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c273d288a0 con 0x55c273dd07b0 2024-09-10T23:41:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.740+0000 7f534affd640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273e40bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f532affd640 10 client.15726 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f534affd640 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273e40bf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdd9380c087b2765 server_cookie=a8fcf68d4b4c2649 in_seq=0 out_seq=0 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f532affd640 1 -- 172.21.15.16:0/3673798511 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c273d288a0 con 0x55c273dd07b0 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f532affd640 10 client.15726 handle_command_reply: tid=0 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 client.15726 shutdown 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 msgr2=0x55c273dc92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dc92c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f533c00b840 tx=0x7f533c02fda0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 shutdown_connections 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55c273dd07b0 0x55c273e40bf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c273dc0d80 0x55c273dc5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c273db4df0 0x55c273dc57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 --2- 172.21.15.16:0/3673798511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c273db44d0 0x55c273dc92c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 >> 172.21.15.16:0/3673798511 conn(0x55c273db2300 msgr2=0x55c273db1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f532affd640 0 client.15726 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 shutdown_connections 2024-09-10T23:41:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 1 -- 172.21.15.16:0/3673798511 wait complete. 2024-09-10T23:41:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.741+0000 7f53543e3740 20 client.15726 trim_cache size 0 max 16384 2024-09-10T23:41:47.754 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f53340b54d0 msgr2=0x7f53340b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f53340b54d0 0x7f53340b7990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55c273db31e0 tx=0x7f533c00b4d0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 msgr2=0x7f534c19b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c19b960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5340005940 tx=0x7f53400042f0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 shutdown_connections 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f53340b54d0 0x7f53340b7990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f534c108120 0x7f534c1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f534c107780 0x7f534c19b960 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 --2- 172.21.15.16:0/3301313905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f534c102920 0x7f534c19b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 >> 172.21.15.16:0/3301313905 conn(0x7f534c076f50 msgr2=0x7f534c100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 shutdown_connections 2024-09-10T23:41:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:47.742+0000 7f535200e640 1 -- 172.21.15.16:0/3301313905 wait complete. 2024-09-10T23:41:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:47 smithi016 ceph-mon[30855]: pgmap v367: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 602 KiB/s wr, 200 op/s 2024-09-10T23:41:48.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:47 smithi071 ceph-mon[35018]: pgmap v367: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 602 KiB/s wr, 200 op/s 2024-09-10T23:41:48.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:47 smithi066 ceph-mon[34761]: pgmap v367: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 602 KiB/s wr, 200 op/s 2024-09-10T23:41:49.458 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:41:49.459 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:41:49.728 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:50.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:49 smithi016 ceph-mon[30855]: pgmap v368: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 530 KiB/s wr, 158 op/s 2024-09-10T23:41:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.246+0000 7ff88db47640 1 -- 172.21.15.16:0/755960606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8881045c0 msgr2=0x7ff88810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.246+0000 7ff88db47640 1 --2- 172.21.15.16:0/755960606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8881045c0 0x7ff88810cab0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009900 tx=0x7ff87c02a410 comp rx=0 tx=0).stop 2024-09-10T23:41:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 -- 172.21.15.16:0/755960606 shutdown_connections 2024-09-10T23:41:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 --2- 172.21.15.16:0/755960606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff88810d100 0x7ff88810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 --2- 172.21.15.16:0/755960606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8881045c0 0x7ff88810cab0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 --2- 172.21.15.16:0/755960606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff888103ca0 0x7ff888104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 -- 172.21.15.16:0/755960606 >> 172.21.15.16:0/755960606 conn(0x7ff8880fd700 msgr2=0x7ff8880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 -- 172.21.15.16:0/755960606 shutdown_connections 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 -- 172.21.15.16:0/755960606 wait complete. 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 Processor -- start 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.247+0000 7ff88db47640 1 -- start start 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff88db47640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff888103ca0 0x7ff8881992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff88db47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8881045c0 0x7ff888199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff88db47640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff88810d100 0x7ff88819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff88db47640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff888112db0 con 0x7ff88810d100 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff88db47640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff888112c30 con 0x7ff8881045c0 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff88db47640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff888112f30 con 0x7ff888103ca0 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff88810d100 0x7ff88819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff88810d100 0x7ff88819ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54638/0 (socket says 172.21.15.16:54638) 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 -- 172.21.15.16:0/1557087211 learned_addr learned my addr 172.21.15.16:0/1557087211 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff8877fe640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff888103ca0 0x7ff8881992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff886ffd640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8881045c0 0x7ff888199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 -- 172.21.15.16:0/1557087211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff888103ca0 msgr2=0x7ff8881992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff888103ca0 0x7ff8881992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 -- 172.21.15.16:0/1557087211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8881045c0 msgr2=0x7ff888199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8881045c0 0x7ff888199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 -- 172.21.15.16:0/1557087211 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88819f390 con 0x7ff88810d100 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff886ffd640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8881045c0 0x7ff888199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff887fff640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff88810d100 0x7ff88819ebc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b970 tx=0x7ff88000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.248+0000 7ff884ff9640 1 -- 172.21.15.16:0/1557087211 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880019070 con 0x7ff88810d100 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.249+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88819f680 con 0x7ff88810d100 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.249+0000 7ff884ff9640 1 -- 172.21.15.16:0/1557087211 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff880014440 con 0x7ff88810d100 2024-09-10T23:41:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.249+0000 7ff884ff9640 1 -- 172.21.15.16:0/1557087211 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8800075d0 con 0x7ff88810d100 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.249+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8881a5dc0 con 0x7ff88810d100 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 Processor -- start 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff884ff9640 1 -- 172.21.15.16:0/1557087211 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff88000cb40 con 0x7ff88810d100 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 -- start start 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6bfe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c10f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e6f6b74e60 con 0x55e6f6c0eba0 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e6f6b64290 con 0x55e6f6bfe800 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6f6b680a0 con 0x55e6f6bfdee0 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c10f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:53978/0 (socket says 172.21.15.16:53978) 2024-09-10T23:41:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.252+0000 7ff8877fe640 1 -- 172.21.15.16:0/2800644816 learned_addr learned my addr 172.21.15.16:0/2800644816 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff886ffd640 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6bfe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff886ffd640 1 -- 172.21.15.16:0/2800644816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 msgr2=0x55e6f6bfe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff886ffd640 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6bfe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff886ffd640 1 -- 172.21.15.16:0/2800644816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 msgr2=0x55e6f6c0e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff884ff9640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8700b5450 0x7ff8700b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff886ffd640 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff886ffd640 1 -- 172.21.15.16:0/2800644816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f68c2930 con 0x55e6f6c0eba0 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff8877fe640 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff887fff640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8700b5450 0x7ff8700b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff886ffd640 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c10f90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009230 tx=0x7ff87c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdde5b1baae980a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff884ff9640 1 -- 172.21.15.16:0/1557087211 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff8800e5760 con 0x7ff88810d100 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff86dffb640 1 -- 172.21.15.16:0/2800644816 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c035040 con 0x55e6f6c0eba0 2024-09-10T23:41:50.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff86dffb640 1 -- 172.21.15.16:0/2800644816 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff87c005030 con 0x55e6f6c0eba0 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.253+0000 7ff86dffb640 1 -- 172.21.15.16:0/2800644816 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0044e0 con 0x55e6f6c0eba0 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 -- 172.21.15.16:0/2800644816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 msgr2=0x55e6f6c10f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff887fff640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8700b5450 0x7ff8700b7910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff8800e2fc0 tx=0x7ff8800dc0b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c10f90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009230 tx=0x7ff87c031400 comp rx=0 tx=0).stop 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 -- 172.21.15.16:0/2800644816 shutdown_connections 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c10f90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/2800644816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6bfe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 -- 172.21.15.16:0/2800644816 >> 172.21.15.16:0/2800644816 conn(0x55e6f6bfbd10 msgr2=0x55e6f6bfceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 -- 172.21.15.16:0/2800644816 shutdown_connections 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 -- 172.21.15.16:0/2800644816 wait complete. 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.254+0000 7ff88ff1c740 1 -- start start 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 1 Processor -- start 2024-09-10T23:41:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c0c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e6f69c5890 con 0x55e6f6c0eba0 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e6f6afed40 con 0x55e6f6bfe800 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6f6c117f0 con 0x55e6f6bfdee0 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff88ff1c740 10 client.0 _ll_register_callbacks cb 0x55e6f6b62c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c0c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c0c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54662/0 (socket says 172.21.15.16:54662) 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff886ffd640 1 -- 172.21.15.16:0/3280278070 learned_addr learned my addr 172.21.15.16:0/3280278070 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.255+0000 7ff8877fe640 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff886ffd640 1 -- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 msgr2=0x55e6f6c0bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff886ffd640 1 -- 172.21.15.16:0/3280278070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 msgr2=0x55e6f6c0c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff886ffd640 1 -- 172.21.15.16:0/3280278070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f6c1ac50 con 0x55e6f6c0eba0 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c0c650 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff87c001eb0 tx=0x7ff87c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a674084f7ef05a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff866ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff866ffd640 1 -- 172.21.15.16:0/3280278070 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c035040 con 0x55e6f6c0eba0 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff866ffd640 1 -- 172.21.15.16:0/3280278070 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff87c004d00 con 0x55e6f6c0eba0 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff87c005030 con 0x55e6f6c0eba0 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff866ffd640 1 -- 172.21.15.16:0/3280278070 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff87c004020 con 0x55e6f6c0eba0 2024-09-10T23:41:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff88ff1c740 10 client.15738 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:50.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6f6c1d5e0 con 0x55e6f6c0eba0 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff866ffd640 1 -- 172.21.15.16:0/3280278070 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff87c005030 con 0x55e6f6c0eba0 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff866ffd640 1 -- 172.21.15.16:0/3280278070 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff87c03a040 con 0x55e6f6c0eba0 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff88ff1c740 10 client.15738 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff88ff1c740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff88ff1c740 20 client.15738 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.256+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c1e930 0x55e6f6c20d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.257+0000 7ff88ff1c740 4 client.15738 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:50.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.257+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6f6b76db0 con 0x55e6f6c1e930 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.257+0000 7ff8877fe640 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c1e930 0x55e6f6c20d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.257+0000 7ff866ffd640 10 client.15738 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.257+0000 7ff8877fe640 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c1e930 0x55e6f6c20d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7fb6114d15a98fb server_cookie=d56da3aacc753bd8 in_seq=0 out_seq=0 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff866ffd640 1 -- 172.21.15.16:0/3280278070 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6f6b76db0 con 0x55e6f6c1e930 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff866ffd640 10 client.15738 handle_command_reply: tid=0 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 client.15738 shutdown 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 msgr2=0x55e6f6c0c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c0c650 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff87c001eb0 tx=0x7ff87c02a410 comp rx=0 tx=0).stop 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 shutdown_connections 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c1e930 0x55e6f6c20d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c0c650 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff866ffd640 0 client.15738 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:50.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3280278070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 >> 172.21.15.16:0/3280278070 conn(0x55e6f6bfbd10 msgr2=0x55e6f6bfaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:50.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 shutdown_connections 2024-09-10T23:41:50.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3280278070 wait complete. 2024-09-10T23:41:50.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.258+0000 7ff88ff1c740 20 client.15738 trim_cache size 0 max 16384 2024-09-10T23:41:50.332 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:49 smithi066 ceph-mon[34761]: pgmap v368: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 530 KiB/s wr, 158 op/s 2024-09-10T23:41:50.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:49 smithi071 ceph-mon[35018]: pgmap v368: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 530 KiB/s wr, 158 op/s 2024-09-10T23:41:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.276+0000 7ff88ff1c740 1 Processor -- start 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff88ff1c740 1 -- start start 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c19a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881aeda0 con 0x55e6f6c0eba0 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881ac670 con 0x55e6f6bfe800 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881aa4c0 con 0x55e6f6bfdee0 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c19a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c19a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54672/0 (socket says 172.21.15.16:54672) 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 -- 172.21.15.16:0/3661106994 learned_addr learned my addr 172.21.15.16:0/3661106994 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff8877fe640 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 -- 172.21.15.16:0/3661106994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 msgr2=0x55e6f6c0c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 -- 172.21.15.16:0/3661106994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 msgr2=0x55e6f6c0b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 -- 172.21.15.16:0/3661106994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f6c04040 con 0x55e6f6c0eba0 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.277+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c19a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff87c003dc0 tx=0x7ff87c0041c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aac5e492a14a3d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff86d7fa640 1 -- 172.21.15.16:0/3661106994 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c035040 con 0x55e6f6c0eba0 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff86d7fa640 1 -- 172.21.15.16:0/3661106994 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff87c003aa0 con 0x55e6f6c0eba0 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff86d7fa640 1 -- 172.21.15.16:0/3661106994 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c004e10 con 0x55e6f6c0eba0 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3661106994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 msgr2=0x55e6f6c19a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c19a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff87c003dc0 tx=0x7ff87c0041c0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3661106994 shutdown_connections 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c19a80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6bfe800 0x55e6f6c0b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3661106994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c0c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3661106994 >> 172.21.15.16:0/3661106994 conn(0x55e6f6bfbd10 msgr2=0x55e6f6c0bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.278+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3661106994 shutdown_connections 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3661106994 wait complete. 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 -- start start 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 Processor -- start 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c22e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6bfe800 0x55e6f6c233b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c238f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881aab30 con 0x55e6f6bfe800 2024-09-10T23:41:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881abfa0 con 0x55e6f6c0eba0 2024-09-10T23:41:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881ab200 con 0x55e6f6bfdee0 2024-09-10T23:41:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff88ff1c740 10 client.0 _ll_register_callbacks cb 0x7ff87800a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.279+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6bfe800 0x55e6f6c233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6bfe800 0x55e6f6c233b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54686/0 (socket says 172.21.15.16:54686) 2024-09-10T23:41:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 -- 172.21.15.16:0/3178707535 learned_addr learned my addr 172.21.15.16:0/3178707535 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c22e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 -- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 msgr2=0x55e6f6c22e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c22e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 -- 172.21.15.16:0/3178707535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6c0eba0 msgr2=0x55e6f6c238f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c238f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 -- 172.21.15.16:0/3178707535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f6c8b6b0 con 0x55e6f6bfe800 2024-09-10T23:41:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff8877fe640 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6bfe800 0x55e6f6c233b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff87800a520 tx=0x7ff878010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269d348c9b55c105 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff866ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff866ffd640 1 -- 172.21.15.16:0/3178707535 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878028030 con 0x55e6f6bfe800 2024-09-10T23:41:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff866ffd640 1 -- 172.21.15.16:0/3178707535 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff878004020 con 0x55e6f6bfe800 2024-09-10T23:41:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff87c003aa0 con 0x55e6f6bfe800 2024-09-10T23:41:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff866ffd640 1 -- 172.21.15.16:0/3178707535 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff878032050 con 0x55e6f6bfe800 2024-09-10T23:41:50.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff88ff1c740 10 client.15744 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:50.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.280+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6f6c8ca60 con 0x55e6f6bfe800 2024-09-10T23:41:50.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff866ffd640 1 -- 172.21.15.16:0/3178707535 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff87c003aa0 con 0x55e6f6bfe800 2024-09-10T23:41:50.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff866ffd640 1 -- 172.21.15.16:0/3178707535 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff8780037b0 con 0x55e6f6bfe800 2024-09-10T23:41:50.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff88ff1c740 10 client.15744 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:50.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff88ff1c740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:50.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff88ff1c740 20 client.15744 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:50.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c8d210 0x55e6f6c8f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:50.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff88ff1c740 4 client.15744 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:41:50.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e6f6b72860 con 0x55e6f6c8d210 2024-09-10T23:41:50.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.281+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c8d210 0x55e6f6c8f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:50.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.282+0000 7ff886ffd640 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c8d210 0x55e6f6c8f630 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e8c117bc171cf4 server_cookie=881514461f7a055d in_seq=0 out_seq=0 2024-09-10T23:41:50.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.282+0000 7ff866ffd640 10 client.15744 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:50.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff866ffd640 1 -- 172.21.15.16:0/3178707535 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e6f6b72860 con 0x55e6f6c8d210 2024-09-10T23:41:50.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff866ffd640 10 client.15744 handle_command_reply: tid=0 2024-09-10T23:41:50.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 client.15744 shutdown 2024-09-10T23:41:50.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6bfe800 msgr2=0x55e6f6c233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6bfe800 0x55e6f6c233b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff87800a520 tx=0x7ff878010af0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 shutdown_connections 2024-09-10T23:41:50.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e6f6c8d210 0x55e6f6c8f630 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6f6c0eba0 0x55e6f6c238f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e6f6bfe800 0x55e6f6c233b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 --2- 172.21.15.16:0/3178707535 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f6bfdee0 0x55e6f6c22e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 >> 172.21.15.16:0/3178707535 conn(0x55e6f6bfbd10 msgr2=0x55e6f6c03850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:50.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.283+0000 7ff866ffd640 0 client.15744 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:50.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 shutdown_connections 2024-09-10T23:41:50.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88ff1c740 1 -- 172.21.15.16:0/3178707535 wait complete. 2024-09-10T23:41:50.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88ff1c740 20 client.15744 trim_cache size 0 max 16384 2024-09-10T23:41:50.349 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:41:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:41:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8", 2024-09-10T23:41:50.350 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:41:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:41:50.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8700b5450 msgr2=0x7ff8700b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8700b5450 0x7ff8700b7910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff8800e2fc0 tx=0x7ff8800dc0b0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff88810d100 msgr2=0x7ff88819ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:50.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff88810d100 0x7ff88819ebc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b970 tx=0x7ff88000be30 comp rx=0 tx=0).stop 2024-09-10T23:41:50.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 shutdown_connections 2024-09-10T23:41:50.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff88810d100 0x7ff88819ebc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff8700b5450 0x7ff8700b7910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8881045c0 0x7ff888199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 --2- 172.21.15.16:0/1557087211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff888103ca0 0x7ff8881992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:50.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 >> 172.21.15.16:0/1557087211 conn(0x7ff8880fd700 msgr2=0x7ff8880fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:50.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 shutdown_connections 2024-09-10T23:41:50.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:50.284+0000 7ff88db47640 1 -- 172.21.15.16:0/1557087211 wait complete. 2024-09-10T23:41:51.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:41:51.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:50 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:41:51.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:50 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:51.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:50 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:41:51.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:50 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:51.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:50 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:41:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:50 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:50 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:41:51.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:50 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:51.287 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:41:51.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:50 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:41:51.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:50 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:51.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:50 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:41:51.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:50 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:41:51.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 -- 172.21.15.16:0/1827179801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc10d150 msgr2=0x7f8dbc10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/1827179801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc10d150 0x7f8dbc10f560 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009ca0 tx=0x7f8db402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 -- 172.21.15.16:0/1827179801 shutdown_connections 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/1827179801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc10d150 0x7f8dbc10f560 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/1827179801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dbc1045a0 0x7f8dbc10cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/1827179801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dbc103ba0 0x7f8dbc103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 -- 172.21.15.16:0/1827179801 >> 172.21.15.16:0/1827179801 conn(0x7f8dbc0fd730 msgr2=0x7f8dbc0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 -- 172.21.15.16:0/1827179801 shutdown_connections 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.779+0000 7f8dc29f0640 1 -- 172.21.15.16:0/1827179801 wait complete. 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 Processor -- start 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 -- start start 2024-09-10T23:41:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc103ba0 0x7f8dbc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dbc1045a0 0x7f8dbc199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dbc10d150 0x7f8dbc19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc112d70 con 0x7f8dbc103ba0 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc112bf0 con 0x7f8dbc10d150 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc29f0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc112ef0 con 0x7f8dbc1045a0 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc103ba0 0x7f8dbc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc103ba0 0x7f8dbc199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54704/0 (socket says 172.21.15.16:54704) 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 -- 172.21.15.16:0/4195376541 learned_addr learned my addr 172.21.15.16:0/4195376541 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dbc10d150 0x7f8dbc19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8db3fff640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dbc1045a0 0x7f8dbc199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 -- 172.21.15.16:0/4195376541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dbc1045a0 msgr2=0x7f8dbc199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dbc1045a0 0x7f8dbc199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 -- 172.21.15.16:0/4195376541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dbc10d150 msgr2=0x7f8dbc19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dbc10d150 0x7f8dbc19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dbbfff640 1 -- 172.21.15.16:0/4195376541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc19f2f0 con 0x7f8dbc103ba0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.780+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dbc10d150 0x7f8dbc19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.781+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc103ba0 0x7f8dbc199240 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00d950 tx=0x7f8dac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.781+0000 7f8db9ffb640 1 -- 172.21.15.16:0/4195376541 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac017030 con 0x7f8dbc103ba0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.781+0000 7f8db9ffb640 1 -- 172.21.15.16:0/4195376541 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dac004020 con 0x7f8dbc103ba0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.781+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc19f5e0 con 0x7f8dbc103ba0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.781+0000 7f8db9ffb640 1 -- 172.21.15.16:0/4195376541 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0047a0 con 0x7f8dbc103ba0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.781+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc1a5e70 con 0x7f8dbc103ba0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.783+0000 7f8db9ffb640 1 -- 172.21.15.16:0/4195376541 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f8dac009a30 con 0x7f8dbc103ba0 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.783+0000 7f8dc4dc5740 1 Processor -- start 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.783+0000 7f8dc4dc5740 1 -- start start 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3480 0x557f08da3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3da0 0x557f08daf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08db2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f08d19e50 con 0x557f08dafd30 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557f08d09280 con 0x557f08da3da0 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557f08d0d090 con 0x557f08da3480 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08db2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08db2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54720/0 (socket says 172.21.15.16:54720) 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 -- 172.21.15.16:0/1256941550 learned_addr learned my addr 172.21.15.16:0/1256941550 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3480 0x557f08da3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3da0 0x557f08daf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 -- 172.21.15.16:0/1256941550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3480 msgr2=0x557f08da3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3480 0x557f08da3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 -- 172.21.15.16:0/1256941550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3da0 msgr2=0x557f08daf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3da0 0x557f08daf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 -- 172.21.15.16:0/1256941550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f08a67650 con 0x557f08dafd30 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db9ffb640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8da80b54d0 0x7f8da80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8da80b54d0 0x7f8da80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db3fff640 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08db2120 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009ae0 tx=0x7f8da400e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362b9ce179e3788c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.784+0000 7f8db9ffb640 1 -- 172.21.15.16:0/4195376541 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f8dac0e5af0 con 0x7f8dbc103ba0 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8db27fc640 1 -- 172.21.15.16:0/1256941550 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4016070 con 0x557f08dafd30 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8db27fc640 1 -- 172.21.15.16:0/1256941550 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da400ecc0 con 0x557f08dafd30 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8db27fc640 1 -- 172.21.15.16:0/1256941550 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4010680 con 0x557f08dafd30 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/1256941550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 msgr2=0x557f08db2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08db2120 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009ae0 tx=0x7f8da400e2f0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8da80b54d0 0x7f8da80b7990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8db4004af0 tx=0x7f8db4005d80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/1256941550 shutdown_connections 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08db2120 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3da0 0x557f08daf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/1256941550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3480 0x557f08da3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/1256941550 >> 172.21.15.16:0/1256941550 conn(0x557f08da12b0 msgr2=0x557f08da2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/1256941550 shutdown_connections 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.785+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/1256941550 wait complete. 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 -- start start 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 Processor -- start 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08daf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08da3da0 0x557f08dac950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08dafd30 0x557f08dace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f08b6a700 con 0x557f08da3da0 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557f08ca4110 con 0x557f08da3480 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557f08db29b0 con 0x557f08dafd30 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8dc4dc5740 10 client.0 _ll_register_callbacks cb 0x557f08cbd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08da3da0 0x557f08dac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08da3da0 0x557f08dac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54736/0 (socket says 172.21.15.16:54736) 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.786+0000 7f8db3fff640 1 -- 172.21.15.16:0/3007314154 learned_addr learned my addr 172.21.15.16:0/3007314154 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08dafd30 0x557f08dace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08daf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8db3fff640 1 -- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08dafd30 msgr2=0x557f08dace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8db3fff640 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08dafd30 0x557f08dace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8db3fff640 1 -- 172.21.15.16:0/3007314154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 msgr2=0x557f08daf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8db3fff640 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08daf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8db3fff640 1 -- 172.21.15.16:0/3007314154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f08cd1c40 con 0x557f08da3da0 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8db3fff640 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08da3da0 0x557f08dac950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005690 tx=0x7f8da40056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2c5ae3c3554e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8d9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3007314154 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4027020 con 0x557f08da3da0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3007314154 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f8da4004020 con 0x557f08da3da0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da400ecc0 con 0x557f08da3da0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3007314154 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8da4016050 con 0x557f08da3da0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8dc4dc5740 10 client.15756 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.787+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557f08dbe1f0 con 0x557f08da3da0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3007314154 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da400ecc0 con 0x557f08da3da0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3007314154 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8da400f040 con 0x557f08da3da0 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dc4dc5740 10 client.15756 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dc4dc5740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dc4dc5740 20 client.15756 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08dbf5f0 0x557f08dc19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dc4dc5740 4 client.15756 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:41:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f08d1bda0 con 0x557f08dbf5f0 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08dbf5f0 0x557f08dc19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8d9b7fe640 10 client.15756 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.788+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08dbf5f0 0x557f08dc19e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=105044d5ca6e7f4 server_cookie=3add2969b01ff652 in_seq=0 out_seq=0 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3007314154 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f08d1bda0 con 0x557f08dbf5f0 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8d9b7fe640 10 client.15756 handle_command_reply: tid=0 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 client.15756 shutdown 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08da3da0 msgr2=0x557f08dac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08da3da0 0x557f08dac950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005690 tx=0x7f8da40056c0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 shutdown_connections 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08dbf5f0 0x557f08dc19e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08dafd30 0x557f08dace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08da3da0 0x557f08dac950 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3007314154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08daf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8d9b7fe640 0 client.15756 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.789+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 >> 172.21.15.16:0/3007314154 conn(0x557f08da12b0 msgr2=0x557f08da6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.790+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 shutdown_connections 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.790+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3007314154 wait complete. 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.790+0000 7f8dc4dc5740 20 client.15756 trim_cache size 0 max 16384 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 Processor -- start 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 -- start start 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08da2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08da02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08da9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1b0eb0 con 0x557f08dafd30 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1ae780 con 0x557f08da3480 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1ac5d0 con 0x557f08da3da0 2024-09-10T23:41:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc0f8d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08da9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc0f8d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08da9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54748/0 (socket says 172.21.15.16:54748) 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/4264079011 learned_addr learned my addr 172.21.15.16:0/4264079011 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.807+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08da2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8db3fff640 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08da02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/4264079011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 msgr2=0x557f08da02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08da02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/4264079011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 msgr2=0x557f08da2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08da2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/4264079011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f08da1d30 con 0x557f08dafd30 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08da2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08da9b60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8db4032e50 tx=0x7f8db4043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c450f1362afb190 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8db1ffb640 1 -- 172.21.15.16:0/4264079011 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4032e80 con 0x557f08dafd30 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8db1ffb640 1 -- 172.21.15.16:0/4264079011 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db4036050 con 0x557f08dafd30 2024-09-10T23:41:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.808+0000 7f8db1ffb640 1 -- 172.21.15.16:0/4264079011 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db402fa40 con 0x557f08dafd30 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/4264079011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 msgr2=0x557f08da9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08da9b60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8db4032e50 tx=0x7f8db4043000 comp rx=0 tx=0).stop 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/4264079011 shutdown_connections 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08da9b60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08da02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/4264079011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08da2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/4264079011 >> 172.21.15.16:0/4264079011 conn(0x557f08da12b0 msgr2=0x557f08d9fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/4264079011 shutdown_connections 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/4264079011 wait complete. 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 -- start start 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 Processor -- start 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.809+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08db4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08db4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc4dc5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08e25340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1acc40 con 0x557f08dafd30 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1ae0b0 con 0x557f08da3480 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc4dc5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc1ad310 con 0x557f08da3da0 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc4dc5740 10 client.0 _ll_register_callbacks cb 0x7f8dac0e9470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08e25340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08e25340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54764/0 (socket says 172.21.15.16:54764) 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/3564984116 learned_addr learned my addr 172.21.15.16:0/3564984116 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8db3fff640 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08db4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08db4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 msgr2=0x557f08db4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08db4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/3564984116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 msgr2=0x557f08db4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:41:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08db4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 -- 172.21.15.16:0/3564984116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f08e25a50 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc0f8d640 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08e25340 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8db4032e20 tx=0x7f8db4032e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20dfe3d8127a9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8d9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3564984116 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4004000 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3564984116 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f8db40041a0 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.810+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8db4036050 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3564984116 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8db4064050 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 10 client.15762 fetch_fsmap learned FSMap version 25 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557f08e2cef0 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3564984116 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db4036050 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3564984116 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8db40305c0 con 0x557f08dafd30 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 10 client.15762 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:41:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 20 client.15762 populate_metadata read hostname 'smithi016' 2024-09-10T23:41:51.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08e2d550 0x557f08e2f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:41:51.846 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:41:51.846 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:41:51.846 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:41:51.846 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:41:51.846 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:51.846 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8", 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:51.847 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:51.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:41:51.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 4 client.15762 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f08d17850 con 0x557f08e2d550 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.811+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08e2d550 0x557f08e2f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dbbfff640 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08e2d550 0x557f08e2f940 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f5c299099ea4d45 server_cookie=a543566cbab33792 in_seq=0 out_seq=0 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8d9b7fe640 10 client.15762 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8d9b7fe640 1 -- 172.21.15.16:0/3564984116 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x557f08d17850 con 0x557f08e2d550 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8d9b7fe640 10 client.15762 handle_command_reply: tid=0 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 client.15762 shutdown 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 msgr2=0x557f08e25340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08e25340 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8db4032e20 tx=0x7f8db4032e80 comp rx=0 tx=0).stop 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 shutdown_connections 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557f08e2d550 0x557f08e2f940 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f08dafd30 0x557f08e25340 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557f08da3da0 0x557f08db4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 --2- 172.21.15.16:0/3564984116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f08da3480 0x557f08db4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 >> 172.21.15.16:0/3564984116 conn(0x557f08da12b0 msgr2=0x557f08dae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8d9b7fe640 0 client.15762 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 shutdown_connections 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 1 -- 172.21.15.16:0/3564984116 wait complete. 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.812+0000 7f8dc4dc5740 20 client.15762 trim_cache size 0 max 16384 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8da80b54d0 msgr2=0x7f8da80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8da80b54d0 0x7f8da80b7990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8db4004af0 tx=0x7f8db4005d80 comp rx=0 tx=0).stop 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc103ba0 msgr2=0x7f8dbc199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc103ba0 0x7f8dbc199240 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00d950 tx=0x7f8dac00de10 comp rx=0 tx=0).stop 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 shutdown_connections 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8da80b54d0 0x7f8da80b7990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dbc10d150 0x7f8dbc19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8dbc1045a0 0x7f8dbc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 --2- 172.21.15.16:0/4195376541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dbc103ba0 0x7f8dbc199240 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:41:51.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 >> 172.21.15.16:0/4195376541 conn(0x7f8dbc0fd730 msgr2=0x7f8dbc0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:41:51.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 shutdown_connections 2024-09-10T23:41:51.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:41:51.813+0000 7f8dc29f0640 1 -- 172.21.15.16:0/4195376541 wait complete. 2024-09-10T23:41:52.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:51 smithi016 ceph-mon[30855]: pgmap v369: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 16 op/s 2024-09-10T23:41:52.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:51 smithi071 ceph-mon[35018]: pgmap v369: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 16 op/s 2024-09-10T23:41:52.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:51 smithi066 ceph-mon[34761]: pgmap v369: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 16 op/s 2024-09-10T23:41:52.618 INFO:tasks.cephfs.filesystem:scrub status for tag:e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8 - {'path': '/', 'tag': 'e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8', 'options': 'recursive,force'} 2024-09-10T23:41:53.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:52 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:41:53.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:52 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:41:53.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:52 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:41:54.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:53 smithi016 ceph-mon[30855]: pgmap v370: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2024-09-10T23:41:54.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:53 smithi071 ceph-mon[35018]: pgmap v370: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2024-09-10T23:41:54.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:53 smithi066 ceph-mon[34761]: pgmap v370: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2024-09-10T23:41:56.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:55 smithi016 ceph-mon[30855]: pgmap v371: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:41:56.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:55 smithi071 ceph-mon[35018]: pgmap v371: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:41:56.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:55 smithi066 ceph-mon[34761]: pgmap v371: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:41:58.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:57 smithi016 ceph-mon[30855]: pgmap v372: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:41:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:57 smithi071 ceph-mon[35018]: pgmap v372: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:41:58.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:57 smithi066 ceph-mon[34761]: pgmap v372: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:42:00.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:41:59 smithi016 ceph-mon[30855]: pgmap v373: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-10T23:42:00.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:41:59 smithi071 ceph-mon[35018]: pgmap v373: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-10T23:42:00.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:41:59 smithi066 ceph-mon[34761]: pgmap v373: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-10T23:42:02.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:01 smithi016 ceph-mon[30855]: pgmap v374: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:42:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:01 smithi071 ceph-mon[35018]: pgmap v374: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:42:02.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:01 smithi066 ceph-mon[34761]: pgmap v374: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T23:42:04.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:03 smithi071 ceph-mon[35018]: pgmap v375: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:42:04.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:03 smithi066 ceph-mon[34761]: pgmap v375: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:42:04.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:03 smithi016 ceph-mon[30855]: pgmap v375: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:42:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:05 smithi071 ceph-mon[35018]: pgmap v376: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:06.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:05 smithi066 ceph-mon[34761]: pgmap v376: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:06.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:05 smithi016 ceph-mon[30855]: pgmap v376: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:08.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:07 smithi071 ceph-mon[35018]: pgmap v377: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:08.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:07 smithi066 ceph-mon[34761]: pgmap v377: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:08.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:07 smithi016 ceph-mon[30855]: pgmap v377: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:10.273 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:09 smithi071 ceph-mon[35018]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:42:10.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:09 smithi066 ceph-mon[34761]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:42:10.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:09 smithi016 ceph-mon[30855]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:42:12.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:11 smithi071 ceph-mon[35018]: pgmap v379: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:12.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:11 smithi066 ceph-mon[34761]: pgmap v379: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:12.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:11 smithi016 ceph-mon[30855]: pgmap v379: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:42:14.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:14 smithi071 ceph-mon[35018]: pgmap v380: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:42:14.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:14 smithi066 ceph-mon[34761]: pgmap v380: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:42:14.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:14 smithi016 ceph-mon[30855]: pgmap v380: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:42:16.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:16 smithi016 ceph-mon[30855]: pgmap v381: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:42:16.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:16 smithi071 ceph-mon[35018]: pgmap v381: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:42:16.513 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:16 smithi066 ceph-mon[34761]: pgmap v381: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:42:18.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:18 smithi071 ceph-mon[35018]: pgmap v382: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T23:42:18.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:18 smithi066 ceph-mon[34761]: pgmap v382: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T23:42:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:18 smithi016 ceph-mon[30855]: pgmap v382: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T23:42:20.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:20 smithi071 ceph-mon[35018]: pgmap v383: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:42:20.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:20 smithi066 ceph-mon[34761]: pgmap v383: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:42:20.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:20 smithi016 ceph-mon[30855]: pgmap v383: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T23:42:22.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:22 smithi071 ceph-mon[35018]: pgmap v384: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:42:22.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:22 smithi066 ceph-mon[34761]: pgmap v384: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:42:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:22 smithi016 ceph-mon[30855]: pgmap v384: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:42:22.620 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:42:22.895 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:42:23.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 -- 172.21.15.16:0/2821473555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 msgr2=0x7ffbf0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 --2- 172.21.15.16:0/2821473555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf0102070 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009900 tx=0x7ffbec02a410 comp rx=0 tx=0).stop 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 -- 172.21.15.16:0/2821473555 shutdown_connections 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 --2- 172.21.15.16:0/2821473555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbf0108020 0x7ffbf010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 --2- 172.21.15.16:0/2821473555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbf01076a0 0x7ffbf0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 --2- 172.21.15.16:0/2821473555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf0102070 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 -- 172.21.15.16:0/2821473555 >> 172.21.15.16:0/2821473555 conn(0x7ffbf00fd700 msgr2=0x7ffbf00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 -- 172.21.15.16:0/2821473555 shutdown_connections 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.376+0000 7ffbf809d640 1 -- 172.21.15.16:0/2821473555 wait complete. 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 Processor -- start 2024-09-10T23:42:23.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 -- start start 2024-09-10T23:42:23.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbf01076a0 0x7ffbf019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbf0108020 0x7ffbf019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0111ca0 con 0x7ffbf0101c90 2024-09-10T23:42:23.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0111b20 con 0x7ffbf0108020 2024-09-10T23:42:23.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf809d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0111e20 con 0x7ffbf01076a0 2024-09-10T23:42:23.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.377+0000 7ffbf5e39640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf019a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34554/0 (socket says 172.21.15.16:34554) 2024-09-10T23:42:23.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 -- 172.21.15.16:0/1075579323 learned_addr learned my addr 172.21.15.16:0/1075579323 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:23.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5638640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbf01076a0 0x7ffbf019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf663a640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbf0108020 0x7ffbf019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 -- 172.21.15.16:0/1075579323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbf01076a0 msgr2=0x7ffbf019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbf01076a0 0x7ffbf019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 -- 172.21.15.16:0/1075579323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbf0108020 msgr2=0x7ffbf019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbf0108020 0x7ffbf019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 -- 172.21.15.16:0/1075579323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf01a54d0 con 0x7ffbf0101c90 2024-09-10T23:42:23.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf5e39640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf019a0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffbec005940 tx=0x7ffbec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:23.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbe2ffd640 1 -- 172.21.15.16:0/1075579323 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec03f030 con 0x7ffbf0101c90 2024-09-10T23:42:23.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf01a5760 con 0x7ffbf0101c90 2024-09-10T23:42:23.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbe2ffd640 1 -- 172.21.15.16:0/1075579323 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbec003cb0 con 0x7ffbf0101c90 2024-09-10T23:42:23.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbe2ffd640 1 -- 172.21.15.16:0/1075579323 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec035070 con 0x7ffbf0101c90 2024-09-10T23:42:23.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.378+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf01a5c40 con 0x7ffbf0101c90 2024-09-10T23:42:23.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.381+0000 7ffbfa472740 1 Processor -- start 2024-09-10T23:42:23.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.381+0000 7ffbfa472740 1 -- start start 2024-09-10T23:42:23.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.381+0000 7ffbe2ffd640 1 -- 172.21.15.16:0/1075579323 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ffbec03bbf0 con 0x7ffbf0101c90 2024-09-10T23:42:23.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f37a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37ada0 0x55b72f3867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f389120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbfa472740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b72f2f0e50 con 0x55b72f37a480 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbfa472740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b72f2e0280 con 0x55b72f37ada0 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbfa472740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b72f2e4090 con 0x55b72f386d30 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f37a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f37a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34568/0 (socket says 172.21.15.16:34568) 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 -- 172.21.15.16:0/2304611726 learned_addr learned my addr 172.21.15.16:0/2304611726 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf5e39640 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37ada0 0x55b72f3867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf5638640 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f389120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 -- 172.21.15.16:0/2304611726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 msgr2=0x55b72f389120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f389120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 -- 172.21.15.16:0/2304611726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37ada0 msgr2=0x55b72f3867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37ada0 0x55b72f3867f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf663a640 1 -- 172.21.15.16:0/2304611726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72f03e650 con 0x55b72f37a480 2024-09-10T23:42:23.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.382+0000 7ffbf5638640 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f389120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:42:23.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.383+0000 7ffbf663a640 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f37a860 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800ae90 tx=0x7ffbe800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebada1cbfa2b437 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:23.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.383+0000 7ffbe2ffd640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffbdc0b5450 0x7ffbdc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.383+0000 7ffbdbfff640 1 -- 172.21.15.16:0/2304611726 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8003b70 con 0x55b72f37a480 2024-09-10T23:42:23.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.383+0000 7ffbdbfff640 1 -- 172.21.15.16:0/2304611726 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbe8003d10 con 0x55b72f37a480 2024-09-10T23:42:23.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.383+0000 7ffbdbfff640 1 -- 172.21.15.16:0/2304611726 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8010ba0 con 0x55b72f37a480 2024-09-10T23:42:23.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.383+0000 7ffbf5e39640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffbdc0b5450 0x7ffbdc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.383+0000 7ffbe2ffd640 1 -- 172.21.15.16:0/1075579323 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ffbec106a90 con 0x7ffbf0101c90 2024-09-10T23:42:23.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 -- 172.21.15.16:0/2304611726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 msgr2=0x55b72f37a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbf5e39640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffbdc0b5450 0x7ffbdc0b7910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffbec1042f0 tx=0x7ffbec10a5e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:23.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f37a860 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800ae90 tx=0x7ffbe800f790 comp rx=0 tx=0).stop 2024-09-10T23:42:23.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 -- 172.21.15.16:0/2304611726 shutdown_connections 2024-09-10T23:42:23.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f389120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37ada0 0x55b72f3867f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2304611726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f37a860 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 -- 172.21.15.16:0/2304611726 >> 172.21.15.16:0/2304611726 conn(0x55b72f3782b0 msgr2=0x55b72f379450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:23.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 -- 172.21.15.16:0/2304611726 shutdown_connections 2024-09-10T23:42:23.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 -- 172.21.15.16:0/2304611726 wait complete. 2024-09-10T23:42:23.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 -- start start 2024-09-10T23:42:23.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.384+0000 7ffbfa472740 1 Processor -- start 2024-09-10T23:42:23.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f386620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f383a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f3840a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbfa472740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b72f141700 con 0x55b72f37ada0 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbfa472740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b72f27b110 con 0x55b72f37a480 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbfa472740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b72f3899b0 con 0x55b72f386d30 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbfa472740 10 client.0 _ll_register_callbacks cb 0x55b72f294990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f383a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f383a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34578/0 (socket says 172.21.15.16:34578) 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 -- 172.21.15.16:0/483290562 learned_addr learned my addr 172.21.15.16:0/483290562 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf663a640 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f386620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf663a640 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f3840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 -- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 msgr2=0x55b72f3840a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f3840a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 -- 172.21.15.16:0/483290562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 msgr2=0x55b72f386620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f386620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.385+0000 7ffbf5638640 1 -- 172.21.15.16:0/483290562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72f2a8c40 con 0x55b72f37ada0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbf5638640 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f383a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400baa0 tx=0x7ffbe400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffb6d58c7a37f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbd97fa640 1 -- 172.21.15.16:0/483290562 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4003df0 con 0x55b72f37ada0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbd97fa640 1 -- 172.21.15.16:0/483290562 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ffbe4011440 con 0x55b72f37ada0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe8003d10 con 0x55b72f37ada0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbd97fa640 1 -- 172.21.15.16:0/483290562 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffbe4011640 con 0x55b72f37ada0 2024-09-10T23:42:23.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbfa472740 10 client.15774 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b72f395340 con 0x55b72f37ada0 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbd97fa640 1 -- 172.21.15.16:0/483290562 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbe4011c90 con 0x55b72f37ada0 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbd97fa640 1 -- 172.21.15.16:0/483290562 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffbe401ba70 con 0x55b72f37ada0 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.386+0000 7ffbfa472740 10 client.15774 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbfa472740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbfa472740 20 client.15774 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbfa472740 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f396800 0x55b72f398c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbfa472740 4 client.15774 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffbe8003d10 con 0x55b72f396800 2024-09-10T23:42:23.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbf663a640 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f396800 0x55b72f398c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbd97fa640 10 client.15774 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.387+0000 7ffbf663a640 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f396800 0x55b72f398c20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42439a3fbf7a5f6c server_cookie=d490c73c07d0b5df in_seq=0 out_seq=0 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbd97fa640 1 -- 172.21.15.16:0/483290562 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ffbe8003d10 con 0x55b72f396800 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbd97fa640 10 client.15774 handle_command_reply: tid=0 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 client.15774 shutdown 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 msgr2=0x55b72f383a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f383a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400baa0 tx=0x7ffbe400bf60 comp rx=0 tx=0).stop 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 shutdown_connections 2024-09-10T23:42:23.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f396800 0x55b72f398c20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f3840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f383a70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbd97fa640 0 client.15774 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 --2- 172.21.15.16:0/483290562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f386620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.388+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 >> 172.21.15.16:0/483290562 conn(0x55b72f3782b0 msgr2=0x55b72f37de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.389+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 shutdown_connections 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.389+0000 7ffbfa472740 1 -- 172.21.15.16:0/483290562 wait complete. 2024-09-10T23:42:23.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.389+0000 7ffbfa472740 20 client.15774 trim_cache size 0 max 16384 2024-09-10T23:42:23.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 Processor -- start 2024-09-10T23:42:23.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 -- start start 2024-09-10T23:42:23.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f37ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f388120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f388660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01b0f20 con 0x55b72f37ada0 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ae7f0 con 0x55b72f37a480 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.406+0000 7ffbfa472740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ac640 con 0x55b72f386d30 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f388120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f388120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34590/0 (socket says 172.21.15.16:34590) 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 -- 172.21.15.16:0/28735025 learned_addr learned my addr 172.21.15.16:0/28735025 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf663a640 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f37ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf663a640 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f388660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 -- 172.21.15.16:0/28735025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 msgr2=0x55b72f388660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f388660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 -- 172.21.15.16:0/28735025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 msgr2=0x55b72f37ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f37ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 -- 172.21.15.16:0/28735025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72f381f70 con 0x55b72f37ada0 2024-09-10T23:42:23.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf663a640 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f388660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:23.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbf5638640 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f388120 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c010 tx=0x7ffbe40115d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad32357d41e52bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:23.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbdb7fe640 1 -- 172.21.15.16:0/28735025 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4031070 con 0x55b72f37ada0 2024-09-10T23:42:23.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbdb7fe640 1 -- 172.21.15.16:0/28735025 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbe4010e10 con 0x55b72f37ada0 2024-09-10T23:42:23.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.407+0000 7ffbdb7fe640 1 -- 172.21.15.16:0/28735025 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4028070 con 0x55b72f37ada0 2024-09-10T23:42:23.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 -- 172.21.15.16:0/28735025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 msgr2=0x55b72f388120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f388120 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c010 tx=0x7ffbe40115d0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 -- 172.21.15.16:0/28735025 shutdown_connections 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f386d30 0x55b72f388660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37ada0 0x55b72f388120 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 --2- 172.21.15.16:0/28735025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f37a480 0x55b72f37ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 -- 172.21.15.16:0/28735025 >> 172.21.15.16:0/28735025 conn(0x55b72f3782b0 msgr2=0x55b72f3822f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 -- 172.21.15.16:0/28735025 shutdown_connections 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.408+0000 7ffbfa472740 1 -- 172.21.15.16:0/28735025 wait complete. 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 -- start start 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 Processor -- start 2024-09-10T23:42:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f38ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f37ada0 0x55b72f38f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f386d30 0x55b72f37fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01accb0 con 0x55b72f37a480 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ae120 con 0x55b72f386d30 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ad380 con 0x55b72f37ada0 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbfa472740 10 client.0 _ll_register_callbacks cb 0x7ffbe4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbf663a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f38ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbf663a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f38ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34592/0 (socket says 172.21.15.16:34592) 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbf663a640 1 -- 172.21.15.16:0/2673472895 learned_addr learned my addr 172.21.15.16:0/2673472895 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.409+0000 7ffbf5638640 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f37ada0 0x55b72f38f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbf663a640 1 -- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f37ada0 msgr2=0x55b72f38f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbf663a640 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f37ada0 0x55b72f38f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbf663a640 1 -- 172.21.15.16:0/2673472895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f386d30 msgr2=0x55b72f37fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbf663a640 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f386d30 0x55b72f37fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbf663a640 1 -- 172.21.15.16:0/2673472895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72f38f870 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbf5638640 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f37ada0 0x55b72f38f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbf663a640 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f38ec40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800ae60 tx=0x7ffbe8010640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b333616917b838e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbd97fa640 1 -- 172.21.15.16:0/2673472895 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8004a00 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe4010e10 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbd97fa640 1 -- 172.21.15.16:0/2673472895 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ffbe8004ba0 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbd97fa640 1 -- 172.21.15.16:0/2673472895 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffbe80107f0 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbfa472740 10 client.15780 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b72f404c00 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.410+0000 7ffbd97fa640 1 -- 172.21.15.16:0/2673472895 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbe4010e10 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbd97fa640 1 -- 172.21.15.16:0/2673472895 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffbe8023040 con 0x55b72f37a480 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbfa472740 10 client.15780 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbfa472740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbfa472740 20 client.15780 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f405140 0x55b72f407530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbfa472740 4 client.15780 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b72f2f2da0 con 0x55b72f405140 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbf5638640 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f405140 0x55b72f407530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbf5638640 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f405140 0x55b72f407530 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d9736210e6a4132 server_cookie=a4ad2d8db8614982 in_seq=0 out_seq=0 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.411+0000 7ffbd97fa640 10 client.15780 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbd97fa640 1 -- 172.21.15.16:0/2673472895 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55b72f2f2da0 con 0x55b72f405140 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbd97fa640 10 client.15780 handle_command_reply: tid=0 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 client.15780 shutdown 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 msgr2=0x55b72f38ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f38ec40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800ae60 tx=0x7ffbe8010640 comp rx=0 tx=0).stop 2024-09-10T23:42:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 shutdown_connections 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b72f405140 0x55b72f407530 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72f386d30 0x55b72f37fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbd97fa640 0 client.15780 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b72f37ada0 0x55b72f38f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 --2- 172.21.15.16:0/2673472895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b72f37a480 0x55b72f38ec40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 >> 172.21.15.16:0/2673472895 conn(0x55b72f3782b0 msgr2=0x55b72f376bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 shutdown_connections 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 1 -- 172.21.15.16:0/2673472895 wait complete. 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.412+0000 7ffbfa472740 20 client.15780 trim_cache size 0 max 16384 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:42:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:42:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:42:23.421 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffbdc0b5450 msgr2=0x7ffbdc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffbdc0b5450 0x7ffbdc0b7910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffbec1042f0 tx=0x7ffbec10a5e0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 msgr2=0x7ffbf019a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf019a0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffbec005940 tx=0x7ffbec0042f0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 shutdown_connections 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ffbdc0b5450 0x7ffbdc0b7910 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbf0108020 0x7ffbf019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbf01076a0 0x7ffbf019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 --2- 172.21.15.16:0/1075579323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbf0101c90 0x7ffbf019a0d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 >> 172.21.15.16:0/1075579323 conn(0x7ffbf00fd700 msgr2=0x7ffbf00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 shutdown_connections 2024-09-10T23:42:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:23.413+0000 7ffbf809d640 1 -- 172.21.15.16:0/1075579323 wait complete. 2024-09-10T23:42:24.232 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:42:24.232 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:42:24.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:24 smithi071 ceph-mon[35018]: pgmap v385: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:42:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:24 smithi066 ceph-mon[34761]: pgmap v385: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:42:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:24 smithi016 ceph-mon[30855]: pgmap v385: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:42:24.496 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:42:25.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 -- 172.21.15.16:0/4045225324 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 msgr2=0x7f9d6c10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:25.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 --2- 172.21.15.16:0/4045225324 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c10caf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009900 tx=0x7f9d6002a410 comp rx=0 tx=0).stop 2024-09-10T23:42:25.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 -- 172.21.15.16:0/4045225324 shutdown_connections 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 --2- 172.21.15.16:0/4045225324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6c10d140 0x7f9d6c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 --2- 172.21.15.16:0/4045225324 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c10caf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 --2- 172.21.15.16:0/4045225324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d6c103ce0 0x7f9d6c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 -- 172.21.15.16:0/4045225324 >> 172.21.15.16:0/4045225324 conn(0x7f9d6c0fd700 msgr2=0x7f9d6c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 -- 172.21.15.16:0/4045225324 shutdown_connections 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.048+0000 7f9d71a66640 1 -- 172.21.15.16:0/4045225324 wait complete. 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 Processor -- start 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 -- start start 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d6c103ce0 0x7f9d6c1994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6c10d140 0x7f9d6c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c112e70 con 0x7f9d6c104600 2024-09-10T23:42:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c112cf0 con 0x7f9d6c103ce0 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d71a66640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c112ff0 con 0x7f9d6c10d140 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.049+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c1999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46148/0 (socket says 172.21.15.16:46148) 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 -- 172.21.15.16:0/435601014 learned_addr learned my addr 172.21.15.16:0/435601014 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6b7fe640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d6c103ce0 0x7f9d6c1994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6bfff640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6c10d140 0x7f9d6c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 -- 172.21.15.16:0/435601014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6c10d140 msgr2=0x7f9d6c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6c10d140 0x7f9d6c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 -- 172.21.15.16:0/435601014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d6c103ce0 msgr2=0x7f9d6c1994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d6c103ce0 0x7f9d6c1994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 -- 172.21.15.16:0/435601014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c19f550 con 0x7f9d6c104600 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6bfff640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6c10d140 0x7f9d6c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:25.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d6affd640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c1999e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d60004270 tx=0x7f9d600042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d68ff9640 1 -- 172.21.15.16:0/435601014 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6003f030 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d68ff9640 1 -- 172.21.15.16:0/435601014 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d600044c0 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6c19f7e0 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d68ff9640 1 -- 172.21.15.16:0/435601014 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60035070 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.050+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6c1a5f00 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.051+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d6c104140 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.053+0000 7f9d68ff9640 1 -- 172.21.15.16:0/435601014 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f9d6003bad0 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.053+0000 7f9d68ff9640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9d540b5450 0x7f9d540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.054+0000 7f9d6b7fe640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9d540b5450 0x7f9d540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.054+0000 7f9d68ff9640 1 -- 172.21.15.16:0/435601014 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f9d60106c60 con 0x7f9d6c104600 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.054+0000 7f9d6b7fe640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9d540b5450 0x7f9d540b7910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009990 tx=0x7f9d5c009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.057+0000 7f9d68ff9640 1 -- 172.21.15.16:0/435601014 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9d600cd7a0 con 0x7f9d6c104600 2024-09-10T23:42:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.278+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d6c1081b0 con 0x7f9d6c104600 2024-09-10T23:42:25.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.278+0000 7f9d68ff9640 1 -- 172.21.15.16:0/435601014 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f9d600cd0a0 con 0x7f9d6c104600 2024-09-10T23:42:25.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:42:25.280 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:42:25.280 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:42:25.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9d540b5450 msgr2=0x7f9d540b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:25.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9d540b5450 0x7f9d540b7910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009990 tx=0x7f9d5c009110 comp rx=0 tx=0).stop 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 msgr2=0x7f9d6c1999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c1999e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d60004270 tx=0x7f9d600042a0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 shutdown_connections 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9d6c10d140 0x7f9d6c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d6c104600 0x7f9d6c1999e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9d540b5450 0x7f9d540b7910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 --2- 172.21.15.16:0/435601014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d6c103ce0 0x7f9d6c1994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.280+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 >> 172.21.15.16:0/435601014 conn(0x7f9d6c0fd700 msgr2=0x7f9d6c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.281+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 shutdown_connections 2024-09-10T23:42:25.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:25.281+0000 7f9d71a66640 1 -- 172.21.15.16:0/435601014 wait complete. 2024-09-10T23:42:26.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:42:26.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:26 smithi071 ceph-mon[35018]: pgmap v386: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:26.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:26 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/435601014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:42:26.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:26 smithi066 ceph-mon[34761]: pgmap v386: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:26.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:26 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/435601014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:42:26.376 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:42:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:26 smithi016 ceph-mon[30855]: pgmap v386: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:26 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/435601014' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:42:26.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.884+0000 7f9c0cd22640 1 -- 172.21.15.16:0/1930844721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 msgr2=0x7f9c08115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.884+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/1930844721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c08115d80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009900 tx=0x7f9bfc02a410 comp rx=0 tx=0).stop 2024-09-10T23:42:26.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 -- 172.21.15.16:0/1930844721 shutdown_connections 2024-09-10T23:42:26.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/1930844721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c08115d80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/1930844721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c08077ff0 0x7f9c08113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/1930844721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c080776d0 0x7f9c08077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 -- 172.21.15.16:0/1930844721 >> 172.21.15.16:0/1930844721 conn(0x7f9c08100a50 msgr2=0x7f9c08102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:26.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 -- 172.21.15.16:0/1930844721 shutdown_connections 2024-09-10T23:42:26.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 -- 172.21.15.16:0/1930844721 wait complete. 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 Processor -- start 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.885+0000 7f9c0cd22640 1 -- start start 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c0cd22640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c080776d0 0x7f9c0819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c0cd22640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c08077ff0 0x7f9c0819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c0cd22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c081a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c0cd22640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08119360 con 0x7f9c08113990 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c0cd22640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081191e0 con 0x7f9c08077ff0 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c0cd22640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081194e0 con 0x7f9c080776d0 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c081a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c081a50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46170/0 (socket says 172.21.15.16:46170) 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 -- 172.21.15.16:0/882470075 learned_addr learned my addr 172.21.15.16:0/882470075 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:26.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c0659c640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c080776d0 0x7f9c0819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c08077ff0 0x7f9c0819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 -- 172.21.15.16:0/882470075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c080776d0 msgr2=0x7f9c0819f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c080776d0 0x7f9c0819f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 -- 172.21.15.16:0/882470075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c08077ff0 msgr2=0x7f9c0819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c08077ff0 0x7f9c0819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.886+0000 7f9c06d9d640 1 -- 172.21.15.16:0/882470075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c081a5880 con 0x7f9c08113990 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.887+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c081a50b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009230 tx=0x7f9bfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.887+0000 7f9bf77fe640 1 -- 172.21.15.16:0/882470075 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc03f030 con 0x7f9c08113990 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.887+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c081a5b10 con 0x7f9c08113990 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.887+0000 7f9bf77fe640 1 -- 172.21.15.16:0/882470075 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bfc003800 con 0x7f9c08113990 2024-09-10T23:42:26.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.887+0000 7f9bf77fe640 1 -- 172.21.15.16:0/882470075 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc035070 con 0x7f9c08113990 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.887+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c081ac230 con 0x7f9c08113990 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.889+0000 7f9c0f0f7740 1 Processor -- start 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9bf77fe640 1 -- 172.21.15.16:0/882470075 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f9bfc031b10 con 0x7f9c08113990 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0f0f7740 1 -- start start 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca6894d0 0x55faca6898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca689df0 0x55faca695840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca698170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55faca5ffea0 con 0x55faca695d80 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55faca5ef2d0 con 0x55faca689df0 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55faca5f30e0 con 0x55faca6894d0 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c05d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca698170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c05d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca698170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46174/0 (socket says 172.21.15.16:46174) 2024-09-10T23:42:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c05d9b640 1 -- 172.21.15.16:0/1230667432 learned_addr learned my addr 172.21.15.16:0/1230667432 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca6894d0 0x55faca6898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.890+0000 7f9c0659c640 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca689df0 0x55faca695840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c05d9b640 1 -- 172.21.15.16:0/1230667432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca6894d0 msgr2=0x55faca6898b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca6894d0 0x55faca6898b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c05d9b640 1 -- 172.21.15.16:0/1230667432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca689df0 msgr2=0x55faca695840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca689df0 0x55faca695840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c05d9b640 1 -- 172.21.15.16:0/1230667432 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faca34d650 con 0x55faca695d80 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c0659c640 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca689df0 0x55faca695840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca698170 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9c00014c80 tx=0x7f9c0000aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c89e92fd2325d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9bf77fe640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9bf00b5450 0x7f9bf00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9bf4ff9640 1 -- 172.21.15.16:0/1230667432 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00014e30 con 0x55faca695d80 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9bf4ff9640 1 -- 172.21.15.16:0/1230667432 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c000140d0 con 0x55faca695d80 2024-09-10T23:42:26.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9bf4ff9640 1 -- 172.21.15.16:0/1230667432 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00005730 con 0x55faca695d80 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9c0659c640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9bf00b5450 0x7f9bf00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.891+0000 7f9bf77fe640 1 -- 172.21.15.16:0/882470075 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f9bfc106890 con 0x7f9c08113990 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/1230667432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 msgr2=0x55faca698170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0659c640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9bf00b5450 0x7f9bf00b7910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55faca6881e0 tx=0x7f9bf800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca698170 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9c00014c80 tx=0x7f9c0000aa20 comp rx=0 tx=0).stop 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/1230667432 shutdown_connections 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca698170 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca689df0 0x55faca695840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/1230667432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca6894d0 0x55faca6898b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/1230667432 >> 172.21.15.16:0/1230667432 conn(0x55faca687300 msgr2=0x55faca6884a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/1230667432 shutdown_connections 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/1230667432 wait complete. 2024-09-10T23:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.892+0000 7f9c0f0f7740 1 -- start start 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 1 Processor -- start 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca6956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca692b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca6931c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55faca450700 con 0x55faca6894d0 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55faca58a160 con 0x55faca695d80 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55faca6989a0 con 0x55faca689df0 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0f0f7740 10 client.0 _ll_register_callbacks cb 0x55faca5a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca6956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca6956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46190/0 (socket says 172.21.15.16:46190) 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0659c640 1 -- 172.21.15.16:0/390964202 learned_addr learned my addr 172.21.15.16:0/390964202 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca692b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca6931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c05d9b640 1 -- 172.21.15.16:0/390964202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 msgr2=0x55faca6931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca6931c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c05d9b640 1 -- 172.21.15.16:0/390964202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 msgr2=0x55faca6956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca6956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c05d9b640 1 -- 172.21.15.16:0/390964202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faca5b7c90 con 0x55faca689df0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.893+0000 7f9c0659c640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca6956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca692b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c00005c40 tx=0x7f9c0000af10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e94603c2423dc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9bedffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9bedffb640 1 -- 172.21.15.16:0/390964202 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00014920 con 0x55faca689df0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c000140d0 con 0x55faca689df0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9bedffb640 1 -- 172.21.15.16:0/390964202 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f9c00014280 con 0x55faca689df0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9bedffb640 1 -- 172.21.15.16:0/390964202 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c00004a40 con 0x55faca689df0 2024-09-10T23:42:26.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9c0f0f7740 10 client.25474 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:26.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55faca6a4380 con 0x55faca689df0 2024-09-10T23:42:26.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9bedffb640 1 -- 172.21.15.16:0/390964202 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c000140d0 con 0x55faca689df0 2024-09-10T23:42:26.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9bedffb640 1 -- 172.21.15.16:0/390964202 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c000125e0 con 0x55faca689df0 2024-09-10T23:42:26.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9c0f0f7740 10 client.25474 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.894+0000 7f9c0f0f7740 10 client.25474 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.895+0000 7f9c0f0f7740 20 client.25474 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.895+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca6a5730 0x55faca6a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.895+0000 7f9c0f0f7740 4 client.25474 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.895+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faca601df0 con 0x55faca6a5730 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.895+0000 7f9c0659c640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca6a5730 0x55faca6a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.895+0000 7f9bedffb640 10 client.25474 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.895+0000 7f9c0659c640 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca6a5730 0x55faca6a7b20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d64cb64f337acdca server_cookie=830b2b81187fe840 in_seq=0 out_seq=0 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9bedffb640 1 -- 172.21.15.16:0/390964202 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55faca601df0 con 0x55faca6a5730 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9bedffb640 10 client.25474 handle_command_reply: tid=0 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 client.25474 shutdown 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 msgr2=0x55faca692b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca692b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c00005c40 tx=0x7f9c0000af10 comp rx=0 tx=0).stop 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 shutdown_connections 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca6a5730 0x55faca6a7b20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca6931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9bedffb640 0 client.25474 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca692b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/390964202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca6956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 >> 172.21.15.16:0/390964202 conn(0x55faca687300 msgr2=0x55faca68ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 shutdown_connections 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/390964202 wait complete. 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.896+0000 7f9c0f0f7740 20 client.25474 trim_cache size 0 max 16384 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.909+0000 7f9c0f0f7740 1 Processor -- start 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.909+0000 7f9c0f0f7740 1 -- start start 2024-09-10T23:42:26.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca68d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca686c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca697170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b7400 con 0x55faca6894d0 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b4cd0 con 0x55faca695d80 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b2b20 con 0x55faca689df0 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca68d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca68d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46204/0 (socket says 172.21.15.16:46204) 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 -- 172.21.15.16:0/39698723 learned_addr learned my addr 172.21.15.16:0/39698723 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca686c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca697170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 -- 172.21.15.16:0/39698723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 msgr2=0x55faca686c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca686c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 -- 172.21.15.16:0/39698723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 msgr2=0x55faca697170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca697170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 -- 172.21.15.16:0/39698723 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faca698500 con 0x55faca6894d0 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca686c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.910+0000 7f9c0659c640 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca68d540 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8012cb0 tx=0x7f9bf8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09760cae24d528b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9beffff640 1 -- 172.21.15.16:0/39698723 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8005020 con 0x55faca6894d0 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9beffff640 1 -- 172.21.15.16:0/39698723 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf80047a0 con 0x55faca6894d0 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9beffff640 1 -- 172.21.15.16:0/39698723 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80306e0 con 0x55faca6894d0 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/39698723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 msgr2=0x55faca68d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca68d540 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8012cb0 tx=0x7f9bf8015000 comp rx=0 tx=0).stop 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/39698723 shutdown_connections 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca695d80 0x55faca697170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca686c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/39698723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca6894d0 0x55faca68d540 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/39698723 >> 172.21.15.16:0/39698723 conn(0x55faca687300 msgr2=0x55faca694990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/39698723 shutdown_connections 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.911+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/39698723 wait complete. 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 -- start start 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 Processor -- start 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca6894d0 0x55faca6ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca6a6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca6a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b3190 con 0x55faca695d80 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b4600 con 0x55faca6894d0 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b3860 con 0x55faca689df0 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0f0f7740 10 client.0 _ll_register_callbacks cb 0x7f9c00014640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca6a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca6a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46206/0 (socket says 172.21.15.16:46206) 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 -- 172.21.15.16:0/3398819099 learned_addr learned my addr 172.21.15.16:0/3398819099 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c0659c640 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca6894d0 0x55faca6ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c05d9b640 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca6a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 -- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 msgr2=0x55faca6a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca6a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 -- 172.21.15.16:0/3398819099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca6894d0 msgr2=0x55faca6ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca6894d0 0x55faca6ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.912+0000 7f9c06d9d640 1 -- 172.21.15.16:0/3398819099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faca6a7600 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c06d9d640 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca6a6dd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc031440 tx=0x7f9bfc0ccc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6512d3c3d9fd131 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9bedffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9bedffb640 1 -- 172.21.15.16:0/3398819099 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc049040 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9bedffb640 1 -- 172.21.15.16:0/3398819099 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f9bfc003cb0 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf80047a0 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9bedffb640 1 -- 172.21.15.16:0/3398819099 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9bfc0cd470 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 10 client.15804 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55faca712360 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9bedffb640 1 -- 172.21.15.16:0/3398819099 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf80047a0 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9bedffb640 1 -- 172.21.15.16:0/3398819099 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9bfc078be0 con 0x55faca695d80 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 10 client.15804 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 10 client.15804 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 20 client.15804 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca712ab0 0x55faca714ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 4 client.15804 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.913+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55faca5fd8a0 con 0x55faca712ab0 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9c0659c640 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca712ab0 0x55faca714ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9c0659c640 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca712ab0 0x55faca714ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=14c1e6a639143693 server_cookie=8470d4dd858d33ec in_seq=0 out_seq=0 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9bedffb640 10 client.15804 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9bedffb640 1 -- 172.21.15.16:0/3398819099 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55faca5fd8a0 con 0x55faca712ab0 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9bedffb640 10 client.15804 handle_command_reply: tid=0 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9c0f0f7740 1 client.15804 shutdown 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 msgr2=0x55faca6a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.914+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca6a6dd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc031440 tx=0x7f9bfc0ccc00 comp rx=0 tx=0).stop 2024-09-10T23:42:26.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 shutdown_connections 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55faca712ab0 0x55faca714ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55faca695d80 0x55faca6a6dd0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55faca689df0 0x55faca6a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 --2- 172.21.15.16:0/3398819099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55faca6894d0 0x55faca6ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 >> 172.21.15.16:0/3398819099 conn(0x55faca687300 msgr2=0x55faca68c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9bedffb640 0 client.15804 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 shutdown_connections 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 1 -- 172.21.15.16:0/3398819099 wait complete. 2024-09-10T23:42:26.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0f0f7740 20 client.15804 trim_cache size 0 max 16384 2024-09-10T23:42:26.929 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:42:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9bf00b5450 msgr2=0x7f9bf00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9bf00b5450 0x7f9bf00b7910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55faca6881e0 tx=0x7f9bf800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 msgr2=0x7f9c081a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c081a50b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009230 tx=0x7f9bfc0042f0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 shutdown_connections 2024-09-10T23:42:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c08113990 0x7f9c081a50b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9bf00b5450 0x7f9bf00b7910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c08077ff0 0x7f9c0819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 --2- 172.21.15.16:0/882470075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c080776d0 0x7f9c0819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:26.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 >> 172.21.15.16:0/882470075 conn(0x7f9c08100a50 msgr2=0x7f9c08102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:26.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 shutdown_connections 2024-09-10T23:42:26.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:26.915+0000 7f9c0cd22640 1 -- 172.21.15.16:0/882470075 wait complete. 2024-09-10T23:42:27.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:42:27.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:42:27.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:42:27.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:42:27.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:42:27.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:42:27.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:42:27.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:42:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:42:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:42:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:42:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:42:27.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:42:27.922 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:42:28.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:28 smithi066 ceph-mon[34761]: pgmap v387: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:28.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:28 smithi016 ceph-mon[30855]: pgmap v387: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:28.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.409+0000 7f640bd72640 1 -- 172.21.15.16:0/53992160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6404102190 msgr2=0x7f640410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.409+0000 7f640bd72640 1 --2- 172.21.15.16:0/53992160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6404102190 0x7f640410eee0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009900 tx=0x7f63f402a410 comp rx=0 tx=0).stop 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 -- 172.21.15.16:0/53992160 shutdown_connections 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 --2- 172.21.15.16:0/53992160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f640410f420 0x7f6404111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 --2- 172.21.15.16:0/53992160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6404102190 0x7f640410eee0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 --2- 172.21.15.16:0/53992160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6404101870 0x7f6404101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 -- 172.21.15.16:0/53992160 >> 172.21.15.16:0/53992160 conn(0x7f64040fd700 msgr2=0x7f64040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 -- 172.21.15.16:0/53992160 shutdown_connections 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 -- 172.21.15.16:0/53992160 wait complete. 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 Processor -- start 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 -- start start 2024-09-10T23:42:28.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.410+0000 7f640bd72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6404101870 0x7f640419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640bd72640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6404102190 0x7f640419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640bd72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f640410f420 0x7f64041a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640bd72640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6404114f70 con 0x7f640410f420 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640bd72640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6404114df0 con 0x7f6404101870 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640bd72640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64041150f0 con 0x7f6404102190 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f640410f420 0x7f64041a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f640410f420 0x7f64041a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46228/0 (socket says 172.21.15.16:46228) 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 -- 172.21.15.16:0/4121394467 learned_addr learned my addr 172.21.15.16:0/4121394467 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f6409b0e640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6404101870 0x7f640419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640930d640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6404102190 0x7f640419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 -- 172.21.15.16:0/4121394467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6404102190 msgr2=0x7f640419b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6404102190 0x7f640419b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 -- 172.21.15.16:0/4121394467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6404101870 msgr2=0x7f640419b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6404101870 0x7f640419b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 -- 172.21.15.16:0/4121394467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64041a14f0 con 0x7f640410f420 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640a30f640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f640410f420 0x7f64041a0d20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00e9d0 tx=0x7f63fc00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f63faffd640 1 -- 172.21.15.16:0/4121394467 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc004d20 con 0x7f640410f420 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f63faffd640 1 -- 172.21.15.16:0/4121394467 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63fc005020 con 0x7f640410f420 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64041a17e0 con 0x7f640410f420 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f63faffd640 1 -- 172.21.15.16:0/4121394467 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0116b0 con 0x7f640410f420 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.411+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64041a7ea0 con 0x7f640410f420 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 Processor -- start 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f63faffd640 1 -- 172.21.15.16:0/4121394467 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f63fc00f040 con 0x7f640410f420 2024-09-10T23:42:28.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 -- start start 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a53268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5326df0 0x5562a5332840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5332d80 0x5562a5335170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5562a529cea0 con 0x5562a53264d0 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5562a528c2d0 con 0x5562a5326df0 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.414+0000 7f640e147740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5562a52900e0 con 0x5562a5332d80 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a53268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a53268b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46240/0 (socket says 172.21.15.16:46240) 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 -- 172.21.15.16:0/1790905501 learned_addr learned my addr 172.21.15.16:0/1790905501 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f6409b0e640 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5326df0 0x5562a5332840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5332d80 0x5562a5335170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 -- 172.21.15.16:0/1790905501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5332d80 msgr2=0x5562a5335170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5332d80 0x5562a5335170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 -- 172.21.15.16:0/1790905501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5326df0 msgr2=0x5562a5332840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5326df0 0x5562a5332840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 -- 172.21.15.16:0/1790905501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a4fea650 con 0x5562a53264d0 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f63faffd640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63f00b5450 0x7f63f00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f640930d640 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a53268b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f63f4005940 tx=0x7f63f40058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee939da10058ba65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f6409b0e640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63f00b5450 0x7f63f00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f63faffd640 1 -- 172.21.15.16:0/4121394467 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f63fc0e5e90 con 0x7f640410f420 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.415+0000 7f63effff640 1 -- 172.21.15.16:0/1790905501 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4035050 con 0x5562a53264d0 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f63effff640 1 -- 172.21.15.16:0/1790905501 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63f40316f0 con 0x5562a53264d0 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f63effff640 1 -- 172.21.15.16:0/1790905501 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f40046c0 con 0x5562a53264d0 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 -- 172.21.15.16:0/1790905501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 msgr2=0x5562a53268b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a53268b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f63f4005940 tx=0x7f63f40058b0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f6409b0e640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63f00b5450 0x7f63f00b7910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5562a53251e0 tx=0x7f640000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 -- 172.21.15.16:0/1790905501 shutdown_connections 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5332d80 0x5562a5335170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5326df0 0x5562a5332840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 --2- 172.21.15.16:0/1790905501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a53268b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 -- 172.21.15.16:0/1790905501 >> 172.21.15.16:0/1790905501 conn(0x5562a5324300 msgr2=0x5562a53254a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 -- 172.21.15.16:0/1790905501 shutdown_connections 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.416+0000 7f640e147740 1 -- 172.21.15.16:0/1790905501 wait complete. 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 -- start start 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 Processor -- start 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a53264d0 0x5562a5332660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a532fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a5332d80 0x5562a53300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5562a50ed700 con 0x5562a5332d80 2024-09-10T23:42:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5562a5227160 con 0x5562a53264d0 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5562a53359a0 con 0x5562a5326df0 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640e147740 10 client.0 _ll_register_callbacks cb 0x5562a52409e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640a30f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a5332d80 0x5562a53300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640a30f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a5332d80 0x5562a53300e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46244/0 (socket says 172.21.15.16:46244) 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640a30f640 1 -- 172.21.15.16:0/3945241937 learned_addr learned my addr 172.21.15.16:0/3945241937 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.417+0000 7f640930d640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a532fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f6409b0e640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a53264d0 0x5562a5332660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640a30f640 1 -- 172.21.15.16:0/3945241937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 msgr2=0x5562a532fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640a30f640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a532fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640a30f640 1 -- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a53264d0 msgr2=0x5562a5332660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640a30f640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a53264d0 0x5562a5332660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640a30f640 1 -- 172.21.15.16:0/3945241937 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562a5254c90 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f6409b0e640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a53264d0 0x5562a5332660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640a30f640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a5332d80 0x5562a53300e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0ac300 tx=0x7f63fc0e3b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b21bcb3db5e7c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f63ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f63ed7fa640 1 -- 172.21.15.16:0/3945241937 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc01f030 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f63ed7fa640 1 -- 172.21.15.16:0/3945241937 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f63fc0ab5d0 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63f40316f0 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f63ed7fa640 1 -- 172.21.15.16:0/3945241937 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63fc0ac370 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640e147740 10 client.15816 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5562a5341380 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f63ed7fa640 1 -- 172.21.15.16:0/3945241937 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63f40316f0 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f63ed7fa640 1 -- 172.21.15.16:0/3945241937 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f63fc0d30a0 con 0x5562a5332d80 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640e147740 10 client.15816 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.418+0000 7f640e147740 10 client.15816 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:42:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.419+0000 7f640e147740 20 client.15816 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.419+0000 7f640e147740 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53428e0 0x5562a5344d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.419+0000 7f640e147740 4 client.15816 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.419+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562a529edf0 con 0x5562a53428e0 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.419+0000 7f6409b0e640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53428e0 0x5562a5344d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.419+0000 7f63ed7fa640 10 client.15816 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.419+0000 7f6409b0e640 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53428e0 0x5562a5344d30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb5b45b25d0f4a78 server_cookie=6ba58b4f5425aa25 in_seq=0 out_seq=0 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f63ed7fa640 1 -- 172.21.15.16:0/3945241937 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562a529edf0 con 0x5562a53428e0 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f63ed7fa640 10 client.15816 handle_command_reply: tid=0 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 client.15816 shutdown 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a5332d80 msgr2=0x5562a53300e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a5332d80 0x5562a53300e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0ac300 tx=0x7f63fc0e3b40 comp rx=0 tx=0).stop 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 shutdown_connections 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53428e0 0x5562a5344d30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a5332d80 0x5562a53300e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a532fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 --2- 172.21.15.16:0/3945241937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a53264d0 0x5562a5332660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 >> 172.21.15.16:0/3945241937 conn(0x5562a5324300 msgr2=0x5562a5329e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f63ed7fa640 0 client.15816 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:42:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 shutdown_connections 2024-09-10T23:42:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.420+0000 7f640e147740 1 -- 172.21.15.16:0/3945241937 wait complete. 2024-09-10T23:42:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.421+0000 7f640e147740 20 client.15816 trim_cache size 0 max 16384 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 Processor -- start 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 -- start start 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a5334170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a53346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64041b2f30 con 0x5562a53264d0 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64041b0800 con 0x5562a5332d80 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.434+0000 7f640e147740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64041ae650 con 0x5562a5326df0 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46258/0 (socket says 172.21.15.16:46258) 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 -- 172.21.15.16:0/3946400112 learned_addr learned my addr 172.21.15.16:0/3946400112 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:28.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f640a30f640 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a53346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f640930d640 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a5334170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 -- 172.21.15.16:0/3946400112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 msgr2=0x5562a5334170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a5334170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 -- 172.21.15.16:0/3946400112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 msgr2=0x5562a53346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a53346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 -- 172.21.15.16:0/3946400112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562a5324d80 con 0x5562a53264d0 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f640930d640 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a5334170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f6409b0e640 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533ec30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x5562a53455a0 tx=0x7f6400019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f8df54dc3a7075 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f63ef7fe640 1 -- 172.21.15.16:0/3946400112 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400005020 con 0x5562a53264d0 2024-09-10T23:42:28.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f63ef7fe640 1 -- 172.21.15.16:0/3946400112 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64000047a0 con 0x5562a53264d0 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.435+0000 7f63ef7fe640 1 -- 172.21.15.16:0/3946400112 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640002d660 con 0x5562a53264d0 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 -- 172.21.15.16:0/3946400112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 msgr2=0x5562a533ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533ec30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x5562a53455a0 tx=0x7f6400019000 comp rx=0 tx=0).stop 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 -- 172.21.15.16:0/3946400112 shutdown_connections 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a53346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a5334170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 --2- 172.21.15.16:0/3946400112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533ec30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 -- 172.21.15.16:0/3946400112 >> 172.21.15.16:0/3946400112 conn(0x5562a5324300 msgr2=0x5562a53253c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 -- 172.21.15.16:0/3946400112 shutdown_connections 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 -- 172.21.15.16:0/3946400112 wait complete. 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.436+0000 7f640e147740 1 -- start start 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 1 Processor -- start 2024-09-10T23:42:28.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a533b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a5335c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64041aecc0 con 0x5562a53264d0 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64041b0130 con 0x5562a5332d80 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64041af390 con 0x5562a5326df0 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640e147740 10 client.0 _ll_register_callbacks cb 0x7f63fc004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46264/0 (socket says 172.21.15.16:46264) 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 -- 172.21.15.16:0/2299979369 learned_addr learned my addr 172.21.15.16:0/2299979369 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640a30f640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a5335c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640930d640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a533b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 -- 172.21.15.16:0/2299979369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 msgr2=0x5562a533b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a533b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 -- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 msgr2=0x5562a5335c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a5335c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f6409b0e640 1 -- 172.21.15.16:0/2299979369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562a5336190 con 0x5562a53264d0 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640930d640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a533b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.437+0000 7f640a30f640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a5335c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f6409b0e640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533aca0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f640000a720 tx=0x7f6400004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5bd441902b3af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f63ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f63ed7fa640 1 -- 172.21.15.16:0/2299979369 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400039020 con 0x5562a53264d0 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f63ed7fa640 1 -- 172.21.15.16:0/2299979369 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f64000054b0 con 0x5562a53264d0 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64000047a0 con 0x5562a53264d0 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f63ed7fa640 1 -- 172.21.15.16:0/2299979369 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6400044050 con 0x5562a53264d0 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f640e147740 10 client.15822 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:28.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5562a53aff30 con 0x5562a53264d0 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f63ed7fa640 1 -- 172.21.15.16:0/2299979369 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64000047a0 con 0x5562a53264d0 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f63ed7fa640 1 -- 172.21.15.16:0/2299979369 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f63fc0051d0 con 0x5562a53264d0 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f640e147740 10 client.15822 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f640e147740 10 client.15822 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.438+0000 7f640e147740 20 client.15822 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f640e147740 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53b0640 0x5562a53b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f640e147740 4 client.15822 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5562a529a8a0 con 0x5562a53b0640 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f640930d640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53b0640 0x5562a53b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f640930d640 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53b0640 0x5562a53b2a60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=73b704411a163cba server_cookie=ecb41f54181ccf37 in_seq=0 out_seq=0 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f63ed7fa640 10 client.15822 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f63ed7fa640 1 -- 172.21.15.16:0/2299979369 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5562a529a8a0 con 0x5562a53b0640 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f63ed7fa640 10 client.15822 handle_command_reply: tid=0 2024-09-10T23:42:28.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.439+0000 7f640e147740 1 client.15822 shutdown 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 msgr2=0x5562a533aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533aca0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f640000a720 tx=0x7f6400004700 comp rx=0 tx=0).stop 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 shutdown_connections 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5562a53b0640 0x5562a53b2a60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5562a5332d80 0x5562a5335c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5562a5326df0 0x5562a533b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f63ed7fa640 0 client.15822 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 --2- 172.21.15.16:0/2299979369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562a53264d0 0x5562a533aca0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 >> 172.21.15.16:0/2299979369 conn(0x5562a5324300 msgr2=0x5562a53310e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 shutdown_connections 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 1 -- 172.21.15.16:0/2299979369 wait complete. 2024-09-10T23:42:28.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640e147740 20 client.15822 trim_cache size 0 max 16384 2024-09-10T23:42:28.456 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:42:28.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63f00b5450 msgr2=0x7f63f00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63f00b5450 0x7f63f00b7910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5562a53251e0 tx=0x7f640000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f640410f420 msgr2=0x7f64041a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f640410f420 0x7f64041a0d20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00e9d0 tx=0x7f63fc00edd0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 shutdown_connections 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f640410f420 0x7f64041a0d20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6404102190 0x7f640419b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63f00b5450 0x7f63f00b7910 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 --2- 172.21.15.16:0/4121394467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6404101870 0x7f640419b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.440+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 >> 172.21.15.16:0/4121394467 conn(0x7f64040fd700 msgr2=0x7f64041115b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.441+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 shutdown_connections 2024-09-10T23:42:28.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:28.441+0000 7f640bd72640 1 -- 172.21.15.16:0/4121394467 wait complete. 2024-09-10T23:42:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:28 smithi071 ceph-mon[35018]: pgmap v387: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:29.273 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:42:29.534 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:42:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 -- 172.21.15.16:0/3350522992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 msgr2=0x7f7c2810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3350522992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c2810cab0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009900 tx=0x7f7c1802a410 comp rx=0 tx=0).stop 2024-09-10T23:42:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 -- 172.21.15.16:0/3350522992 shutdown_connections 2024-09-10T23:42:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3350522992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c2810d100 0x7f7c2810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3350522992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c2810cab0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3350522992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c28103ca0 0x7f7c28104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 -- 172.21.15.16:0/3350522992 >> 172.21.15.16:0/3350522992 conn(0x7f7c280fd700 msgr2=0x7f7c280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 -- 172.21.15.16:0/3350522992 shutdown_connections 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.028+0000 7f7c3000c640 1 -- 172.21.15.16:0/3350522992 wait complete. 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 Processor -- start 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 -- start start 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c28103ca0 0x7f7c28199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c28199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c2810d100 0x7f7c2819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28112dc0 con 0x7f7c281045c0 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28112c40 con 0x7f7c28103ca0 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c3000c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28112f40 con 0x7f7c2810d100 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c2d5a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c28199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c2d5a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c28199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46280/0 (socket says 172.21.15.16:46280) 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.029+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3918648434 learned_addr learned my addr 172.21.15.16:0/3918648434 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c2810d100 0x7f7c2819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c28103ca0 0x7f7c28199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3918648434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c2810d100 msgr2=0x7f7c2819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c2810d100 0x7f7c2819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3918648434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c28103ca0 msgr2=0x7f7c28199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c28103ca0 0x7f7c28199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3918648434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2819f300 con 0x7f7c281045c0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c28199790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005ab0 tx=0x7f7c18003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c1effd640 1 -- 172.21.15.16:0/3918648434 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1803f070 con 0x7f7c281045c0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2819f590 con 0x7f7c281045c0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c1effd640 1 -- 172.21.15.16:0/3918648434 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c18031b50 con 0x7f7c281045c0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c1effd640 1 -- 172.21.15.16:0/3918648434 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18035030 con 0x7f7c281045c0 2024-09-10T23:42:30.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.030+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c281a5cb0 con 0x7f7c281045c0 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c1effd640 1 -- 172.21.15.16:0/3918648434 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f7c180316a0 con 0x7f7c281045c0 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 Processor -- start 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 -- start start 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896bb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557389625ea0 con 0x5573896bb9a0 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5573896152d0 con 0x5573896afa10 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c323e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5573896190e0 con 0x5573896af0f0 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c2d5a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.033+0000 7f7c2e5a9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2dda8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896bb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2e5a9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:53894/0 (socket says 172.21.15.16:53894) 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2d5a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46290/0 (socket says 172.21.15.16:46290) 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2e5a9640 1 -- 172.21.15.16:0/281612030 learned_addr learned my addr 172.21.15.16:0/281612030 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2dda8640 1 -- 172.21.15.16:0/281612030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 msgr2=0x5573896af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/281612030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2dda8640 1 -- 172.21.15.16:0/281612030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 msgr2=0x5573896bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/281612030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2dda8640 1 -- 172.21.15.16:0/281612030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557389373650 con 0x5573896afa10 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c1effd640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7c140b5450 0x7f7c140b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/281612030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896bb460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009c20 tx=0x7f7c24011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ae18d321075c074 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7c140b5450 0x7f7c140b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c1effd640 1 -- 172.21.15.16:0/3918648434 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f7c18106830 con 0x7f7c281045c0 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c13fff640 1 -- 172.21.15.16:0/281612030 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24004050 con 0x5573896afa10 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c13fff640 1 -- 172.21.15.16:0/281612030 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c240054d0 con 0x5573896afa10 2024-09-10T23:42:30.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.034+0000 7f7c13fff640 1 -- 172.21.15.16:0/281612030 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24004ca0 con 0x5573896afa10 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 -- 172.21.15.16:0/281612030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 msgr2=0x5573896bb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7c140b5450 0x7f7c140b7910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c20010540 tx=0x7f7c20007520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 --2- 172.21.15.16:0/281612030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896bb460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009c20 tx=0x7f7c24011810 comp rx=0 tx=0).stop 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 -- 172.21.15.16:0/281612030 shutdown_connections 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 --2- 172.21.15.16:0/281612030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 --2- 172.21.15.16:0/281612030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896bb460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 --2- 172.21.15.16:0/281612030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 -- 172.21.15.16:0/281612030 >> 172.21.15.16:0/281612030 conn(0x5573896acf20 msgr2=0x5573896ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 -- 172.21.15.16:0/281612030 shutdown_connections 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.035+0000 7f7c323e1740 1 -- 172.21.15.16:0/281612030 wait complete. 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 -- start start 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 Processor -- start 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896bb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557389476700 con 0x5573896bb9a0 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5573895b0160 con 0x5573896afa10 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5573896be620 con 0x5573896af0f0 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c323e1740 10 client.0 _ll_register_callbacks cb 0x5573895c99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c2e5a9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c2e5a9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896b8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46296/0 (socket says 172.21.15.16:46296) 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c2e5a9640 1 -- 172.21.15.16:0/685388383 learned_addr learned my addr 172.21.15.16:0/685388383 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896bb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.036+0000 7f7c2e5a9640 1 -- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 msgr2=0x5573896bb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896bb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c2e5a9640 1 -- 172.21.15.16:0/685388383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 msgr2=0x5573896b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c2e5a9640 1 -- 172.21.15.16:0/685388383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573895ddc90 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896b8b20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7c20005c20 tx=0x7f7c20004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fdf5a572201b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c117fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c117fa640 1 -- 172.21.15.16:0/685388383 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2002b060 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c117fa640 1 -- 172.21.15.16:0/685388383 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f7c20016030 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c240054d0 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c117fa640 1 -- 172.21.15.16:0/685388383 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c20007a10 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c323e1740 10 client.15834 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5573896c9ee0 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c117fa640 1 -- 172.21.15.16:0/685388383 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c240054d0 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.037+0000 7f7c117fa640 1 -- 172.21.15.16:0/685388383 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c2001b430 con 0x5573896bb9a0 2024-09-10T23:42:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c323e1740 10 client.15834 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c323e1740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c323e1740 20 client.15834 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c323e1740 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5573896cb3a0 0x5573896cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c323e1740 4 client.15834 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557389627df0 con 0x5573896cb3a0 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5573896cb3a0 0x5573896cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5573896cb3a0 0x5573896cd820 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3f9841694d40c4 server_cookie=10da1279f67e1834 in_seq=0 out_seq=0 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.038+0000 7f7c117fa640 10 client.15834 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c117fa640 1 -- 172.21.15.16:0/685388383 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557389627df0 con 0x5573896cb3a0 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c117fa640 10 client.15834 handle_command_reply: tid=0 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 client.15834 shutdown 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 msgr2=0x5573896b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896b8b20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7c20005c20 tx=0x7f7c20004ab0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 shutdown_connections 2024-09-10T23:42:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5573896cb3a0 0x5573896cd820 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896bb9a0 0x5573896b8b20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c117fa640 0 client.15834 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 --2- 172.21.15.16:0/685388383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896bb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 >> 172.21.15.16:0/685388383 conn(0x5573896acf20 msgr2=0x5573896b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 shutdown_connections 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 1 -- 172.21.15.16:0/685388383 wait complete. 2024-09-10T23:42:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.039+0000 7f7c323e1740 20 client.15834 trim_cache size 0 max 16384 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 Processor -- start 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 -- start start 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896af0f0 0x5573896b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896bb9a0 0x5573896d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281b0e30 con 0x5573896af0f0 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281ae700 con 0x5573896afa10 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c323e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281ac550 con 0x5573896bb9a0 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c2dda8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896af0f0 0x5573896b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c2dda8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896af0f0 0x5573896b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46312/0 (socket says 172.21.15.16:46312) 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.053+0000 7f7c2dda8640 1 -- 172.21.15.16:0/402484026 learned_addr learned my addr 172.21.15.16:0/402484026 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896bb9a0 0x5573896d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2dda8640 1 -- 172.21.15.16:0/402484026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896bb9a0 msgr2=0x5573896d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896bb9a0 0x5573896d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2dda8640 1 -- 172.21.15.16:0/402484026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 msgr2=0x5573896b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2dda8640 1 -- 172.21.15.16:0/402484026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573896be100 con 0x5573896af0f0 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896af0f0 0x5573896b57f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7c24014040 tx=0x7f7c240056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a314add5b8f134af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c137fe640 1 -- 172.21.15.16:0/402484026 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240044d0 con 0x5573896af0f0 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c137fe640 1 -- 172.21.15.16:0/402484026 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c24004670 con 0x5573896af0f0 2024-09-10T23:42:30.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.054+0000 7f7c137fe640 1 -- 172.21.15.16:0/402484026 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24019690 con 0x5573896af0f0 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 -- 172.21.15.16:0/402484026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896af0f0 msgr2=0x5573896b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896af0f0 0x5573896b57f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7c24014040 tx=0x7f7c240056e0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 -- 172.21.15.16:0/402484026 shutdown_connections 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896bb9a0 0x5573896d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896afa10 0x5573896b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 --2- 172.21.15.16:0/402484026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896af0f0 0x5573896b57f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 -- 172.21.15.16:0/402484026 >> 172.21.15.16:0/402484026 conn(0x5573896acf20 msgr2=0x5573896ba430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 -- 172.21.15.16:0/402484026 shutdown_connections 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 -- 172.21.15.16:0/402484026 wait complete. 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 -- start start 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.055+0000 7f7c323e1740 1 Processor -- start 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896afa10 0x5573896c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c323e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896bb9a0 0x5573897372f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c323e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281acbc0 con 0x5573896afa10 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c323e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281ae030 con 0x5573896bb9a0 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c323e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281ad290 con 0x5573896af0f0 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c323e1740 10 client.0 _ll_register_callbacks cb 0x7f7c20007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896afa10 0x5573896c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896afa10 0x5573896c06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46324/0 (socket says 172.21.15.16:46324) 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3362121070 learned_addr learned my addr 172.21.15.16:0/3362121070 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 msgr2=0x5573896c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3362121070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896bb9a0 msgr2=0x5573897372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896bb9a0 0x5573897372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896bb9a0 0x5573897372f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 -- 172.21.15.16:0/3362121070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557389737a00 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2e5a9640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896bb9a0 0x5573897372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c2d5a7640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896afa10 0x5573896c06c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7c18031440 tx=0x7f7c18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e689fcab404270f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.056+0000 7f7c117fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c117fa640 1 -- 172.21.15.16:0/3362121070 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18049070 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c117fa640 1 -- 172.21.15.16:0/3362121070 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f7c1803dcb0 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c24004670 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c117fa640 1 -- 172.21.15.16:0/3362121070 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c180cc6b0 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 10 client.15840 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557389738cd0 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c117fa640 1 -- 172.21.15.16:0/3362121070 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c24004670 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c117fa640 1 -- 172.21.15.16:0/3362121070 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c18104200 con 0x5573896afa10 2024-09-10T23:42:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 10 client.15840 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 20 client.15840 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557389739400 0x55738973b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 4 client.15840 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.057+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5573896238a0 con 0x557389739400 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557389739400 0x55738973b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c117fa640 10 client.15840 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c2dda8640 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557389739400 0x55738973b820 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17cce176389929d2 server_cookie=bf913434adb30803 in_seq=0 out_seq=0 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c117fa640 1 -- 172.21.15.16:0/3362121070 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5573896238a0 con 0x557389739400 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c117fa640 10 client.15840 handle_command_reply: tid=0 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c323e1740 1 client.15840 shutdown 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896afa10 msgr2=0x5573896c06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.058+0000 7f7c323e1740 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896afa10 0x5573896c06c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7c18031440 tx=0x7f7c18000bc0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 shutdown_connections 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557389739400 0x55738973b820 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5573896bb9a0 0x5573897372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573896afa10 0x5573896c06c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c117fa640 0 client.15840 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 --2- 172.21.15.16:0/3362121070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573896af0f0 0x5573896c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 >> 172.21.15.16:0/3362121070 conn(0x5573896acf20 msgr2=0x5573896ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 shutdown_connections 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 1 -- 172.21.15.16:0/3362121070 wait complete. 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c323e1740 20 client.15840 trim_cache size 0 max 16384 2024-09-10T23:42:30.066 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:42:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7c140b5450 msgr2=0x7f7c140b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7c140b5450 0x7f7c140b7910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c20010540 tx=0x7f7c20007520 comp rx=0 tx=0).stop 2024-09-10T23:42:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 msgr2=0x7f7c28199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c28199790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005ab0 tx=0x7f7c18003b90 comp rx=0 tx=0).stop 2024-09-10T23:42:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 shutdown_connections 2024-09-10T23:42:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c2810d100 0x7f7c2819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.059+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c281045c0 0x7f7c28199790 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.060+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7c140b5450 0x7f7c140b7910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.060+0000 7f7c3000c640 1 --2- 172.21.15.16:0/3918648434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c28103ca0 0x7f7c28199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:30.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.060+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 >> 172.21.15.16:0/3918648434 conn(0x7f7c280fd700 msgr2=0x7f7c2810f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:30.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.060+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 shutdown_connections 2024-09-10T23:42:30.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:30.060+0000 7f7c3000c640 1 -- 172.21.15.16:0/3918648434 wait complete. 2024-09-10T23:42:30.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:30 smithi016 ceph-mon[30855]: pgmap v388: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:42:30.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:30 smithi066 ceph-mon[34761]: pgmap v388: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:42:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:30 smithi071 ceph-mon[35018]: pgmap v388: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:42:31.728 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:42:31.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:42:31.999 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:42:32.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:32 smithi016 ceph-mon[30855]: pgmap v389: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:42:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:32 smithi066 ceph-mon[34761]: pgmap v389: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 -- 172.21.15.16:0/4079845050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06410d100 msgr2=0x7fd06410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 --2- 172.21.15.16:0/4079845050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06410d100 0x7fd06410f560 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009ca0 tx=0x7fd05c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 -- 172.21.15.16:0/4079845050 shutdown_connections 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 --2- 172.21.15.16:0/4079845050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06410d100 0x7fd06410f560 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 --2- 172.21.15.16:0/4079845050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0641045c0 0x7fd06410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 --2- 172.21.15.16:0/4079845050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd064103ca0 0x7fd064104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 -- 172.21.15.16:0/4079845050 >> 172.21.15.16:0/4079845050 conn(0x7fd0640fd700 msgr2=0x7fd0640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 -- 172.21.15.16:0/4079845050 shutdown_connections 2024-09-10T23:42:32.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 -- 172.21.15.16:0/4079845050 wait complete. 2024-09-10T23:42:32.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 Processor -- start 2024-09-10T23:42:32.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.497+0000 7fd06a20b640 1 -- start start 2024-09-10T23:42:32.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd06a20b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd064103ca0 0x7fd064199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd06a20b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0641045c0 0x7fd0641997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd06a20b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd06410d100 0x7fd06419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd06a20b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd064112d70 con 0x7fd064103ca0 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd06a20b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd064112bf0 con 0x7fd0641045c0 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd06a20b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd064112ef0 con 0x7fd06410d100 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd064103ca0 0x7fd064199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd064103ca0 0x7fd064199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46346/0 (socket says 172.21.15.16:46346) 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 -- 172.21.15.16:0/904898701 learned_addr learned my addr 172.21.15.16:0/904898701 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd062ffd640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0641045c0 0x7fd0641997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd063fff640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd06410d100 0x7fd06419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 -- 172.21.15.16:0/904898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd06410d100 msgr2=0x7fd06419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd06410d100 0x7fd06419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 -- 172.21.15.16:0/904898701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0641045c0 msgr2=0x7fd0641997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0641045c0 0x7fd0641997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 -- 172.21.15.16:0/904898701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06419f330 con 0x7fd064103ca0 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.498+0000 7fd0637fe640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd064103ca0 0x7fd064199280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd05400d950 tx=0x7fd05400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.499+0000 7fd060ff9640 1 -- 172.21.15.16:0/904898701 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054017070 con 0x7fd064103ca0 2024-09-10T23:42:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.499+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06419f620 con 0x7fd064103ca0 2024-09-10T23:42:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.499+0000 7fd060ff9640 1 -- 172.21.15.16:0/904898701 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd054009c30 con 0x7fd064103ca0 2024-09-10T23:42:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.499+0000 7fd060ff9640 1 -- 172.21.15.16:0/904898701 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05400f620 con 0x7fd064103ca0 2024-09-10T23:42:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.499+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0641a5ce0 con 0x7fd064103ca0 2024-09-10T23:42:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.501+0000 7fd060ff9640 1 -- 172.21.15.16:0/904898701 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd054010460 con 0x7fd064103ca0 2024-09-10T23:42:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.501+0000 7fd06c5e0740 1 Processor -- start 2024-09-10T23:42:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd06c5e0740 1 -- start start 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b0142c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b020250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b022b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e71af8ae60 con 0x55e71b013ee0 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e71af7a290 con 0x55e71b014800 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e71af7e0a0 con 0x55e71b020790 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b0142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b0142c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46356/0 (socket says 172.21.15.16:46356) 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 -- 172.21.15.16:0/166997137 learned_addr learned my addr 172.21.15.16:0/166997137 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd062ffd640 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b022b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd0637fe640 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b020250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 -- 172.21.15.16:0/166997137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 msgr2=0x55e71b022b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b022b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 -- 172.21.15.16:0/166997137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 msgr2=0x55e71b020250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b020250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd063fff640 1 -- 172.21.15.16:0/166997137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71acd8930 con 0x55e71b013ee0 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd0637fe640 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b020250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.502+0000 7fd062ffd640 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b022b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.503+0000 7fd060ff9640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd0500b5450 0x7fd0500b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.503+0000 7fd063fff640 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b0142c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0099c0 tx=0x7fd05c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7f1d37f4b670a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.503+0000 7fd0637fe640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd0500b5450 0x7fd0500b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.503+0000 7fd060ff9640 1 -- 172.21.15.16:0/904898701 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd0540e5c20 con 0x7fd064103ca0 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.503+0000 7fd059ffb640 1 -- 172.21.15.16:0/166997137 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c031710 con 0x55e71b013ee0 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.503+0000 7fd059ffb640 1 -- 172.21.15.16:0/166997137 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd05c040070 con 0x55e71b013ee0 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.503+0000 7fd059ffb640 1 -- 172.21.15.16:0/166997137 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0047a0 con 0x55e71b013ee0 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 -- 172.21.15.16:0/166997137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 msgr2=0x55e71b0142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd0637fe640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd0500b5450 0x7fd0500b7910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd0540e3480 tx=0x7fd054010cb0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b0142c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0099c0 tx=0x7fd05c0099f0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 -- 172.21.15.16:0/166997137 shutdown_connections 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b022b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b020250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/166997137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b0142c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 -- 172.21.15.16:0/166997137 >> 172.21.15.16:0/166997137 conn(0x55e71b011d10 msgr2=0x55e71b012eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 -- 172.21.15.16:0/166997137 shutdown_connections 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 -- 172.21.15.16:0/166997137 wait complete. 2024-09-10T23:42:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.504+0000 7fd06c5e0740 1 -- start start 2024-09-10T23:42:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 1 Processor -- start 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b013ee0 0x55e71b01d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b014800 0x55e71b01dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b01e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e71addb890 con 0x55e71b020790 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e71af14d40 con 0x55e71b013ee0 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e71b0277f0 con 0x55e71b014800 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd06c5e0740 10 client.0 _ll_register_callbacks cb 0x55e71af78c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b01e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b01e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46372/0 (socket says 172.21.15.16:46372) 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 -- 172.21.15.16:0/2141733688 learned_addr learned my addr 172.21.15.16:0/2141733688 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd062ffd640 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b014800 0x55e71b01dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b013ee0 0x55e71b01d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 -- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b014800 msgr2=0x55e71b01dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b014800 0x55e71b01dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 -- 172.21.15.16:0/2141733688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b013ee0 msgr2=0x55e71b01d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b013ee0 0x55e71b01d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.505+0000 7fd063fff640 1 -- 172.21.15.16:0/2141733688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71b030c50 con 0x55e71b020790 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd063fff640 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b01e260 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009620 tx=0x7fd05c03e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5111ff22a4c3c13a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd042ffd640 1 -- 172.21.15.16:0/2141733688 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c003db0 con 0x55e71b020790 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd042ffd640 1 -- 172.21.15.16:0/2141733688 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd05c02f660 con 0x55e71b020790 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd05c040070 con 0x55e71b020790 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd042ffd640 1 -- 172.21.15.16:0/2141733688 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd05c004b40 con 0x55e71b020790 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 10 client.15852 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e71b033570 con 0x55e71b020790 2024-09-10T23:42:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd042ffd640 1 -- 172.21.15.16:0/2141733688 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd05c040070 con 0x55e71b020790 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd042ffd640 1 -- 172.21.15.16:0/2141733688 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd05c05c020 con 0x55e71b020790 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 10 client.15852 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 20 client.15852 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0348c0 0x55e71b036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 4 client.15852 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.506+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e71af8cdb0 con 0x55e71b0348c0 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.507+0000 7fd062ffd640 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0348c0 0x55e71b036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.507+0000 7fd062ffd640 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0348c0 0x55e71b036cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c115e6e40599ef3 server_cookie=76aa5bc1fa348e0b in_seq=0 out_seq=0 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.507+0000 7fd042ffd640 10 client.15852 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd042ffd640 1 -- 172.21.15.16:0/2141733688 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e71af8cdb0 con 0x55e71b0348c0 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd042ffd640 10 client.15852 handle_command_reply: tid=0 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 client.15852 shutdown 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 msgr2=0x55e71b01e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b01e260 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009620 tx=0x7fd05c03e040 comp rx=0 tx=0).stop 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 shutdown_connections 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0348c0 0x55e71b036cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b01e260 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd042ffd640 0 client.15852 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b014800 0x55e71b01dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/2141733688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b013ee0 0x55e71b01d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 >> 172.21.15.16:0/2141733688 conn(0x55e71b011d10 msgr2=0x55e71b010f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 shutdown_connections 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.508+0000 7fd06c5e0740 1 -- 172.21.15.16:0/2141733688 wait complete. 2024-09-10T23:42:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.509+0000 7fd06c5e0740 20 client.15852 trim_cache size 0 max 16384 2024-09-10T23:42:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:32 smithi071 ceph-mon[35018]: pgmap v389: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 Processor -- start 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 -- start start 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b017f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b01de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b01a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0641aed90 con 0x55e71b013ee0 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0641ac660 con 0x55e71b014800 2024-09-10T23:42:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0641aa4b0 con 0x55e71b020790 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b017f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b017f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46386/0 (socket says 172.21.15.16:46386) 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.526+0000 7fd063fff640 1 -- 172.21.15.16:0/3862726650 learned_addr learned my addr 172.21.15.16:0/3862726650 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd062ffd640 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b01de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd063fff640 1 -- 172.21.15.16:0/3862726650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 msgr2=0x55e71b01a9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd063fff640 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b01a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd063fff640 1 -- 172.21.15.16:0/3862726650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 msgr2=0x55e71b01de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd063fff640 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b01de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd063fff640 1 -- 172.21.15.16:0/3862726650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71b012560 con 0x55e71b013ee0 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd063fff640 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b017f50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0042d0 tx=0x7fd05c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10eecf03193065d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd0597fa640 1 -- 172.21.15.16:0/3862726650 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0318b0 con 0x55e71b013ee0 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd0597fa640 1 -- 172.21.15.16:0/3862726650 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd05c062020 con 0x55e71b013ee0 2024-09-10T23:42:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.527+0000 7fd0597fa640 1 -- 172.21.15.16:0/3862726650 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c030840 con 0x55e71b013ee0 2024-09-10T23:42:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3862726650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 msgr2=0x55e71b017f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b017f50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0042d0 tx=0x7fd05c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3862726650 shutdown_connections 2024-09-10T23:42:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b020790 0x55e71b01a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b01de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3862726650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b013ee0 0x55e71b017f50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3862726650 >> 172.21.15.16:0/3862726650 conn(0x55e71b011d10 msgr2=0x55e71b01d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3862726650 shutdown_connections 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3862726650 wait complete. 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 -- start start 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.528+0000 7fd06c5e0740 1 Processor -- start 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b013ee0 0x55e71b0380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b0385f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b0a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0641aab20 con 0x55e71b020790 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0641abf90 con 0x55e71b014800 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0641ab1f0 con 0x55e71b013ee0 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 10 client.0 _ll_register_callbacks cb 0x7fd05c009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b0a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b0a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46392/0 (socket says 172.21.15.16:46392) 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 -- 172.21.15.16:0/3415597475 learned_addr learned my addr 172.21.15.16:0/3415597475 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd062ffd640 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b0385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b013ee0 0x55e71b0380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 -- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b013ee0 msgr2=0x55e71b0380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b013ee0 0x55e71b0380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 -- 172.21.15.16:0/3415597475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 msgr2=0x55e71b0385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b0385f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 -- 172.21.15.16:0/3415597475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71b0a0970 con 0x55e71b020790 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd063fff640 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b0a0430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009620 tx=0x7fd05c0093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c87fa8dd4867c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd042ffd640 1 -- 172.21.15.16:0/3415597475 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c030ce0 con 0x55e71b020790 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd05c062020 con 0x55e71b020790 2024-09-10T23:42:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.529+0000 7fd042ffd640 1 -- 172.21.15.16:0/3415597475 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd05c030a60 con 0x55e71b020790 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd042ffd640 1 -- 172.21.15.16:0/3415597475 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd05c003db0 con 0x55e71b020790 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 10 client.15858 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e71b0a1c00 con 0x55e71b020790 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd042ffd640 1 -- 172.21.15.16:0/3415597475 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd05c062020 con 0x55e71b020790 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd042ffd640 1 -- 172.21.15.16:0/3415597475 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd05c05c070 con 0x55e71b020790 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 10 client.15858 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 20 client.15858 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0a22b0 0x55e71b0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 4 client.15858 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e71af88860 con 0x55e71b0a22b0 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.530+0000 7fd062ffd640 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0a22b0 0x55e71b0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.531+0000 7fd062ffd640 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0a22b0 0x55e71b0a46a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25ce73cf92f1528f server_cookie=af315c2c66722b42 in_seq=0 out_seq=0 2024-09-10T23:42:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.531+0000 7fd042ffd640 10 client.15858 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.532+0000 7fd042ffd640 1 -- 172.21.15.16:0/3415597475 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e71af88860 con 0x55e71b0a22b0 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.532+0000 7fd042ffd640 10 client.15858 handle_command_reply: tid=0 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.532+0000 7fd06c5e0740 1 client.15858 shutdown 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 msgr2=0x55e71b0a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b0a0430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009620 tx=0x7fd05c0093f0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 shutdown_connections 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e71b0a22b0 0x55e71b0a46a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e71b020790 0x55e71b0a0430 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd042ffd640 0 client.15858 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e71b014800 0x55e71b0385f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 --2- 172.21.15.16:0/3415597475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e71b013ee0 0x55e71b0380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 >> 172.21.15.16:0/3415597475 conn(0x55e71b011d10 msgr2=0x55e71b01df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 shutdown_connections 2024-09-10T23:42:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 1 -- 172.21.15.16:0/3415597475 wait complete. 2024-09-10T23:42:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.533+0000 7fd06c5e0740 20 client.15858 trim_cache size 0 max 16384 2024-09-10T23:42:32.538 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:42:32.538 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:42:32.538 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "28040b4e-b0ec-451e-ab01-68613a292947", 2024-09-10T23:42:32.538 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:42:32.538 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd0500b5450 msgr2=0x7fd0500b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd0500b5450 0x7fd0500b7910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd0540e3480 tx=0x7fd054010cb0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd064103ca0 msgr2=0x7fd064199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd064103ca0 0x7fd064199280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd05400d950 tx=0x7fd05400de10 comp rx=0 tx=0).stop 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 shutdown_connections 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd06410d100 0x7fd06419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd0500b5450 0x7fd0500b7910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0641045c0 0x7fd0641997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 --2- 172.21.15.16:0/904898701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd064103ca0 0x7fd064199280 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:32.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 >> 172.21.15.16:0/904898701 conn(0x7fd0640fd700 msgr2=0x7fd0640fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:32.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 shutdown_connections 2024-09-10T23:42:32.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:32.534+0000 7fd06a20b640 1 -- 172.21.15.16:0/904898701 wait complete. 2024-09-10T23:42:33.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:42:33.686 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:42:34.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:34 smithi016 ceph-mon[30855]: pgmap v390: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:42:34.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:34 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:42:34.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:34 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:42:34.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:34 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:42:34.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:34 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:42:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 -- 172.21.15.16:0/4165255892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a01076a0 msgr2=0x7f69a0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 --2- 172.21.15.16:0/4165255892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a01076a0 0x7f69a0107ae0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6990009900 tx=0x7f699002a410 comp rx=0 tx=0).stop 2024-09-10T23:42:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 -- 172.21.15.16:0/4165255892 shutdown_connections 2024-09-10T23:42:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 --2- 172.21.15.16:0/4165255892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69a0108020 0x7f69a010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 --2- 172.21.15.16:0/4165255892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a01076a0 0x7f69a0107ae0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 --2- 172.21.15.16:0/4165255892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69a0101c90 0x7f69a0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 -- 172.21.15.16:0/4165255892 >> 172.21.15.16:0/4165255892 conn(0x7f69a00fd700 msgr2=0x7f69a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 -- 172.21.15.16:0/4165255892 shutdown_connections 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 -- 172.21.15.16:0/4165255892 wait complete. 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 Processor -- start 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.148+0000 7f69a86e8640 1 -- start start 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a86e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69a0101c90 0x7f69a0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a86e8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69a01076a0 0x7f69a0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a86e8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a0108020 0x7f69a019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a86e8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69a0111ce0 con 0x7f69a0108020 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a86e8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69a0111b60 con 0x7f69a0101c90 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a86e8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69a0111e60 con 0x7f69a01076a0 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a0108020 0x7f69a019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a0108020 0x7f69a019ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51502/0 (socket says 172.21.15.16:51502) 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 -- 172.21.15.16:0/594851340 learned_addr learned my addr 172.21.15.16:0/594851340 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a5c83640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69a01076a0 0x7f69a0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6484640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69a0101c90 0x7f69a0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 -- 172.21.15.16:0/594851340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69a01076a0 msgr2=0x7f69a0199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69a01076a0 0x7f69a0199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 -- 172.21.15.16:0/594851340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69a0101c90 msgr2=0x7f69a0199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69a0101c90 0x7f69a0199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 -- 172.21.15.16:0/594851340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a019f3c0 con 0x7f69a0108020 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6484640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69a0101c90 0x7f69a0199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a5c83640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69a01076a0 0x7f69a0199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.149+0000 7f69a6c85640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a0108020 0x7f69a019ebf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f699800cad0 tx=0x7f699800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.150+0000 7f69977fe640 1 -- 172.21.15.16:0/594851340 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699800ae20 con 0x7f69a0108020 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.150+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a019f6b0 con 0x7f69a0108020 2024-09-10T23:42:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.150+0000 7f69977fe640 1 -- 172.21.15.16:0/594851340 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6998005020 con 0x7f69a0108020 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.150+0000 7f69977fe640 1 -- 172.21.15.16:0/594851340 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699800f6b0 con 0x7f69a0108020 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.150+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a01a5d70 con 0x7f69a0108020 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.152+0000 7f69977fe640 1 -- 172.21.15.16:0/594851340 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f69980054f0 con 0x7f69a0108020 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.152+0000 7f69aaabd740 1 Processor -- start 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69aaabd740 1 -- start start 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a00040860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a0004c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69aaabd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5629fffb6e50 con 0x562a00040480 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69aaabd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5629fffa6280 con 0x562a0004cd30 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69aaabd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5629fffaa090 con 0x562a00040da0 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69a5c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a00040860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69a5c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a00040860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51506/0 (socket says 172.21.15.16:51506) 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69a5c83640 1 -- 172.21.15.16:0/667422870 learned_addr learned my addr 172.21.15.16:0/667422870 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69a6484640 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a0004c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.153+0000 7f69a5c83640 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a6484640 1 -- 172.21.15.16:0/667422870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 msgr2=0x562a0004f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a6484640 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a6484640 1 -- 172.21.15.16:0/667422870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 msgr2=0x562a00040860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a6484640 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a00040860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a6484640 1 -- 172.21.15.16:0/667422870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ffd04650 con 0x562a00040da0 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a5c83640 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a00040860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69977fe640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f698c0b5450 0x7f698c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a5c83640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f698c0b5450 0x7f698c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a6484640 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a0004c7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f699c009c30 tx=0x7f699c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a125b20edf19d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69977fe640 1 -- 172.21.15.16:0/594851340 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f69980e6010 con 0x7f69a0108020 2024-09-10T23:42:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f6994ff9640 1 -- 172.21.15.16:0/667422870 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c012450 con 0x562a00040da0 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f6994ff9640 1 -- 172.21.15.16:0/667422870 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f699c012aa0 con 0x562a00040da0 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f69a5c83640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f698c0b5450 0x7f698c0b7910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6990005ec0 tx=0x7f699003f040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.154+0000 7f6994ff9640 1 -- 172.21.15.16:0/667422870 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c00f9f0 con 0x562a00040da0 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 -- 172.21.15.16:0/667422870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 msgr2=0x562a0004c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a0004c7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f699c009c30 tx=0x7f699c0117b0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 -- 172.21.15.16:0/667422870 shutdown_connections 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a0004c7f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 --2- 172.21.15.16:0/667422870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a00040860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 -- 172.21.15.16:0/667422870 >> 172.21.15.16:0/667422870 conn(0x562a0003e2b0 msgr2=0x562a0003f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 -- 172.21.15.16:0/667422870 shutdown_connections 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 -- 172.21.15.16:0/667422870 wait complete. 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.155+0000 7f69aaabd740 1 -- start start 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 1 Processor -- start 2024-09-10T23:42:34.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a0004c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a00049a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a00049fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5629ffe07700 con 0x562a00040480 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5629fff41110 con 0x562a0004cd30 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a0004f9b0 con 0x562a00040da0 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a0004c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69aaabd740 10 client.0 _ll_register_callbacks cb 0x5629fff5a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a0004c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51508/0 (socket says 172.21.15.16:51508) 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 -- 172.21.15.16:0/1989076400 learned_addr learned my addr 172.21.15.16:0/1989076400 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a5c83640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a00049a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 -- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 msgr2=0x562a00049a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6c85640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a00049fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a00049a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 -- 172.21.15.16:0/1989076400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 msgr2=0x562a00049fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a00049fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 -- 172.21.15.16:0/1989076400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629fff6ec40 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6c85640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a00049fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.156+0000 7f69a6484640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a0004c5d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f699c01c040 tx=0x7f699c012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dd8176df4c9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f6989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f6989ffb640 1 -- 172.21.15.16:0/1989076400 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0126e0 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f6989ffb640 1 -- 172.21.15.16:0/1989076400 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f699c012880 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f699c012aa0 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f6989ffb640 1 -- 172.21.15.16:0/1989076400 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f699c033050 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 10 client.15870 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a0005b2a0 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f6989ffb640 1 -- 172.21.15.16:0/1989076400 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f699c012aa0 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f6989ffb640 1 -- 172.21.15.16:0/1989076400 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f699c0046c0 con 0x562a00040480 2024-09-10T23:42:34.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 10 client.15870 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 20 client.15870 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a0005eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 4 client.15870 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.157+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629fffb8da0 con 0x562a0005c700 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.158+0000 7f69a5c83640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a0005eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.158+0000 7f6989ffb640 10 client.15870 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.158+0000 7f69a5c83640 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a0005eaf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6cb21ff0920bd86 server_cookie=5d3a5667cd18ac2 in_seq=0 out_seq=0 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f6989ffb640 1 -- 172.21.15.16:0/1989076400 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629fffb8da0 con 0x562a0005c700 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f6989ffb640 10 client.15870 handle_command_reply: tid=0 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 client.15870 shutdown 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 msgr2=0x562a0004c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a0004c5d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f699c01c040 tx=0x7f699c012f00 comp rx=0 tx=0).stop 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 shutdown_connections 2024-09-10T23:42:34.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a0005eaf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f6989ffb640 0 client.15870 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a00049fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040da0 0x562a00049a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1989076400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040480 0x562a0004c5d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 >> 172.21.15.16:0/1989076400 conn(0x562a0003e2b0 msgr2=0x562a00043e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 shutdown_connections 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 1 -- 172.21.15.16:0/1989076400 wait complete. 2024-09-10T23:42:34.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.159+0000 7f69aaabd740 20 client.15870 trim_cache size 0 max 16384 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 Processor -- start 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 -- start start 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a00040480 0x562a00058be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a0004e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a0004cd30 0x562a0004e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01b0f60 con 0x562a00040da0 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01ae830 con 0x562a00040480 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.177+0000 7f69aaabd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01ac680 con 0x562a0004cd30 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a0004e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a0004e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51518/0 (socket says 172.21.15.16:51518) 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 -- 172.21.15.16:0/3395872052 learned_addr learned my addr 172.21.15.16:0/3395872052 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a6c85640 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a0004cd30 0x562a0004e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a6484640 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a00040480 0x562a00058be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 -- 172.21.15.16:0/3395872052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a0004cd30 msgr2=0x562a0004e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a0004cd30 0x562a0004e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 -- 172.21.15.16:0/3395872052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a00040480 msgr2=0x562a00058be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a00040480 0x562a00058be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 -- 172.21.15.16:0/3395872052 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a0003dae0 con 0x562a00040da0 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a6484640 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a00040480 0x562a00058be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.178+0000 7f69a5c83640 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a0004e120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6990009900 tx=0x7f6990039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c9eb3515bbdc5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f698bfff640 1 -- 172.21.15.16:0/3395872052 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990004240 con 0x562a00040da0 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f698bfff640 1 -- 172.21.15.16:0/3395872052 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69900043e0 con 0x562a00040da0 2024-09-10T23:42:34.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f698bfff640 1 -- 172.21.15.16:0/3395872052 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69900538d0 con 0x562a00040da0 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 -- 172.21.15.16:0/3395872052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 msgr2=0x562a0004e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a0004e120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6990009900 tx=0x7f6990039000 comp rx=0 tx=0).stop 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 -- 172.21.15.16:0/3395872052 shutdown_connections 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a0004cd30 0x562a0004e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a0004e120 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 --2- 172.21.15.16:0/3395872052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a00040480 0x562a00058be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 -- 172.21.15.16:0/3395872052 >> 172.21.15.16:0/3395872052 conn(0x562a0003e2b0 msgr2=0x562a0003d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 -- 172.21.15.16:0/3395872052 shutdown_connections 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.179+0000 7f69aaabd740 1 -- 172.21.15.16:0/3395872052 wait complete. 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 -- start start 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 Processor -- start 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040480 0x562a00054ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a00055440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01accf0 con 0x562a00040da0 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69a5c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a00055440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01ae160 con 0x562a0004cd30 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69a5c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a00055440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51532/0 (socket says 172.21.15.16:51532) 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01ad3c0 con 0x562a00040480 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69a5c83640 1 -- 172.21.15.16:0/1490719222 learned_addr learned my addr 172.21.15.16:0/1490719222 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69aaabd740 10 client.0 _ll_register_callbacks cb 0x7f699c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.180+0000 7f69a6484640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040480 0x562a00054ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a6c85640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a5c83640 1 -- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040480 msgr2=0x562a00054ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a5c83640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040480 0x562a00054ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a5c83640 1 -- 172.21.15.16:0/1490719222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 msgr2=0x562a0004fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:42:34.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a5c83640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a5c83640 1 -- 172.21.15.16:0/1490719222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a00050450 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a6c85640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69a5c83640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a00055440 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f699002a930 tx=0x7f69900318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deec72deef24c69d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f6989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f6989ffb640 1 -- 172.21.15.16:0/1490719222 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990062070 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f6989ffb640 1 -- 172.21.15.16:0/1490719222 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6990003b40 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69900043e0 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f6989ffb640 1 -- 172.21.15.16:0/1490719222 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6990003d40 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69aaabd740 10 client.15876 fetch_fsmap learned FSMap version 25 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a000c9e10 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.181+0000 7f6989ffb640 1 -- 172.21.15.16:0/1490719222 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69900043e0 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f6989ffb640 1 -- 172.21.15.16:0/1490719222 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f699c009d20 con 0x562a00040da0 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f69aaabd740 10 client.15876 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f69aaabd740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:42:34.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f69aaabd740 20 client.15876 populate_metadata read hostname 'smithi016' 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a000cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f69aaabd740 4 client.15876 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5629fffb4850 con 0x562a0005c700 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.182+0000 7f69a6484640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a000cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69a6484640 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a000cc570 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3159d9a53e969b server_cookie=849080ccc3b03422 in_seq=0 out_seq=0 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f6989ffb640 10 client.15876 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f6989ffb640 1 -- 172.21.15.16:0/1490719222 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x5629fffb4850 con 0x562a0005c700 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f6989ffb640 10 client.15876 handle_command_reply: tid=0 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 client.15876 shutdown 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 msgr2=0x562a00055440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a00055440 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f699002a930 tx=0x7f69900318e0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 shutdown_connections 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562a0005c700 0x562a000cc570 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562a0004cd30 0x562a0004fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562a00040da0 0x562a00055440 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f6989ffb640 0 client.15876 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 --2- 172.21.15.16:0/1490719222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a00040480 0x562a00054ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 >> 172.21.15.16:0/1490719222 conn(0x562a0003e2b0 msgr2=0x562a000434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 shutdown_connections 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 1 -- 172.21.15.16:0/1490719222 wait complete. 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.183+0000 7f69aaabd740 20 client.15876 trim_cache size 0 max 16384 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:42:34.192 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "28040b4e-b0ec-451e-ab01-68613a292947", 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:34.193 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:34.194 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:42:34.195 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:42:34.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f698c0b5450 msgr2=0x7f698c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f698c0b5450 0x7f698c0b7910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6990005ec0 tx=0x7f699003f040 comp rx=0 tx=0).stop 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a0108020 msgr2=0x7f69a019ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a0108020 0x7f69a019ebf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f699800cad0 tx=0x7f699800cf90 comp rx=0 tx=0).stop 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 shutdown_connections 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a0108020 0x7f69a019ebf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69a01076a0 0x7f69a0199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f698c0b5450 0x7f698c0b7910 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 --2- 172.21.15.16:0/594851340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69a0101c90 0x7f69a0199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 >> 172.21.15.16:0/594851340 conn(0x7f69a00fd700 msgr2=0x7f69a006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 shutdown_connections 2024-09-10T23:42:34.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:42:34.184+0000 7f69a86e8640 1 -- 172.21.15.16:0/594851340 wait complete. 2024-09-10T23:42:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:34 smithi066 ceph-mon[34761]: pgmap v390: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:42:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:34 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:42:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:34 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:42:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:34 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:42:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:34 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:42:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:34 smithi071 ceph-mon[35018]: pgmap v390: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:42:34.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:34 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:42:34.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:34 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:42:34.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:34 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:42:34.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:34 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:42:34.900 INFO:tasks.cephfs.filesystem:scrub status for tag:28040b4e-b0ec-451e-ab01-68613a292947 - {'path': '/', 'tag': '28040b4e-b0ec-451e-ab01-68613a292947', 'options': 'recursive,force'} 2024-09-10T23:42:36.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:36 smithi066 ceph-mon[34761]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:36.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:36 smithi016 ceph-mon[30855]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:36.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:36 smithi071 ceph-mon[35018]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:38 smithi066 ceph-mon[34761]: pgmap v392: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:38 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:42:38.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:38 smithi016 ceph-mon[30855]: pgmap v392: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:38.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:38 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:42:38.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:38 smithi071 ceph-mon[35018]: pgmap v392: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:38.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:38 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:42:40.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:40 smithi066 ceph-mon[34761]: pgmap v393: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:42:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:40 smithi016 ceph-mon[30855]: pgmap v393: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:42:40.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:40 smithi071 ceph-mon[35018]: pgmap v393: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:42:42.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:42 smithi066 ceph-mon[34761]: pgmap v394: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:42:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:42 smithi016 ceph-mon[30855]: pgmap v394: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:42:42.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:42 smithi071 ceph-mon[35018]: pgmap v394: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:42:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:44 smithi066 ceph-mon[34761]: pgmap v395: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:42:44.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:44 smithi016 ceph-mon[30855]: pgmap v395: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:42:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:44 smithi071 ceph-mon[35018]: pgmap v395: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:42:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:46 smithi066 ceph-mon[34761]: pgmap v396: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:42:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:46 smithi016 ceph-mon[30855]: pgmap v396: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:42:46.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:46 smithi071 ceph-mon[35018]: pgmap v396: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:42:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:48 smithi016 ceph-mon[30855]: pgmap v397: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:42:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:48 smithi071 ceph-mon[35018]: pgmap v397: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:42:48.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:48 smithi066 ceph-mon[34761]: pgmap v397: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:42:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:50 smithi016 ceph-mon[30855]: pgmap v398: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:42:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:50 smithi071 ceph-mon[35018]: pgmap v398: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:42:50.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:50 smithi066 ceph-mon[34761]: pgmap v398: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:42:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:52 smithi016 ceph-mon[30855]: pgmap v399: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:42:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:52 smithi071 ceph-mon[35018]: pgmap v399: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:42:52.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:52 smithi066 ceph-mon[34761]: pgmap v399: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:42:54.321 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:54 smithi071 ceph-mon[35018]: pgmap v400: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:42:54.354 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:54 smithi066 ceph-mon[34761]: pgmap v400: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:42:54.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:54 smithi016 ceph-mon[30855]: pgmap v400: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:42:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:56 smithi016 ceph-mon[30855]: pgmap v401: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:56.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:56 smithi071 ceph-mon[35018]: pgmap v401: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:56.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:56 smithi066 ceph-mon[34761]: pgmap v401: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:42:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:42:58 smithi016 ceph-mon[30855]: pgmap v402: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:42:58 smithi071 ceph-mon[35018]: pgmap v402: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:42:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:42:58 smithi066 ceph-mon[34761]: pgmap v402: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:00.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:00 smithi016 ceph-mon[30855]: pgmap v403: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:00.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:00 smithi071 ceph-mon[35018]: pgmap v403: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:00.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:00 smithi066 ceph-mon[34761]: pgmap v403: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:02 smithi016 ceph-mon[30855]: pgmap v404: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:02 smithi071 ceph-mon[35018]: pgmap v404: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:02.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:02 smithi066 ceph-mon[34761]: pgmap v404: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:04.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:04 smithi016 ceph-mon[30855]: pgmap v405: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:43:04.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:04 smithi071 ceph-mon[35018]: pgmap v405: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:43:04.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:04 smithi066 ceph-mon[34761]: pgmap v405: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:43:04.901 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:43:05.176 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:05.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/3298606405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8102dc0 msgr2=0x7fd2b81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/3298606405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8102dc0 0x7fd2b81031a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009900 tx=0x7fd2a802a410 comp rx=0 tx=0).stop 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/3298606405 shutdown_connections 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/3298606405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b8109150 0x7fd2b810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/3298606405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b81087d0 0x7fd2b8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/3298606405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8102dc0 0x7fd2b81031a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/3298606405 >> 172.21.15.16:0/3298606405 conn(0x7fd2b80fe830 msgr2=0x7fd2b8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/3298606405 shutdown_connections 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/3298606405 wait complete. 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.655+0000 7fd2bd5fc640 1 Processor -- start 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2bd5fc640 1 -- start start 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2bd5fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b8102dc0 0x7fd2b81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2bd5fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b81087d0 0x7fd2b81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2bd5fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8109150 0x7fd2b819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2bd5fc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112dd0 con 0x7fd2b8109150 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2bd5fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112c50 con 0x7fd2b8102dc0 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2bd5fc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112f50 con 0x7fd2b81087d0 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8109150 0x7fd2b819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8109150 0x7fd2b819eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55562/0 (socket says 172.21.15.16:55562) 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 -- 172.21.15.16:0/2481176857 learned_addr learned my addr 172.21.15.16:0/2481176857 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b81087d0 0x7fd2b81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 -- 172.21.15.16:0/2481176857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b81087d0 msgr2=0x7fd2b81997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b81087d0 0x7fd2b81997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 -- 172.21.15.16:0/2481176857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b8102dc0 msgr2=0x7fd2b81992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b8102dc0 0x7fd2b81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b8102dc0 0x7fd2b81992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 -- 172.21.15.16:0/2481176857 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b819f350 con 0x7fd2b8109150 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b8102dc0 0x7fd2b81992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.656+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8109150 0x7fd2b819eb80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000eaa0 tx=0x7fd2b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.657+0000 7fd2b4ff9640 1 -- 172.21.15.16:0/2481176857 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000cdb0 con 0x7fd2b8109150 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.657+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b819f640 con 0x7fd2b8109150 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.657+0000 7fd2b4ff9640 1 -- 172.21.15.16:0/2481176857 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b0005020 con 0x7fd2b8109150 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.657+0000 7fd2b4ff9640 1 -- 172.21.15.16:0/2481176857 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00116d0 con 0x7fd2b8109150 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.657+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b81a5d00 con 0x7fd2b8109150 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.659+0000 7fd2bf9d1740 1 Processor -- start 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.659+0000 7fd2b4ff9640 1 -- 172.21.15.16:0/2481176857 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd2b000f040 con 0x7fd2b8109150 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.659+0000 7fd2bf9d1740 1 -- start start 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1eae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ebec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1ebf140 0x5620d1ec1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5620d1e24e50 con 0x5620d1ebf140 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5620d1e14280 con 0x5620d1eaeda0 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5620d1e18090 con 0x5620d1eae480 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1ebf140 0x5620d1ec1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1ebf140 0x5620d1ec1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55564/0 (socket says 172.21.15.16:55564) 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/2968563968 learned_addr learned my addr 172.21.15.16:0/2968563968 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ebec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1eae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/2968563968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 msgr2=0x5620d1eae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1eae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/2968563968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 msgr2=0x5620d1ebec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ebec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/2968563968 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d1b72650 con 0x5620d1ebf140 2024-09-10T23:43:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2b4ff9640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2a40b5450 0x7fd2a40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.660+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1ebf140 0x5620d1ec1530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00149f0 tx=0x7fd2a000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06f4221ef0345ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2a40b5450 0x7fd2a40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2b4ff9640 1 -- 172.21.15.16:0/2481176857 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd2b00e5ee0 con 0x7fd2b8109150 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2ad7fa640 1 -- 172.21.15.16:0/2968563968 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00142d0 con 0x5620d1ebf140 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2ad7fa640 1 -- 172.21.15.16:0/2968563968 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2a000fc10 con 0x5620d1ebf140 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2ad7fa640 1 -- 172.21.15.16:0/2968563968 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0012ab0 con 0x5620d1ebf140 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/2968563968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1ebf140 msgr2=0x5620d1ec1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2a40b5450 0x7fd2a40b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5620d1eadf60 tx=0x7fd2a8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.661+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1ebf140 0x5620d1ec1530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00149f0 tx=0x7fd2a000c4d0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/2968563968 shutdown_connections 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1ebf140 0x5620d1ec1530 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ebec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/2968563968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1eae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/2968563968 >> 172.21.15.16:0/2968563968 conn(0x5620d1eac2b0 msgr2=0x5620d1ead450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/2968563968 shutdown_connections 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/2968563968 wait complete. 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- start start 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 Processor -- start 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ebead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eaeda0 0x5620d1ebbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1ebc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5620d1c75700 con 0x5620d1eae480 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5620d1daf110 con 0x5620d1ebf140 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5620d1ec1df0 con 0x5620d1eaeda0 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2bf9d1740 10 client.0 _ll_register_callbacks cb 0x5620d1dc8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.662+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ebead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ebead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55566/0 (socket says 172.21.15.16:55566) 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/350311436 learned_addr learned my addr 172.21.15.16:0/350311436 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1ebc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eaeda0 0x5620d1ebbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eaeda0 msgr2=0x5620d1ebbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eaeda0 0x5620d1ebbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/350311436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 msgr2=0x5620d1ebc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1ebc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/350311436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d1ddcc40 con 0x5620d1eae480 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1ebc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ebead0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8033000 tx=0x7fd2a802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7512c126f0448a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd29e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd29e7fc640 1 -- 172.21.15.16:0/350311436 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a804c070 con 0x5620d1eae480 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd29e7fc640 1 -- 172.21.15.16:0/350311436 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd2a8004310 con 0x5620d1eae480 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2a000fc10 con 0x5620d1eae480 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd29e7fc640 1 -- 172.21.15.16:0/350311436 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2a8058050 con 0x5620d1eae480 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2bf9d1740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.663+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5620d1ecd7c0 con 0x5620d1eae480 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd29e7fc640 1 -- 172.21.15.16:0/350311436 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2a000fc10 con 0x5620d1eae480 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd29e7fc640 1 -- 172.21.15.16:0/350311436 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2a803c600 con 0x5620d1eae480 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd2bf9d1740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd2bf9d1740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd2bf9d1740 20 client.15888 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1ecece0 0x5620d1ed1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd2bf9d1740 4 client.15888 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620d1e26da0 con 0x5620d1ecece0 2024-09-10T23:43:05.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.664+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1ecece0 0x5620d1ed1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.665+0000 7fd29e7fc640 10 client.15888 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.665+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1ecece0 0x5620d1ed1140 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30c5d2ef54203d0f server_cookie=2de38a86b3a990bf in_seq=0 out_seq=0 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.665+0000 7fd29e7fc640 1 -- 172.21.15.16:0/350311436 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620d1e26da0 con 0x5620d1ecece0 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.665+0000 7fd29e7fc640 10 client.15888 handle_command_reply: tid=0 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 client.15888 shutdown 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 msgr2=0x5620d1ebead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ebead0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8033000 tx=0x7fd2a802a410 comp rx=0 tx=0).stop 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 shutdown_connections 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1ecece0 0x5620d1ed1140 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1ebc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd29e7fc640 0 client.15888 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eaeda0 0x5620d1ebbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/350311436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ebead0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 >> 172.21.15.16:0/350311436 conn(0x5620d1eac2b0 msgr2=0x5620d1eb1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:05.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 shutdown_connections 2024-09-10T23:43:05.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/350311436 wait complete. 2024-09-10T23:43:05.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.666+0000 7fd2bf9d1740 20 client.15888 trim_cache size 0 max 16384 2024-09-10T23:43:05.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 Processor -- start 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 -- start start 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1ead970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eaeda0 0x5620d1ecb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1eab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81aece0 con 0x5620d1eaeda0 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81ac5b0 con 0x5620d1ebf140 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81aa400 con 0x5620d1eae480 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eaeda0 0x5620d1ecb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eaeda0 0x5620d1ecb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55582/0 (socket says 172.21.15.16:55582) 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/3676018369 learned_addr learned my addr 172.21.15.16:0/3676018369 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1ead970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1eab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/3676018369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 msgr2=0x5620d1ead970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1ead970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/3676018369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 msgr2=0x5620d1eab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1eab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.684+0000 7fd2ae7fc640 1 -- 172.21.15.16:0/3676018369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d1ebe700 con 0x5620d1eaeda0 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.685+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1eab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.685+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eaeda0 0x5620d1ecb020 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00149f0 tx=0x7fd2a00125f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7e7baae1d89d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.685+0000 7fd2acff9640 1 -- 172.21.15.16:0/3676018369 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00140c0 con 0x5620d1eaeda0 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.685+0000 7fd2acff9640 1 -- 172.21.15.16:0/3676018369 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2a0005a90 con 0x5620d1eaeda0 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.685+0000 7fd2acff9640 1 -- 172.21.15.16:0/3676018369 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0005330 con 0x5620d1eaeda0 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/3676018369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eaeda0 msgr2=0x5620d1ecb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eaeda0 0x5620d1ecb020 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00149f0 tx=0x7fd2a00125f0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/3676018369 shutdown_connections 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1ebf140 0x5620d1eab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eaeda0 0x5620d1ecb020 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/3676018369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1eae480 0x5620d1ead970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/3676018369 >> 172.21.15.16:0/3676018369 conn(0x5620d1eac2b0 msgr2=0x5620d1eaabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/3676018369 shutdown_connections 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/3676018369 wait complete. 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 -- start start 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 Processor -- start 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.686+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ec7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ec75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2bf9d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1ebf140 0x5620d1ec4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81aaa70 con 0x5620d1eae480 2024-09-10T23:43:05.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81abee0 con 0x5620d1eaeda0 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2bf9d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81ab140 con 0x5620d1ebf140 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ec7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ec7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55588/0 (socket says 172.21.15.16:55588) 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/1651470148 learned_addr learned my addr 172.21.15.16:0/1651470148 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2bf9d1740 10 client.0 _ll_register_callbacks cb 0x7fd2a8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1ebf140 0x5620d1ec4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ec75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1ebf140 msgr2=0x5620d1ec4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1ebf140 0x5620d1ec4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/1651470148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 msgr2=0x5620d1ec75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ec75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 -- 172.21.15.16:0/1651470148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d1ec7d50 con 0x5620d1eae480 2024-09-10T23:43:05.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b77fe640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1ebf140 0x5620d1ec4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ec75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2b6ffd640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ec7080 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8031440 tx=0x7fd2a8004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04ab2f4af2d9a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd29e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd29e7fc640 1 -- 172.21.15.16:0/1651470148 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a804c040 con 0x5620d1eae480 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd29e7fc640 1 -- 172.21.15.16:0/1651470148 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd2a803c440 con 0x5620d1eae480 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.687+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620d1e22850 con 0x5620d1eae480 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd29e7fc640 1 -- 172.21.15.16:0/1651470148 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2a806a050 con 0x5620d1eae480 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 10 client.15894 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5620d1f3c1d0 con 0x5620d1eae480 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd29e7fc640 1 -- 172.21.15.16:0/1651470148 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5620d1e22850 con 0x5620d1eae480 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd29e7fc640 1 -- 172.21.15.16:0/1651470148 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2a8051440 con 0x5620d1eae480 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 10 client.15894 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 20 client.15894 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1f3c9d0 0x5620d1f3edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 4 client.15894 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5620d1e1fc80 con 0x5620d1f3c9d0 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.688+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1f3c9d0 0x5620d1f3edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2ae7fc640 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1f3c9d0 0x5620d1f3edf0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a69361ac1197f7c6 server_cookie=7c7808d5674e1b in_seq=0 out_seq=0 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd29e7fc640 10 client.15894 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd29e7fc640 1 -- 172.21.15.16:0/1651470148 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x5620d1e1fc80 con 0x5620d1f3c9d0 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd29e7fc640 10 client.15894 handle_command_reply: tid=0 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 client.15894 shutdown 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 msgr2=0x5620d1ec7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ec7080 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8031440 tx=0x7fd2a8004520 comp rx=0 tx=0).stop 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 shutdown_connections 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5620d1f3c9d0 0x5620d1f3edf0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5620d1ebf140 0x5620d1ec4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5620d1eaeda0 0x5620d1ec75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 --2- 172.21.15.16:0/1651470148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5620d1eae480 0x5620d1ec7080 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 >> 172.21.15.16:0/1651470148 conn(0x5620d1eac2b0 msgr2=0x5620d1eab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:05.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd29e7fc640 0 client.15894 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 shutdown_connections 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 1 -- 172.21.15.16:0/1651470148 wait complete. 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.689+0000 7fd2bf9d1740 20 client.15894 trim_cache size 0 max 16384 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:05.703 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2a40b5450 msgr2=0x7fd2a40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2a40b5450 0x7fd2a40b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5620d1eadf60 tx=0x7fd2a8005a20 comp rx=0 tx=0).stop 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8109150 msgr2=0x7fd2b819eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8109150 0x7fd2b819eb80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000eaa0 tx=0x7fd2b000ef60 comp rx=0 tx=0).stop 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 shutdown_connections 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2b8109150 0x7fd2b819eb80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2b81087d0 0x7fd2b81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd2a40b5450 0x7fd2a40b7910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 --2- 172.21.15.16:0/2481176857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b8102dc0 0x7fd2b81992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 >> 172.21.15.16:0/2481176857 conn(0x7fd2b80fe830 msgr2=0x7fd2b8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 shutdown_connections 2024-09-10T23:43:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:05.690+0000 7fd2bd5fc640 1 -- 172.21.15.16:0/2481176857 wait complete. 2024-09-10T23:43:06.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:06 smithi016 ceph-mon[30855]: pgmap v406: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:06.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:06 smithi071 ceph-mon[35018]: pgmap v406: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:06.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:06 smithi066 ceph-mon[34761]: pgmap v406: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:06.614 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:43:06.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:43:06.880 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 -- 172.21.15.16:0/2001804561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96001045d0 msgr2=0x7f960010cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 --2- 172.21.15.16:0/2001804561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96001045d0 0x7f960010cbb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009ca0 tx=0x7f95f002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 -- 172.21.15.16:0/2001804561 shutdown_connections 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 --2- 172.21.15.16:0/2001804561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960010d180 0x7f960010f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 --2- 172.21.15.16:0/2001804561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96001045d0 0x7f960010cbb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 --2- 172.21.15.16:0/2001804561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9600103bd0 0x7f9600103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 -- 172.21.15.16:0/2001804561 >> 172.21.15.16:0/2001804561 conn(0x7f96000fd700 msgr2=0x7f96000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 -- 172.21.15.16:0/2001804561 shutdown_connections 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.320+0000 7f9607190640 1 -- 172.21.15.16:0/2001804561 wait complete. 2024-09-10T23:43:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 Processor -- start 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 -- start start 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9600103bd0 0x7f960019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96001045d0 0x7f960019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960010d180 0x7f96001a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9600112da0 con 0x7f9600103bd0 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9600112c20 con 0x7f96001045d0 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9607190640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9600112f20 con 0x7f960010d180 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9604f2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9600103bd0 0x7f960019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9604f2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9600103bd0 0x7f960019b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55612/0 (socket says 172.21.15.16:55612) 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f9604f2c640 1 -- 172.21.15.16:0/40965578 learned_addr learned my addr 172.21.15.16:0/40965578 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f95fffff640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96001045d0 0x7f960019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.321+0000 7f960572d640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960010d180 0x7f96001a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9604f2c640 1 -- 172.21.15.16:0/40965578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960010d180 msgr2=0x7f96001a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9604f2c640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960010d180 0x7f96001a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9604f2c640 1 -- 172.21.15.16:0/40965578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96001045d0 msgr2=0x7f960019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9604f2c640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96001045d0 0x7f960019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9604f2c640 1 -- 172.21.15.16:0/40965578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96001a1530 con 0x7f9600103bd0 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9604f2c640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9600103bd0 0x7f960019b480 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c920 tx=0x7f95f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f95fdffb640 1 -- 172.21.15.16:0/40965578 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8007c70 con 0x7f9600103bd0 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f95fdffb640 1 -- 172.21.15.16:0/40965578 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f8007e10 con 0x7f9600103bd0 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96001a1820 con 0x7f9600103bd0 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f95fdffb640 1 -- 172.21.15.16:0/40965578 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8018820 con 0x7f9600103bd0 2024-09-10T23:43:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.322+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96001a7ee0 con 0x7f9600103bd0 2024-09-10T23:43:07.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.323+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9600103fb0 con 0x7f9600103bd0 2024-09-10T23:43:07.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.325+0000 7f95fdffb640 1 -- 172.21.15.16:0/40965578 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f95f800f450 con 0x7f9600103bd0 2024-09-10T23:43:07.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.325+0000 7f95fdffb640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f95ec0b5450 0x7f95ec0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:07.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.326+0000 7f95fffff640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f95ec0b5450 0x7f95ec0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:07.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.326+0000 7f95fdffb640 1 -- 172.21.15.16:0/40965578 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f95f80e60b0 con 0x7f9600103bd0 2024-09-10T23:43:07.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.326+0000 7f95fffff640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f95ec0b5450 0x7f95ec0b7910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f960010e800 tx=0x7f95f0009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:07.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.330+0000 7f95fdffb640 1 -- 172.21.15.16:0/40965578 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f95f8014030 con 0x7f9600103bd0 2024-09-10T23:43:07.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.551+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96001a8290 con 0x7f9600103bd0 2024-09-10T23:43:07.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.551+0000 7f95fdffb640 1 -- 172.21.15.16:0/40965578 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f95f80acc30 con 0x7f9600103bd0 2024-09-10T23:43:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:43:07.553 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:43:07.553 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f95ec0b5450 msgr2=0x7f95ec0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f95ec0b5450 0x7f95ec0b7910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f960010e800 tx=0x7f95f0009360 comp rx=0 tx=0).stop 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9600103bd0 msgr2=0x7f960019b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9600103bd0 0x7f960019b480 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c920 tx=0x7f95f800cde0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 shutdown_connections 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960010d180 0x7f96001a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f95ec0b5450 0x7f95ec0b7910 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96001045d0 0x7f960019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 --2- 172.21.15.16:0/40965578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9600103bd0 0x7f960019b480 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:07.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 >> 172.21.15.16:0/40965578 conn(0x7f96000fd700 msgr2=0x7f960010f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:07.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 shutdown_connections 2024-09-10T23:43:07.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:07.554+0000 7f9607190640 1 -- 172.21.15.16:0/40965578 wait complete. 2024-09-10T23:43:08.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:08 smithi016 ceph-mon[30855]: pgmap v407: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:08.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:08 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/40965578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:43:08.359 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:43:08.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:08 smithi071 ceph-mon[35018]: pgmap v407: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:08.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:08 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/40965578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:43:08.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:08 smithi066 ceph-mon[34761]: pgmap v407: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:08.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:08 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/40965578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:43:08.619 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.156+0000 7f47f3624640 1 -- 172.21.15.16:0/2554847938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 msgr2=0x7f47ec107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.156+0000 7f47f3624640 1 --2- 172.21.15.16:0/2554847938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec107b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009900 tx=0x7f47dc02a410 comp rx=0 tx=0).stop 2024-09-10T23:43:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.156+0000 7f47f3624640 1 -- 172.21.15.16:0/2554847938 shutdown_connections 2024-09-10T23:43:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.156+0000 7f47f3624640 1 --2- 172.21.15.16:0/2554847938 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47ec108040 0x7f47ec10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.156+0000 7f47f3624640 1 --2- 172.21.15.16:0/2554847938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec107b00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.156+0000 7f47f3624640 1 --2- 172.21.15.16:0/2554847938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec101cb0 0x7f47ec102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.156+0000 7f47f3624640 1 -- 172.21.15.16:0/2554847938 >> 172.21.15.16:0/2554847938 conn(0x7f47ec0fd700 msgr2=0x7f47ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 -- 172.21.15.16:0/2554847938 shutdown_connections 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 -- 172.21.15.16:0/2554847938 wait complete. 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 Processor -- start 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 -- start start 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47ec101cb0 0x7f47ec0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec108040 0x7f47ec0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec111d00 con 0x7f47ec1076c0 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec111b80 con 0x7f47ec108040 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f3624640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec111e80 con 0x7f47ec101cb0 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.157+0000 7f47f0bbf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55640/0 (socket says 172.21.15.16:55640) 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 -- 172.21.15.16:0/3856350330 learned_addr learned my addr 172.21.15.16:0/3856350330 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec108040 0x7f47ec0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f13c0640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47ec101cb0 0x7f47ec0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 -- 172.21.15.16:0/3856350330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47ec101cb0 msgr2=0x7f47ec0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47ec101cb0 0x7f47ec0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 -- 172.21.15.16:0/3856350330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec108040 msgr2=0x7f47ec0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec108040 0x7f47ec0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 -- 172.21.15.16:0/3856350330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec1a76f0 con 0x7f47ec1076c0 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f13c0640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47ec101cb0 0x7f47ec0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec0fe140 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f47dc005940 tx=0x7f47dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47e27fc640 1 -- 172.21.15.16:0/3856350330 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc03f030 con 0x7f47ec1076c0 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47e27fc640 1 -- 172.21.15.16:0/3856350330 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47dc003aa0 con 0x7f47ec1076c0 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec1a7980 con 0x7f47ec1076c0 2024-09-10T23:43:09.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47e27fc640 1 -- 172.21.15.16:0/3856350330 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc035070 con 0x7f47ec1076c0 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.158+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec1a7f30 con 0x7f47ec1076c0 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47e27fc640 1 -- 172.21.15.16:0/3856350330 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f47dc003c50 con 0x7f47ec1076c0 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 Processor -- start 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 -- start start 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b44597df0 0x557b445a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445a3d80 0x557b445a6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557b4450dea0 con 0x557b44597df0 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557b444fd2d0 con 0x557b445a3d80 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.161+0000 7f47f59f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b445010e0 con 0x557b445974d0 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b44597df0 0x557b445a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b44597df0 0x557b445a3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55652/0 (socket says 172.21.15.16:55652) 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 -- 172.21.15.16:0/2004874416 learned_addr learned my addr 172.21.15.16:0/2004874416 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445a3d80 0x557b445a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 -- 172.21.15.16:0/2004874416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 msgr2=0x557b445978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 -- 172.21.15.16:0/2004874416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445a3d80 msgr2=0x557b445a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445a3d80 0x557b445a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 -- 172.21.15.16:0/2004874416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4425b650 con 0x557b44597df0 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47e27fc640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47d80b54d0 0x7f47d80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f13c0640 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b44597df0 0x557b445a3840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f47e800aa10 tx=0x7f47e800aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a48f2fd6d80043 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47d80b54d0 0x7f47d80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47e27fc640 1 -- 172.21.15.16:0/3856350330 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f47dc106910 con 0x7f47ec1076c0 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47d77fe640 1 -- 172.21.15.16:0/2004874416 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8015070 con 0x557b44597df0 2024-09-10T23:43:09.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47d77fe640 1 -- 172.21.15.16:0/2004874416 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47e800cc60 con 0x557b44597df0 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.162+0000 7f47d77fe640 1 -- 172.21.15.16:0/2004874416 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8018560 con 0x557b44597df0 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 -- 172.21.15.16:0/2004874416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b44597df0 msgr2=0x557b445a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47d80b54d0 0x7f47d80b7990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0ffcc0 tx=0x7f47e4009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b44597df0 0x557b445a3840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f47e800aa10 tx=0x7f47e800aed0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 -- 172.21.15.16:0/2004874416 shutdown_connections 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445a3d80 0x557b445a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b44597df0 0x557b445a3840 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 --2- 172.21.15.16:0/2004874416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 -- 172.21.15.16:0/2004874416 >> 172.21.15.16:0/2004874416 conn(0x557b44595300 msgr2=0x557b445964a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 -- 172.21.15.16:0/2004874416 shutdown_connections 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.163+0000 7f47f59f9740 1 -- 172.21.15.16:0/2004874416 wait complete. 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 -- start start 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 Processor -- start 2024-09-10T23:43:09.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445974d0 0x557b445a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b44597df0 0x557b445a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b445a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557b4435e700 con 0x557b445a3d80 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557b44498160 con 0x557b445974d0 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b445a6a00 con 0x557b44597df0 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f59f9740 10 client.0 _ll_register_callbacks cb 0x557b444b19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f1bc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b445a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f1bc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b445a0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55658/0 (socket says 172.21.15.16:55658) 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f1bc1640 1 -- 172.21.15.16:0/1183367509 learned_addr learned my addr 172.21.15.16:0/1183367509 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.164+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b44597df0 0x557b445a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f13c0640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445974d0 0x557b445a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f1bc1640 1 -- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b44597df0 msgr2=0x557b445a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b44597df0 0x557b445a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f1bc1640 1 -- 172.21.15.16:0/1183367509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445974d0 msgr2=0x557b445a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445974d0 0x557b445a35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f1bc1640 1 -- 172.21.15.16:0/1183367509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b444c5c90 con 0x557b445a3d80 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f13c0640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445974d0 0x557b445a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b445a0f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f47e4003f80 tx=0x7f47e4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add3d31ea44661cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47d4ff9640 1 -- 172.21.15.16:0/1183367509 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e400f870 con 0x557b445a3d80 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47d4ff9640 1 -- 172.21.15.16:0/1183367509 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f47e400fa10 con 0x557b445a3d80 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e800cc60 con 0x557b445a3d80 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47d4ff9640 1 -- 172.21.15.16:0/1183367509 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f47e400fc10 con 0x557b445a3d80 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f59f9740 10 client.15912 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.165+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b445b2330 con 0x557b445a3d80 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47d4ff9640 1 -- 172.21.15.16:0/1183367509 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47e800cc60 con 0x557b445a3d80 2024-09-10T23:43:09.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47d4ff9640 1 -- 172.21.15.16:0/1183367509 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f47e4026070 con 0x557b445a3d80 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47f59f9740 10 client.15912 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47f59f9740 10 client.15912 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47f59f9740 20 client.15912 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47f59f9740 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b445b3890 0x557b445b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47f59f9740 4 client.15912 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b4450fdf0 con 0x557b445b3890 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.166+0000 7f47f13c0640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b445b3890 0x557b445b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.167+0000 7f47f13c0640 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b445b3890 0x557b445b5cc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9b47da38a7ace08 server_cookie=43954a88ee4cb0e0 in_seq=0 out_seq=0 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.167+0000 7f47d4ff9640 10 client.15912 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.167+0000 7f47d4ff9640 1 -- 172.21.15.16:0/1183367509 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b4450fdf0 con 0x557b445b3890 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.167+0000 7f47d4ff9640 10 client.15912 handle_command_reply: tid=0 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.167+0000 7f47f59f9740 1 client.15912 shutdown 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 msgr2=0x557b445a0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b445a0f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f47e4003f80 tx=0x7f47e4004ab0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 shutdown_connections 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b445b3890 0x557b445b5cc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b445a0f40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b44597df0 0x557b445a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 --2- 172.21.15.16:0/1183367509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b445974d0 0x557b445a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 >> 172.21.15.16:0/1183367509 conn(0x557b44595300 msgr2=0x557b4459aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47d4ff9640 0 client.15912 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 shutdown_connections 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 1 -- 172.21.15.16:0/1183367509 wait complete. 2024-09-10T23:43:09.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.168+0000 7f47f59f9740 20 client.15912 trim_cache size 0 max 16384 2024-09-10T23:43:09.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 Processor -- start 2024-09-10T23:43:09.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 -- start start 2024-09-10T23:43:09.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445974d0 0x557b445a2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b4459dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445a3d80 0x557b4459e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec1b3140 con 0x557b445974d0 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec1b0a10 con 0x557b44597df0 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f59f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec1ae860 con 0x557b445a3d80 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f13c0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445974d0 0x557b445a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f13c0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445974d0 0x557b445a2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55662/0 (socket says 172.21.15.16:55662) 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.181+0000 7f47f13c0640 1 -- 172.21.15.16:0/814856132 learned_addr learned my addr 172.21.15.16:0/814856132 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445a3d80 0x557b4459e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b4459dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f13c0640 1 -- 172.21.15.16:0/814856132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445a3d80 msgr2=0x557b4459e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f13c0640 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445a3d80 0x557b4459e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f13c0640 1 -- 172.21.15.16:0/814856132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 msgr2=0x557b4459dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f13c0640 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b4459dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f13c0640 1 -- 172.21.15.16:0/814856132 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b44595fe0 con 0x557b445974d0 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b4459dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47f13c0640 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445974d0 0x557b445a2740 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c520 tx=0x7f47e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3130b382a3f060fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47d6ffd640 1 -- 172.21.15.16:0/814856132 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8015040 con 0x557b445974d0 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47d6ffd640 1 -- 172.21.15.16:0/814856132 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47e800cda0 con 0x557b445974d0 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.182+0000 7f47d6ffd640 1 -- 172.21.15.16:0/814856132 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e801a6b0 con 0x557b445974d0 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 -- 172.21.15.16:0/814856132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445974d0 msgr2=0x557b445a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445974d0 0x557b445a2740 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c520 tx=0x7f47e8008040 comp rx=0 tx=0).stop 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 -- 172.21.15.16:0/814856132 shutdown_connections 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445a3d80 0x557b4459e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b4459dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 --2- 172.21.15.16:0/814856132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445974d0 0x557b445a2740 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 -- 172.21.15.16:0/814856132 >> 172.21.15.16:0/814856132 conn(0x557b44595300 msgr2=0x557b445a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:09.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 -- 172.21.15.16:0/814856132 shutdown_connections 2024-09-10T23:43:09.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 -- 172.21.15.16:0/814856132 wait complete. 2024-09-10T23:43:09.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 -- start start 2024-09-10T23:43:09.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.183+0000 7f47f59f9740 1 Processor -- start 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b445a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f59f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b4461f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f59f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec1aeed0 con 0x557b445a3d80 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f59f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec1b0340 con 0x557b44597df0 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f59f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec1af5a0 con 0x557b445974d0 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f59f9740 10 client.0 _ll_register_callbacks cb 0x7f47e4009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f1bc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b4461f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445a7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:55020/0 (socket says 172.21.15.16:55020) 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 -- 172.21.15.16:0/3401579784 learned_addr learned my addr 172.21.15.16:0/3401579784 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b445a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 -- 172.21.15.16:0/3401579784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 msgr2=0x557b445a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b445a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 -- 172.21.15.16:0/3401579784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 msgr2=0x557b4461f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b4461f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f13c0640 1 -- 172.21.15.16:0/3401579784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b445a8da0 con 0x557b445974d0 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.184+0000 7f47f1bc1640 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b4461f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f13c0640 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445a7f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006aa0 tx=0x7f47e800c5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8c48356980698ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47d4ff9640 1 -- 172.21.15.16:0/3401579784 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8032070 con 0x557b445974d0 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e800cda0 con 0x557b445974d0 2024-09-10T23:43:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47d4ff9640 1 -- 172.21.15.16:0/3401579784 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f47e8011c30 con 0x557b445974d0 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47d4ff9640 1 -- 172.21.15.16:0/3401579784 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f47e803e050 con 0x557b445974d0 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 10 client.25576 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b44620e00 con 0x557b445974d0 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47d4ff9640 1 -- 172.21.15.16:0/3401579784 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47e800cda0 con 0x557b445974d0 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47d4ff9640 1 -- 172.21.15.16:0/3401579784 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f47e802a020 con 0x557b445974d0 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 10 client.25576 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 10 client.25576 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 20 client.25576 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b44621130 0x557b44623520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 4 client.25576 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.185+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b4450b8a0 con 0x557b44621130 2024-09-10T23:43:09.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b44621130 0x557b44623520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f0bbf640 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b44621130 0x557b44623520 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9cdab6e1c2d0efc4 server_cookie=c3b3affc05022c13 in_seq=0 out_seq=0 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47d4ff9640 10 client.25576 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47d4ff9640 1 -- 172.21.15.16:0/3401579784 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b4450b8a0 con 0x557b44621130 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47d4ff9640 10 client.25576 handle_command_reply: tid=0 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 client.25576 shutdown 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 msgr2=0x557b445a7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445a7f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006aa0 tx=0x7f47e800c5e0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 shutdown_connections 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x557b44621130 0x557b44623520 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b445a3d80 0x557b4461f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b44597df0 0x557b445a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47d4ff9640 0 client.25576 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:09.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 --2- 172.21.15.16:0/3401579784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b445974d0 0x557b445a7f70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.186+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 >> 172.21.15.16:0/3401579784 conn(0x557b44595300 msgr2=0x557b445a2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:09.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 shutdown_connections 2024-09-10T23:43:09.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f59f9740 1 -- 172.21.15.16:0/3401579784 wait complete. 2024-09-10T23:43:09.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f59f9740 20 client.25576 trim_cache size 0 max 16384 2024-09-10T23:43:09.194 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47d80b54d0 msgr2=0x7f47d80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47d80b54d0 0x7f47d80b7990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0ffcc0 tx=0x7f47e4009500 comp rx=0 tx=0).stop 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 msgr2=0x7f47ec0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec0fe140 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f47dc005940 tx=0x7f47dc004270 comp rx=0 tx=0).stop 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 shutdown_connections 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f47d80b54d0 0x7f47d80b7990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec108040 0x7f47ec0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ec1076c0 0x7f47ec0fe140 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 --2- 172.21.15.16:0/3856350330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47ec101cb0 0x7f47ec0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:09.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 >> 172.21.15.16:0/3856350330 conn(0x7f47ec0fd700 msgr2=0x7f47ec1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 shutdown_connections 2024-09-10T23:43:09.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:09.187+0000 7f47f3624640 1 -- 172.21.15.16:0/3856350330 wait complete. 2024-09-10T23:43:10.042 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:43:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:10.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:10 smithi016 ceph-mon[30855]: pgmap v408: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:43:10.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:10 smithi071 ceph-mon[35018]: pgmap v408: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:43:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:10 smithi066 ceph-mon[34761]: pgmap v408: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:43:10.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 -- 172.21.15.16:0/163248180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2081087d0 msgr2=0x7fe208108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 --2- 172.21.15.16:0/163248180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2081087d0 0x7fe208108c10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009900 tx=0x7fe1fc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 -- 172.21.15.16:0/163248180 shutdown_connections 2024-09-10T23:43:10.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 --2- 172.21.15.16:0/163248180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe208109150 0x7fe20810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 --2- 172.21.15.16:0/163248180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2081087d0 0x7fe208108c10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 --2- 172.21.15.16:0/163248180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe208102dc0 0x7fe2081031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 -- 172.21.15.16:0/163248180 >> 172.21.15.16:0/163248180 conn(0x7fe2080fe830 msgr2=0x7fe208100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 -- 172.21.15.16:0/163248180 shutdown_connections 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.749+0000 7fe20c914640 1 -- 172.21.15.16:0/163248180 wait complete. 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 Processor -- start 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 -- start start 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe208102dc0 0x7fe208199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2081087d0 0x7fe208199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe208109150 0x7fe20819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe208112e10 con 0x7fe208109150 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe208112c90 con 0x7fe208102dc0 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe20c914640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe208112f90 con 0x7fe2081087d0 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe208109150 0x7fe20819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe208109150 0x7fe20819ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55704/0 (socket says 172.21.15.16:55704) 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.750+0000 7fe206d9d640 1 -- 172.21.15.16:0/2874186321 learned_addr learned my addr 172.21.15.16:0/2874186321 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe205d9b640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2081087d0 0x7fe208199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe20659c640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe208102dc0 0x7fe208199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe206d9d640 1 -- 172.21.15.16:0/2874186321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2081087d0 msgr2=0x7fe208199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe206d9d640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2081087d0 0x7fe208199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe206d9d640 1 -- 172.21.15.16:0/2874186321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe208102dc0 msgr2=0x7fe208199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe206d9d640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe208102dc0 0x7fe208199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe206d9d640 1 -- 172.21.15.16:0/2874186321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20819f3f0 con 0x7fe208109150 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe20659c640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe208102dc0 0x7fe208199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe206d9d640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe208109150 0x7fe20819ec20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe20000cce0 tx=0x7fe20000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe1f77fe640 1 -- 172.21.15.16:0/2874186321 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20000f450 con 0x7fe208109150 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe1f77fe640 1 -- 172.21.15.16:0/2874186321 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe20000faa0 con 0x7fe208109150 2024-09-10T23:43:10.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20819f6e0 con 0x7fe208109150 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe1f77fe640 1 -- 172.21.15.16:0/2874186321 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200018b70 con 0x7fe208109150 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.751+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2081a5da0 con 0x7fe208109150 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 Processor -- start 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe1f77fe640 1 -- 172.21.15.16:0/2874186321 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe20000f5f0 con 0x7fe208109150 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 -- start start 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587ffeec4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeeca10 0x5587ffefc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffeff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5587ffe62ea0 con 0x5587ffeeca10 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5587ffe522d0 con 0x5587ffeec0f0 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.754+0000 7fe20ece9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5587ffe560e0 con 0x5587ffefcdb0 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeeca10 0x5587ffefc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeeca10 0x5587ffefc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55716/0 (socket says 172.21.15.16:55716) 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 -- 172.21.15.16:0/29609138 learned_addr learned my addr 172.21.15.16:0/29609138 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe205d9b640 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587ffeec4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe205d9b640 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffeff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 -- 172.21.15.16:0/29609138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 msgr2=0x5587ffeff1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffeff1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 -- 172.21.15.16:0/29609138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 msgr2=0x5587ffeec4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587ffeec4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 -- 172.21.15.16:0/29609138 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ffbb0650 con 0x5587ffeeca10 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe1f77fe640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1f00b5450 0x7fe1f00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe205d9b640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1f00b5450 0x7fe1f00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe20659c640 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeeca10 0x5587ffefc870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800cca0 tx=0x7fe1f800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f665f98f6834f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe1f77fe640 1 -- 172.21.15.16:0/2874186321 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe2000e66b0 con 0x7fe208109150 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe1f4ff9640 1 -- 172.21.15.16:0/29609138 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8005220 con 0x5587ffeeca10 2024-09-10T23:43:10.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.755+0000 7fe1f4ff9640 1 -- 172.21.15.16:0/29609138 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1f8004c50 con 0x5587ffeeca10 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe1f4ff9640 1 -- 172.21.15.16:0/29609138 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8010790 con 0x5587ffeeca10 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe205d9b640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1f00b5450 0x7fe1f00b7910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc031440 tx=0x7fe1fc009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 -- 172.21.15.16:0/29609138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeeca10 msgr2=0x5587ffefc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeeca10 0x5587ffefc870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800cca0 tx=0x7fe1f800e720 comp rx=0 tx=0).stop 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 -- 172.21.15.16:0/29609138 shutdown_connections 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffeff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeeca10 0x5587ffefc870 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 --2- 172.21.15.16:0/29609138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587ffeec4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 -- 172.21.15.16:0/29609138 >> 172.21.15.16:0/29609138 conn(0x5587ffee9f20 msgr2=0x5587ffeeb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 -- 172.21.15.16:0/29609138 shutdown_connections 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.756+0000 7fe20ece9740 1 -- 172.21.15.16:0/29609138 wait complete. 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 -- start start 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 Processor -- start 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeec0f0 0x5587ffefc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587ffef9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffefa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5587ffcb3700 con 0x5587ffeec0f0 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5587ffded160 con 0x5587ffeeca10 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5587ffeffa30 con 0x5587ffefcdb0 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20ece9740 10 client.0 _ll_register_callbacks cb 0x5587ffe069e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeec0f0 0x5587ffefc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeec0f0 0x5587ffefc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55722/0 (socket says 172.21.15.16:55722) 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20659c640 1 -- 172.21.15.16:0/935310771 learned_addr learned my addr 172.21.15.16:0/935310771 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe205d9b640 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587ffef9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe206d9d640 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffefa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20659c640 1 -- 172.21.15.16:0/935310771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 msgr2=0x5587ffefa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.757+0000 7fe20659c640 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffefa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20659c640 1 -- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 msgr2=0x5587ffef9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20659c640 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587ffef9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20659c640 1 -- 172.21.15.16:0/935310771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587ffe1ac90 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20659c640 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeec0f0 0x5587ffefc6b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800cc70 tx=0x7fe1f800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc7a4d705106de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe1edffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe1edffb640 1 -- 172.21.15.16:0/935310771 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f802a060 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe1edffb640 1 -- 172.21.15.16:0/935310771 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe1f8005010 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1f8004c50 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe1edffb640 1 -- 172.21.15.16:0/935310771 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1f8005210 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20ece9740 10 client.15930 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5587fff0b380 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe1edffb640 1 -- 172.21.15.16:0/935310771 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1f8004c50 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe1edffb640 1 -- 172.21.15.16:0/935310771 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe1f8025470 con 0x5587ffeec0f0 2024-09-10T23:43:10.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20ece9740 10 client.15930 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20ece9740 10 client.15930 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.758+0000 7fe20ece9740 20 client.15930 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.759+0000 7fe20ece9740 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff0c780 0x5587fff0eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.759+0000 7fe20ece9740 4 client.15930 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.759+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587ffe64df0 con 0x5587fff0c780 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.759+0000 7fe205d9b640 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff0c780 0x5587fff0eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.759+0000 7fe1edffb640 10 client.15930 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.759+0000 7fe205d9b640 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff0c780 0x5587fff0eb70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9e686b15b8fda464 server_cookie=5593f587736aae0c in_seq=0 out_seq=0 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe1edffb640 1 -- 172.21.15.16:0/935310771 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5587ffe64df0 con 0x5587fff0c780 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe1edffb640 10 client.15930 handle_command_reply: tid=0 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 client.15930 shutdown 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeec0f0 msgr2=0x5587ffefc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeec0f0 0x5587ffefc6b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800cc70 tx=0x7fe1f800c9e0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 shutdown_connections 2024-09-10T23:43:10.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff0c780 0x5587fff0eb70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffefcdb0 0x5587ffefa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587ffef9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe1edffb640 0 client.15930 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 --2- 172.21.15.16:0/935310771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffeec0f0 0x5587ffefc6b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 >> 172.21.15.16:0/935310771 conn(0x5587ffee9f20 msgr2=0x5587ffeefac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 shutdown_connections 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 1 -- 172.21.15.16:0/935310771 wait complete. 2024-09-10T23:43:10.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.760+0000 7fe20ece9740 20 client.15930 trim_cache size 0 max 16384 2024-09-10T23:43:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 Processor -- start 2024-09-10T23:43:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 -- start start 2024-09-10T23:43:10.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeec0f0 0x5587fff08c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587fff141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff146e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2081aec40 con 0x5587ffefcdb0 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2081ac510 con 0x5587ffeeca10 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20ece9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2081aa380 con 0x5587ffeec0f0 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff146e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55732/0 (socket says 172.21.15.16:55732) 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 -- 172.21.15.16:0/4118630376 learned_addr learned my addr 172.21.15.16:0/4118630376 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe205d9b640 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587fff141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe20659c640 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeec0f0 0x5587fff08c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 -- 172.21.15.16:0/4118630376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeec0f0 msgr2=0x5587fff08c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeec0f0 0x5587fff08c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 -- 172.21.15.16:0/4118630376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 msgr2=0x5587fff141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587fff141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe206d9d640 1 -- 172.21.15.16:0/4118630376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ffef98b0 con 0x5587ffefcdb0 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.774+0000 7fe205d9b640 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587fff141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe206d9d640 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff146e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe2000a9160 tx=0x7fe2000a8b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d78b6788a4672ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe1effff640 1 -- 172.21.15.16:0/4118630376 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000a8300 con 0x5587ffefcdb0 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe1effff640 1 -- 172.21.15.16:0/4118630376 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2000ac6a0 con 0x5587ffefcdb0 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe1effff640 1 -- 172.21.15.16:0/4118630376 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000b6120 con 0x5587ffefcdb0 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe20ece9740 1 -- 172.21.15.16:0/4118630376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 msgr2=0x5587fff146e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe20ece9740 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff146e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe2000a9160 tx=0x7fe2000a8b30 comp rx=0 tx=0).stop 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe20ece9740 1 -- 172.21.15.16:0/4118630376 shutdown_connections 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe20ece9740 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff146e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe20ece9740 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeeca10 0x5587fff141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.775+0000 7fe20ece9740 1 --2- 172.21.15.16:0/4118630376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeec0f0 0x5587fff08c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 -- 172.21.15.16:0/4118630376 >> 172.21.15.16:0/4118630376 conn(0x5587ffee9f20 msgr2=0x5587ffefebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 -- 172.21.15.16:0/4118630376 shutdown_connections 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 -- 172.21.15.16:0/4118630376 wait complete. 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 -- start start 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 Processor -- start 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587fff05400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeeca10 0x5587fff01c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff021d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2081aa9d0 con 0x5587ffefcdb0 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2081abe40 con 0x5587ffeec0f0 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2081ab0a0 con 0x5587ffeeca10 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe20ece9740 10 client.0 _ll_register_callbacks cb 0x7fe1f8014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.776+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff021d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55746/0 (socket says 172.21.15.16:55746) 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 -- 172.21.15.16:0/413319693 learned_addr learned my addr 172.21.15.16:0/413319693 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:10.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe20659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587fff05400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe205d9b640 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeeca10 0x5587fff01c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 -- 172.21.15.16:0/413319693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeeca10 msgr2=0x5587fff01c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeeca10 0x5587fff01c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 -- 172.21.15.16:0/413319693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 msgr2=0x5587fff05400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587fff05400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 -- 172.21.15.16:0/413319693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587fff02a00 con 0x5587ffefcdb0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe205d9b640 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeeca10 0x5587fff01c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe206d9d640 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff021d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe20000ab20 tx=0x7fe200018580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3611db83c47ebaeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe1edffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe1edffb640 1 -- 172.21.15.16:0/413319693 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000acb90 con 0x5587ffefcdb0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe1edffb640 1 -- 172.21.15.16:0/413319693 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe2000abdf0 con 0x5587ffefcdb0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2000ac6a0 con 0x5587ffefcdb0 2024-09-10T23:43:10.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe1edffb640 1 -- 172.21.15.16:0/413319693 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe2000ad290 con 0x5587ffefcdb0 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe20ece9740 10 client.15936 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5587fff7a3a0 con 0x5587ffefcdb0 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.777+0000 7fe1edffb640 1 -- 172.21.15.16:0/413319693 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2000ac6a0 con 0x5587ffefcdb0 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe1edffb640 1 -- 172.21.15.16:0/413319693 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2000ab860 con 0x5587ffefcdb0 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20ece9740 10 client.15936 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20ece9740 10 client.15936 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20ece9740 20 client.15936 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20ece9740 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff7a9f0 0x5587fff7ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20ece9740 4 client.15936 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5587ffe608a0 con 0x5587fff7a9f0 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20659c640 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff7a9f0 0x5587fff7ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe20659c640 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff7a9f0 0x5587fff7ce10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d0efb3910e4712d server_cookie=ac915213bf047256 in_seq=0 out_seq=0 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.778+0000 7fe1edffb640 10 client.15936 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:10.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe1edffb640 1 -- 172.21.15.16:0/413319693 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5587ffe608a0 con 0x5587fff7a9f0 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe1edffb640 10 client.15936 handle_command_reply: tid=0 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 client.15936 shutdown 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 msgr2=0x5587fff021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff021d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe20000ab20 tx=0x7fe200018580 comp rx=0 tx=0).stop 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 shutdown_connections 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5587fff7a9f0 0x5587fff7ce10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe1edffb640 0 client.15936 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587ffefcdb0 0x5587fff021d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5587ffeeca10 0x5587fff01c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 --2- 172.21.15.16:0/413319693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5587ffeec0f0 0x5587fff05400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 >> 172.21.15.16:0/413319693 conn(0x5587ffee9f20 msgr2=0x5587ffee8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 shutdown_connections 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 1 -- 172.21.15.16:0/413319693 wait complete. 2024-09-10T23:43:10.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.779+0000 7fe20ece9740 20 client.15936 trim_cache size 0 max 16384 2024-09-10T23:43:10.787 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:43:10.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1f00b5450 msgr2=0x7fe1f00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1f00b5450 0x7fe1f00b7910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc031440 tx=0x7fe1fc009560 comp rx=0 tx=0).stop 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe208109150 msgr2=0x7fe20819ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe208109150 0x7fe20819ec20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe20000cce0 tx=0x7fe20000a620 comp rx=0 tx=0).stop 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 shutdown_connections 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe208109150 0x7fe20819ec20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2081087d0 0x7fe208199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1f00b5450 0x7fe1f00b7910 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 --2- 172.21.15.16:0/2874186321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe208102dc0 0x7fe208199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 >> 172.21.15.16:0/2874186321 conn(0x7fe2080fe830 msgr2=0x7fe208100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 shutdown_connections 2024-09-10T23:43:10.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:10.780+0000 7fe20c914640 1 -- 172.21.15.16:0/2874186321 wait complete. 2024-09-10T23:43:11.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:43:11.834 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:12.225 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:12 smithi016 ceph-mon[30855]: pgmap v409: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:12.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 -- 172.21.15.16:0/3108715549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4101c90 msgr2=0x7f1da4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 --2- 172.21.15.16:0/3108715549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4101c90 0x7f1da4102070 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009ca0 tx=0x7f1d9402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 -- 172.21.15.16:0/3108715549 shutdown_connections 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 --2- 172.21.15.16:0/3108715549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1da4108020 0x7f1da410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 --2- 172.21.15.16:0/3108715549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1da41076a0 0x7f1da4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 --2- 172.21.15.16:0/3108715549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4101c90 0x7f1da4102070 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 -- 172.21.15.16:0/3108715549 >> 172.21.15.16:0/3108715549 conn(0x7f1da40fd700 msgr2=0x7f1da40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 -- 172.21.15.16:0/3108715549 shutdown_connections 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 -- 172.21.15.16:0/3108715549 wait complete. 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 Processor -- start 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.308+0000 7f1da96ac640 1 -- start start 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da96ac640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1da4101c90 0x7f1da419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da96ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1da41076a0 0x7f1da419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da96ac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4108020 0x7f1da41a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da96ac640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4111ce0 con 0x7f1da4108020 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da96ac640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4111b60 con 0x7f1da41076a0 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da96ac640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4111e60 con 0x7f1da4101c90 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4108020 0x7f1da41a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4108020 0x7f1da41a50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55758/0 (socket says 172.21.15.16:55758) 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 -- 172.21.15.16:0/1033417826 learned_addr learned my addr 172.21.15.16:0/1033417826 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da27fc640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1da41076a0 0x7f1da419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1da4101c90 0x7f1da419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 -- 172.21.15.16:0/1033417826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1da4101c90 msgr2=0x7f1da419a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1da4101c90 0x7f1da419a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 -- 172.21.15.16:0/1033417826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1da41076a0 msgr2=0x7f1da419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1da41076a0 0x7f1da419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 -- 172.21.15.16:0/1033417826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da41a55f0 con 0x7f1da4108020 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1da4101c90 0x7f1da419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.309+0000 7f1da37fe640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4108020 0x7f1da41a50b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d750 tx=0x7f1d9c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.310+0000 7f1d8bfff640 1 -- 172.21.15.16:0/1033417826 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c017070 con 0x7f1da4108020 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.310+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da41a57c0 con 0x7f1da4108020 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.310+0000 7f1d8bfff640 1 -- 172.21.15.16:0/1033417826 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d9c0054d0 con 0x7f1da4108020 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.310+0000 7f1d8bfff640 1 -- 172.21.15.16:0/1033417826 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c004c60 con 0x7f1da4108020 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.310+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da41a5ca0 con 0x7f1da4108020 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1d8bfff640 1 -- 172.21.15.16:0/1033417826 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f1d9c004e00 con 0x7f1da4108020 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 Processor -- start 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 -- start start 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bce14d0 0x55753bce18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bced840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bcedd80 0x55753bcf0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55753bc57ea0 con 0x55753bce1df0 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55753bc472d0 con 0x55753bce14d0 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.312+0000 7f1daba81740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55753bc4b0e0 con 0x55753bcedd80 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bced840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bced840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55774/0 (socket says 172.21.15.16:55774) 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 -- 172.21.15.16:0/2472153480 learned_addr learned my addr 172.21.15.16:0/2472153480 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da27fc640 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bcedd80 0x55753bcf0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da27fc640 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bce14d0 0x55753bce18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 -- 172.21.15.16:0/2472153480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bcedd80 msgr2=0x55753bcf0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bcedd80 0x55753bcf0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 -- 172.21.15.16:0/2472153480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bce14d0 msgr2=0x55753bce18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bce14d0 0x55753bce18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 -- 172.21.15.16:0/2472153480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753b9a5650 con 0x55753bce1df0 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da27fc640 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bce14d0 0x55753bce18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1d8bfff640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d8c0b5450 0x7f1d8c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bced840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1d94035000 tx=0x7f1d94009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20abcda35be47eed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1da27fc640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d8c0b5450 0x7f1d8c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1d8bfff640 1 -- 172.21.15.16:0/1033417826 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f1d9c0e5900 con 0x7f1da4108020 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.313+0000 7f1d897fa640 1 -- 172.21.15.16:0/2472153480 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94031db0 con 0x55753bce1df0 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1d897fa640 1 -- 172.21.15.16:0/2472153480 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d94036040 con 0x55753bce1df0 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1d897fa640 1 -- 172.21.15.16:0/2472153480 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940042a0 con 0x55753bce1df0 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 -- 172.21.15.16:0/2472153480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 msgr2=0x55753bced840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1da27fc640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d8c0b5450 0x7f1d8c0b7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1da406b710 tx=0x7f1d9800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bced840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1d94035000 tx=0x7f1d94009880 comp rx=0 tx=0).stop 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 -- 172.21.15.16:0/2472153480 shutdown_connections 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bcedd80 0x55753bcf0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bced840 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 --2- 172.21.15.16:0/2472153480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bce14d0 0x55753bce18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 -- 172.21.15.16:0/2472153480 >> 172.21.15.16:0/2472153480 conn(0x55753bcdf300 msgr2=0x55753bce04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 -- 172.21.15.16:0/2472153480 shutdown_connections 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.314+0000 7f1daba81740 1 -- 172.21.15.16:0/2472153480 wait complete. 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 -- start start 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 Processor -- start 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce14d0 0x55753bced660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce1df0 0x55753bceaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bceb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55753baa8700 con 0x55753bce14d0 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55753bbe2160 con 0x55753bcedd80 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55753bcf09a0 con 0x55753bce1df0 2024-09-10T23:43:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1daba81740 10 client.0 _ll_register_callbacks cb 0x55753bbfb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce14d0 0x55753bced660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce14d0 0x55753bced660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55788/0 (socket says 172.21.15.16:55788) 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.315+0000 7f1da2ffd640 1 -- 172.21.15.16:0/577908623 learned_addr learned my addr 172.21.15.16:0/577908623 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da27fc640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce1df0 0x55753bceaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da37fe640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bceb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da2ffd640 1 -- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce1df0 msgr2=0x55753bceaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce1df0 0x55753bceaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da2ffd640 1 -- 172.21.15.16:0/577908623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 msgr2=0x55753bceb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bceb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da2ffd640 1 -- 172.21.15.16:0/577908623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753bc0fc90 con 0x55753bce14d0 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da37fe640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bceb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce14d0 0x55753bced660 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d94005e30 tx=0x7f1d94003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c55a4fc84315264 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1d86ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1d86ff5640 1 -- 172.21.15.16:0/577908623 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94052020 con 0x55753bce14d0 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1d86ff5640 1 -- 172.21.15.16:0/577908623 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f1d94031db0 con 0x55753bce14d0 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d94036040 con 0x55753bce14d0 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1d86ff5640 1 -- 172.21.15.16:0/577908623 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d9405d050 con 0x55753bce14d0 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1daba81740 10 client.15948 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55753bcfc230 con 0x55753bce14d0 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.316+0000 7f1d86ff5640 1 -- 172.21.15.16:0/577908623 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d94036040 con 0x55753bce14d0 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1d86ff5640 1 -- 172.21.15.16:0/577908623 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1d9404d030 con 0x55753bce14d0 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1daba81740 10 client.15948 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1daba81740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1daba81740 20 client.15948 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1daba81740 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bcfd580 0x55753bcff970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1daba81740 4 client.15948 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55753bc59df0 con 0x55753bcfd580 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.317+0000 7f1da27fc640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bcfd580 0x55753bcff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1da27fc640 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bcfd580 0x55753bcff970 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a95d74034763ccc8 server_cookie=78f4d83fc17106d1 in_seq=0 out_seq=0 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1d86ff5640 10 client.15948 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1d86ff5640 1 -- 172.21.15.16:0/577908623 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55753bc59df0 con 0x55753bcfd580 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1d86ff5640 10 client.15948 handle_command_reply: tid=0 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 client.15948 shutdown 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce14d0 msgr2=0x55753bced660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce14d0 0x55753bced660 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d94005e30 tx=0x7f1d94003eb0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 shutdown_connections 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bcfd580 0x55753bcff970 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bceb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce1df0 0x55753bceaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 --2- 172.21.15.16:0/577908623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce14d0 0x55753bced660 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1d86ff5640 0 client.15948 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.318+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 >> 172.21.15.16:0/577908623 conn(0x55753bcdf300 msgr2=0x55753bce4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.319+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 shutdown_connections 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.319+0000 7f1daba81740 1 -- 172.21.15.16:0/577908623 wait complete. 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.319+0000 7f1daba81740 20 client.15948 trim_cache size 0 max 16384 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 Processor -- start 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 -- start start 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bcdec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bcf6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bcf6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41b0ea0 con 0x55753bce1df0 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41ae770 con 0x55753bcedd80 2024-09-10T23:43:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1daba81740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41ac5c0 con 0x55753bce14d0 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bcf6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bcf6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55792/0 (socket says 172.21.15.16:55792) 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 -- 172.21.15.16:0/1080563059 learned_addr learned my addr 172.21.15.16:0/1080563059 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 -- 172.21.15.16:0/1080563059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 msgr2=0x55753bcdec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bcdec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da37fe640 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bcf6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bcdec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 -- 172.21.15.16:0/1080563059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 msgr2=0x55753bcf6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bcf6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da27fc640 1 -- 172.21.15.16:0/1080563059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753bcdfd80 con 0x55753bce1df0 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bcdec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.332+0000 7f1da37fe640 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bcf6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:12.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1da27fc640 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bcf6010 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d98003d30 tx=0x7f1d98014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab5e9614f05cb84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1d88ff9640 1 -- 172.21.15.16:0/1080563059 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9801de20 con 0x55753bce1df0 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1d88ff9640 1 -- 172.21.15.16:0/1080563059 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d98003de0 con 0x55753bce1df0 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1d88ff9640 1 -- 172.21.15.16:0/1080563059 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9801b6b0 con 0x55753bce1df0 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1daba81740 1 -- 172.21.15.16:0/1080563059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 msgr2=0x55753bcf6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1daba81740 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bcf6010 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d98003d30 tx=0x7f1d98014040 comp rx=0 tx=0).stop 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1daba81740 1 -- 172.21.15.16:0/1080563059 shutdown_connections 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1daba81740 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bcf6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1daba81740 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bcf6010 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1daba81740 1 --2- 172.21.15.16:0/1080563059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bcdec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.333+0000 7f1daba81740 1 -- 172.21.15.16:0/1080563059 >> 172.21.15.16:0/1080563059 conn(0x55753bcdf300 msgr2=0x55753bcec900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 -- 172.21.15.16:0/1080563059 shutdown_connections 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 -- 172.21.15.16:0/1080563059 wait complete. 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 -- start start 2024-09-10T23:43:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 Processor -- start 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bd62340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bd628c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bd641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41acc30 con 0x55753bce1df0 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41ae0a0 con 0x55753bcedd80 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41ad300 con 0x55753bce14d0 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1daba81740 10 client.0 _ll_register_callbacks cb 0x7f1d94009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bd628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bd628c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55804/0 (socket says 172.21.15.16:55804) 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.334+0000 7f1da27fc640 1 -- 172.21.15.16:0/3799480958 learned_addr learned my addr 172.21.15.16:0/3799480958 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da37fe640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bd641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bd62340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da27fc640 1 -- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 msgr2=0x55753bd62340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da27fc640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bd62340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da27fc640 1 -- 172.21.15.16:0/3799480958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 msgr2=0x55753bd641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da27fc640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bd641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da27fc640 1 -- 172.21.15.16:0/3799480958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753bd64900 con 0x55753bce1df0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da37fe640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bd641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1da27fc640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bd628c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005340 tx=0x7f1d98005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dc41841f354661 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1d86ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1d86ff5640 1 -- 172.21.15.16:0/3799480958 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980048c0 con 0x55753bce1df0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1d86ff5640 1 -- 172.21.15.16:0/3799480958 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f1d98004a60 con 0x55753bce1df0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d98003de0 con 0x55753bce1df0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1d86ff5640 1 -- 172.21.15.16:0/3799480958 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d98004c60 con 0x55753bce1df0 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1daba81740 10 client.15954 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55753bd6ef20 con 0x55753bce1df0 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.335+0000 7f1d86ff5640 1 -- 172.21.15.16:0/3799480958 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d98003de0 con 0x55753bce1df0 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1d86ff5640 1 -- 172.21.15.16:0/3799480958 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1d98019040 con 0x55753bce1df0 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1daba81740 10 client.15954 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1daba81740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1daba81740 20 client.15954 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1daba81740 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bd6f5a0 0x55753bd719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1daba81740 4 client.15954 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55753bc558a0 con 0x55753bd6f5a0 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bd6f5a0 0x55753bd719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1da2ffd640 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bd6f5a0 0x55753bd719c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78956e4b52a44842 server_cookie=6bc6b1f0d47f7976 in_seq=0 out_seq=0 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.336+0000 7f1d86ff5640 10 client.15954 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1d86ff5640 1 -- 172.21.15.16:0/3799480958 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55753bc558a0 con 0x55753bd6f5a0 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1d86ff5640 10 client.15954 handle_command_reply: tid=0 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 client.15954 shutdown 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 msgr2=0x55753bd628c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bd628c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1d98005340 tx=0x7f1d98005370 comp rx=0 tx=0).stop 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 shutdown_connections 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55753bd6f5a0 0x55753bd719c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55753bcedd80 0x55753bd641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55753bce1df0 0x55753bd628c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 --2- 172.21.15.16:0/3799480958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55753bce14d0 0x55753bd62340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1d86ff5640 0 client.15954 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 >> 172.21.15.16:0/3799480958 conn(0x55753bcdf300 msgr2=0x55753bce9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 shutdown_connections 2024-09-10T23:43:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 1 -- 172.21.15.16:0/3799480958 wait complete. 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1daba81740 20 client.15954 trim_cache size 0 max 16384 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d8c0b5450 msgr2=0x7f1d8c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1da96ac640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d8c0b5450 0x7f1d8c0b7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1da406b710 tx=0x7f1d9800b390 comp rx=0 tx=0).stop 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4108020 msgr2=0x7f1da41a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.337+0000 7f1da96ac640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4108020 0x7f1da41a50b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d750 tx=0x7f1d9c00dc10 comp rx=0 tx=0).stop 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 shutdown_connections 2024-09-10T23:43:12.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1da4108020 0x7f1da41a50b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1d8c0b5450 0x7f1d8c0b7910 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1da41076a0 0x7f1da419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 --2- 172.21.15.16:0/1033417826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1da4101c90 0x7f1da419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:12.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 >> 172.21.15.16:0/1033417826 conn(0x7f1da40fd700 msgr2=0x7f1da40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:12.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 shutdown_connections 2024-09-10T23:43:12.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:12.338+0000 7f1da96ac640 1 -- 172.21.15.16:0/1033417826 wait complete. 2024-09-10T23:43:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:12 smithi071 ceph-mon[35018]: pgmap v409: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:12.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:12 smithi066 ceph-mon[34761]: pgmap v409: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:43:14.052 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:43:14.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:43:14.329 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:14.450 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:14 smithi016 ceph-mon[30855]: pgmap v410: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:43:14.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:14 smithi071 ceph-mon[35018]: pgmap v410: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:43:14.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:14 smithi066 ceph-mon[34761]: pgmap v410: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:43:14.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 -- 172.21.15.16:0/4082539075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e0103cb0 msgr2=0x7fa5e0104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 --2- 172.21.15.16:0/4082539075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e0103cb0 0x7fa5e0104090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009ca0 tx=0x7fa5d002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 -- 172.21.15.16:0/4082539075 shutdown_connections 2024-09-10T23:43:14.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 --2- 172.21.15.16:0/4082539075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e010d110 0x7fa5e010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 --2- 172.21.15.16:0/4082539075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5e01045d0 0x7fa5e010cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 --2- 172.21.15.16:0/4082539075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e0103cb0 0x7fa5e0104090 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 -- 172.21.15.16:0/4082539075 >> 172.21.15.16:0/4082539075 conn(0x7fa5e00fd730 msgr2=0x7fa5e00ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:14.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 -- 172.21.15.16:0/4082539075 shutdown_connections 2024-09-10T23:43:14.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 -- 172.21.15.16:0/4082539075 wait complete. 2024-09-10T23:43:14.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 Processor -- start 2024-09-10T23:43:14.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.830+0000 7fa5e56af640 1 -- start start 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5e56af640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5e0103cb0 0x7fa5e0101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5e56af640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e01045d0 0x7fa5e0101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5e56af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e010d110 0x7fa5e01023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5e56af640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0112d80 con 0x7fa5e01045d0 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5e56af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0112c00 con 0x7fa5e010d110 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5e56af640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0112f00 con 0x7fa5e0103cb0 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e01045d0 0x7fa5e0101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e01045d0 0x7fa5e0101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59874/0 (socket says 172.21.15.16:59874) 2024-09-10T23:43:14.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 -- 172.21.15.16:0/2398238091 learned_addr learned my addr 172.21.15.16:0/2398238091 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5deffd640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5e0103cb0 0x7fa5e0101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e010d110 0x7fa5e01023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 -- 172.21.15.16:0/2398238091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5e0103cb0 msgr2=0x7fa5e0101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5e0103cb0 0x7fa5e0101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 -- 172.21.15.16:0/2398238091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e010d110 msgr2=0x7fa5e01023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e010d110 0x7fa5e01023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 -- 172.21.15.16:0/2398238091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e01a76b0 con 0x7fa5e01045d0 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5deffd640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5e0103cb0 0x7fa5e0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e010d110 0x7fa5e01023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.831+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e01045d0 0x7fa5e0101ea0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800d750 tx=0x7fa5c800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.832+0000 7fa5d7fff640 1 -- 172.21.15.16:0/2398238091 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8017070 con 0x7fa5e01045d0 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.832+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e01a79a0 con 0x7fa5e01045d0 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.832+0000 7fa5d7fff640 1 -- 172.21.15.16:0/2398238091 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5c8004020 con 0x7fa5e01045d0 2024-09-10T23:43:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.832+0000 7fa5d7fff640 1 -- 172.21.15.16:0/2398238091 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8003c00 con 0x7fa5e01045d0 2024-09-10T23:43:14.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.832+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e01a7f30 con 0x7fa5e01045d0 2024-09-10T23:43:14.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.834+0000 7fa5d7fff640 1 -- 172.21.15.16:0/2398238091 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa5c8009a30 con 0x7fa5e01045d0 2024-09-10T23:43:14.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.834+0000 7fa5e7a84740 1 Processor -- start 2024-09-10T23:43:14.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.834+0000 7fa5e7a84740 1 -- start start 2024-09-10T23:43:14.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c7a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c7a800 0x559852c86250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c86790 0x559852c88b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559852bf0e60 con 0x559852c7a800 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559852be0290 con 0x559852c86790 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559852be40a0 con 0x559852c79ee0 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c7a800 0x559852c86250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c7a800 0x559852c86250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59888/0 (socket says 172.21.15.16:59888) 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 -- 172.21.15.16:0/3357479680 learned_addr learned my addr 172.21.15.16:0/3357479680 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c7a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c86790 0x559852c88b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 -- 172.21.15.16:0/3357479680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 msgr2=0x559852c7a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c7a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 -- 172.21.15.16:0/3357479680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c86790 msgr2=0x559852c88b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c86790 0x559852c88b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 -- 172.21.15.16:0/3357479680 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985293e930 con 0x559852c7a800 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c86790 0x559852c88b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5d7fff640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5cc0b54d0 0x7fa5cc0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.835+0000 7fa5deffd640 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c7a800 0x559852c86250 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0005fa0 tx=0x7fa5d00093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb694015e83b8bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.836+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5cc0b54d0 0x7fa5cc0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.836+0000 7fa5d7fff640 1 -- 172.21.15.16:0/2398238091 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa5c80e5880 con 0x7fa5e01045d0 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.836+0000 7fa5d57fa640 1 -- 172.21.15.16:0/3357479680 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0031cf0 con 0x559852c7a800 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.836+0000 7fa5d57fa640 1 -- 172.21.15.16:0/3357479680 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d0040070 con 0x559852c7a800 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.836+0000 7fa5d57fa640 1 -- 172.21.15.16:0/3357479680 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00042a0 con 0x559852c7a800 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3357479680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c7a800 msgr2=0x559852c86250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5cc0b54d0 0x7fa5cc0b7990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0103a20 tx=0x7fa5d8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c7a800 0x559852c86250 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0005fa0 tx=0x7fa5d00093e0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3357479680 shutdown_connections 2024-09-10T23:43:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c86790 0x559852c88b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c7a800 0x559852c86250 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3357479680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c7a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3357479680 >> 172.21.15.16:0/3357479680 conn(0x559852c77d10 msgr2=0x559852c78eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3357479680 shutdown_connections 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3357479680 wait complete. 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 -- start start 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.837+0000 7fa5e7a84740 1 Processor -- start 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c83750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c83c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c841d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559852a41890 con 0x559852c86790 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559852b7ad40 con 0x559852c7a800 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559852c893e0 con 0x559852c79ee0 2024-09-10T23:43:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5e7a84740 10 client.0 _ll_register_callbacks cb 0x559852bdec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c841d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c841d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59904/0 (socket says 172.21.15.16:59904) 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3543401701 learned_addr learned my addr 172.21.15.16:0/3543401701 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5deffd640 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c83750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c83c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 msgr2=0x559852c83750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c83750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3543401701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 msgr2=0x559852c83c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c83c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3543401701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559852c927c0 con 0x559852c86790 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c841d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009b10 tx=0x7fa5d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb8399586ba83a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.838+0000 7fa5c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5c67fc640 1 -- 172.21.15.16:0/3543401701 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d802d060 con 0x559852c86790 2024-09-10T23:43:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5c67fc640 1 -- 172.21.15.16:0/3543401701 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa5d8018030 con 0x559852c86790 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5d0040070 con 0x559852c86790 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5c67fc640 1 -- 172.21.15.16:0/3543401701 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa5d80119c0 con 0x559852c86790 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 10 client.15966 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559852c951d0 con 0x559852c86790 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5c67fc640 1 -- 172.21.15.16:0/3543401701 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d0040070 con 0x559852c86790 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5c67fc640 1 -- 172.21.15.16:0/3543401701 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa5d8028ba0 con 0x559852c86790 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 10 client.15966 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 20 client.15966 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852c96730 0x559852c98b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 4 client.15966 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.839+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559852bf2db0 con 0x559852c96730 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.840+0000 7fa5deffd640 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852c96730 0x559852c98b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.840+0000 7fa5deffd640 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852c96730 0x559852c98b20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410221ce61eb78d3 server_cookie=317c9e79931eb1ae in_seq=0 out_seq=0 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.840+0000 7fa5c67fc640 10 client.15966 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5c67fc640 1 -- 172.21.15.16:0/3543401701 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559852bf2db0 con 0x559852c96730 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5c67fc640 10 client.15966 handle_command_reply: tid=0 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 client.15966 shutdown 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 msgr2=0x559852c841d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c841d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009b10 tx=0x7fa5d8004730 comp rx=0 tx=0).stop 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 shutdown_connections 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852c96730 0x559852c98b20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5c67fc640 0 client.15966 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c841d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c83c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3543401701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c83750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 >> 172.21.15.16:0/3543401701 conn(0x559852c77d10 msgr2=0x559852c76f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 shutdown_connections 2024-09-10T23:43:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3543401701 wait complete. 2024-09-10T23:43:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.841+0000 7fa5e7a84740 20 client.15966 trim_cache size 0 max 16384 2024-09-10T23:43:14.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.859+0000 7fa5e7a84740 1 Processor -- start 2024-09-10T23:43:14.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.859+0000 7fa5e7a84740 1 -- start start 2024-09-10T23:43:14.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.859+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c85490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.859+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c9e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.859+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c9e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.859+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01b31d0 con 0x559852c86790 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.859+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01b0aa0 con 0x559852c7a800 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01ae8f0 con 0x559852c79ee0 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c9e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c9e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59908/0 (socket says 172.21.15.16:59908) 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3435569130 learned_addr learned my addr 172.21.15.16:0/3435569130 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5deffd640 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c85490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c9e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3435569130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 msgr2=0x559852c85490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c85490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3435569130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 msgr2=0x559852c9e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c9e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 -- 172.21.15.16:0/3435569130 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559852c78790 con 0x559852c86790 2024-09-10T23:43:14.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c9e930 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8004700 tx=0x7fa5d8009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cf3ab058f1adbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:14.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5d4ff9640 1 -- 172.21.15.16:0/3435569130 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8011d60 con 0x559852c86790 2024-09-10T23:43:14.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5d4ff9640 1 -- 172.21.15.16:0/3435569130 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d801da60 con 0x559852c86790 2024-09-10T23:43:14.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.860+0000 7fa5d4ff9640 1 -- 172.21.15.16:0/3435569130 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8028960 con 0x559852c86790 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3435569130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 msgr2=0x559852c9e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c9e930 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8004700 tx=0x7fa5d8009a30 comp rx=0 tx=0).stop 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3435569130 shutdown_connections 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852c9e930 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c7a800 0x559852c9e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/3435569130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c79ee0 0x559852c85490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3435569130 >> 172.21.15.16:0/3435569130 conn(0x559852c77d10 msgr2=0x559852c84d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3435569130 shutdown_connections 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.861+0000 7fa5e7a84740 1 -- 172.21.15.16:0/3435569130 wait complete. 2024-09-10T23:43:14.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 -- start start 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 Processor -- start 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c79ee0 0x559852c8b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c7a800 0x559852c8b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852cfc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01aef60 con 0x559852c86790 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01b03d0 con 0x559852c79ee0 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01af630 con 0x559852c7a800 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5e7a84740 10 client.0 _ll_register_callbacks cb 0x7fa5d8009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852cfc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852cfc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59914/0 (socket says 172.21.15.16:59914) 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 -- 172.21.15.16:0/1286898913 learned_addr learned my addr 172.21.15.16:0/1286898913 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5deffd640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c79ee0 0x559852c8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c7a800 0x559852c8b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 -- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c7a800 msgr2=0x559852c8b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c7a800 0x559852c8b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 -- 172.21.15.16:0/1286898913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c79ee0 msgr2=0x559852c8b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c79ee0 0x559852c8b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5df7fe640 1 -- 172.21.15.16:0/1286898913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559852cfcd70 con 0x559852c86790 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.862+0000 7fa5de7fc640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c7a800 0x559852c8b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5df7fe640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852cfc630 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8012e50 tx=0x7fa5d801d760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e87f3a305132e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5c67fc640 1 -- 172.21.15.16:0/1286898913 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8040020 con 0x559852c86790 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5c67fc640 1 -- 172.21.15.16:0/1286898913 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa5d8005450 con 0x559852c86790 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5d801da60 con 0x559852c86790 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5c67fc640 1 -- 172.21.15.16:0/1286898913 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa5d804b050 con 0x559852c86790 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5e7a84740 10 client.15972 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:14.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559852d04210 con 0x559852c86790 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5c67fc640 1 -- 172.21.15.16:0/1286898913 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d801da60 con 0x559852c86790 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.863+0000 7fa5c67fc640 1 -- 172.21.15.16:0/1286898913 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa5d803a030 con 0x559852c86790 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5e7a84740 10 client.15972 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5e7a84740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5e7a84740 20 client.15972 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852d048c0 0x559852d06ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5e7a84740 4 client.15972 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559852bee860 con 0x559852d048c0 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5deffd640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852d048c0 0x559852d06ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5deffd640 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852d048c0 0x559852d06ce0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee25de4837b4df3a server_cookie=b061f8881e82316d in_seq=0 out_seq=0 2024-09-10T23:43:14.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.864+0000 7fa5c67fc640 10 client.15972 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:14.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5c67fc640 1 -- 172.21.15.16:0/1286898913 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559852bee860 con 0x559852d048c0 2024-09-10T23:43:14.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5c67fc640 10 client.15972 handle_command_reply: tid=0 2024-09-10T23:43:14.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 client.15972 shutdown 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 msgr2=0x559852cfc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852cfc630 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8012e50 tx=0x7fa5d801d760 comp rx=0 tx=0).stop 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 shutdown_connections 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559852d048c0 0x559852d06ce0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559852c86790 0x559852cfc630 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559852c7a800 0x559852c8b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 --2- 172.21.15.16:0/1286898913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559852c79ee0 0x559852c8b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 >> 172.21.15.16:0/1286898913 conn(0x559852c77d10 msgr2=0x559852c76f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5c67fc640 0 client.15972 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 shutdown_connections 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 1 -- 172.21.15.16:0/1286898913 wait complete. 2024-09-10T23:43:14.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.866+0000 7fa5e7a84740 20 client.15972 trim_cache size 0 max 16384 2024-09-10T23:43:14.872 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:43:14.872 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:43:14.872 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309", 2024-09-10T23:43:14.872 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:43:14.872 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5cc0b54d0 msgr2=0x7fa5cc0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5cc0b54d0 0x7fa5cc0b7990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0103a20 tx=0x7fa5d8005f90 comp rx=0 tx=0).stop 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e01045d0 msgr2=0x7fa5e0101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e01045d0 0x7fa5e0101ea0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800d750 tx=0x7fa5c800dc10 comp rx=0 tx=0).stop 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 shutdown_connections 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa5cc0b54d0 0x7fa5cc0b7990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e010d110 0x7fa5e01023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5e01045d0 0x7fa5e0101ea0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 --2- 172.21.15.16:0/2398238091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5e0103cb0 0x7fa5e0101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 >> 172.21.15.16:0/2398238091 conn(0x7fa5e00fd730 msgr2=0x7fa5e00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 shutdown_connections 2024-09-10T23:43:14.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:14.867+0000 7fa5e56af640 1 -- 172.21.15.16:0/2398238091 wait complete. 2024-09-10T23:43:15.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:43:15.989 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:16.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:16 smithi016 ceph-mon[30855]: pgmap v411: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:43:16.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:16 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:43:16.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:16 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:16.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:16 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:43:16.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:16 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 -- 172.21.15.16:0/3920767651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 msgr2=0x7fbdcc108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 --2- 172.21.15.16:0/3920767651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc108c30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009900 tx=0x7fbdb402a410 comp rx=0 tx=0).stop 2024-09-10T23:43:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 -- 172.21.15.16:0/3920767651 shutdown_connections 2024-09-10T23:43:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 --2- 172.21.15.16:0/3920767651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc109170 0x7fbdcc10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 --2- 172.21.15.16:0/3920767651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc108c30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 --2- 172.21.15.16:0/3920767651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdcc102de0 0x7fbdcc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 -- 172.21.15.16:0/3920767651 >> 172.21.15.16:0/3920767651 conn(0x7fbdcc0fe830 msgr2=0x7fbdcc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 -- 172.21.15.16:0/3920767651 shutdown_connections 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.462+0000 7fbdd2645640 1 -- 172.21.15.16:0/3920767651 wait complete. 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 Processor -- start 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 -- start start 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc102de0 0x7fbdcc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdcc109170 0x7fbdcc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc112df0 con 0x7fbdcc1087f0 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc112c70 con 0x7fbdcc109170 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd2645640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc112f70 con 0x7fbdcc102de0 2024-09-10T23:43:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59942/0 (socket says 172.21.15.16:59942) 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdc3fff640 1 -- 172.21.15.16:0/1304046736 learned_addr learned my addr 172.21.15.16:0/1304046736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdd0be2640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdcc109170 0x7fbdcc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.463+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc102de0 0x7fbdcc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc3fff640 1 -- 172.21.15.16:0/1304046736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc102de0 msgr2=0x7fbdcc0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc102de0 0x7fbdcc0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc3fff640 1 -- 172.21.15.16:0/1304046736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdcc109170 msgr2=0x7fbdcc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdcc109170 0x7fbdcc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc3fff640 1 -- 172.21.15.16:0/1304046736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc1a7660 con 0x7fbdcc1087f0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc0759e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4005940 tx=0x7fbdb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc9ffb640 1 -- 172.21.15.16:0/1304046736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb403f030 con 0x7fbdcc1087f0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc9ffb640 1 -- 172.21.15.16:0/1304046736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdb4003cb0 con 0x7fbdcc1087f0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdcc1a78f0 con 0x7fbdcc1087f0 2024-09-10T23:43:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdc9ffb640 1 -- 172.21.15.16:0/1304046736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4035070 con 0x7fbdcc1087f0 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.464+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdcc1a7dd0 con 0x7fbdcc1087f0 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.466+0000 7fbdc9ffb640 1 -- 172.21.15.16:0/1304046736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fbdb403bbf0 con 0x7fbdcc1087f0 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.466+0000 7fbdd4a1a740 1 Processor -- start 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd4a1a740 1 -- start start 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470e480 0x5641d470e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d471a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d471ad30 0x5641d471d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5641d4684e50 con 0x5641d471ad30 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5641d4674280 con 0x5641d470eda0 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5641d4678090 con 0x5641d470e480 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd0be2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470e480 0x5641d470e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d471ad30 0x5641d471d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd0be2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470e480 0x5641d470e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:55222/0 (socket says 172.21.15.16:55222) 2024-09-10T23:43:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdd0be2640 1 -- 172.21.15.16:0/3956840820 learned_addr learned my addr 172.21.15.16:0/3956840820 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d471a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdc3fff640 1 -- 172.21.15.16:0/3956840820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470e480 msgr2=0x5641d470e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470e480 0x5641d470e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdc3fff640 1 -- 172.21.15.16:0/3956840820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 msgr2=0x5641d471a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d471a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdc3fff640 1 -- 172.21.15.16:0/3956840820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d43d2650 con 0x5641d471ad30 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.467+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d471a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.468+0000 7fbdc9ffb640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdb80b5450 0x7fbdb80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.468+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d471ad30 0x5641d471d120 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbdb41042b0 tx=0x7fbdb410ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf4e3a1e5481e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.468+0000 7fbdd0be2640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdb80b5450 0x7fbdb80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.468+0000 7fbdc9ffb640 1 -- 172.21.15.16:0/1304046736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fbdb4106b00 con 0x7fbdcc1087f0 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.468+0000 7fbdc27fc640 1 -- 172.21.15.16:0/3956840820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40c9630 con 0x5641d471ad30 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.468+0000 7fbdc27fc640 1 -- 172.21.15.16:0/3956840820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdb40ccaf0 con 0x5641d471ad30 2024-09-10T23:43:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.468+0000 7fbdc27fc640 1 -- 172.21.15.16:0/3956840820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4005d50 con 0x5641d471ad30 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3956840820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d471ad30 msgr2=0x5641d471d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d471ad30 0x5641d471d120 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbdb41042b0 tx=0x7fbdb410ac40 comp rx=0 tx=0).stop 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd0be2640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdb80b5450 0x7fbdb80b7910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40049d0 tx=0x7fbdc4009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3956840820 shutdown_connections 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d471ad30 0x5641d471d120 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d471a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3956840820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470e480 0x5641d470e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3956840820 >> 172.21.15.16:0/3956840820 conn(0x5641d470c2b0 msgr2=0x5641d470d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3956840820 shutdown_connections 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3956840820 wait complete. 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 -- start start 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 Processor -- start 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.469+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d471a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d4717a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d4718030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5641d44d5700 con 0x5641d470e480 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5641d460f110 con 0x5641d470eda0 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5641d471d770 con 0x5641d471ad30 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d471a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd4a1a740 10 client.0 _ll_register_callbacks cb 0x5641d4628990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d471a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59960/0 (socket says 172.21.15.16:59960) 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 -- 172.21.15.16:0/3126100737 learned_addr learned my addr 172.21.15.16:0/3126100737 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d4717a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd0be2640 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d4718030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 -- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 msgr2=0x5641d4718030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d4718030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 -- 172.21.15.16:0/3126100737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 msgr2=0x5641d4717a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d4717a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 -- 172.21.15.16:0/3126100737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d463cc40 con 0x5641d470e480 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d471a600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc010840 tx=0x7fbdbc010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d004a0887fa2c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:16.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdab7fe640 1 -- 172.21.15.16:0/3126100737 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00cb10 con 0x5641d470e480 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdab7fe640 1 -- 172.21.15.16:0/3126100737 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fbdbc00ccb0 con 0x5641d470e480 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.470+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb40ccaf0 con 0x5641d470e480 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdab7fe640 1 -- 172.21.15.16:0/3126100737 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbdbc011440 con 0x5641d470e480 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 10 client.15984 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641d47290a0 con 0x5641d470e480 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdab7fe640 1 -- 172.21.15.16:0/3126100737 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdb40ccaf0 con 0x5641d470e480 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdab7fe640 1 -- 172.21.15.16:0/3126100737 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbdbc01a530 con 0x5641d470e480 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 10 client.15984 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 20 client.15984 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d472a600 0x5641d472c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 4 client.15984 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641d4686da0 con 0x5641d472a600 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.471+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d472a600 0x5641d472c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.472+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d472a600 0x5641d472c9f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b333b41e42207153 server_cookie=8764535179a5207b in_seq=0 out_seq=0 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.472+0000 7fbdab7fe640 10 client.15984 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.472+0000 7fbdab7fe640 1 -- 172.21.15.16:0/3126100737 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641d4686da0 con 0x5641d472a600 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.472+0000 7fbdab7fe640 10 client.15984 handle_command_reply: tid=0 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.472+0000 7fbdd4a1a740 1 client.15984 shutdown 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 msgr2=0x5641d471a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d471a600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc010840 tx=0x7fbdbc010d00 comp rx=0 tx=0).stop 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 shutdown_connections 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d472a600 0x5641d472c9f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d4718030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470eda0 0x5641d4717a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdab7fe640 0 client.15984 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/3126100737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d471a600 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 >> 172.21.15.16:0/3126100737 conn(0x5641d470c2b0 msgr2=0x5641d4711e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:16.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 shutdown_connections 2024-09-10T23:43:16.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/3126100737 wait complete. 2024-09-10T23:43:16.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.473+0000 7fbdd4a1a740 20 client.15984 trim_cache size 0 max 16384 2024-09-10T23:43:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 Processor -- start 2024-09-10T23:43:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 -- start start 2024-09-10T23:43:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d4726960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470eda0 0x5641d471c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d471ad30 0x5641d471c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1b3030 con 0x5641d470e480 2024-09-10T23:43:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1b0900 con 0x5641d471ad30 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1ae750 con 0x5641d470eda0 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d4726960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d4726960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59964/0 (socket says 172.21.15.16:59964) 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.491+0000 7fbdcbfff640 1 -- 172.21.15.16:0/139360629 learned_addr learned my addr 172.21.15.16:0/139360629 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdd0be2640 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d471ad30 0x5641d471c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470eda0 0x5641d471c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdcbfff640 1 -- 172.21.15.16:0/139360629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470eda0 msgr2=0x5641d471c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470eda0 0x5641d471c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdcbfff640 1 -- 172.21.15.16:0/139360629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d471ad30 msgr2=0x5641d471c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d471ad30 0x5641d471c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdcbfff640 1 -- 172.21.15.16:0/139360629 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d4717800 con 0x5641d470e480 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d4726960 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc01a9a0 tx=0x7fbdbc005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f089eb6e1dc5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdc1ffb640 1 -- 172.21.15.16:0/139360629 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc027040 con 0x5641d470e480 2024-09-10T23:43:16.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdc1ffb640 1 -- 172.21.15.16:0/139360629 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdbc030070 con 0x5641d470e480 2024-09-10T23:43:16.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.492+0000 7fbdc1ffb640 1 -- 172.21.15.16:0/139360629 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00cb70 con 0x5641d470e480 2024-09-10T23:43:16.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/139360629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 msgr2=0x5641d4726960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d4726960 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc01a9a0 tx=0x7fbdbc005900 comp rx=0 tx=0).stop 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/139360629 shutdown_connections 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d471ad30 0x5641d471c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d470eda0 0x5641d471c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/139360629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470e480 0x5641d4726960 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/139360629 >> 172.21.15.16:0/139360629 conn(0x5641d470c2b0 msgr2=0x5641d47198a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/139360629 shutdown_connections 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/139360629 wait complete. 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.493+0000 7fbdd4a1a740 1 -- start start 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 1 Processor -- start 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470e480 0x5641d47233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470eda0 0x5641d471d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d471e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1aedc0 con 0x5641d470eda0 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1b0230 con 0x5641d470e480 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1af490 con 0x5641d471ad30 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd4a1a740 10 client.0 _ll_register_callbacks cb 0x7fbdbc00e3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470eda0 0x5641d471d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470eda0 0x5641d471d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59972/0 (socket says 172.21.15.16:59972) 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 -- 172.21.15.16:0/2622597598 learned_addr learned my addr 172.21.15.16:0/2622597598 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdd0be2640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d471e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470e480 0x5641d47233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 -- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 msgr2=0x5641d471e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d471e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 -- 172.21.15.16:0/2622597598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470e480 msgr2=0x5641d47233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470e480 0x5641d47233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdc3fff640 1 -- 172.21.15.16:0/2622597598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d47974c0 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.494+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470e480 0x5641d47233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdc3fff640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470eda0 0x5641d471d980 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40ca250 tx=0x7fbdb4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1628e8eb572e3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdab7fe640 1 -- 172.21.15.16:0/2622597598 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4049040 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdab7fe640 1 -- 172.21.15.16:0/2622597598 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fbdb40cd240 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdbc030070 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdab7fe640 1 -- 172.21.15.16:0/2622597598 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbdb40cc750 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdd4a1a740 10 client.15990 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641d4798780 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdab7fe640 1 -- 172.21.15.16:0/2622597598 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdbc030070 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdab7fe640 1 -- 172.21.15.16:0/2622597598 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbdb40d60e0 con 0x5641d470eda0 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdd4a1a740 10 client.15990 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdd4a1a740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.495+0000 7fbdd4a1a740 20 client.15990 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d4798c10 0x5641d479b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdd4a1a740 4 client.15990 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641d4682850 con 0x5641d4798c10 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d4798c10 0x5641d479b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdcbfff640 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d4798c10 0x5641d479b030 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4960eaae4e1c3229 server_cookie=47eaf6f0064981be in_seq=0 out_seq=0 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdab7fe640 10 client.15990 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdab7fe640 1 -- 172.21.15.16:0/2622597598 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5641d4682850 con 0x5641d4798c10 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.496+0000 7fbdab7fe640 10 client.15990 handle_command_reply: tid=0 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 client.15990 shutdown 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470eda0 msgr2=0x5641d471d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470eda0 0x5641d471d980 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40ca250 tx=0x7fbdb4005c90 comp rx=0 tx=0).stop 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 shutdown_connections 2024-09-10T23:43:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5641d4798c10 0x5641d479b030 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5641d471ad30 0x5641d471e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5641d470eda0 0x5641d471d980 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 --2- 172.21.15.16:0/2622597598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641d470e480 0x5641d47233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 >> 172.21.15.16:0/2622597598 conn(0x5641d470c2b0 msgr2=0x5641d47114e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdab7fe640 0 client.15990 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 shutdown_connections 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 1 -- 172.21.15.16:0/2622597598 wait complete. 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.497+0000 7fbdd4a1a740 20 client.15990 trim_cache size 0 max 16384 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:43:16.503 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309", 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:43:16.504 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:16.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:16.506 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:43:16.507 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:16.508 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdb80b5450 msgr2=0x7fbdb80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdb80b5450 0x7fbdb80b7910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40049d0 tx=0x7fbdc4009600 comp rx=0 tx=0).stop 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 msgr2=0x7fbdcc0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc0759e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4005940 tx=0x7fbdb40042f0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 shutdown_connections 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdb80b5450 0x7fbdb80b7910 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdcc109170 0x7fbdcc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdcc1087f0 0x7fbdcc0759e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 --2- 172.21.15.16:0/1304046736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdcc102de0 0x7fbdcc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 >> 172.21.15.16:0/1304046736 conn(0x7fbdcc0fe830 msgr2=0x7fbdcc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 shutdown_connections 2024-09-10T23:43:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:16.498+0000 7fbdd2645640 1 -- 172.21.15.16:0/1304046736 wait complete. 2024-09-10T23:43:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:16 smithi071 ceph-mon[35018]: pgmap v411: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:43:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:16 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:43:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:16 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:16 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:43:16.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:16 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:16 smithi066 ceph-mon[34761]: pgmap v411: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:43:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:16 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:43:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:16 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:16 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:43:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:16 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:17.280 INFO:tasks.cephfs.filesystem:scrub status for tag:b4d8eb92-df0e-4fca-b2e9-ea75bebd5309 - {'path': '/', 'tag': 'b4d8eb92-df0e-4fca-b2e9-ea75bebd5309', 'options': 'recursive,force'} 2024-09-10T23:43:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:18 smithi016 ceph-mon[30855]: pgmap v412: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:43:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:18 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:43:18.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:18 smithi071 ceph-mon[35018]: pgmap v412: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:43:18.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:18 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:43:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:18 smithi066 ceph-mon[34761]: pgmap v412: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:43:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:18 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:43:20.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:20 smithi016 ceph-mon[30855]: pgmap v413: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:43:20.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:20 smithi071 ceph-mon[35018]: pgmap v413: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:43:20.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:20 smithi066 ceph-mon[34761]: pgmap v413: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:43:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:22 smithi016 ceph-mon[30855]: pgmap v414: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:43:22.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:22 smithi071 ceph-mon[35018]: pgmap v414: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:43:22.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:22 smithi066 ceph-mon[34761]: pgmap v414: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:43:24.354 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:24 smithi066 ceph-mon[34761]: pgmap v415: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:43:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:24 smithi016 ceph-mon[30855]: pgmap v415: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:43:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:24 smithi071 ceph-mon[35018]: pgmap v415: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:43:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:26 smithi016 ceph-mon[30855]: pgmap v416: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:43:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:26 smithi071 ceph-mon[35018]: pgmap v416: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:43:26.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:26 smithi066 ceph-mon[34761]: pgmap v416: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:43:27.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:43:27.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:43:27.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:43:27.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:43:27.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:43:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:43:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:43:27.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:43:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:43:27.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:43:27.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:43:27.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:43:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:28 smithi016 ceph-mon[30855]: pgmap v417: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:43:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:28 smithi071 ceph-mon[35018]: pgmap v417: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:43:28.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:28 smithi066 ceph-mon[34761]: pgmap v417: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:43:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:30 smithi016 ceph-mon[30855]: pgmap v418: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:43:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:30 smithi071 ceph-mon[35018]: pgmap v418: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:43:30.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:30 smithi066 ceph-mon[34761]: pgmap v418: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:43:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:32 smithi016 ceph-mon[30855]: pgmap v419: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:32 smithi071 ceph-mon[35018]: pgmap v419: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:32.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:32 smithi066 ceph-mon[34761]: pgmap v419: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:34 smithi016 ceph-mon[30855]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:34 smithi071 ceph-mon[35018]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:34.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:34 smithi066 ceph-mon[34761]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:36.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:36 smithi016 ceph-mon[30855]: pgmap v421: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:36.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:36 smithi071 ceph-mon[35018]: pgmap v421: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:36.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:36 smithi066 ceph-mon[34761]: pgmap v421: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:38.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:38 smithi016 ceph-mon[30855]: pgmap v422: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:38.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:38 smithi071 ceph-mon[35018]: pgmap v422: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:38 smithi066 ceph-mon[34761]: pgmap v422: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:40 smithi016 ceph-mon[30855]: pgmap v423: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:40.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:40 smithi071 ceph-mon[35018]: pgmap v423: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:40.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:40 smithi066 ceph-mon[34761]: pgmap v423: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:42 smithi016 ceph-mon[30855]: pgmap v424: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:42.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:42 smithi071 ceph-mon[35018]: pgmap v424: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:42.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:42 smithi066 ceph-mon[34761]: pgmap v424: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:44.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:44 smithi016 ceph-mon[30855]: pgmap v425: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:44 smithi071 ceph-mon[35018]: pgmap v425: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:44.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:44 smithi066 ceph-mon[34761]: pgmap v425: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:46 smithi016 ceph-mon[30855]: pgmap v426: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:46.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:46 smithi071 ceph-mon[35018]: pgmap v426: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:46 smithi066 ceph-mon[34761]: pgmap v426: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:47.282 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:43:47.560 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.156+0000 7f9c815a4640 1 -- 172.21.15.16:0/3256923517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 msgr2=0x7f9c7c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.156+0000 7f9c815a4640 1 --2- 172.21.15.16:0/3256923517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c107b20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009900 tx=0x7f9c6402a410 comp rx=0 tx=0).stop 2024-09-10T23:43:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.156+0000 7f9c815a4640 1 -- 172.21.15.16:0/3256923517 shutdown_connections 2024-09-10T23:43:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.156+0000 7f9c815a4640 1 --2- 172.21.15.16:0/3256923517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c7c108060 0x7f9c7c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.156+0000 7f9c815a4640 1 --2- 172.21.15.16:0/3256923517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c107b20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.156+0000 7f9c815a4640 1 --2- 172.21.15.16:0/3256923517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c7c101cd0 0x7f9c7c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.156+0000 7f9c815a4640 1 -- 172.21.15.16:0/3256923517 >> 172.21.15.16:0/3256923517 conn(0x7f9c7c0fd700 msgr2=0x7f9c7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.157+0000 7f9c815a4640 1 -- 172.21.15.16:0/3256923517 shutdown_connections 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.157+0000 7f9c815a4640 1 -- 172.21.15.16:0/3256923517 wait complete. 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.157+0000 7f9c815a4640 1 Processor -- start 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.157+0000 7f9c815a4640 1 -- start start 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c815a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c7c101cd0 0x7f9c7c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c815a4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c815a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c7c108060 0x7f9c7c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c815a4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c111d20 con 0x7f9c7c1076e0 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c815a4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c111ba0 con 0x7f9c7c101cd0 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c815a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c111ea0 con 0x7f9c7c108060 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60244/0 (socket says 172.21.15.16:60244) 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 -- 172.21.15.16:0/2872647278 learned_addr learned my addr 172.21.15.16:0/2872647278 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7affd640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c7c101cd0 0x7f9c7c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c7c108060 0x7f9c7c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 -- 172.21.15.16:0/2872647278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c7c108060 msgr2=0x7f9c7c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c7c108060 0x7f9c7c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 -- 172.21.15.16:0/2872647278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c7c101cd0 msgr2=0x7f9c7c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c7c101cd0 0x7f9c7c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 -- 172.21.15.16:0/2872647278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7c19f390 con 0x7f9c7c1076e0 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c199820 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9c64005940 tx=0x7f9c640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.158+0000 7f9c73fff640 1 -- 172.21.15.16:0/2872647278 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6403f030 con 0x7f9c7c1076e0 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.159+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7c19f620 con 0x7f9c7c1076e0 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.159+0000 7f9c73fff640 1 -- 172.21.15.16:0/2872647278 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c640044c0 con 0x7f9c7c1076e0 2024-09-10T23:43:48.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.159+0000 7f9c73fff640 1 -- 172.21.15.16:0/2872647278 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c64035070 con 0x7f9c7c1076e0 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.159+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7c1a5d40 con 0x7f9c7c1076e0 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 Processor -- start 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 -- start start 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c73fff640 1 -- 172.21.15.16:0/2872647278 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f9c6403ba20 con 0x7f9c7c1076e0 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19df480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df9c0 0x55dea19eb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19edd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55dea1955e50 con 0x55dea19df9c0 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dea1945280 con 0x55dea19df0a0 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.161+0000 7f9c83979740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dea1949090 con 0x55dea19eb950 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df9c0 0x55dea19eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df9c0 0x55dea19eb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60256/0 (socket says 172.21.15.16:60256) 2024-09-10T23:43:48.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 -- 172.21.15.16:0/3584332225 learned_addr learned my addr 172.21.15.16:0/3584332225 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 -- 172.21.15.16:0/3584332225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 msgr2=0x55dea19edd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19edd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 -- 172.21.15.16:0/3584332225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 msgr2=0x55dea19df480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19df480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 -- 172.21.15.16:0/3584332225 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dea16a3650 con 0x55dea19df9c0 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19df480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c7affd640 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df9c0 0x55dea19eb410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009d20 tx=0x7f9c6c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfe200dc1dcdcd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c717fa640 1 -- 172.21.15.16:0/3584332225 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c01e070 con 0x55dea19df9c0 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c717fa640 1 -- 172.21.15.16:0/3584332225 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c6c019ae0 con 0x55dea19df9c0 2024-09-10T23:43:48.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c717fa640 1 -- 172.21.15.16:0/3584332225 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00ea60 con 0x55dea19df9c0 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.162+0000 7f9c73fff640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9c680b5450 0x7f9c680b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9c680b5450 0x7f9c680b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c73fff640 1 -- 172.21.15.16:0/2872647278 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f9c64106550 con 0x7f9c7c1076e0 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 -- 172.21.15.16:0/3584332225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df9c0 msgr2=0x55dea19eb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df9c0 0x55dea19eb410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009d20 tx=0x7f9c6c011810 comp rx=0 tx=0).stop 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9c680b5450 0x7f9c680b7910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9c74005fd0 tx=0x7f9c74009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 -- 172.21.15.16:0/3584332225 shutdown_connections 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df9c0 0x55dea19eb410 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 --2- 172.21.15.16:0/3584332225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19df480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 -- 172.21.15.16:0/3584332225 >> 172.21.15.16:0/3584332225 conn(0x55dea19dced0 msgr2=0x55dea19de070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 -- 172.21.15.16:0/3584332225 shutdown_connections 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.163+0000 7f9c83979740 1 -- 172.21.15.16:0/3584332225 wait complete. 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 -- start start 2024-09-10T23:43:48.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 Processor -- start 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19eb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19eb950 0x55dea19e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55dea17a6700 con 0x55dea19df0a0 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dea18e0110 con 0x55dea19eb950 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dea19ee5d0 con 0x55dea19df9c0 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c83979740 10 client.0 _ll_register_callbacks cb 0x55dea18f9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19eb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60266/0 (socket says 172.21.15.16:60266) 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 -- 172.21.15.16:0/315016144 learned_addr learned my addr 172.21.15.16:0/315016144 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19eb950 0x55dea19e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 -- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 msgr2=0x55dea19e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 -- 172.21.15.16:0/315016144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19eb950 msgr2=0x55dea19e8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19eb950 0x55dea19e8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.164+0000 7f9c7affd640 1 -- 172.21.15.16:0/315016144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dea190dc40 con 0x55dea19df0a0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c7affd640 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19eb290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00e760 tx=0x7f9c6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1a467dafaca50b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c627fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c627fc640 1 -- 172.21.15.16:0/315016144 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c01e050 con 0x55dea19df0a0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c627fc640 1 -- 172.21.15.16:0/315016144 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f9c6c019430 con 0x55dea19df0a0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c6c019ae0 con 0x55dea19df0a0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c627fc640 1 -- 172.21.15.16:0/315016144 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c6c005c50 con 0x55dea19df0a0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c83979740 10 client.16002 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dea19f9ef0 con 0x55dea19df0a0 2024-09-10T23:43:48.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c627fc640 1 -- 172.21.15.16:0/315016144 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c6c019ae0 con 0x55dea19df0a0 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c627fc640 1 -- 172.21.15.16:0/315016144 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c6c003780 con 0x55dea19df0a0 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c83979740 10 client.16002 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c83979740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.165+0000 7f9c83979740 20 client.16002 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.166+0000 7f9c83979740 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea19fd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.166+0000 7f9c83979740 4 client.16002 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.166+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dea1957da0 con 0x55dea19fb240 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.166+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea19fd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.166+0000 7f9c627fc640 10 client.16002 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.166+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea19fd630 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2da301619b09121 server_cookie=116b5761f6bebbd9 in_seq=0 out_seq=0 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c627fc640 1 -- 172.21.15.16:0/315016144 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dea1957da0 con 0x55dea19fb240 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c627fc640 10 client.16002 handle_command_reply: tid=0 2024-09-10T23:43:48.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 client.16002 shutdown 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 msgr2=0x55dea19eb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19eb290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00e760 tx=0x7f9c6c004270 comp rx=0 tx=0).stop 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 shutdown_connections 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea19fd630 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c627fc640 0 client.16002 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19eb950 0x55dea19e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 --2- 172.21.15.16:0/315016144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19eb290 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 >> 172.21.15.16:0/315016144 conn(0x55dea19dced0 msgr2=0x55dea19e2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 shutdown_connections 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 1 -- 172.21.15.16:0/315016144 wait complete. 2024-09-10T23:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.167+0000 7f9c83979740 20 client.16002 trim_cache size 0 max 16384 2024-09-10T23:43:48.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 Processor -- start 2024-09-10T23:43:48.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 -- start start 2024-09-10T23:43:48.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:48 smithi016 ceph-mon[30855]: pgmap v427: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:48.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19f7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19eb950 0x55dea19e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1b0e90 con 0x55dea19eb950 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1ae760 con 0x55dea19df0a0 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.185+0000 7f9c83979740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1ac5b0 con 0x55dea19df9c0 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19eb950 0x55dea19e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7a7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19eb950 0x55dea19e28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60270/0 (socket says 172.21.15.16:60270) 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7b7fe640 1 -- 172.21.15.16:0/966636193 learned_addr learned my addr 172.21.15.16:0/966636193 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7affd640 1 -- 172.21.15.16:0/966636193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 msgr2=0x55dea19e7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7affd640 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7affd640 1 -- 172.21.15.16:0/966636193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19eb950 msgr2=0x55dea19e28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7affd640 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19eb950 0x55dea19e28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7affd640 1 -- 172.21.15.16:0/966636193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dea19e9600 con 0x55dea19df0a0 2024-09-10T23:43:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19eb950 0x55dea19e28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.186+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:48.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.187+0000 7f9c7affd640 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19f7830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c003d40 tx=0x7f9c6c0097c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0822250fd461f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.187+0000 7f9c70ff9640 1 -- 172.21.15.16:0/966636193 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c01e040 con 0x55dea19df0a0 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.187+0000 7f9c70ff9640 1 -- 172.21.15.16:0/966636193 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c6c01f040 con 0x55dea19df0a0 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.187+0000 7f9c70ff9640 1 -- 172.21.15.16:0/966636193 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c019bc0 con 0x55dea19df0a0 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 -- 172.21.15.16:0/966636193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 msgr2=0x55dea19f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19f7830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c003d40 tx=0x7f9c6c0097c0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 -- 172.21.15.16:0/966636193 shutdown_connections 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19eb950 0x55dea19e28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19df9c0 0x55dea19e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 --2- 172.21.15.16:0/966636193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df0a0 0x55dea19f7830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 -- 172.21.15.16:0/966636193 >> 172.21.15.16:0/966636193 conn(0x55dea19dced0 msgr2=0x55dea19e2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 -- 172.21.15.16:0/966636193 shutdown_connections 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 -- 172.21.15.16:0/966636193 wait complete. 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.188+0000 7f9c83979740 1 -- start start 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 1 Processor -- start 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df9c0 0x55dea19ee850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19eed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1acc20 con 0x55dea19df0a0 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1ae090 con 0x55dea19df9c0 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c1ad2f0 con 0x55dea19eb950 2024-09-10T23:43:48.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c83979740 10 client.0 _ll_register_callbacks cb 0x7f9c6c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60286/0 (socket says 172.21.15.16:60286) 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c7affd640 1 -- 172.21.15.16:0/2861138200 learned_addr learned my addr 172.21.15.16:0/2861138200 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df9c0 0x55dea19ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.189+0000 7f9c7b7fe640 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c7affd640 1 -- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 msgr2=0x55dea19eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c7affd640 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c7affd640 1 -- 172.21.15.16:0/2861138200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df9c0 msgr2=0x55dea19ee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c7affd640 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df9c0 0x55dea19ee850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c7affd640 1 -- 172.21.15.16:0/2861138200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dea19ef500 con 0x55dea19df0a0 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c7affd640 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19f3f60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005bc0 tx=0x7f9c6c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2930fe55fd3657 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c627fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:48.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c627fc640 1 -- 172.21.15.16:0/2861138200 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c03b070 con 0x55dea19df0a0 2024-09-10T23:43:48.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c627fc640 1 -- 172.21.15.16:0/2861138200 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f9c6c019430 con 0x55dea19df0a0 2024-09-10T23:43:48.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c6c01f040 con 0x55dea19df0a0 2024-09-10T23:43:48.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c627fc640 1 -- 172.21.15.16:0/2861138200 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c6c047050 con 0x55dea19df0a0 2024-09-10T23:43:48.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c83979740 10 client.16008 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:48.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.190+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dea1a6d330 con 0x55dea19df0a0 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c627fc640 1 -- 172.21.15.16:0/2861138200 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c6c01f040 con 0x55dea19df0a0 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c627fc640 1 -- 172.21.15.16:0/2861138200 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c6c00e790 con 0x55dea19df0a0 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c83979740 10 client.16008 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c83979740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c83979740 20 client.16008 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c83979740 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea1a6fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c83979740 4 client.16008 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dea1953850 con 0x55dea19fb240 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.191+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea1a6fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c627fc640 10 client.16008 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c7a7fc640 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea1a6fa90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cbbc75cc54e523 server_cookie=d74640fe2d947260 in_seq=0 out_seq=0 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c627fc640 1 -- 172.21.15.16:0/2861138200 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55dea1953850 con 0x55dea19fb240 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c627fc640 10 client.16008 handle_command_reply: tid=0 2024-09-10T23:43:48.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 client.16008 shutdown 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 msgr2=0x55dea19f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19f3f60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005bc0 tx=0x7f9c6c011e80 comp rx=0 tx=0).stop 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 shutdown_connections 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55dea19fb240 0x55dea1a6fa90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dea19eb950 0x55dea19eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea19df9c0 0x55dea19ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 --2- 172.21.15.16:0/2861138200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dea19df0a0 0x55dea19f3f60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 >> 172.21.15.16:0/2861138200 conn(0x55dea19dced0 msgr2=0x55dea19e2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c627fc640 0 client.16008 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 shutdown_connections 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 1 -- 172.21.15.16:0/2861138200 wait complete. 2024-09-10T23:43:48.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.192+0000 7f9c83979740 20 client.16008 trim_cache size 0 max 16384 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:48.199 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:48.200 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:43:48.201 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:48.202 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9c680b5450 msgr2=0x7f9c680b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9c680b5450 0x7f9c680b7910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9c74005fd0 tx=0x7f9c74009500 comp rx=0 tx=0).stop 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 msgr2=0x7f9c7c199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c199820 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9c64005940 tx=0x7f9c640040c0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 shutdown_connections 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c7c108060 0x7f9c7c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c7c1076e0 0x7f9c7c199820 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f9c680b5450 0x7f9c680b7910 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 --2- 172.21.15.16:0/2872647278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c7c101cd0 0x7f9c7c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:48.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 >> 172.21.15.16:0/2872647278 conn(0x7f9c7c0fd700 msgr2=0x7f9c7c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:48.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 shutdown_connections 2024-09-10T23:43:48.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:48.193+0000 7f9c815a4640 1 -- 172.21.15.16:0/2872647278 wait complete. 2024-09-10T23:43:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:48 smithi071 ceph-mon[35018]: pgmap v427: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:48.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:48 smithi066 ceph-mon[34761]: pgmap v427: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:49.098 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:43:49.099 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:43:49.363 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 -- 172.21.15.16:0/3120087498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f966010d100 msgr2=0x7f966010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 --2- 172.21.15.16:0/3120087498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f966010d100 0x7f966010f560 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9658009900 tx=0x7f965802a410 comp rx=0 tx=0).stop 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 -- 172.21.15.16:0/3120087498 shutdown_connections 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 --2- 172.21.15.16:0/3120087498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f966010d100 0x7f966010f560 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 --2- 172.21.15.16:0/3120087498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96601045c0 0x7f966010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 --2- 172.21.15.16:0/3120087498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9660103ca0 0x7f9660104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 -- 172.21.15.16:0/3120087498 >> 172.21.15.16:0/3120087498 conn(0x7f96600fd700 msgr2=0x7f96600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 -- 172.21.15.16:0/3120087498 shutdown_connections 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 -- 172.21.15.16:0/3120087498 wait complete. 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.897+0000 7f9665346640 1 Processor -- start 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f9665346640 1 -- start start 2024-09-10T23:43:49.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f9665346640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9660103ca0 0x7f9660101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f9665346640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96601045c0 0x7f9660101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f9665346640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f966010d100 0x7f96601023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f9665346640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9660112d70 con 0x7f96601045c0 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f9665346640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9660112bf0 con 0x7f9660103ca0 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f9665346640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9660112ef0 con 0x7f966010d100 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96601045c0 0x7f9660101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96601045c0 0x7f9660101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60304/0 (socket says 172.21.15.16:60304) 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 -- 172.21.15.16:0/3007551307 learned_addr learned my addr 172.21.15.16:0/3007551307 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965f7fe640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f966010d100 0x7f96601023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965effd640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9660103ca0 0x7f9660101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 -- 172.21.15.16:0/3007551307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f966010d100 msgr2=0x7f96601023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f966010d100 0x7f96601023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:49.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 -- 172.21.15.16:0/3007551307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9660103ca0 msgr2=0x7f9660101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9660103ca0 0x7f9660101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 -- 172.21.15.16:0/3007551307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96601a76c0 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.898+0000 7f965e7fc640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96601045c0 0x7f9660101e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f964800d6b0 tx=0x7f964800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.899+0000 7f9657fff640 1 -- 172.21.15.16:0/3007551307 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648017070 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.899+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96601a79b0 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.899+0000 7f9657fff640 1 -- 172.21.15.16:0/3007551307 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9648010460 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.899+0000 7f9657fff640 1 -- 172.21.15.16:0/3007551307 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964800f620 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.899+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96601a7ea0 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.900+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9660104080 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.901+0000 7f9657fff640 1 -- 172.21.15.16:0/3007551307 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f9648010930 con 0x7f96601045c0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.902+0000 7f9657fff640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f964c0b5450 0x7f964c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.902+0000 7f965effd640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f964c0b5450 0x7f964c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:49.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.902+0000 7f9657fff640 1 -- 172.21.15.16:0/3007551307 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f96480e5ce0 con 0x7f96601045c0 2024-09-10T23:43:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.903+0000 7f965effd640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f964c0b5450 0x7f964c0b7910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9650005fd0 tx=0x7f9650009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:49.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:49.905+0000 7f9657fff640 1 -- 172.21.15.16:0/3007551307 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96480ac860 con 0x7f96601045c0 2024-09-10T23:43:50.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.126+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f966002e5c0 con 0x7f96601045c0 2024-09-10T23:43:50.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.127+0000 7f9657fff640 1 -- 172.21.15.16:0/3007551307 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f96480ac160 con 0x7f96601045c0 2024-09-10T23:43:50.129 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:43:50.129 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:43:50.129 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f964c0b5450 msgr2=0x7f964c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f964c0b5450 0x7f964c0b7910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9650005fd0 tx=0x7f9650009500 comp rx=0 tx=0).stop 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96601045c0 msgr2=0x7f9660101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96601045c0 0x7f9660101e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f964800d6b0 tx=0x7f964800db70 comp rx=0 tx=0).stop 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 shutdown_connections 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f966010d100 0x7f96601023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96601045c0 0x7f9660101e90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f964c0b5450 0x7f964c0b7910 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 --2- 172.21.15.16:0/3007551307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9660103ca0 0x7f9660101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 >> 172.21.15.16:0/3007551307 conn(0x7f96600fd700 msgr2=0x7f96600fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 shutdown_connections 2024-09-10T23:43:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:50.130+0000 7f9665346640 1 -- 172.21.15.16:0/3007551307 wait complete. 2024-09-10T23:43:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:50 smithi016 ceph-mon[30855]: pgmap v428: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:50 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3007551307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:43:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:50 smithi071 ceph-mon[35018]: pgmap v428: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:50 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3007551307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:43:50.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:50 smithi066 ceph-mon[34761]: pgmap v428: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:43:50.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:50 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3007551307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:43:50.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:43:51.198 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 -- 172.21.15.16:0/2930960024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304102dc0 msgr2=0x7fb3041031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 --2- 172.21.15.16:0/2930960024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304102dc0 0x7fb3041031a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009900 tx=0x7fb2f402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 -- 172.21.15.16:0/2930960024 shutdown_connections 2024-09-10T23:43:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 --2- 172.21.15.16:0/2930960024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb304109150 0x7fb30410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 --2- 172.21.15.16:0/2930960024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3041087d0 0x7fb304108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 --2- 172.21.15.16:0/2930960024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304102dc0 0x7fb3041031a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 -- 172.21.15.16:0/2930960024 >> 172.21.15.16:0/2930960024 conn(0x7fb3040fe830 msgr2=0x7fb304100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 -- 172.21.15.16:0/2930960024 shutdown_connections 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 -- 172.21.15.16:0/2930960024 wait complete. 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.716+0000 7fb30a454640 1 Processor -- start 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb30a454640 1 -- start start 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb30a454640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb304102dc0 0x7fb304199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb30a454640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3041087d0 0x7fb304199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb30a454640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304109150 0x7fb30419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb30a454640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb304112e60 con 0x7fb304109150 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb30a454640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb304112ce0 con 0x7fb304102dc0 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb30a454640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb304112fe0 con 0x7fb3041087d0 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304109150 0x7fb30419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304109150 0x7fb30419eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60324/0 (socket says 172.21.15.16:60324) 2024-09-10T23:43:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 -- 172.21.15.16:0/3740165740 learned_addr learned my addr 172.21.15.16:0/3740165740 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3041087d0 0x7fb304199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb303fff640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb304102dc0 0x7fb304199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 -- 172.21.15.16:0/3740165740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3041087d0 msgr2=0x7fb304199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3041087d0 0x7fb304199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 -- 172.21.15.16:0/3740165740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb304102dc0 msgr2=0x7fb304199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb304102dc0 0x7fb304199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 -- 172.21.15.16:0/3740165740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30419f2c0 con 0x7fb304109150 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb303fff640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb304102dc0 0x7fb304199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.717+0000 7fb3089f1640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304109150 0x7fb30419eaf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00cce0 tx=0x7fb2fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.718+0000 7fb301ffb640 1 -- 172.21.15.16:0/3740165740 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00f450 con 0x7fb304109150 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.718+0000 7fb301ffb640 1 -- 172.21.15.16:0/3740165740 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2fc00faa0 con 0x7fb304109150 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.718+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30419f5b0 con 0x7fb304109150 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.718+0000 7fb301ffb640 1 -- 172.21.15.16:0/3740165740 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc018a80 con 0x7fb304109150 2024-09-10T23:43:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.718+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3041a5c70 con 0x7fb304109150 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.720+0000 7fb30c829740 1 Processor -- start 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.720+0000 7fb301ffb640 1 -- 172.21.15.16:0/3740165740 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb2fc020030 con 0x7fb304109150 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.720+0000 7fb30c829740 1 -- start start 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb30c829740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bd14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb30c829740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bdd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb30c829740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb30c829740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ef10b47ea0 con 0x55ef10bd1a10 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb30c829740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ef10b372d0 con 0x55ef10bdd9a0 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb30c829740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef10b3b0e0 con 0x55ef10bd10f0 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bdd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bdd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60340/0 (socket says 172.21.15.16:60340) 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 -- 172.21.15.16:0/2896431822 learned_addr learned my addr 172.21.15.16:0/2896431822 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bd14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 -- 172.21.15.16:0/2896431822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 msgr2=0x55ef10bd14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bd14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 -- 172.21.15.16:0/2896431822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 msgr2=0x55ef10bdfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 -- 172.21.15.16:0/2896431822 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef10895650 con 0x55ef10bd1a10 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb301ffb640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2f00b5450 0x7fb2f00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.721+0000 7fb303fff640 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bdd460 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4000c00 tx=0x7fb2f4004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5dc443648aaa54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2f00b5450 0x7fb2f00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb301ffb640 1 -- 172.21.15.16:0/3740165740 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb2fc0e60d0 con 0x7fb304109150 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb2fa7fc640 1 -- 172.21.15.16:0/2896431822 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f403f070 con 0x55ef10bd1a10 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb2fa7fc640 1 -- 172.21.15.16:0/2896431822 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2f40046c0 con 0x55ef10bd1a10 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb30c829740 1 -- 172.21.15.16:0/2896431822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 msgr2=0x55ef10bdd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2f00b5450 0x7fb2f00b7910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb304108240 tx=0x7fb2ec012040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb30c829740 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bdd460 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4000c00 tx=0x7fb2f4004390 comp rx=0 tx=0).stop 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb30c829740 1 -- 172.21.15.16:0/2896431822 shutdown_connections 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb30c829740 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb30c829740 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bdd460 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb30c829740 1 --2- 172.21.15.16:0/2896431822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bd14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.722+0000 7fb30c829740 1 -- 172.21.15.16:0/2896431822 >> 172.21.15.16:0/2896431822 conn(0x55ef10bcef20 msgr2=0x55ef10bd00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.723+0000 7fb30c829740 1 -- 172.21.15.16:0/2896431822 shutdown_connections 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.723+0000 7fb30c829740 1 -- 172.21.15.16:0/2896431822 wait complete. 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.723+0000 7fb30c829740 1 -- start start 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.723+0000 7fb30c829740 1 Processor -- start 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bdd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bda650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ef10998700 con 0x55ef10bd1a10 2024-09-10T23:43:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ef10ad2160 con 0x55ef10bdd9a0 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ef10be0610 con 0x55ef10bd10f0 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 10 client.0 _ll_register_callbacks cb 0x55ef10aeb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bda650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bda650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60352/0 (socket says 172.21.15.16:60352) 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1217723061 learned_addr learned my addr 172.21.15.16:0/1217723061 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb303fff640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bdd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb3089f1640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 msgr2=0x55ef10bdd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bdd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1217723061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 msgr2=0x55ef10bdabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1217723061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef10affc90 con 0x55ef10bd1a10 2024-09-10T23:43:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb303fff640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bdd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bda650 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00fe10 tx=0x7fb2ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c4ddde7074d027 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2e37fe640 1 -- 172.21.15.16:0/1217723061 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec022070 con 0x55ef10bd1a10 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb2e37fe640 1 -- 172.21.15.16:0/1217723061 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb2ec005220 con 0x55ef10bd1a10 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.724+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2f40046c0 con 0x55ef10bd1a10 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb2e37fe640 1 -- 172.21.15.16:0/1217723061 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2ec018070 con 0x55ef10bd1a10 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 10 client.16026 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef10bebf10 con 0x55ef10bd1a10 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb2e37fe640 1 -- 172.21.15.16:0/1217723061 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2f40046c0 con 0x55ef10bd1a10 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb2e37fe640 1 -- 172.21.15.16:0/1217723061 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2ec02f4b0 con 0x55ef10bd1a10 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 10 client.16026 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 10 client.16026 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 20 client.16026 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10bed320 0x55ef10bef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 4 client.16026 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef10b49df0 con 0x55ef10bed320 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.725+0000 7fb303fff640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10bed320 0x55ef10bef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.726+0000 7fb303fff640 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10bed320 0x55ef10bef7a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64e626eef0753dd4 server_cookie=3084905cdc3206f3 in_seq=0 out_seq=0 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.726+0000 7fb2e37fe640 10 client.16026 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb2e37fe640 1 -- 172.21.15.16:0/1217723061 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef10b49df0 con 0x55ef10bed320 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb2e37fe640 10 client.16026 handle_command_reply: tid=0 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 client.16026 shutdown 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 msgr2=0x55ef10bda650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bda650 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00fe10 tx=0x7fb2ec0046c0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 shutdown_connections 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10bed320 0x55ef10bef7a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10bdabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb2e37fe640 0 client.16026 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bda650 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 --2- 172.21.15.16:0/1217723061 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10bdd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 >> 172.21.15.16:0/1217723061 conn(0x55ef10bcef20 msgr2=0x55ef10bd4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 shutdown_connections 2024-09-10T23:43:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 1 -- 172.21.15.16:0/1217723061 wait complete. 2024-09-10T23:43:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.727+0000 7fb30c829740 20 client.16026 trim_cache size 0 max 16384 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 Processor -- start 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 -- start start 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bd10f0 0x55ef10be98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bcde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bdd9a0 0x55ef10bd7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041b0dc0 con 0x55ef10bd1a10 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041ae690 con 0x55ef10bd10f0 2024-09-10T23:43:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb30c829740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041ac4e0 con 0x55ef10bdd9a0 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bcde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bcde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60362/0 (socket says 172.21.15.16:60362) 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.741+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1206864016 learned_addr learned my addr 172.21.15.16:0/1206864016 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb3089f1640 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bdd9a0 0x55ef10bd7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb303fff640 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bd10f0 0x55ef10be98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1206864016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bdd9a0 msgr2=0x55ef10bd7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bdd9a0 0x55ef10bd7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1206864016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bd10f0 msgr2=0x55ef10be98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bd10f0 0x55ef10be98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2fbfff640 1 -- 172.21.15.16:0/1206864016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef10bd1840 con 0x55ef10bd1a10 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bcde60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00f010 tx=0x7fb2ec00ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c9f2c9519fbb38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2f9ffb640 1 -- 172.21.15.16:0/1206864016 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec022040 con 0x55ef10bd1a10 2024-09-10T23:43:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2f9ffb640 1 -- 172.21.15.16:0/1206864016 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2ec00ec10 con 0x55ef10bd1a10 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.742+0000 7fb2f9ffb640 1 -- 172.21.15.16:0/1206864016 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec01ebc0 con 0x55ef10bd1a10 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 -- 172.21.15.16:0/1206864016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 msgr2=0x55ef10bcde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bcde60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00f010 tx=0x7fb2ec00ff80 comp rx=0 tx=0).stop 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 -- 172.21.15.16:0/1206864016 shutdown_connections 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bdd9a0 0x55ef10bd7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10bcde60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 --2- 172.21.15.16:0/1206864016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bd10f0 0x55ef10be98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 -- 172.21.15.16:0/1206864016 >> 172.21.15.16:0/1206864016 conn(0x55ef10bcef20 msgr2=0x55ef10bcd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 -- 172.21.15.16:0/1206864016 shutdown_connections 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 -- 172.21.15.16:0/1206864016 wait complete. 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.743+0000 7fb30c829740 1 -- start start 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 1 Processor -- start 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10be2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10be2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10c59270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041acb50 con 0x55ef10bd1a10 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10be2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041adfc0 con 0x55ef10bdd9a0 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041ad220 con 0x55ef10bd10f0 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10be2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60374/0 (socket says 172.21.15.16:60374) 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb2fbfff640 1 -- 172.21.15.16:0/2743914309 learned_addr learned my addr 172.21.15.16:0/2743914309 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb30c829740 10 client.0 _ll_register_callbacks cb 0x7fb2ec00ada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb303fff640 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10be2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.744+0000 7fb3089f1640 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10c59270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2fbfff640 1 -- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 msgr2=0x55ef10be2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10be2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2fbfff640 1 -- 172.21.15.16:0/2743914309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 msgr2=0x55ef10c59270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10c59270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2fbfff640 1 -- 172.21.15.16:0/2743914309 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef10c598b0 con 0x55ef10bd1a10 2024-09-10T23:43:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2fbfff640 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10be2580 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00fe10 tx=0x7fb2ec00aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1270383ac171802 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2e37fe640 1 -- 172.21.15.16:0/2743914309 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec022040 con 0x55ef10bd1a10 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2e37fe640 1 -- 172.21.15.16:0/2743914309 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb2ec01e620 con 0x55ef10bd1a10 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2ec00ec10 con 0x55ef10bd1a10 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2e37fe640 1 -- 172.21.15.16:0/2743914309 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2ec01e940 con 0x55ef10bd1a10 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb30c829740 10 client.16032 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef10c5abb0 con 0x55ef10bd1a10 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.745+0000 7fb2e37fe640 1 -- 172.21.15.16:0/2743914309 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2ec00ec10 con 0x55ef10bd1a10 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb2e37fe640 1 -- 172.21.15.16:0/2743914309 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2ec004660 con 0x55ef10bd1a10 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb30c829740 10 client.16032 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb30c829740 10 client.16032 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb30c829740 20 client.16032 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb30c829740 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10c5b2a0 0x55ef10c5d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb30c829740 4 client.16032 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ef10b458a0 con 0x55ef10c5b2a0 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb303fff640 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10c5b2a0 0x55ef10c5d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb303fff640 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10c5b2a0 0x55ef10c5d6c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ab8d36d0d9faaa2 server_cookie=93892ff1d9345d2 in_seq=0 out_seq=0 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb2e37fe640 10 client.16032 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb2e37fe640 1 -- 172.21.15.16:0/2743914309 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ef10b458a0 con 0x55ef10c5b2a0 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb2e37fe640 10 client.16032 handle_command_reply: tid=0 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.746+0000 7fb30c829740 1 client.16032 shutdown 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 msgr2=0x55ef10be2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10be2580 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00fe10 tx=0x7fb2ec00aa50 comp rx=0 tx=0).stop 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 shutdown_connections 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ef10c5b2a0 0x55ef10c5d6c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef10bdd9a0 0x55ef10c59270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ef10bd1a10 0x55ef10be2580 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 --2- 172.21.15.16:0/2743914309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ef10bd10f0 0x55ef10be2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 >> 172.21.15.16:0/2743914309 conn(0x55ef10bcef20 msgr2=0x55ef10bdc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:51.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb2e37fe640 0 client.16032 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:43:51.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 shutdown_connections 2024-09-10T23:43:51.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 1 -- 172.21.15.16:0/2743914309 wait complete. 2024-09-10T23:43:51.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30c829740 20 client.16032 trim_cache size 0 max 16384 2024-09-10T23:43:51.755 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2f00b5450 msgr2=0x7fb2f00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30a454640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2f00b5450 0x7fb2f00b7910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb304108240 tx=0x7fb2ec012040 comp rx=0 tx=0).stop 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304109150 msgr2=0x7fb30419eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.747+0000 7fb30a454640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304109150 0x7fb30419eaf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00cce0 tx=0x7fb2fc00a620 comp rx=0 tx=0).stop 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 shutdown_connections 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb304109150 0x7fb30419eaf0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3041087d0 0x7fb304199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb2f00b5450 0x7fb2f00b7910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 --2- 172.21.15.16:0/3740165740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb304102dc0 0x7fb304199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 >> 172.21.15.16:0/3740165740 conn(0x7fb3040fe830 msgr2=0x7fb3040ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 shutdown_connections 2024-09-10T23:43:51.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:51.748+0000 7fb30a454640 1 -- 172.21.15.16:0/3740165740 wait complete. 2024-09-10T23:43:52.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:52 smithi016 ceph-mon[30855]: pgmap v429: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:52.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:43:52.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:52 smithi071 ceph-mon[35018]: pgmap v429: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:52.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:52 smithi066 ceph-mon[34761]: pgmap v429: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:43:52.724 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 -- 172.21.15.16:0/1130250646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d010d100 msgr2=0x7fc5d010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1130250646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d010d100 0x7fc5d010f560 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009ca0 tx=0x7fc5c002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 -- 172.21.15.16:0/1130250646 shutdown_connections 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1130250646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d010d100 0x7fc5d010f560 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1130250646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d01045c0 0x7fc5d010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1130250646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d0103ca0 0x7fc5d0104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 -- 172.21.15.16:0/1130250646 >> 172.21.15.16:0/1130250646 conn(0x7fc5d00fd700 msgr2=0x7fc5d00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 -- 172.21.15.16:0/1130250646 shutdown_connections 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 -- 172.21.15.16:0/1130250646 wait complete. 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 Processor -- start 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 -- start start 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.210+0000 7fc5d8421640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d0103ca0 0x7fc5d01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d8421640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d01045c0 0x7fc5d01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d8421640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d010d100 0x7fc5d019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d8421640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0112d70 con 0x7fc5d01045c0 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d8421640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0112bf0 con 0x7fc5d0103ca0 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d8421640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0112ef0 con 0x7fc5d010d100 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d01045c0 0x7fc5d01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d01045c0 0x7fc5d01997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60396/0 (socket says 172.21.15.16:60396) 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1619090655 learned_addr learned my addr 172.21.15.16:0/1619090655 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d0103ca0 0x7fc5d01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d69be640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d010d100 0x7fc5d019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1619090655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d010d100 msgr2=0x7fc5d019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d010d100 0x7fc5d019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1619090655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d0103ca0 msgr2=0x7fc5d01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d0103ca0 0x7fc5d01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1619090655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d019f350 con 0x7fc5d01045c0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d01045c0 0x7fc5d01997e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400d6b0 tx=0x7fc5c400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5cf7fe640 1 -- 172.21.15.16:0/1619090655 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4017070 con 0x7fc5d01045c0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5cf7fe640 1 -- 172.21.15.16:0/1619090655 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c4010460 con 0x7fc5d01045c0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d019f640 con 0x7fc5d01045c0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5cf7fe640 1 -- 172.21.15.16:0/1619090655 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400f620 con 0x7fc5d01045c0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.211+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d01a5d00 con 0x7fc5d01045c0 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 Processor -- start 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 -- start start 2024-09-10T23:43:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5cf7fe640 1 -- 172.21.15.16:0/1619090655 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc5c4010930 con 0x7fc5d01045c0 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df22092a10 0x55df220a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df220a2db0 0x55df220a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55df22008ea0 con 0x55df220a2db0 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55df21ff82d0 con 0x55df22092a10 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.214+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55df21ffc0e0 con 0x55df220920f0 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df220a2db0 0x55df220a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df220a2db0 0x55df220a51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60402/0 (socket says 172.21.15.16:60402) 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 -- 172.21.15.16:0/2265837002 learned_addr learned my addr 172.21.15.16:0/2265837002 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df22092a10 0x55df220a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d69be640 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 -- 172.21.15.16:0/2265837002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 msgr2=0x55df220924d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220924d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 -- 172.21.15.16:0/2265837002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df22092a10 msgr2=0x55df220a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df22092a10 0x55df220a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 -- 172.21.15.16:0/2265837002 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df21d56650 con 0x55df220a2db0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df220a2db0 0x55df220a51a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40e32b0 tx=0x7fc5c40ee700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec2b33a45ff8216 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5ccde6640 1 -- 172.21.15.16:0/2265837002 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40f0820 con 0x55df220a2db0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5cf7fe640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5b80b54d0 0x7fc5b80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5ccde6640 1 -- 172.21.15.16:0/2265837002 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c40abbb0 con 0x55df220a2db0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.215+0000 7fc5ccde6640 1 -- 172.21.15.16:0/2265837002 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40ab810 con 0x55df220a2db0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5d69be640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5b80b54d0 0x7fc5b80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5cf7fe640 1 -- 172.21.15.16:0/1619090655 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc5c40e5bc0 con 0x7fc5d01045c0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 -- 172.21.15.16:0/2265837002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df220a2db0 msgr2=0x55df220a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df220a2db0 0x55df220a51a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40e32b0 tx=0x7fc5c40ee700 comp rx=0 tx=0).stop 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5d69be640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5b80b54d0 0x7fc5b80b7990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005e30 tx=0x7fc5c0005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 -- 172.21.15.16:0/2265837002 shutdown_connections 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df220a2db0 0x55df220a51a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df22092a10 0x55df220a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/2265837002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220924d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 -- 172.21.15.16:0/2265837002 >> 172.21.15.16:0/2265837002 conn(0x55df2208ff20 msgr2=0x55df220910c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 -- 172.21.15.16:0/2265837002 shutdown_connections 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.216+0000 7fc5da7f6740 1 -- 172.21.15.16:0/2265837002 wait complete. 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 -- start start 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 Processor -- start 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220a2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df2209fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df220a0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55df21e59700 con 0x55df22092a10 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55df21f93160 con 0x55df220920f0 2024-09-10T23:43:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55df220a5a60 con 0x55df220a2db0 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5da7f6740 10 client.0 _ll_register_callbacks cb 0x55df21fac9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df2209fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df2209fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60418/0 (socket says 172.21.15.16:60418) 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 -- 172.21.15.16:0/3063229738 learned_addr learned my addr 172.21.15.16:0/3063229738 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d69be640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df220a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 -- 172.21.15.16:0/3063229738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 msgr2=0x55df220a0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df220a0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 -- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 msgr2=0x55df220a2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220a2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.217+0000 7fc5d59bc640 1 -- 172.21.15.16:0/3063229738 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df21fc0c90 con 0x55df22092a10 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5d69be640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df220a0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220a2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df2209fae0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b3bf0 tx=0x7fc5c4005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dfa51658209625 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/3063229738 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40aa250 con 0x55df22092a10 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/3063229738 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc5c4010610 con 0x55df22092a10 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5c40abbb0 con 0x55df22092a10 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/3063229738 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc5c4021020 con 0x55df22092a10 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 10 client.16044 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df220b13e0 con 0x55df22092a10 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/3063229738 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c40abbb0 con 0x55df22092a10 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/3063229738 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc5c40e35f0 con 0x55df22092a10 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 10 client.16044 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 10 client.16044 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 20 client.16044 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df220b2730 0x55df220b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 4 client.16044 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.218+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df2200adf0 con 0x55df220b2730 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.219+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df220b2730 0x55df220b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.219+0000 7fc5b5ffb640 10 client.16044 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.219+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df220b2730 0x55df220b4b20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d9bb8315644b548b server_cookie=6b877e45eaca08c7 in_seq=0 out_seq=0 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/3063229738 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df2200adf0 con 0x55df220b2730 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5b5ffb640 10 client.16044 handle_command_reply: tid=0 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 client.16044 shutdown 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 msgr2=0x55df2209fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df2209fae0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40b3bf0 tx=0x7fc5c4005f30 comp rx=0 tx=0).stop 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 shutdown_connections 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df220b2730 0x55df220b4b20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df220a0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5b5ffb640 0 client.16044 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df2209fae0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/3063229738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220a2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 >> 172.21.15.16:0/3063229738 conn(0x55df2208ff20 msgr2=0x55df22095ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:53.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 shutdown_connections 2024-09-10T23:43:53.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.220+0000 7fc5da7f6740 1 -- 172.21.15.16:0/3063229738 wait complete. 2024-09-10T23:43:53.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.221+0000 7fc5da7f6740 20 client.16044 trim_cache size 0 max 16384 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 Processor -- start 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 -- start start 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df22091050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df22091590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01aed30 con 0x55df22092a10 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01ac600 con 0x55df220920f0 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01aa470 con 0x55df220a2db0 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df22091050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df22091050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60424/0 (socket says 172.21.15.16:60424) 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1872780236 learned_addr learned my addr 172.21.15.16:0/1872780236 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5d69be640 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df22091590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.234+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1872780236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 msgr2=0x55df22091590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df22091590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1872780236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 msgr2=0x55df220aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5d59bc640 1 -- 172.21.15.16:0/1872780236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df2209da50 con 0x55df22092a10 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df22091050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40a8670 tx=0x7fc5c40ee700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112c35ee9661791 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5b7fff640 1 -- 172.21.15.16:0/1872780236 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40aa470 con 0x55df22092a10 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5b7fff640 1 -- 172.21.15.16:0/1872780236 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c40e94e0 con 0x55df22092a10 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.235+0000 7fc5b7fff640 1 -- 172.21.15.16:0/1872780236 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40aa660 con 0x55df22092a10 2024-09-10T23:43:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 -- 172.21.15.16:0/1872780236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 msgr2=0x55df22091050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df22091050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40a8670 tx=0x7fc5c40ee700 comp rx=0 tx=0).stop 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 -- 172.21.15.16:0/1872780236 shutdown_connections 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220a2db0 0x55df22091590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df22091050 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/1872780236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220920f0 0x55df220aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 -- 172.21.15.16:0/1872780236 >> 172.21.15.16:0/1872780236 conn(0x55df2208ff20 msgr2=0x55df2209e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 -- 172.21.15.16:0/1872780236 shutdown_connections 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 -- 172.21.15.16:0/1872780236 wait complete. 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 -- start start 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 Processor -- start 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.236+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df220b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5da7f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220a2db0 0x55df220b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01aaac0 con 0x55df22092a10 2024-09-10T23:43:53.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01abf30 con 0x55df220a2db0 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5da7f6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01ab190 con 0x55df220920f0 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5da7f6740 10 client.0 _ll_register_callbacks cb 0x7fc5c800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df220b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df220b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60438/0 (socket says 172.21.15.16:60438) 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 -- 172.21.15.16:0/669181300 learned_addr learned my addr 172.21.15.16:0/669181300 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d69be640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220a2db0 0x55df220b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 -- 172.21.15.16:0/669181300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 msgr2=0x55df220b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 -- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220a2db0 msgr2=0x55df220b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220a2db0 0x55df220b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 -- 172.21.15.16:0/669181300 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df220b53a0 con 0x55df22092a10 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:53.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5d59bc640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df220b4720 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40ac030 tx=0x7fc5c40e5f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497db1a9104027d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/669181300 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4097070 con 0x55df22092a10 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/669181300 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc5c40a8310 con 0x55df22092a10 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.237+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5c40e94e0 con 0x55df22092a10 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/669181300 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc5c40aa9e0 con 0x55df22092a10 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 10 client.16050 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df220b53a0 con 0x55df22092a10 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/669181300 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5c40e94e0 con 0x55df22092a10 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/669181300 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc5c40ac300 con 0x55df22092a10 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 10 client.16050 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 10 client.16050 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 20 client.16050 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:53.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df22120500 0x55df22122920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 4 client.16050 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df220068a0 con 0x55df22120500 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.238+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df22120500 0x55df22122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5d61bd640 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df22120500 0x55df22122920 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=963453e1320f094d server_cookie=75c62d12f45b818b in_seq=0 out_seq=0 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5b5ffb640 10 client.16050 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5b5ffb640 1 -- 172.21.15.16:0/669181300 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df220068a0 con 0x55df22120500 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5b5ffb640 10 client.16050 handle_command_reply: tid=0 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 client.16050 shutdown 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 msgr2=0x55df220b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df220b4720 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40ac030 tx=0x7fc5c40e5f40 comp rx=0 tx=0).stop 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 shutdown_connections 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55df22120500 0x55df22122920 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df220a2db0 0x55df220b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df22092a10 0x55df220b4720 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5b5ffb640 0 client.16050 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:43:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 --2- 172.21.15.16:0/669181300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df220920f0 0x55df220b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 >> 172.21.15.16:0/669181300 conn(0x55df2208ff20 msgr2=0x55df220a4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 shutdown_connections 2024-09-10T23:43:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 1 -- 172.21.15.16:0/669181300 wait complete. 2024-09-10T23:43:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.239+0000 7fc5da7f6740 20 client.16050 trim_cache size 0 max 16384 2024-09-10T23:43:53.254 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5b80b54d0 msgr2=0x7fc5b80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5b80b54d0 0x7fc5b80b7990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005e30 tx=0x7fc5c0005c30 comp rx=0 tx=0).stop 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d01045c0 msgr2=0x7fc5d01997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d01045c0 0x7fc5d01997e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400d6b0 tx=0x7fc5c400db70 comp rx=0 tx=0).stop 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 shutdown_connections 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d010d100 0x7fc5d019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5d01045c0 0x7fc5d01997e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc5b80b54d0 0x7fc5b80b7990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 --2- 172.21.15.16:0/1619090655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d0103ca0 0x7fc5d01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 >> 172.21.15.16:0/1619090655 conn(0x7fc5d00fd700 msgr2=0x7fc5d00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 shutdown_connections 2024-09-10T23:43:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:53.240+0000 7fc5d8421640 1 -- 172.21.15.16:0/1619090655 wait complete. 2024-09-10T23:43:54.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:43:54.316 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:54.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:54 smithi016 ceph-mon[30855]: pgmap v430: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:54.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:54 smithi071 ceph-mon[35018]: pgmap v430: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:54.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:54 smithi066 ceph-mon[34761]: pgmap v430: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:43:54.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 -- 172.21.15.16:0/213325819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf81076c0 msgr2=0x7fbdf8107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/213325819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf81076c0 0x7fbdf8107b00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009900 tx=0x7fbdec02a410 comp rx=0 tx=0).stop 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 -- 172.21.15.16:0/213325819 shutdown_connections 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/213325819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf8108040 0x7fbdf810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/213325819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf81076c0 0x7fbdf8107b00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/213325819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdf8101cb0 0x7fbdf8102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 -- 172.21.15.16:0/213325819 >> 172.21.15.16:0/213325819 conn(0x7fbdf80fd700 msgr2=0x7fbdf80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 -- 172.21.15.16:0/213325819 shutdown_connections 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.801+0000 7fbdfd24e640 1 -- 172.21.15.16:0/213325819 wait complete. 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 Processor -- start 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 -- start start 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdf8101cb0 0x7fbdf8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf81076c0 0x7fbdf8199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf8108040 0x7fbdf819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8111d00 con 0x7fbdf8108040 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8111b80 con 0x7fbdf8101cb0 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdfd24e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8111e80 con 0x7fbdf81076c0 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdf759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf8108040 0x7fbdf819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdf759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf8108040 0x7fbdf819ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35556/0 (socket says 172.21.15.16:35556) 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdf759e640 1 -- 172.21.15.16:0/3001251088 learned_addr learned my addr 172.21.15.16:0/3001251088 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdf8101cb0 0x7fbdf8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.802+0000 7fbdf659c640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf81076c0 0x7fbdf8199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdf759e640 1 -- 172.21.15.16:0/3001251088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf81076c0 msgr2=0x7fbdf8199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdf759e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf81076c0 0x7fbdf8199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdf759e640 1 -- 172.21.15.16:0/3001251088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdf8101cb0 msgr2=0x7fbdf8199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdf759e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdf8101cb0 0x7fbdf8199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdf759e640 1 -- 172.21.15.16:0/3001251088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf819f400 con 0x7fbdf8108040 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdf659c640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf81076c0 0x7fbdf8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:54.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdf759e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf8108040 0x7fbdf819ec30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000eaa0 tx=0x7fbdf000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbddffff640 1 -- 172.21.15.16:0/3001251088 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0004d20 con 0x7fbdf8108040 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbddffff640 1 -- 172.21.15.16:0/3001251088 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf0005020 con 0x7fbdf8108040 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf819f6f0 con 0x7fbdf8108040 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbddffff640 1 -- 172.21.15.16:0/3001251088 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00116b0 con 0x7fbdf8108040 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.803+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf81a5db0 con 0x7fbdf8108040 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.805+0000 7fbdff623740 1 Processor -- start 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.805+0000 7fbddffff640 1 -- 172.21.15.16:0/3001251088 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fbdf000f040 con 0x7fbdf8108040 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdff623740 1 -- start start 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdff623740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf6654d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdff623740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf675870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdff623740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdff623740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564fbf5dbea0 con 0x564fbf6650f0 2024-09-10T23:43:54.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdff623740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564fbf5cb2d0 con 0x564fbf665a10 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdff623740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564fbf5cf0e0 con 0x564fbf675db0 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf6654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf6654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35572/0 (socket says 172.21.15.16:35572) 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 -- 172.21.15.16:0/1640921103 learned_addr learned my addr 172.21.15.16:0/1640921103 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf675870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 -- 172.21.15.16:0/1640921103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 msgr2=0x564fbf6781a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 -- 172.21.15.16:0/1640921103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 msgr2=0x564fbf675870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf675870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 -- 172.21.15.16:0/1640921103 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fbf329650 con 0x564fbf6650f0 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.806+0000 7fbdf659c640 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf6654d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbdec006010 tx=0x7fbdec005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96173096c093b626 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbddffff640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbde00b5450 0x7fbde00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbddd7fa640 1 -- 172.21.15.16:0/1640921103 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec035050 con 0x564fbf6650f0 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbddd7fa640 1 -- 172.21.15.16:0/1640921103 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdec0316a0 con 0x564fbf6650f0 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbddd7fa640 1 -- 172.21.15.16:0/1640921103 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0046c0 con 0x564fbf6650f0 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbde00b5450 0x7fbde00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbddffff640 1 -- 172.21.15.16:0/3001251088 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fbdf00e5e70 con 0x7fbdf8108040 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbde00b5450 0x7fbde00b7910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x564fbf668270 tx=0x7fbde8008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 -- 172.21.15.16:0/1640921103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 msgr2=0x564fbf6654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf6654d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbdec006010 tx=0x7fbdec005dd0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 -- 172.21.15.16:0/1640921103 shutdown_connections 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6781a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf675870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 --2- 172.21.15.16:0/1640921103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf6654d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 -- 172.21.15.16:0/1640921103 >> 172.21.15.16:0/1640921103 conn(0x564fbf662f20 msgr2=0x564fbf6640c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 -- 172.21.15.16:0/1640921103 shutdown_connections 2024-09-10T23:43:54.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.807+0000 7fbdff623740 1 -- 172.21.15.16:0/1640921103 wait complete. 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 -- start start 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 Processor -- start 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf6650f0 0x564fbf6756e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf665a10 0x564fbf672b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564fbf42c700 con 0x564fbf665a10 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564fbf566160 con 0x564fbf6650f0 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564fbf678a00 con 0x564fbf675db0 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdff623740 10 client.0 _ll_register_callbacks cb 0x564fbf57f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdf659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf665a10 0x564fbf672b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdf659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf665a10 0x564fbf672b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35580/0 (socket says 172.21.15.16:35580) 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdf659c640 1 -- 172.21.15.16:0/2615063124 learned_addr learned my addr 172.21.15.16:0/2615063124 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf6650f0 0x564fbf6756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.808+0000 7fbdf759e640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdf659c640 1 -- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 msgr2=0x564fbf6731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdf659c640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdf659c640 1 -- 172.21.15.16:0/2615063124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf6650f0 msgr2=0x564fbf6756e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdf659c640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf6650f0 0x564fbf6756e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdf659c640 1 -- 172.21.15.16:0/2615063124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fbf593c90 con 0x564fbf665a10 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf6650f0 0x564fbf6756e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdf659c640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf665a10 0x564fbf672b30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009900 tx=0x7fbdec031520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfda5ef033f084a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbddaff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbddaff5640 1 -- 172.21.15.16:0/2615063124 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec04c020 con 0x564fbf665a10 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbddaff5640 1 -- 172.21.15.16:0/2615063124 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fbdec004ad0 con 0x564fbf665a10 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdec0316a0 con 0x564fbf665a10 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbddaff5640 1 -- 172.21.15.16:0/2615063124 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbdec057050 con 0x564fbf665a10 2024-09-10T23:43:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdff623740 10 client.16062 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564fbf6843a0 con 0x564fbf665a10 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.809+0000 7fbddaff5640 1 -- 172.21.15.16:0/2615063124 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdec0316a0 con 0x564fbf665a10 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbddaff5640 1 -- 172.21.15.16:0/2615063124 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbdec03a440 con 0x564fbf665a10 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbdff623740 10 client.16062 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbdff623740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbdff623740 20 client.16062 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbdff623740 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6856f0 0x564fbf687ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbdff623740 4 client.16062 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fbf5dddf0 con 0x564fbf6856f0 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.810+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6856f0 0x564fbf687ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6856f0 0x564fbf687ae0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ca5e097c9e602c server_cookie=1a658fde99fb1031 in_seq=0 out_seq=0 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbddaff5640 10 client.16062 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbddaff5640 1 -- 172.21.15.16:0/2615063124 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fbf5dddf0 con 0x564fbf6856f0 2024-09-10T23:43:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbddaff5640 10 client.16062 handle_command_reply: tid=0 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 client.16062 shutdown 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf665a10 msgr2=0x564fbf672b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf665a10 0x564fbf672b30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009900 tx=0x7fbdec031520 comp rx=0 tx=0).stop 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 shutdown_connections 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6856f0 0x564fbf687ae0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf665a10 0x564fbf672b30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbddaff5640 0 client.16062 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 --2- 172.21.15.16:0/2615063124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf6650f0 0x564fbf6756e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.811+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 >> 172.21.15.16:0/2615063124 conn(0x564fbf662f20 msgr2=0x564fbf668ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.812+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 shutdown_connections 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.812+0000 7fbdff623740 1 -- 172.21.15.16:0/2615063124 wait complete. 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.812+0000 7fbdff623740 20 client.16062 trim_cache size 0 max 16384 2024-09-10T23:43:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 Processor -- start 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 -- start start 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf6650f0 0x564fbf681cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf662760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf675db0 0x564fbf676c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81aecb0 con 0x564fbf675db0 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81ac580 con 0x564fbf665a10 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdff623740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81aa3f0 con 0x564fbf6650f0 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdf759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf675db0 0x564fbf676c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdf759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf675db0 0x564fbf676c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35584/0 (socket says 172.21.15.16:35584) 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.825+0000 7fbdf759e640 1 -- 172.21.15.16:0/1360678295 learned_addr learned my addr 172.21.15.16:0/1360678295 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf659c640 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf662760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf6650f0 0x564fbf681cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf759e640 1 -- 172.21.15.16:0/1360678295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf6650f0 msgr2=0x564fbf681cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf759e640 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf6650f0 0x564fbf681cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf759e640 1 -- 172.21.15.16:0/1360678295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 msgr2=0x564fbf662760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf759e640 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf662760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf759e640 1 -- 172.21.15.16:0/1360678295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fbf68ddd0 con 0x564fbf675db0 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbdf759e640 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf675db0 0x564fbf676c80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00e3680 tx=0x7fbdf00b52e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9609f686f80abd78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbddcff9640 1 -- 172.21.15.16:0/1360678295 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf001f030 con 0x564fbf675db0 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbddcff9640 1 -- 172.21.15.16:0/1360678295 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf00ac350 con 0x564fbf675db0 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.826+0000 7fbddcff9640 1 -- 172.21.15.16:0/1360678295 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00cf070 con 0x564fbf675db0 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 -- 172.21.15.16:0/1360678295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf675db0 msgr2=0x564fbf676c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf675db0 0x564fbf676c80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00e3680 tx=0x7fbdf00b52e0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 -- 172.21.15.16:0/1360678295 shutdown_connections 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf675db0 0x564fbf676c80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf662760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 --2- 172.21.15.16:0/1360678295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf6650f0 0x564fbf681cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 -- 172.21.15.16:0/1360678295 >> 172.21.15.16:0/1360678295 conn(0x564fbf662f20 msgr2=0x564fbf676190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 -- 172.21.15.16:0/1360678295 shutdown_connections 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 -- 172.21.15.16:0/1360678295 wait complete. 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 -- start start 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 Processor -- start 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf689460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf689a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.827+0000 7fbdff623740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdff623740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81aaa40 con 0x564fbf6650f0 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdff623740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81abeb0 con 0x564fbf665a10 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdff623740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81ab110 con 0x564fbf675db0 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdff623740 10 client.0 _ll_register_callbacks cb 0x7fbdec032d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:54.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf689460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf689460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35586/0 (socket says 172.21.15.16:35586) 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 -- 172.21.15.16:0/494882254 learned_addr learned my addr 172.21.15.16:0/494882254 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf659c640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf689a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf759e640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 -- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 msgr2=0x564fbf6eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 -- 172.21.15.16:0/494882254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 msgr2=0x564fbf689a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf689a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 -- 172.21.15.16:0/494882254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fbf6eb9e0 con 0x564fbf6650f0 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf659c640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf689a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdf6d9d640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf689460 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x564fbf678b10 tx=0x7fbde80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928741f811dd5b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbddaff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:54.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbddaff5640 1 -- 172.21.15.16:0/494882254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8022600 con 0x564fbf6650f0 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbddaff5640 1 -- 172.21.15.16:0/494882254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fbde80227a0 con 0x564fbf6650f0 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdf00ac350 con 0x564fbf6650f0 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbddaff5640 1 -- 172.21.15.16:0/494882254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbde8038050 con 0x564fbf6650f0 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdff623740 10 client.16068 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.828+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564fbf6f2e40 con 0x564fbf6650f0 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbddaff5640 1 -- 172.21.15.16:0/494882254 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf00ac350 con 0x564fbf6650f0 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbddaff5640 1 -- 172.21.15.16:0/494882254 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbde8014af0 con 0x564fbf6650f0 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbdff623740 10 client.16068 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbdff623740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbdff623740 20 client.16068 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbdff623740 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6f3620 0x564fbf6f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbdff623740 4 client.16068 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564fbf5d98a0 con 0x564fbf6f3620 2024-09-10T23:43:54.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.829+0000 7fbdf659c640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6f3620 0x564fbf6f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdf659c640 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6f3620 0x564fbf6f5a40 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e2fb8cdc58a271 server_cookie=9977ab2f99333331 in_seq=0 out_seq=0 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbddaff5640 10 client.16068 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbddaff5640 1 -- 172.21.15.16:0/494882254 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564fbf5d98a0 con 0x564fbf6f3620 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbddaff5640 10 client.16068 handle_command_reply: tid=0 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 client.16068 shutdown 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 msgr2=0x564fbf689460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf689460 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x564fbf678b10 tx=0x7fbde80046c0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 shutdown_connections 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564fbf6f3620 0x564fbf6f5a40 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564fbf675db0 0x564fbf6eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564fbf665a10 0x564fbf689a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 --2- 172.21.15.16:0/494882254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564fbf6650f0 0x564fbf689460 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 >> 172.21.15.16:0/494882254 conn(0x564fbf662f20 msgr2=0x564fbf677bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:54.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbddaff5640 0 client.16068 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:54.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 shutdown_connections 2024-09-10T23:43:54.853 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:43:54.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.830+0000 7fbdff623740 1 -- 172.21.15.16:0/494882254 wait complete. 2024-09-10T23:43:54.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdff623740 20 client.16068 trim_cache size 0 max 16384 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbde00b5450 msgr2=0x7fbde00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbde00b5450 0x7fbde00b7910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x564fbf668270 tx=0x7fbde8008040 comp rx=0 tx=0).stop 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf8108040 msgr2=0x7fbdf819ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf8108040 0x7fbdf819ec30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000eaa0 tx=0x7fbdf000eea0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 shutdown_connections 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdf8108040 0x7fbdf819ec30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdf81076c0 0x7fbdf8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbde00b5450 0x7fbde00b7910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 --2- 172.21.15.16:0/3001251088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdf8101cb0 0x7fbdf8199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 >> 172.21.15.16:0/3001251088 conn(0x7fbdf80fd700 msgr2=0x7fbdf8104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 shutdown_connections 2024-09-10T23:43:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:54.831+0000 7fbdfd24e640 1 -- 172.21.15.16:0/3001251088 wait complete. 2024-09-10T23:43:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:56 smithi016 ceph-mon[30855]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:56.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:56 smithi071 ceph-mon[35018]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:56.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:56 smithi066 ceph-mon[34761]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:43:56.633 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:43:56.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:43:56.904 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 -- 172.21.15.16:0/726693024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc1087d0 msgr2=0x7f81bc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 --2- 172.21.15.16:0/726693024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc1087d0 0x7f81bc108c10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009900 tx=0x7f81ac02a410 comp rx=0 tx=0).stop 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 -- 172.21.15.16:0/726693024 shutdown_connections 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 --2- 172.21.15.16:0/726693024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81bc109150 0x7f81bc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 --2- 172.21.15.16:0/726693024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc1087d0 0x7f81bc108c10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 --2- 172.21.15.16:0/726693024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc102dc0 0x7f81bc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 -- 172.21.15.16:0/726693024 >> 172.21.15.16:0/726693024 conn(0x7f81bc0fe830 msgr2=0x7f81bc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 -- 172.21.15.16:0/726693024 shutdown_connections 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.388+0000 7f81c3d43640 1 -- 172.21.15.16:0/726693024 wait complete. 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 Processor -- start 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 -- start start 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc102dc0 0x7f81bc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc1087d0 0x7f81bc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81bc109150 0x7f81bc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc112dd0 con 0x7f81bc102dc0 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc112c50 con 0x7f81bc1087d0 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c3d43640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc112f50 con 0x7f81bc109150 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc102dc0 0x7f81bc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc102dc0 0x7f81bc0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35602/0 (socket says 172.21.15.16:35602) 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 -- 172.21.15.16:0/2057135802 learned_addr learned my addr 172.21.15.16:0/2057135802 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81bc109150 0x7f81bc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c12de640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc1087d0 0x7f81bc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 -- 172.21.15.16:0/2057135802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81bc109150 msgr2=0x7f81bc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81bc109150 0x7f81bc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 -- 172.21.15.16:0/2057135802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc1087d0 msgr2=0x7f81bc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc1087d0 0x7f81bc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 -- 172.21.15.16:0/2057135802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc1a76e0 con 0x7f81bc102dc0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.389+0000 7f81c1adf640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc102dc0 0x7f81bc0754a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c890 tx=0x7f81b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.390+0000 7f81b2ffd640 1 -- 172.21.15.16:0/2057135802 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8004220 con 0x7f81bc102dc0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.390+0000 7f81b2ffd640 1 -- 172.21.15.16:0/2057135802 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b80043c0 con 0x7f81bc102dc0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.390+0000 7f81b2ffd640 1 -- 172.21.15.16:0/2057135802 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8004a00 con 0x7f81bc102dc0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.390+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc1a79d0 con 0x7f81bc102dc0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.390+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc1a7ee0 con 0x7f81bc102dc0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.392+0000 7f81c6118740 1 Processor -- start 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81b2ffd640 1 -- 172.21.15.16:0/2057135802 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f81b80079b0 con 0x7f81bc102dc0 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c6118740 1 -- start start 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c6118740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c88452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c6118740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c8851250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c6118740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8853b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c6118740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5581c87bbe60 con 0x5581c8851790 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c6118740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5581c87ab290 con 0x5581c8845800 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c6118740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5581c87af0a0 con 0x5581c8844ee0 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c12de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8853b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c22e0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c88452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c12de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8853b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35606/0 (socket says 172.21.15.16:35606) 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c12de640 1 -- 172.21.15.16:0/1088663618 learned_addr learned my addr 172.21.15.16:0/1088663618 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c1adf640 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c8851250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c22e0640 1 -- 172.21.15.16:0/1088663618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 msgr2=0x5581c8851250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c22e0640 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c8851250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c22e0640 1 -- 172.21.15.16:0/1088663618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 msgr2=0x5581c8853b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c22e0640 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8853b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c22e0640 1 -- 172.21.15.16:0/1088663618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581c8509930 con 0x5581c8844ee0 2024-09-10T23:43:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.393+0000 7f81c12de640 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8853b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.394+0000 7f81b2ffd640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81a80b5450 0x7f81a80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.394+0000 7f81c22e0640 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c88452c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009e20 tx=0x7f81b4010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28e9e2eb02ba8632 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.394+0000 7f81c1adf640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81a80b5450 0x7f81a80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.394+0000 7f81a7fff640 1 -- 172.21.15.16:0/1088663618 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4016070 con 0x5581c8844ee0 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.394+0000 7f81b2ffd640 1 -- 172.21.15.16:0/2057135802 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f81b80e5dd0 con 0x7f81bc102dc0 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.394+0000 7f81a7fff640 1 -- 172.21.15.16:0/1088663618 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b4004d20 con 0x5581c8844ee0 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.394+0000 7f81a7fff640 1 -- 172.21.15.16:0/1088663618 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40126b0 con 0x5581c8844ee0 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 -- 172.21.15.16:0/1088663618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 msgr2=0x5581c88452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c1adf640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81a80b5450 0x7f81a80b7910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81b80e3630 tx=0x7f81b8000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c88452c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009e20 tx=0x7f81b4010740 comp rx=0 tx=0).stop 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 -- 172.21.15.16:0/1088663618 shutdown_connections 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8853b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c8851250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 --2- 172.21.15.16:0/1088663618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c88452c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 -- 172.21.15.16:0/1088663618 >> 172.21.15.16:0/1088663618 conn(0x5581c8842d10 msgr2=0x5581c8843eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 -- 172.21.15.16:0/1088663618 shutdown_connections 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 -- 172.21.15.16:0/1088663618 wait complete. 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 -- start start 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.395+0000 7f81c6118740 1 Processor -- start 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c6118740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c6118740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c6118740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c884f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c6118740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5581c860c890 con 0x5581c8851790 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c6118740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5581c8745d40 con 0x5581c8845800 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c6118740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5581c8854440 con 0x5581c8844ee0 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c6118740 10 client.0 _ll_register_callbacks cb 0x5581c87a9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c884f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c884f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35608/0 (socket says 172.21.15.16:35608) 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 -- 172.21.15.16:0/2925587511 learned_addr learned my addr 172.21.15.16:0/2925587511 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c12de640 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 -- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 msgr2=0x5581c884e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 -- 172.21.15.16:0/2925587511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 msgr2=0x5581c884ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 -- 172.21.15.16:0/2925587511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581c885d8d0 con 0x5581c8851790 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c884f290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f81b40058c0 tx=0x7f81b4005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d90e79ab291708 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.396+0000 7f81a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81a57fa640 1 -- 172.21.15.16:0/2925587511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4016040 con 0x5581c8851790 2024-09-10T23:43:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81a57fa640 1 -- 172.21.15.16:0/2925587511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f81b4012ae0 con 0x5581c8851790 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b4004d20 con 0x5581c8851790 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81a57fa640 1 -- 172.21.15.16:0/2925587511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81b40126f0 con 0x5581c8851790 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 10 client.16080 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5581c8860280 con 0x5581c8851790 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81a57fa640 1 -- 172.21.15.16:0/2925587511 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b4004d20 con 0x5581c8851790 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81a57fa640 1 -- 172.21.15.16:0/2925587511 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81b4012ce0 con 0x5581c8851790 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 10 client.16080 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 20 client.16080 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c8861630 0x5581c8863a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 4 client.16080 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.397+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581c87bddb0 con 0x5581c8861630 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.398+0000 7f81c12de640 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c8861630 0x5581c8863a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.398+0000 7f81c12de640 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c8861630 0x5581c8863a20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f31822291e78a657 server_cookie=dcac93a71974d7c4 in_seq=0 out_seq=0 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.398+0000 7f81a57fa640 10 client.16080 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81a57fa640 1 -- 172.21.15.16:0/2925587511 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5581c87bddb0 con 0x5581c8861630 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81a57fa640 10 client.16080 handle_command_reply: tid=0 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 client.16080 shutdown 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 msgr2=0x5581c884f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c884f290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f81b40058c0 tx=0x7f81b4005a60 comp rx=0 tx=0).stop 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 shutdown_connections 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c8861630 0x5581c8863a20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c884f290 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 --2- 172.21.15.16:0/2925587511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81a57fa640 0 client.16080 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 >> 172.21.15.16:0/2925587511 conn(0x5581c8842d10 msgr2=0x5581c8841f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:57.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 shutdown_connections 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 1 -- 172.21.15.16:0/2925587511 wait complete. 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.399+0000 7f81c6118740 20 client.16080 trim_cache size 0 max 16384 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 Processor -- start 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 -- start start 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8869160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b3150 con 0x5581c8851790 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b0a20 con 0x5581c8845800 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c6118740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1ae870 con 0x5581c8844ee0 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8869160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8869160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35620/0 (socket says 172.21.15.16:35620) 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 -- 172.21.15.16:0/955012877 learned_addr learned my addr 172.21.15.16:0/955012877 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c12de640 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 -- 172.21.15.16:0/955012877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 msgr2=0x5581c884ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 -- 172.21.15.16:0/955012877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 msgr2=0x5581c884bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.417+0000 7f81c22e0640 1 -- 172.21.15.16:0/955012877 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581c8842b40 con 0x5581c8851790 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c22e0640 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8869160 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f81b401ac20 tx=0x7f81b4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f487917a0efcbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81a77fe640 1 -- 172.21.15.16:0/955012877 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4016070 con 0x5581c8851790 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81a77fe640 1 -- 172.21.15.16:0/955012877 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b4005bd0 con 0x5581c8851790 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81a77fe640 1 -- 172.21.15.16:0/955012877 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4005180 con 0x5581c8851790 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 -- 172.21.15.16:0/955012877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 msgr2=0x5581c8869160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8869160 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f81b401ac20 tx=0x7f81b4010740 comp rx=0 tx=0).stop 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 -- 172.21.15.16:0/955012877 shutdown_connections 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8851790 0x5581c8869160 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8845800 0x5581c884bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 --2- 172.21.15.16:0/955012877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c884ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 -- 172.21.15.16:0/955012877 >> 172.21.15.16:0/955012877 conn(0x5581c8842d10 msgr2=0x5581c8850660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 -- 172.21.15.16:0/955012877 shutdown_connections 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.418+0000 7f81c6118740 1 -- 172.21.15.16:0/955012877 wait complete. 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 -- start start 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 Processor -- start 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c8855e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8845800 0x5581c8856350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8851790 0x5581c88cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1aeee0 con 0x5581c8845800 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b0350 con 0x5581c8851790 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1af5b0 con 0x5581c8844ee0 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.419+0000 7f81c6118740 10 client.0 _ll_register_callbacks cb 0x7f81ac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8845800 0x5581c8856350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8845800 0x5581c8856350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35636/0 (socket says 172.21.15.16:35636) 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 -- 172.21.15.16:0/2774357329 learned_addr learned my addr 172.21.15.16:0/2774357329 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c8855e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8851790 0x5581c88cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 -- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 msgr2=0x5581c8855e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c8855e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 -- 172.21.15.16:0/2774357329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8851790 msgr2=0x5581c88cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8851790 0x5581c88cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 -- 172.21.15.16:0/2774357329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581c8853f70 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c8855e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c12de640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8845800 0x5581c8856350 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000c00 tx=0x7f81ac005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5047996e58373e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81a57fa640 1 -- 172.21.15.16:0/2774357329 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac035040 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b4005bd0 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81a57fa640 1 -- 172.21.15.16:0/2774357329 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f81ac005040 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81a57fa640 1 -- 172.21.15.16:0/2774357329 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81ac052050 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c6118740 10 client.16086 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.420+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5581c88cec00 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81a57fa640 1 -- 172.21.15.16:0/2774357329 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b4005bd0 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81a57fa640 1 -- 172.21.15.16:0/2774357329 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81ac0035f0 con 0x5581c8845800 2024-09-10T23:43:57.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81c6118740 10 client.16086 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81c6118740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81c6118740 20 client.16086 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81c6118740 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c88cf380 0x5581c88d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81c6118740 4 client.16086 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5581c87b9860 con 0x5581c88cf380 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.421+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c88cf380 0x5581c88d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.422+0000 7f81c22e0640 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c88cf380 0x5581c88d17a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2151e9ae0c423bc6 server_cookie=e88eaaad3a979db0 in_seq=0 out_seq=0 2024-09-10T23:43:57.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.422+0000 7f81a57fa640 10 client.16086 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:57.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.423+0000 7f81a57fa640 1 -- 172.21.15.16:0/2774357329 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5581c87b9860 con 0x5581c88cf380 2024-09-10T23:43:57.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.423+0000 7f81a57fa640 10 client.16086 handle_command_reply: tid=0 2024-09-10T23:43:57.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.423+0000 7f81c6118740 1 client.16086 shutdown 2024-09-10T23:43:57.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.423+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8845800 msgr2=0x5581c8856350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.423+0000 7f81c6118740 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8845800 0x5581c8856350 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000c00 tx=0x7f81ac005be0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 shutdown_connections 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5581c88cf380 0x5581c88d17a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581c8851790 0x5581c88cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581c8845800 0x5581c8856350 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81a57fa640 0 client.16086 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 --2- 172.21.15.16:0/2774357329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5581c8844ee0 0x5581c8855e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 >> 172.21.15.16:0/2774357329 conn(0x5581c8842d10 msgr2=0x5581c884e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 shutdown_connections 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 1 -- 172.21.15.16:0/2774357329 wait complete. 2024-09-10T23:43:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c6118740 20 client.16086 trim_cache size 0 max 16384 2024-09-10T23:43:57.441 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:43:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:43:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "5cd42502-33fa-4478-8794-e352e38ba9ee", 2024-09-10T23:43:57.441 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:43:57.441 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81a80b5450 msgr2=0x7f81a80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c3d43640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81a80b5450 0x7f81a80b7910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81b80e3630 tx=0x7f81b8000bc0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc102dc0 msgr2=0x7f81bc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.424+0000 7f81c3d43640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc102dc0 0x7f81bc0754a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c890 tx=0x7f81b800cd50 comp rx=0 tx=0).stop 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 shutdown_connections 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81bc109150 0x7f81bc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81a80b5450 0x7f81a80b7910 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc1087d0 0x7f81bc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 --2- 172.21.15.16:0/2057135802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81bc102dc0 0x7f81bc0754a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 >> 172.21.15.16:0/2057135802 conn(0x7f81bc0fe830 msgr2=0x7f81bc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:57.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 shutdown_connections 2024-09-10T23:43:57.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:57.425+0000 7f81c3d43640 1 -- 172.21.15.16:0/2057135802 wait complete. 2024-09-10T23:43:58.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:43:58.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:58 smithi016 ceph-mon[30855]: pgmap v432: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:58.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:58 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:43:58.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:58 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:58.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:58 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:43:58.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:58 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:58.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:43:58 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:43:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:58 smithi071 ceph-mon[35018]: pgmap v432: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:58 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:43:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:58 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:58 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:43:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:58 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:43:58 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:43:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:43:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:58 smithi066 ceph-mon[34761]: pgmap v432: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:43:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:58 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:43:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:58 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:58 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:43:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:58 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:43:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:43:58 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 -- 172.21.15.16:0/2055609769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61001076e0 msgr2=0x7f6100107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 --2- 172.21.15.16:0/2055609769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61001076e0 0x7f6100107b20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009900 tx=0x7f60f402a410 comp rx=0 tx=0).stop 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 -- 172.21.15.16:0/2055609769 shutdown_connections 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 --2- 172.21.15.16:0/2055609769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6100108060 0x7f610010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 --2- 172.21.15.16:0/2055609769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61001076e0 0x7f6100107b20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 --2- 172.21.15.16:0/2055609769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6100101cd0 0x7f61001020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 -- 172.21.15.16:0/2055609769 >> 172.21.15.16:0/2055609769 conn(0x7f61000fd720 msgr2=0x7f61000ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 -- 172.21.15.16:0/2055609769 shutdown_connections 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.015+0000 7f6105f7b640 1 -- 172.21.15.16:0/2055609769 wait complete. 2024-09-10T23:43:59.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 Processor -- start 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 -- start start 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6100101cd0 0x7f610019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61001076e0 0x7f610019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6100108060 0x7f610019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6100111d20 con 0x7f6100101cd0 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6100111ba0 con 0x7f6100108060 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f6105f7b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6100111ea0 con 0x7f61001076e0 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6100101cd0 0x7f610019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6100101cd0 0x7f610019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35652/0 (socket says 172.21.15.16:35652) 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f60ff7fe640 1 -- 172.21.15.16:0/502571988 learned_addr learned my addr 172.21.15.16:0/502571988 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.016+0000 7f60fffff640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6100108060 0x7f610019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60feffd640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61001076e0 0x7f610019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60ff7fe640 1 -- 172.21.15.16:0/502571988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61001076e0 msgr2=0x7f610019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61001076e0 0x7f610019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60ff7fe640 1 -- 172.21.15.16:0/502571988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6100108060 msgr2=0x7f610019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6100108060 0x7f610019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60ff7fe640 1 -- 172.21.15.16:0/502571988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61001a5470 con 0x7f6100101cd0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6100101cd0 0x7f610019a090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f60f000d950 tx=0x7f60f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60fcff9640 1 -- 172.21.15.16:0/502571988 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0017070 con 0x7f6100101cd0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60fcff9640 1 -- 172.21.15.16:0/502571988 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f0009c30 con 0x7f6100101cd0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61001a5760 con 0x7f6100101cd0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f60fcff9640 1 -- 172.21.15.16:0/502571988 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f000f620 con 0x7f6100101cd0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.017+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61001a5cc0 con 0x7f6100101cd0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60fcff9640 1 -- 172.21.15.16:0/502571988 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f60f0010460 con 0x7f6100101cd0 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 Processor -- start 2024-09-10T23:43:59.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 -- start start 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x559944613860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x559944622120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559944589e50 con 0x559944613da0 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559944579280 con 0x559944613480 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f6108350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55994457d090 con 0x55994461fd30 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35666/0 (socket says 172.21.15.16:35666) 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 -- 172.21.15.16:0/1515599254 learned_addr learned my addr 172.21.15.16:0/1515599254 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60feffd640 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x559944622120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60fffff640 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x559944613860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 -- 172.21.15.16:0/1515599254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 msgr2=0x559944622120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x559944622120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 -- 172.21.15.16:0/1515599254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 msgr2=0x559944613860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x559944613860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.020+0000 7f60ff7fe640 1 -- 172.21.15.16:0/1515599254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599442d7650 con 0x559944613da0 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.021+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461f7f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f60f00e3270 tx=0x7f60f00ee680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8349fbc84f3c7206 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.021+0000 7f60fcff9640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60e80b54d0 0x7f60e80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.021+0000 7f60e5ffb640 1 -- 172.21.15.16:0/1515599254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f00f5020 con 0x559944613da0 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.021+0000 7f60fffff640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60e80b54d0 0x7f60e80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.021+0000 7f60e5ffb640 1 -- 172.21.15.16:0/1515599254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f0023d70 con 0x559944613da0 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.021+0000 7f60e5ffb640 1 -- 172.21.15.16:0/1515599254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f00ab980 con 0x559944613da0 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.021+0000 7f60fcff9640 1 -- 172.21.15.16:0/502571988 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f60f00e5b50 con 0x7f6100101cd0 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 -- 172.21.15.16:0/1515599254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 msgr2=0x55994461f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461f7f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f60f00e3270 tx=0x7f60f00ee680 comp rx=0 tx=0).stop 2024-09-10T23:43:59.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f60fffff640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60e80b54d0 0x7f60e80b7990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f610019b070 tx=0x7f60f8009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 -- 172.21.15.16:0/1515599254 shutdown_connections 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x559944622120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461f7f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 --2- 172.21.15.16:0/1515599254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x559944613860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 -- 172.21.15.16:0/1515599254 >> 172.21.15.16:0/1515599254 conn(0x5599446112b0 msgr2=0x559944612450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 -- 172.21.15.16:0/1515599254 shutdown_connections 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 -- 172.21.15.16:0/1515599254 wait complete. 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 -- start start 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.022+0000 7f6108350740 1 Processor -- start 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x55994461f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x55994461d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5599443da700 con 0x559944613da0 2024-09-10T23:43:59.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559944514110 con 0x559944613480 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5599446229b0 con 0x55994461fd30 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 10 client.0 _ll_register_callbacks cb 0x55994452d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35674/0 (socket says 172.21.15.16:35674) 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 -- 172.21.15.16:0/2273642926 learned_addr learned my addr 172.21.15.16:0/2273642926 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x55994461f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60fffff640 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x55994461d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 -- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 msgr2=0x55994461d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x55994461d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 -- 172.21.15.16:0/2273642926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 msgr2=0x55994461f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x55994461f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 -- 172.21.15.16:0/2273642926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559944541c40 con 0x559944613da0 2024-09-10T23:43:59.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60feffd640 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461ca40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f60f402a930 tx=0x7f60f4031880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44500c07354c5bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60deffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60deffd640 1 -- 172.21.15.16:0/2273642926 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4035040 con 0x559944613da0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f60deffd640 1 -- 172.21.15.16:0/2273642926 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f60f4004240 con 0x559944613da0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.023+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60f0023d70 con 0x559944613da0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f60deffd640 1 -- 172.21.15.16:0/2273642926 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60f4004440 con 0x559944613da0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 10 client.16098 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55994462e2e0 con 0x559944613da0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f60deffd640 1 -- 172.21.15.16:0/2273642926 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f0023d70 con 0x559944613da0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f60deffd640 1 -- 172.21.15.16:0/2273642926 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60f4004b10 con 0x559944613da0 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 10 client.16098 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 20 client.16098 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:59.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994462f6f0 0x559944631b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 4 client.16098 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55994458bda0 con 0x55994462f6f0 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.024+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994462f6f0 0x559944631b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.025+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994462f6f0 0x559944631b40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57bc38ecad8b1c1a server_cookie=a688e6d531b47095 in_seq=0 out_seq=0 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.025+0000 7f60deffd640 10 client.16098 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.025+0000 7f60deffd640 1 -- 172.21.15.16:0/2273642926 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55994458bda0 con 0x55994462f6f0 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.025+0000 7f60deffd640 10 client.16098 handle_command_reply: tid=0 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 client.16098 shutdown 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 msgr2=0x55994461ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461ca40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f60f402a930 tx=0x7f60f4031880 comp rx=0 tx=0).stop 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 shutdown_connections 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994462f6f0 0x559944631b40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55994461fd30 0x55994461d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f60deffd640 0 client.16098 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:59.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x55994461ca40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 --2- 172.21.15.16:0/2273642926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559944613480 0x55994461f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 >> 172.21.15.16:0/2273642926 conn(0x5599446112b0 msgr2=0x559944616e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:59.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 shutdown_connections 2024-09-10T23:43:59.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 1 -- 172.21.15.16:0/2273642926 wait complete. 2024-09-10T23:43:59.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.026+0000 7f6108350740 20 client.16098 trim_cache size 0 max 16384 2024-09-10T23:43:59.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 Processor -- start 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 -- start start 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613480 0x55994461b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613da0 0x55994461b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944621120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61001b0f30 con 0x559944613480 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61001ae800 con 0x55994461fd30 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f6108350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61001ac650 con 0x559944613da0 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613480 0x55994461b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613480 0x55994461b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35682/0 (socket says 172.21.15.16:35682) 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f60ff7fe640 1 -- 172.21.15.16:0/837244014 learned_addr learned my addr 172.21.15.16:0/837244014 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.044+0000 7f60feffd640 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613da0 0x55994461b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60fffff640 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944621120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60ff7fe640 1 -- 172.21.15.16:0/837244014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613da0 msgr2=0x55994461b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613da0 0x55994461b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60ff7fe640 1 -- 172.21.15.16:0/837244014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 msgr2=0x559944621120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944621120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60ff7fe640 1 -- 172.21.15.16:0/837244014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994460c940 con 0x559944613480 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60fffff640 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944621120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613480 0x55994461b2c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60f00e33b0 tx=0x7f60f00e9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e057dfedd100fb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60e57fa640 1 -- 172.21.15.16:0/837244014 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f00156a0 con 0x559944613480 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60e57fa640 1 -- 172.21.15.16:0/837244014 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f00cf0b0 con 0x559944613480 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.045+0000 7f60e57fa640 1 -- 172.21.15.16:0/837244014 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f00158e0 con 0x559944613480 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 -- 172.21.15.16:0/837244014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613480 msgr2=0x55994461b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613480 0x55994461b2c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60f00e33b0 tx=0x7f60f00e9690 comp rx=0 tx=0).stop 2024-09-10T23:43:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 -- 172.21.15.16:0/837244014 shutdown_connections 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944621120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613da0 0x55994461b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 --2- 172.21.15.16:0/837244014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613480 0x55994461b2c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 -- 172.21.15.16:0/837244014 >> 172.21.15.16:0/837244014 conn(0x5599446112b0 msgr2=0x559944612300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 -- 172.21.15.16:0/837244014 shutdown_connections 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 -- 172.21.15.16:0/837244014 wait complete. 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 -- start start 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.046+0000 7f6108350740 1 Processor -- start 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613480 0x559944628040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x5599446285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944618da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61001accc0 con 0x559944613da0 2024-09-10T23:43:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61001ae130 con 0x55994461fd30 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61001ad390 con 0x559944613480 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 10 client.0 _ll_register_callbacks cb 0x7f60f4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x5599446285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613480 0x559944628040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x5599446285a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35686/0 (socket says 172.21.15.16:35686) 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 -- 172.21.15.16:0/3050932118 learned_addr learned my addr 172.21.15.16:0/3050932118 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60fffff640 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944618da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 -- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613480 msgr2=0x559944628040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613480 0x559944628040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 -- 172.21.15.16:0/3050932118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 msgr2=0x559944618da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944618da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 -- 172.21.15.16:0/3050932118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599446195d0 con 0x559944613da0 2024-09-10T23:43:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613480 0x559944628040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60feffd640 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x5599446285a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006010 tx=0x7f60f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2325ced281c427b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60deffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60deffd640 1 -- 172.21.15.16:0/3050932118 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4035040 con 0x559944613da0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f60deffd640 1 -- 172.21.15.16:0/3050932118 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f60f4004fe0 con 0x559944613da0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.047+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60f00cf0b0 con 0x559944613da0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f60deffd640 1 -- 172.21.15.16:0/3050932118 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60f4005d50 con 0x559944613da0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 10 client.16104 fetch_fsmap learned FSMap version 25 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55994461a850 con 0x559944613da0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f60deffd640 1 -- 172.21.15.16:0/3050932118 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f00cf0b0 con 0x559944613da0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f60deffd640 1 -- 172.21.15.16:0/3050932118 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60f4003d50 con 0x559944613da0 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 10 client.16104 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 20 client.16104 populate_metadata read hostname 'smithi016' 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994469da00 0x55994469fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:43:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 4 client.16104 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559944587850 con 0x55994469da00 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.048+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994469da00 0x55994469fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f60ff7fe640 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994469da00 0x55994469fe20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2d206350a0b50e server_cookie=c81a1faab5c4c487 in_seq=0 out_seq=0 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f60deffd640 10 client.16104 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f60deffd640 1 -- 172.21.15.16:0/3050932118 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x559944587850 con 0x55994469da00 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f60deffd640 10 client.16104 handle_command_reply: tid=0 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 client.16104 shutdown 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 msgr2=0x5599446285a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x5599446285a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006010 tx=0x7f60f40048f0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 shutdown_connections 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55994469da00 0x55994469fe20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55994461fd30 0x559944618da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559944613da0 0x5599446285a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 --2- 172.21.15.16:0/3050932118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559944613480 0x559944628040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 >> 172.21.15.16:0/3050932118 conn(0x5599446112b0 msgr2=0x55994460fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.049+0000 7f60deffd640 0 client.16104 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 shutdown_connections 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6108350740 1 -- 172.21.15.16:0/3050932118 wait complete. 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6108350740 20 client.16104 trim_cache size 0 max 16384 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:43:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:43:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:43:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:43:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:43:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:43:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:43:59.066 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60e80b54d0 msgr2=0x7f60e80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60e80b54d0 0x7f60e80b7990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f610019b070 tx=0x7f60f8009600 comp rx=0 tx=0).stop 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6100101cd0 msgr2=0x7f610019a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6100101cd0 0x7f610019a090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f60f000d950 tx=0x7f60f000de10 comp rx=0 tx=0).stop 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 shutdown_connections 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60e80b54d0 0x7f60e80b7990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6100108060 0x7f610019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61001076e0 0x7f610019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 --2- 172.21.15.16:0/502571988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6100101cd0 0x7f610019a090 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.050+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 >> 172.21.15.16:0/502571988 conn(0x7f61000fd720 msgr2=0x7f61000ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.051+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 shutdown_connections 2024-09-10T23:43:59.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:43:59.051+0000 7f6105f7b640 1 -- 172.21.15.16:0/502571988 wait complete. 2024-09-10T23:43:59.856 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:43:59.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:44:00.154 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:00.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:00 smithi016 ceph-mon[30855]: pgmap v433: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:44:00.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:00 smithi071 ceph-mon[35018]: pgmap v433: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:44:00.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:00 smithi066 ceph-mon[34761]: pgmap v433: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:44:00.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.649+0000 7f3d4735a640 1 -- 172.21.15.16:0/799239590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d401076e0 msgr2=0x7f3d40107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:00.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.649+0000 7f3d4735a640 1 --2- 172.21.15.16:0/799239590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d401076e0 0x7f3d40107b20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009900 tx=0x7f3d3402a410 comp rx=0 tx=0).stop 2024-09-10T23:44:00.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.649+0000 7f3d4735a640 1 -- 172.21.15.16:0/799239590 shutdown_connections 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.649+0000 7f3d4735a640 1 --2- 172.21.15.16:0/799239590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d40108060 0x7f3d4010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.649+0000 7f3d4735a640 1 --2- 172.21.15.16:0/799239590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d401076e0 0x7f3d40107b20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.649+0000 7f3d4735a640 1 --2- 172.21.15.16:0/799239590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d40101cd0 0x7f3d401020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.649+0000 7f3d4735a640 1 -- 172.21.15.16:0/799239590 >> 172.21.15.16:0/799239590 conn(0x7f3d400fd700 msgr2=0x7f3d400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 -- 172.21.15.16:0/799239590 shutdown_connections 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 -- 172.21.15.16:0/799239590 wait complete. 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 Processor -- start 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 -- start start 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d40101cd0 0x7f3d40199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d401076e0 0x7f3d40199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d40108060 0x7f3d4019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40111d20 con 0x7f3d40101cd0 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40111ba0 con 0x7f3d401076e0 2024-09-10T23:44:00.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.650+0000 7f3d4735a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40111ea0 con 0x7f3d40108060 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d40101cd0 0x7f3d40199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d40101cd0 0x7f3d40199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35700/0 (socket says 172.21.15.16:35700) 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 -- 172.21.15.16:0/2340987109 learned_addr learned my addr 172.21.15.16:0/2340987109 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d448f5640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d401076e0 0x7f3d40199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d458f7640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d40108060 0x7f3d4019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 -- 172.21.15.16:0/2340987109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d40108060 msgr2=0x7f3d4019ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d40108060 0x7f3d4019ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 -- 172.21.15.16:0/2340987109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d401076e0 msgr2=0x7f3d40199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d401076e0 0x7f3d40199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 -- 172.21.15.16:0/2340987109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4019f400 con 0x7f3d40101cd0 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d458f7640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d40108060 0x7f3d4019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d448f5640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d401076e0 0x7f3d40199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d450f6640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d40101cd0 0x7f3d40199350 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00eab0 tx=0x7f3d3c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d327fc640 1 -- 172.21.15.16:0/2340987109 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00ce40 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d327fc640 1 -- 172.21.15.16:0/2340987109 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d3c011920 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d327fc640 1 -- 172.21.15.16:0/2340987109 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c010a30 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4019f6f0 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.651+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d401a5f80 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.653+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d401020b0 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.654+0000 7f3d327fc640 1 -- 172.21.15.16:0/2340987109 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3d3c00f040 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.655+0000 7f3d327fc640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3d2c0b54d0 0x7f3d2c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.655+0000 7f3d327fc640 1 -- 172.21.15.16:0/2340987109 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f3d3c0e6240 con 0x7f3d40101cd0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.655+0000 7f3d448f5640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3d2c0b54d0 0x7f3d2c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.655+0000 7f3d448f5640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3d2c0b54d0 0x7f3d2c0b7990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d34031440 tx=0x7f3d34005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:00.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.658+0000 7f3d327fc640 1 -- 172.21.15.16:0/2340987109 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3d3c016030 con 0x7f3d40101cd0 2024-09-10T23:44:00.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.898+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d4019a480 con 0x7f3d40101cd0 2024-09-10T23:44:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.899+0000 7f3d327fc640 1 -- 172.21.15.16:0/2340987109 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f3d3c0acea0 con 0x7f3d40101cd0 2024-09-10T23:44:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:44:00.901 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:44:00.901 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:44:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3d2c0b54d0 msgr2=0x7f3d2c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3d2c0b54d0 0x7f3d2c0b7990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d34031440 tx=0x7f3d34005a20 comp rx=0 tx=0).stop 2024-09-10T23:44:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d40101cd0 msgr2=0x7f3d40199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d40101cd0 0x7f3d40199350 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00eab0 tx=0x7f3d3c00ef70 comp rx=0 tx=0).stop 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 shutdown_connections 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d40108060 0x7f3d4019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3d2c0b54d0 0x7f3d2c0b7990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d401076e0 0x7f3d40199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 --2- 172.21.15.16:0/2340987109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d40101cd0 0x7f3d40199350 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 >> 172.21.15.16:0/2340987109 conn(0x7f3d400fd700 msgr2=0x7f3d4006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 shutdown_connections 2024-09-10T23:44:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:00.901+0000 7f3d4735a640 1 -- 172.21.15.16:0/2340987109 wait complete. 2024-09-10T23:44:01.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:01 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2340987109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:01.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:01 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2340987109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:01.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:01 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2340987109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:01.741 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:44:02.005 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:02.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:02 smithi016 ceph-mon[30855]: pgmap v434: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:44:02.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 -- 172.21.15.16:0/3381907167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 msgr2=0x7fd67c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 --2- 172.21.15.16:0/3381907167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c10e820 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd674009ca0 tx=0x7fd67402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 -- 172.21.15.16:0/3381907167 shutdown_connections 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 --2- 172.21.15.16:0/3381907167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c10e820 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 --2- 172.21.15.16:0/3381907167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c1076a0 0x7fd67c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 --2- 172.21.15.16:0/3381907167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd67c101c90 0x7fd67c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 -- 172.21.15.16:0/3381907167 >> 172.21.15.16:0/3381907167 conn(0x7fd67c0fd700 msgr2=0x7fd67c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 -- 172.21.15.16:0/3381907167 shutdown_connections 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 -- 172.21.15.16:0/3381907167 wait complete. 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 Processor -- start 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.484+0000 7fd68295c640 1 -- start start 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd68295c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c101c90 0x7fd67c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd68295c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd67c1076a0 0x7fd67c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd68295c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd68295c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c111d20 con 0x7fd67c108020 2024-09-10T23:44:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd68295c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c111ba0 con 0x7fd67c101c90 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd68295c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c111ea0 con 0x7fd67c1076a0 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c19ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35718/0 (socket says 172.21.15.16:35718) 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 -- 172.21.15.16:0/2621319933 learned_addr learned my addr 172.21.15.16:0/2621319933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd67bfff640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c101c90 0x7fd67c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd67c1076a0 0x7fd67c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 -- 172.21.15.16:0/2621319933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd67c1076a0 msgr2=0x7fd67c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd67c1076a0 0x7fd67c1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 -- 172.21.15.16:0/2621319933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c101c90 msgr2=0x7fd67c1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c101c90 0x7fd67c1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 -- 172.21.15.16:0/2621319933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c19f450 con 0x7fd67c108020 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.485+0000 7fd680ef9640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c19ec80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd674005cc0 tx=0x7fd67402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.486+0000 7fd6797fa640 1 -- 172.21.15.16:0/2621319933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674003cf0 con 0x7fd67c108020 2024-09-10T23:44:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.486+0000 7fd6797fa640 1 -- 172.21.15.16:0/2621319933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6740044f0 con 0x7fd67c108020 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.486+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c19f6e0 con 0x7fd67c108020 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.486+0000 7fd6797fa640 1 -- 172.21.15.16:0/2621319933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67402fc30 con 0x7fd67c108020 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.486+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c1a5e80 con 0x7fd67c108020 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.488+0000 7fd684d31740 1 Processor -- start 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.488+0000 7fd6797fa640 1 -- 172.21.15.16:0/2621319933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd674004040 con 0x7fd67c108020 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.488+0000 7fd684d31740 1 -- start start 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd684d31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f139b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd684d31740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd684d31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd684d31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f3f1311ea0 con 0x55f3f13a79a0 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd684d31740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f3f13012d0 con 0x55f3f139ba10 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd684d31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f3f13050e0 con 0x55f3f139b0f0 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35726/0 (socket says 172.21.15.16:35726) 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 -- 172.21.15.16:0/3709441076 learned_addr learned my addr 172.21.15.16:0/3709441076 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67bfff640 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f139b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 -- 172.21.15.16:0/3709441076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 msgr2=0x55f3f139b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f139b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 -- 172.21.15.16:0/3709441076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 msgr2=0x55f3f13a7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 -- 172.21.15.16:0/3709441076 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f105f650 con 0x55f3f13a79a0 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67bfff640 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd6797fa640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6640b54d0 0x7fd6640b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a9d90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd670006aa0 tx=0x7fd670009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae491b79ca3525e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.489+0000 7fd67bfff640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6640b54d0 0x7fd6640b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd6797fa640 1 -- 172.21.15.16:0/2621319933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd674107310 con 0x7fd67c108020 2024-09-10T23:44:02.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd6627fc640 1 -- 172.21.15.16:0/3709441076 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670015760 con 0x55f3f13a79a0 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd6627fc640 1 -- 172.21.15.16:0/3709441076 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd67001d070 con 0x55f3f13a79a0 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd6627fc640 1 -- 172.21.15.16:0/3709441076 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670018a90 con 0x55f3f13a79a0 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd684d31740 1 -- 172.21.15.16:0/3709441076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 msgr2=0x55f3f13a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd684d31740 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a9d90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd670006aa0 tx=0x7fd670009510 comp rx=0 tx=0).stop 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd67bfff640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6640b54d0 0x7fd6640b7990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f3f1399e00 tx=0x7fd66c009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd684d31740 1 -- 172.21.15.16:0/3709441076 shutdown_connections 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd684d31740 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a9d90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd684d31740 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.490+0000 7fd684d31740 1 --2- 172.21.15.16:0/3709441076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f139b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.491+0000 7fd684d31740 1 -- 172.21.15.16:0/3709441076 >> 172.21.15.16:0/3709441076 conn(0x55f3f1398f20 msgr2=0x55f3f139a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.491+0000 7fd684d31740 1 -- 172.21.15.16:0/3709441076 shutdown_connections 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.491+0000 7fd684d31740 1 -- 172.21.15.16:0/3709441076 wait complete. 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.491+0000 7fd684d31740 1 -- start start 2024-09-10T23:44:02.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.491+0000 7fd684d31740 1 Processor -- start 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f13a7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f3f1162700 con 0x55f3f13a79a0 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f3f129c160 con 0x55f3f139ba10 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f3f13aa5c0 con 0x55f3f139b0f0 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 10 client.0 _ll_register_callbacks cb 0x55f3f12b59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35734/0 (socket says 172.21.15.16:35734) 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 -- 172.21.15.16:0/177837837 learned_addr learned my addr 172.21.15.16:0/177837837 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd67bfff640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f13a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 -- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 msgr2=0x55f3f13a7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f13a7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 -- 172.21.15.16:0/177837837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 msgr2=0x55f3f13a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 -- 172.21.15.16:0/177837837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f12c9c90 con 0x55f3f13a79a0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd67bfff640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f13a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd680ef9640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a4d00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd6740c9dc0 tx=0x7fd6740cd200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fbf127a93caa1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd65b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd65b7fe640 1 -- 172.21.15.16:0/177837837 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6740d2020 con 0x55f3f13a79a0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd65b7fe640 1 -- 172.21.15.16:0/177837837 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd674104d40 con 0x55f3f13a79a0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd67001d070 con 0x55f3f13a79a0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.492+0000 7fd65b7fe640 1 -- 172.21.15.16:0/177837837 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd6740cdef0 con 0x55f3f13a79a0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 10 client.16122 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3f13b5f40 con 0x55f3f13a79a0 2024-09-10T23:44:02.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd65b7fe640 1 -- 172.21.15.16:0/177837837 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd67001d070 con 0x55f3f13a79a0 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd65b7fe640 1 -- 172.21.15.16:0/177837837 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd6740c9a60 con 0x55f3f13a79a0 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 10 client.16122 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 10 client.16122 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 20 client.16122 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13b7490 0x55f3f13b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 4 client.16122 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3f1313df0 con 0x55f3f13b7490 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.493+0000 7fd67bfff640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13b7490 0x55f3f13b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.494+0000 7fd65b7fe640 10 client.16122 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.494+0000 7fd67bfff640 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13b7490 0x55f3f13b98f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b4d964390522ea2c server_cookie=bf546e2302c6d236 in_seq=0 out_seq=0 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.494+0000 7fd65b7fe640 1 -- 172.21.15.16:0/177837837 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3f1313df0 con 0x55f3f13b7490 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.494+0000 7fd65b7fe640 10 client.16122 handle_command_reply: tid=0 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.494+0000 7fd684d31740 1 client.16122 shutdown 2024-09-10T23:44:02.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 msgr2=0x55f3f13a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a4d00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd6740c9dc0 tx=0x7fd6740cd200 comp rx=0 tx=0).stop 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 shutdown_connections 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13b7490 0x55f3f13b98f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f13a79a0 0x55f3f13a4d00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 --2- 172.21.15.16:0/177837837 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139b0f0 0x55f3f13a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd65b7fe640 0 client.16122 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 >> 172.21.15.16:0/177837837 conn(0x55f3f1398f20 msgr2=0x55f3f139ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 shutdown_connections 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 1 -- 172.21.15.16:0/177837837 wait complete. 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.495+0000 7fd684d31740 20 client.16122 trim_cache size 0 max 16384 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.508+0000 7fd684d31740 1 Processor -- start 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.508+0000 7fd684d31740 1 -- start start 2024-09-10T23:44:02.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd684d31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f1398f20 0x55f3f13b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd684d31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13a6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd684d31740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd684d31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1b3110 con 0x55f3f139b0f0 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd684d31740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1b09e0 con 0x55f3f139ba10 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd684d31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1ae850 con 0x55f3f1398f20 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13a6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35750/0 (socket says 172.21.15.16:35750) 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2844137879 learned_addr learned my addr 172.21.15.16:0/2844137879 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67bfff640 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f1398f20 0x55f3f13b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd680ef9640 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2844137879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f1398f20 msgr2=0x55f3f13b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f1398f20 0x55f3f13b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2844137879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 msgr2=0x55f3f13a8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2844137879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f13a0170 con 0x55f3f139b0f0 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13a6410 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd6700046f0 tx=0x7fd670006d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e51c39cfaded15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd661ffb640 1 -- 172.21.15.16:0/2844137879 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670025070 con 0x55f3f139b0f0 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.509+0000 7fd661ffb640 1 -- 172.21.15.16:0/2844137879 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd67001d070 con 0x55f3f139b0f0 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd661ffb640 1 -- 172.21.15.16:0/2844137879 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670018910 con 0x55f3f139b0f0 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 -- 172.21.15.16:0/2844137879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 msgr2=0x55f3f13a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13a6410 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd6700046f0 tx=0x7fd670006d60 comp rx=0 tx=0).stop 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 -- 172.21.15.16:0/2844137879 shutdown_connections 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f139ba10 0x55f3f13a8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13a6410 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 --2- 172.21.15.16:0/2844137879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f1398f20 0x55f3f13b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 -- 172.21.15.16:0/2844137879 >> 172.21.15.16:0/2844137879 conn(0x55f3f1398b40 msgr2=0x55f3f13a5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:02.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 -- 172.21.15.16:0/2844137879 shutdown_connections 2024-09-10T23:44:02.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.510+0000 7fd684d31740 1 -- 172.21.15.16:0/2844137879 wait complete. 2024-09-10T23:44:02.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 -- start start 2024-09-10T23:44:02.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:02 smithi071 ceph-mon[35018]: pgmap v434: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:44:02.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 Processor -- start 2024-09-10T23:44:02.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f1398f20 0x55f3f13afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139ba10 0x55f3f13aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1aeea0 con 0x55f3f139b0f0 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1b0310 con 0x55f3f1398f20 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1af570 con 0x55f3f139ba10 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd684d31740 10 client.0 _ll_register_callbacks cb 0x7fd67402f660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35754/0 (socket says 172.21.15.16:35754) 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2399243649 learned_addr learned my addr 172.21.15.16:0/2399243649 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd680ef9640 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139ba10 0x55f3f13aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.511+0000 7fd67bfff640 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f1398f20 0x55f3f13afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139ba10 msgr2=0x55f3f13aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139ba10 0x55f3f13aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2399243649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f1398f20 msgr2=0x55f3f13afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f1398f20 0x55f3f13afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd67b7fe640 1 -- 172.21.15.16:0/2399243649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f13ab160 con 0x55f3f139b0f0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd67b7fe640 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13b0160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd6700159e0 tx=0x7fd670015a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0717488af70ded8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd65b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd65b7fe640 1 -- 172.21.15.16:0/2399243649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670025050 con 0x55f3f139b0f0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd65b7fe640 1 -- 172.21.15.16:0/2399243649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd670018890 con 0x55f3f139b0f0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd67001d070 con 0x55f3f139b0f0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd65b7fe640 1 -- 172.21.15.16:0/2399243649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd670009860 con 0x55f3f139b0f0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd684d31740 10 client.16128 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3f1424fa0 con 0x55f3f139b0f0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd65b7fe640 1 -- 172.21.15.16:0/2399243649 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd67001d070 con 0x55f3f139b0f0 2024-09-10T23:44:02.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd65b7fe640 1 -- 172.21.15.16:0/2399243649 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd67002a630 con 0x55f3f139b0f0 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd684d31740 10 client.16128 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.512+0000 7fd684d31740 10 client.16128 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd684d31740 20 client.16128 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd684d31740 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13a79a0 0x55f3f1427340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd684d31740 4 client.16128 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3f130f8a0 con 0x55f3f13a79a0 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd67bfff640 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13a79a0 0x55f3f1427340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd65b7fe640 10 client.16128 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd67bfff640 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13a79a0 0x55f3f1427340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=430e18db98ce15a server_cookie=87624928eddb7744 in_seq=0 out_seq=0 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd65b7fe640 1 -- 172.21.15.16:0/2399243649 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3f130f8a0 con 0x55f3f13a79a0 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd65b7fe640 10 client.16128 handle_command_reply: tid=0 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.513+0000 7fd684d31740 1 client.16128 shutdown 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 msgr2=0x55f3f13b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13b0160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd6700159e0 tx=0x7fd670015a10 comp rx=0 tx=0).stop 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 shutdown_connections 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55f3f13a79a0 0x55f3f1427340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f3f139ba10 0x55f3f13aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3f139b0f0 0x55f3f13b0160 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 --2- 172.21.15.16:0/2399243649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f3f1398f20 0x55f3f13afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd65b7fe640 0 client.16128 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 >> 172.21.15.16:0/2399243649 conn(0x55f3f1398b40 msgr2=0x55f3f13a6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 shutdown_connections 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 1 -- 172.21.15.16:0/2399243649 wait complete. 2024-09-10T23:44:02.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd684d31740 20 client.16128 trim_cache size 0 max 16384 2024-09-10T23:44:02.531 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:02.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6640b54d0 msgr2=0x7fd6640b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd68295c640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6640b54d0 0x7fd6640b7990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f3f1399e00 tx=0x7fd66c009110 comp rx=0 tx=0).stop 2024-09-10T23:44:02.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 msgr2=0x7fd67c19ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:02.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.514+0000 7fd68295c640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c19ec80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd674005cc0 tx=0x7fd67402f470 comp rx=0 tx=0).stop 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 shutdown_connections 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c108020 0x7fd67c19ec80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd67c1076a0 0x7fd67c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6640b54d0 0x7fd6640b7990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 --2- 172.21.15.16:0/2621319933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd67c101c90 0x7fd67c1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 >> 172.21.15.16:0/2621319933 conn(0x7fd67c0fd700 msgr2=0x7fd67c104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 shutdown_connections 2024-09-10T23:44:02.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:02.515+0000 7fd68295c640 1 -- 172.21.15.16:0/2621319933 wait complete. 2024-09-10T23:44:02.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:02 smithi066 ceph-mon[34761]: pgmap v434: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:44:03.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:44:03.485 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 -- 172.21.15.16:0/118595504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8102dc0 msgr2=0x7fe2e81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 --2- 172.21.15.16:0/118595504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8102dc0 0x7fe2e81031a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009900 tx=0x7fe2e402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 -- 172.21.15.16:0/118595504 shutdown_connections 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 --2- 172.21.15.16:0/118595504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2e8109150 0x7fe2e810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 --2- 172.21.15.16:0/118595504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e81087d0 0x7fe2e8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 --2- 172.21.15.16:0/118595504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8102dc0 0x7fe2e81031a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 -- 172.21.15.16:0/118595504 >> 172.21.15.16:0/118595504 conn(0x7fe2e80fe830 msgr2=0x7fe2e8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:04.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 -- 172.21.15.16:0/118595504 shutdown_connections 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.100+0000 7fe2efbea640 1 -- 172.21.15.16:0/118595504 wait complete. 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 Processor -- start 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 -- start start 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8102dc0 0x7fe2e8199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2e81087d0 0x7fe2e8199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8109150 0x7fe2e819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e8112e50 con 0x7fe2e8109150 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e8112cd0 con 0x7fe2e8102dc0 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2efbea640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e8112fd0 con 0x7fe2e81087d0 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2ee187640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8109150 0x7fe2e819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2ee187640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8109150 0x7fe2e819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37838/0 (socket says 172.21.15.16:37838) 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2ee187640 1 -- 172.21.15.16:0/2647365758 learned_addr learned my addr 172.21.15.16:0/2647365758 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:04.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2ed986640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8102dc0 0x7fe2e8199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.101+0000 7fe2ed185640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2e81087d0 0x7fe2e8199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2ee187640 1 -- 172.21.15.16:0/2647365758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2e81087d0 msgr2=0x7fe2e8199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2ee187640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2e81087d0 0x7fe2e8199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2ee187640 1 -- 172.21.15.16:0/2647365758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8102dc0 msgr2=0x7fe2e8199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2ee187640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8102dc0 0x7fe2e8199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2ee187640 1 -- 172.21.15.16:0/2647365758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e819f4f0 con 0x7fe2e8109150 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2ee187640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8109150 0x7fe2e819ed20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000b970 tx=0x7fe2e000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2deffd640 1 -- 172.21.15.16:0/2647365758 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0019070 con 0x7fe2e8109150 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e819f7e0 con 0x7fe2e8109150 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2deffd640 1 -- 172.21.15.16:0/2647365758 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e0014440 con 0x7fe2e8109150 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2deffd640 1 -- 172.21.15.16:0/2647365758 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00075d0 con 0x7fe2e8109150 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.102+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e81a5ea0 con 0x7fe2e8109150 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2deffd640 1 -- 172.21.15.16:0/2647365758 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe2e00145f0 con 0x7fe2e8109150 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 Processor -- start 2024-09-10T23:44:04.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 -- start start 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c54d0 0x561e881c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881d6190 0x561e881d8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561e8813bea0 con 0x561e881c54d0 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561e8812b2d0 con 0x561e881d6190 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561e8812f0e0 con 0x561e881c5df0 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2ed185640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c54d0 0x561e881c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2ed185640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c54d0 0x561e881c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37846/0 (socket says 172.21.15.16:37846) 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.105+0000 7fe2ed185640 1 -- 172.21.15.16:0/2024972626 learned_addr learned my addr 172.21.15.16:0/2024972626 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed986640 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2deffd640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe2d40b54d0 0x7fe2d40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed185640 1 -- 172.21.15.16:0/2024972626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 msgr2=0x561e881d5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed185640 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed185640 1 -- 172.21.15.16:0/2024972626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881d6190 msgr2=0x561e881d8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed185640 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881d6190 0x561e881d8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed185640 1 -- 172.21.15.16:0/2024972626 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e87e89650 con 0x561e881c54d0 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed986640 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ee187640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe2d40b54d0 0x7fe2d40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2ed185640 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c54d0 0x561e881c58b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009b10 tx=0x7fe2d80101f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cd859126c587a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2deffd640 1 -- 172.21.15.16:0/2647365758 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe2e00e5650 con 0x7fe2e8109150 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2d3fff640 1 -- 172.21.15.16:0/2024972626 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8018020 con 0x561e881c54d0 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2d3fff640 1 -- 172.21.15.16:0/2024972626 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2d8010e00 con 0x561e881c54d0 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.106+0000 7fe2d3fff640 1 -- 172.21.15.16:0/2024972626 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8013800 con 0x561e881c54d0 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2024972626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c54d0 msgr2=0x561e881c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c54d0 0x561e881c58b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009b10 tx=0x7fe2d80101f0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2ee187640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe2d40b54d0 0x7fe2d40b7990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00a8150 tx=0x7fe2e0070740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2024972626 shutdown_connections 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881d6190 0x561e881d8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2024972626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c54d0 0x561e881c58b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2024972626 >> 172.21.15.16:0/2024972626 conn(0x561e881c3300 msgr2=0x561e881c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2024972626 shutdown_connections 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2024972626 wait complete. 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.107+0000 7fe2f1fbf740 1 -- start start 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 1 Processor -- start 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561e87f8c700 con 0x561e881d6190 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561e880c6160 con 0x561e881c54d0 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561e881d8e40 con 0x561e881c5df0 2024-09-10T23:44:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2f1fbf740 10 client.0 _ll_register_callbacks cb 0x561e880df9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37854/0 (socket says 172.21.15.16:37854) 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 -- 172.21.15.16:0/414880910 learned_addr learned my addr 172.21.15.16:0/414880910 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed986640 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 -- 172.21.15.16:0/414880910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 msgr2=0x561e881d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 -- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 msgr2=0x561e881d5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881d5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.108+0000 7fe2ed185640 1 -- 172.21.15.16:0/414880910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e880f3c90 con 0x561e881d6190 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2ed185640 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881d34f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8014eb0 tx=0x7fe2d8014f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1285a981c2179f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2d17fa640 1 -- 172.21.15.16:0/414880910 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8018040 con 0x561e881d6190 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2d8010e00 con 0x561e881d6190 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2d17fa640 1 -- 172.21.15.16:0/414880910 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe2d8013cf0 con 0x561e881d6190 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2d17fa640 1 -- 172.21.15.16:0/414880910 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe2d8014440 con 0x561e881d6190 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 10 client.16140 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e881e4700 con 0x561e881d6190 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2d17fa640 1 -- 172.21.15.16:0/414880910 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2d8010e00 con 0x561e881d6190 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2d17fa640 1 -- 172.21.15.16:0/414880910 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2d8034800 con 0x561e881d6190 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 10 client.16140 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 10 client.16140 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 20 client.16140 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e881e5b10 0x561e881e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 4 client.16140 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.109+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e8813ddf0 con 0x561e881e5b10 2024-09-10T23:44:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.110+0000 7fe2ed986640 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e881e5b10 0x561e881e7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.110+0000 7fe2ed986640 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e881e5b10 0x561e881e7f00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2554a5e69b5d91b8 server_cookie=9ea2cb63a925652c in_seq=0 out_seq=0 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.110+0000 7fe2d17fa640 10 client.16140 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2d17fa640 1 -- 172.21.15.16:0/414880910 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e8813ddf0 con 0x561e881e5b10 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2d17fa640 10 client.16140 handle_command_reply: tid=0 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 client.16140 shutdown 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 msgr2=0x561e881d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881d34f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8014eb0 tx=0x7fe2d8014f10 comp rx=0 tx=0).stop 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 shutdown_connections 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e881e5b10 0x561e881e7f00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881d34f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c5df0 0x561e881d2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2d17fa640 0 client.16140 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/414880910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881d5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 >> 172.21.15.16:0/414880910 conn(0x561e881c3300 msgr2=0x561e881c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 shutdown_connections 2024-09-10T23:44:04.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/414880910 wait complete. 2024-09-10T23:44:04.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.111+0000 7fe2f1fbf740 20 client.16140 trim_cache size 0 max 16384 2024-09-10T23:44:04.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 Processor -- start 2024-09-10T23:44:04.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 -- start start 2024-09-10T23:44:04.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881e2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c5df0 0x561e881c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881d6190 0x561e881d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e81aee00 con 0x561e881c5df0 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e81ac6d0 con 0x561e881c54d0 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e81aa520 con 0x561e881d6190 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2ed986640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c5df0 0x561e881c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2ed986640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c5df0 0x561e881c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37862/0 (socket says 172.21.15.16:37862) 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2ed986640 1 -- 172.21.15.16:0/2398879597 learned_addr learned my addr 172.21.15.16:0/2398879597 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.125+0000 7fe2ed185640 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881e2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2ed185640 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881d6190 0x561e881d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2ed986640 1 -- 172.21.15.16:0/2398879597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881d6190 msgr2=0x561e881d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2ed986640 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881d6190 0x561e881d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2ed986640 1 -- 172.21.15.16:0/2398879597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 msgr2=0x561e881e2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2ed986640 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881e2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2ed986640 1 -- 172.21.15.16:0/2398879597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e881d0e30 con 0x561e881c5df0 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2ed986640 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c5df0 0x561e881c91f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4031de0 tx=0x7fe2e4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3eeaff2872c40f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2d37fe640 1 -- 172.21.15.16:0/2398879597 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4035040 con 0x561e881c5df0 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2d37fe640 1 -- 172.21.15.16:0/2398879597 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e4031950 con 0x561e881c5df0 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.126+0000 7fe2d37fe640 1 -- 172.21.15.16:0/2398879597 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40047a0 con 0x561e881c5df0 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2398879597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c5df0 msgr2=0x561e881c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c5df0 0x561e881c91f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4031de0 tx=0x7fe2e4005e80 comp rx=0 tx=0).stop 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2398879597 shutdown_connections 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881d6190 0x561e881d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881c5df0 0x561e881c91f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/2398879597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c54d0 0x561e881e2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2398879597 >> 172.21.15.16:0/2398879597 conn(0x561e881c3300 msgr2=0x561e881c4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:04.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2398879597 shutdown_connections 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/2398879597 wait complete. 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 -- start start 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.127+0000 7fe2f1fbf740 1 Processor -- start 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c54d0 0x561e881de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c5df0 0x561e881de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2f1fbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e81aab90 con 0x561e881d6190 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e81ac000 con 0x561e881c5df0 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2f1fbf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e81ab260 con 0x561e881c54d0 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2f1fbf740 10 client.0 _ll_register_callbacks cb 0x7fe2d80099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed185640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed185640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881db0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37878/0 (socket says 172.21.15.16:37878) 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed986640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c5df0 0x561e881de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed185640 1 -- 172.21.15.16:0/1530239623 learned_addr learned my addr 172.21.15.16:0/1530239623 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed185640 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c54d0 0x561e881de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed986640 1 -- 172.21.15.16:0/1530239623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c54d0 msgr2=0x561e881de0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed986640 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c54d0 0x561e881de0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed986640 1 -- 172.21.15.16:0/1530239623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 msgr2=0x561e881db0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed986640 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881db0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed986640 1 -- 172.21.15.16:0/1530239623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e881debd0 con 0x561e881c5df0 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.128+0000 7fe2ed185640 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881db0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2ed986640 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c5df0 0x561e881de610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40096c0 tx=0x7fe2e4005600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9be595818eab58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2d17fa640 1 -- 172.21.15.16:0/1530239623 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4035070 con 0x561e881c5df0 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2e4031950 con 0x561e881c5df0 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2d17fa640 1 -- 172.21.15.16:0/1530239623 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe2e4005020 con 0x561e881c5df0 2024-09-10T23:44:04.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2d17fa640 1 -- 172.21.15.16:0/1530239623 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe2e405b050 con 0x561e881c5df0 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2f1fbf740 10 client.25634 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e88252a80 con 0x561e881c5df0 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2d17fa640 1 -- 172.21.15.16:0/1530239623 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e4031950 con 0x561e881c5df0 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.129+0000 7fe2d17fa640 1 -- 172.21.15.16:0/1530239623 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2e404d470 con 0x561e881c5df0 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2f1fbf740 10 client.25634 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2f1fbf740 10 client.25634 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2f1fbf740 20 client.25634 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e88253200 0x561e88255620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2f1fbf740 4 client.25634 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e881398a0 con 0x561e88253200 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2ed185640 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e88253200 0x561e88255620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2d17fa640 10 client.25634 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.130+0000 7fe2ed185640 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e88253200 0x561e88255620 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e721c60b1833e84 server_cookie=4782303e4a52fbde in_seq=0 out_seq=0 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2d17fa640 1 -- 172.21.15.16:0/1530239623 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e881398a0 con 0x561e88253200 2024-09-10T23:44:04.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2d17fa640 10 client.25634 handle_command_reply: tid=0 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 client.25634 shutdown 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c5df0 msgr2=0x561e881de610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c5df0 0x561e881de610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40096c0 tx=0x7fe2e4005600 comp rx=0 tx=0).stop 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 shutdown_connections 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x561e88253200 0x561e88255620 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561e881d6190 0x561e881db0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561e881c5df0 0x561e881de610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2d17fa640 0 client.25634 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 --2- 172.21.15.16:0/1530239623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561e881c54d0 0x561e881de0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 >> 172.21.15.16:0/1530239623 conn(0x561e881c3300 msgr2=0x561e881d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 shutdown_connections 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 1 -- 172.21.15.16:0/1530239623 wait complete. 2024-09-10T23:44:04.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.131+0000 7fe2f1fbf740 20 client.25634 trim_cache size 0 max 16384 2024-09-10T23:44:04.140 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe2d40b54d0 msgr2=0x7fe2d40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe2d40b54d0 0x7fe2d40b7990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00a8150 tx=0x7fe2e0070740 comp rx=0 tx=0).stop 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8109150 msgr2=0x7fe2e819ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8109150 0x7fe2e819ed20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000b970 tx=0x7fe2e000bd70 comp rx=0 tx=0).stop 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 shutdown_connections 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e8109150 0x7fe2e819ed20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2e81087d0 0x7fe2e8199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe2d40b54d0 0x7fe2d40b7990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 --2- 172.21.15.16:0/2647365758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2e8102dc0 0x7fe2e8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 >> 172.21.15.16:0/2647365758 conn(0x7fe2e80fe830 msgr2=0x7fe2e8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 shutdown_connections 2024-09-10T23:44:04.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:04.132+0000 7fe2efbea640 1 -- 172.21.15.16:0/2647365758 wait complete. 2024-09-10T23:44:04.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:04 smithi016 ceph-mon[30855]: pgmap v435: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:44:04.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:04 smithi071 ceph-mon[35018]: pgmap v435: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:44:04.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:04 smithi066 ceph-mon[34761]: pgmap v435: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:44:05.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:44:05.473 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:06.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 -- 172.21.15.16:0/3079293935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8188102dc0 msgr2=0x7f81881031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 --2- 172.21.15.16:0/3079293935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8188102dc0 0x7f81881031a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8178009900 tx=0x7f817802a410 comp rx=0 tx=0).stop 2024-09-10T23:44:06.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 -- 172.21.15.16:0/3079293935 shutdown_connections 2024-09-10T23:44:06.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 --2- 172.21.15.16:0/3079293935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8188109150 0x7f818810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 --2- 172.21.15.16:0/3079293935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81881087d0 0x7f8188108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 --2- 172.21.15.16:0/3079293935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8188102dc0 0x7f81881031a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 -- 172.21.15.16:0/3079293935 >> 172.21.15.16:0/3079293935 conn(0x7f81880fe830 msgr2=0x7f8188100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 -- 172.21.15.16:0/3079293935 shutdown_connections 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 -- 172.21.15.16:0/3079293935 wait complete. 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.090+0000 7f818de28640 1 Processor -- start 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f818de28640 1 -- start start 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f818de28640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8188102dc0 0x7f81881992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f818de28640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81881087d0 0x7f81881997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f818de28640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8188109150 0x7f818819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f818de28640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8188112e20 con 0x7f81881087d0 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f818de28640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8188112ca0 con 0x7f8188102dc0 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f818de28640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8188112fa0 con 0x7f8188109150 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81881087d0 0x7f81881997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81881087d0 0x7f81881997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37894/0 (socket says 172.21.15.16:37894) 2024-09-10T23:44:06.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 -- 172.21.15.16:0/712311879 learned_addr learned my addr 172.21.15.16:0/712311879 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f81877fe640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8188102dc0 0x7f81881992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8187fff640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8188109150 0x7f818819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 -- 172.21.15.16:0/712311879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8188109150 msgr2=0x7f818819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8188109150 0x7f818819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 -- 172.21.15.16:0/712311879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8188102dc0 msgr2=0x7f81881992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8188102dc0 0x7f81881992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 -- 172.21.15.16:0/712311879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818819f360 con 0x7f81881087d0 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f81877fe640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8188102dc0 0x7f81881992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.091+0000 7f8186ffd640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81881087d0 0x7f81881997f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c890 tx=0x7f817c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.092+0000 7f8184ff9640 1 -- 172.21.15.16:0/712311879 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c004220 con 0x7f81881087d0 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.092+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818819f650 con 0x7f81881087d0 2024-09-10T23:44:06.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.092+0000 7f8184ff9640 1 -- 172.21.15.16:0/712311879 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f817c0043c0 con 0x7f81881087d0 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.092+0000 7f8184ff9640 1 -- 172.21.15.16:0/712311879 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c004a00 con 0x7f81881087d0 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.092+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81881a5ee0 con 0x7f81881087d0 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 Processor -- start 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 -- start start 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f8184ff9640 1 -- 172.21.15.16:0/712311879 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f817c0079b0 con 0x7f81881087d0 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d16c442ea0 con 0x55d16c4cc0f0 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d16c4322d0 con 0x55d16c4cca10 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.094+0000 7f81901fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d16c4360e0 con 0x55d16c4d89a0 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37908/0 (socket says 172.21.15.16:37908) 2024-09-10T23:44:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 -- 172.21.15.16:0/1566206190 learned_addr learned my addr 172.21.15.16:0/1566206190 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8186ffd640 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f81877fe640 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 -- 172.21.15.16:0/1566206190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 msgr2=0x55d16c4dad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 -- 172.21.15.16:0/1566206190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 msgr2=0x55d16c4d8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 -- 172.21.15.16:0/1566206190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d16c190650 con 0x55d16c4cc0f0 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8187fff640 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4cc4d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8180009ee0 tx=0x7f8180010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771d110d4e2298d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f8184ff9640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81700b5450 0x7f81700b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f816dffb640 1 -- 172.21.15.16:0/1566206190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180016070 con 0x55d16c4cc0f0 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f816dffb640 1 -- 172.21.15.16:0/1566206190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8180004d20 con 0x55d16c4cc0f0 2024-09-10T23:44:06.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f816dffb640 1 -- 172.21.15.16:0/1566206190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180012780 con 0x55d16c4cc0f0 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.095+0000 7f81877fe640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81700b5450 0x7f81700b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f8184ff9640 1 -- 172.21.15.16:0/712311879 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f817c0e5dd0 con 0x7f81881087d0 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 -- 172.21.15.16:0/1566206190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 msgr2=0x55d16c4cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81877fe640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81700b5450 0x7f81700b7910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8178000c00 tx=0x7f8178009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4cc4d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8180009ee0 tx=0x7f8180010740 comp rx=0 tx=0).stop 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 -- 172.21.15.16:0/1566206190 shutdown_connections 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 --2- 172.21.15.16:0/1566206190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4cc4d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 -- 172.21.15.16:0/1566206190 >> 172.21.15.16:0/1566206190 conn(0x55d16c4c9f20 msgr2=0x55d16c4cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 -- 172.21.15.16:0/1566206190 shutdown_connections 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.096+0000 7f81901fd740 1 -- 172.21.15.16:0/1566206190 wait complete. 2024-09-10T23:44:06.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 -- start start 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 Processor -- start 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cc0f0 0x55d16c4d8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4d89a0 0x55d16c4d5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d16c293700 con 0x55d16c4d89a0 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d16c3cd160 con 0x55d16c4cca10 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d16c4db620 con 0x55d16c4cc0f0 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f81901fd740 10 client.0 _ll_register_callbacks cb 0x55d16c3e69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f8187fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4d89a0 0x55d16c4d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f8187fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4d89a0 0x55d16c4d5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37916/0 (socket says 172.21.15.16:37916) 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f8187fff640 1 -- 172.21.15.16:0/4291970573 learned_addr learned my addr 172.21.15.16:0/4291970573 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.097+0000 7f8186ffd640 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f81877fe640 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cc0f0 0x55d16c4d8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8187fff640 1 -- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cc0f0 msgr2=0x55d16c4d8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8187fff640 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cc0f0 0x55d16c4d8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8187fff640 1 -- 172.21.15.16:0/4291970573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 msgr2=0x55d16c4d56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8187fff640 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8187fff640 1 -- 172.21.15.16:0/4291970573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d16c3fac90 con 0x55d16c4d89a0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8187fff640 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4d89a0 0x55d16c4d5ca0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8180000f80 tx=0x7f8180010fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1b12f7708d7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8166ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8166ffd640 1 -- 172.21.15.16:0/4291970573 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180028060 con 0x55d16c4d89a0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8166ffd640 1 -- 172.21.15.16:0/4291970573 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f81800050d0 con 0x55d16c4d89a0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8180004d20 con 0x55d16c4d89a0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8166ffd640 1 -- 172.21.15.16:0/4291970573 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8180016040 con 0x55d16c4d89a0 2024-09-10T23:44:06.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f81901fd740 10 client.16158 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d16c4e6f30 con 0x55d16c4d89a0 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.098+0000 7f8166ffd640 1 -- 172.21.15.16:0/4291970573 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8180004d20 con 0x55d16c4d89a0 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f8166ffd640 1 -- 172.21.15.16:0/4291970573 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8180022030 con 0x55d16c4d89a0 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81901fd740 10 client.16158 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81901fd740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81901fd740 20 client.16158 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81901fd740 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c4e8330 0x55d16c4ea720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81901fd740 4 client.16158 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d16c444df0 con 0x55d16c4e8330 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81877fe640 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c4e8330 0x55d16c4ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f81877fe640 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c4e8330 0x55d16c4ea720 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1de32b9462f7f6bc server_cookie=b916011242eb91e4 in_seq=0 out_seq=0 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.099+0000 7f8166ffd640 10 client.16158 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f8166ffd640 1 -- 172.21.15.16:0/4291970573 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d16c444df0 con 0x55d16c4e8330 2024-09-10T23:44:06.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f8166ffd640 10 client.16158 handle_command_reply: tid=0 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 client.16158 shutdown 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4d89a0 msgr2=0x55d16c4d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4d89a0 0x55d16c4d5ca0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8180000f80 tx=0x7f8180010fb0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 shutdown_connections 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c4e8330 0x55d16c4ea720 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4d89a0 0x55d16c4d5ca0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4d56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 --2- 172.21.15.16:0/4291970573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cc0f0 0x55d16c4d8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f8166ffd640 0 client.16158 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 >> 172.21.15.16:0/4291970573 conn(0x55d16c4c9f20 msgr2=0x55d16c4cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 shutdown_connections 2024-09-10T23:44:06.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 1 -- 172.21.15.16:0/4291970573 wait complete. 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.100+0000 7f81901fd740 20 client.16158 trim_cache size 0 max 16384 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 Processor -- start 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 -- start start 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cca10 0x55d16c4c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4d89a0 0x55d16c4d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81881b0fa0 con 0x55d16c4cc0f0 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81881ae870 con 0x55d16c4d89a0 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81901fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81881ac6c0 con 0x55d16c4cca10 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37930/0 (socket says 172.21.15.16:37930) 2024-09-10T23:44:06.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 -- 172.21.15.16:0/803221435 learned_addr learned my addr 172.21.15.16:0/803221435 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f8186ffd640 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cca10 0x55d16c4c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f8187fff640 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4d89a0 0x55d16c4d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 -- 172.21.15.16:0/803221435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cca10 msgr2=0x55d16c4c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cca10 0x55d16c4c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 -- 172.21.15.16:0/803221435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4d89a0 msgr2=0x55d16c4d9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4d89a0 0x55d16c4d9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 -- 172.21.15.16:0/803221435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d16c4c9d50 con 0x55d16c4cc0f0 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f8186ffd640 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cca10 0x55d16c4c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f8187fff640 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4d89a0 0x55d16c4d9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f81877fe640 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e4850 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8178005c00 tx=0x7f817803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a039a913d3d550 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.114+0000 7f816d7fa640 1 -- 172.21.15.16:0/803221435 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178057070 con 0x55d16c4cc0f0 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f816d7fa640 1 -- 172.21.15.16:0/803221435 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8178004b70 con 0x55d16c4cc0f0 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f816d7fa640 1 -- 172.21.15.16:0/803221435 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178035040 con 0x55d16c4cc0f0 2024-09-10T23:44:06.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 -- 172.21.15.16:0/803221435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 msgr2=0x55d16c4e4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e4850 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8178005c00 tx=0x7f817803e000 comp rx=0 tx=0).stop 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 -- 172.21.15.16:0/803221435 shutdown_connections 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4d89a0 0x55d16c4d9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4cca10 0x55d16c4c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 --2- 172.21.15.16:0/803221435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e4850 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 -- 172.21.15.16:0/803221435 >> 172.21.15.16:0/803221435 conn(0x55d16c4c9f20 msgr2=0x55d16c4c8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 -- 172.21.15.16:0/803221435 shutdown_connections 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 -- 172.21.15.16:0/803221435 wait complete. 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.115+0000 7f81901fd740 1 -- start start 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 1 Processor -- start 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4db870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81881acd30 con 0x55d16c4cc0f0 2024-09-10T23:44:06.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81881ae1a0 con 0x55d16c4cca10 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81881ad400 con 0x55d16c4d89a0 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81901fd740 10 client.0 _ll_register_callbacks cb 0x7f8178009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37932/0 (socket says 172.21.15.16:37932) 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 -- 172.21.15.16:0/2350954796 learned_addr learned my addr 172.21.15.16:0/2350954796 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f8186ffd640 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4db870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f8187fff640 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 -- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 msgr2=0x55d16c4dbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 -- 172.21.15.16:0/2350954796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 msgr2=0x55d16c4db870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4db870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.116+0000 7f81877fe640 1 -- 172.21.15.16:0/2350954796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d16c4dc470 con 0x55d16c4cc0f0 2024-09-10T23:44:06.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81877fe640 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e0f10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8178006010 tx=0x7f81780038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0568914612c318f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f8166ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f8166ffd640 1 -- 172.21.15.16:0/2350954796 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178057070 con 0x55d16c4cc0f0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f8166ffd640 1 -- 172.21.15.16:0/2350954796 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f81780048d0 con 0x55d16c4cc0f0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8178004b70 con 0x55d16c4cc0f0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f8166ffd640 1 -- 172.21.15.16:0/2350954796 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8178035040 con 0x55d16c4cc0f0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 10 client.16164 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d16c555d20 con 0x55d16c4cc0f0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f8166ffd640 1 -- 172.21.15.16:0/2350954796 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8178004b70 con 0x55d16c4cc0f0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f8166ffd640 1 -- 172.21.15.16:0/2350954796 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81780328b0 con 0x55d16c4cc0f0 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 10 client.16164 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 20 client.16164 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:06.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c5564f0 0x55d16c558910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 4 client.16164 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.117+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d16c4408a0 con 0x55d16c5564f0 2024-09-10T23:44:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f8186ffd640 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c5564f0 0x55d16c558910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:06.137 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f8186ffd640 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c5564f0 0x55d16c558910 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eab0a372bab69977 server_cookie=af51a243f3a474ae in_seq=0 out_seq=0 2024-09-10T23:44:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f8166ffd640 10 client.16164 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f8166ffd640 1 -- 172.21.15.16:0/2350954796 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d16c4408a0 con 0x55d16c5564f0 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f8166ffd640 10 client.16164 handle_command_reply: tid=0 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 client.16164 shutdown 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 msgr2=0x55d16c4e0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e0f10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8178006010 tx=0x7f81780038b0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 shutdown_connections 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d16c5564f0 0x55d16c558910 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d16c4d89a0 0x55d16c4dbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d16c4cca10 0x55d16c4db870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 --2- 172.21.15.16:0/2350954796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d16c4cc0f0 0x55d16c4e0f10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.118+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 >> 172.21.15.16:0/2350954796 conn(0x55d16c4c9f20 msgr2=0x55d16c4d7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f8166ffd640 0 client.16164 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 shutdown_connections 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f81901fd740 1 -- 172.21.15.16:0/2350954796 wait complete. 2024-09-10T23:44:06.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f81901fd740 20 client.16164 trim_cache size 0 max 16384 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81700b5450 msgr2=0x7f81700b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81700b5450 0x7f81700b7910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8178000c00 tx=0x7f8178009560 comp rx=0 tx=0).stop 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81881087d0 msgr2=0x7f81881997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81881087d0 0x7f81881997f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c890 tx=0x7f817c00cd50 comp rx=0 tx=0).stop 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 shutdown_connections 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8188109150 0x7f818819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81881087d0 0x7f81881997f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81700b5450 0x7f81700b7910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 --2- 172.21.15.16:0/712311879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8188102dc0 0x7f81881992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 >> 172.21.15.16:0/712311879 conn(0x7f81880fe830 msgr2=0x7f8188100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 shutdown_connections 2024-09-10T23:44:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:06.119+0000 7f818de28640 1 -- 172.21.15.16:0/712311879 wait complete. 2024-09-10T23:44:06.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:06 smithi016 ceph-mon[30855]: pgmap v436: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:06.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:06 smithi071 ceph-mon[35018]: pgmap v436: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:06.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:06 smithi066 ceph-mon[34761]: pgmap v436: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:07.883 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:44:07.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:44:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:08.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:08 smithi016 ceph-mon[30855]: pgmap v437: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:08.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:08 smithi071 ceph-mon[35018]: pgmap v437: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:08.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:08 smithi066 ceph-mon[34761]: pgmap v437: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/2656814642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08108020 msgr2=0x7f5d0810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/2656814642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08108020 0x7f5d0810e820 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009ca0 tx=0x7f5d0002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/2656814642 shutdown_connections 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/2656814642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08108020 0x7f5d0810e820 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/2656814642 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d081076a0 0x7f5d08107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/2656814642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d08101c90 0x7f5d08102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/2656814642 >> 172.21.15.16:0/2656814642 conn(0x7f5d080fd700 msgr2=0x7f5d080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/2656814642 shutdown_connections 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.802+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/2656814642 wait complete. 2024-09-10T23:44:08.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 Processor -- start 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 -- start start 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d08101c90 0x7f5d08199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d081076a0 0x7f5d081997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d08108020 0x7f5d0819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08111ca0 con 0x7f5d081076a0 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08111b20 con 0x7f5d08108020 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0ca9c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08111e20 con 0x7f5d08101c90 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d05d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d081076a0 0x7f5d081997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d05d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d081076a0 0x7f5d081997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37938/0 (socket says 172.21.15.16:37938) 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d05d9b640 1 -- 172.21.15.16:0/3250491371 learned_addr learned my addr 172.21.15.16:0/3250491371 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:08.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d0659c640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d08101c90 0x7f5d08199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d08108020 0x7f5d0819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d05d9b640 1 -- 172.21.15.16:0/3250491371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d08101c90 msgr2=0x7f5d08199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d08101c90 0x7f5d08199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d05d9b640 1 -- 172.21.15.16:0/3250491371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d08108020 msgr2=0x7f5d0819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.803+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d08108020 0x7f5d0819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5d05d9b640 1 -- 172.21.15.16:0/3250491371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0819f310 con 0x7f5d081076a0 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d08108020 0x7f5d0819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d081076a0 0x7f5d081997a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c970 tx=0x7f5cfc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5cf77fe640 1 -- 172.21.15.16:0/3250491371 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc007bb0 con 0x7f5d081076a0 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0819f600 con 0x7f5d081076a0 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5cf77fe640 1 -- 172.21.15.16:0/3250491371 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cfc007d50 con 0x7f5d081076a0 2024-09-10T23:44:08.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5cf77fe640 1 -- 172.21.15.16:0/3250491371 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00f450 con 0x7f5d081076a0 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.804+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d081a5cc0 con 0x7f5d081076a0 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 Processor -- start 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5cf77fe640 1 -- 172.21.15.16:0/3250491371 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f5cfc004f20 con 0x7f5d081076a0 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 -- start start 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943471ee0 0x5599434722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943472800 0x559943482660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943484f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5599433e8e60 con 0x559943472800 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5599433d8290 con 0x559943471ee0 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5599433dc0a0 con 0x559943482ba0 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943472800 0x559943482660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943472800 0x559943482660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37946/0 (socket says 172.21.15.16:37946) 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d0659c640 1 -- 172.21.15.16:0/3204292181 learned_addr learned my addr 172.21.15.16:0/3204292181 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943471ee0 0x5599434722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.807+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943484f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d0659c640 1 -- 172.21.15.16:0/3204292181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 msgr2=0x559943484f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d0659c640 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943484f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d0659c640 1 -- 172.21.15.16:0/3204292181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943471ee0 msgr2=0x5599434722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d0659c640 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943471ee0 0x5599434722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d0659c640 1 -- 172.21.15.16:0/3204292181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559943136930 con 0x559943472800 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943484f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d0659c640 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943472800 0x559943482660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800cbf0 tx=0x7f5cf800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3292eae5cf27c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:08.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5cf77fe640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cf00b5450 0x7f5cf00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5cf4ff9640 1 -- 172.21.15.16:0/3204292181 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8010630 con 0x559943472800 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cf00b5450 0x7f5cf00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5cf4ff9640 1 -- 172.21.15.16:0/3204292181 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cf8010c80 con 0x559943472800 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5cf4ff9640 1 -- 172.21.15.16:0/3204292181 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8019b40 con 0x559943472800 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.808+0000 7f5cf77fe640 1 -- 172.21.15.16:0/3250491371 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5cfc0e5d80 con 0x7f5d081076a0 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 -- 172.21.15.16:0/3204292181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943472800 msgr2=0x559943482660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cf00b5450 0x7f5cf00b7910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009430 tx=0x7f5d00009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943472800 0x559943482660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800cbf0 tx=0x7f5cf800e720 comp rx=0 tx=0).stop 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 -- 172.21.15.16:0/3204292181 shutdown_connections 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943484f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943472800 0x559943482660 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/3204292181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943471ee0 0x5599434722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 -- 172.21.15.16:0/3204292181 >> 172.21.15.16:0/3204292181 conn(0x55994346fd10 msgr2=0x559943470eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 -- 172.21.15.16:0/3204292181 shutdown_connections 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 -- 172.21.15.16:0/3204292181 wait complete. 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.809+0000 7f5d0ee71740 1 -- start start 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 1 Processor -- start 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994347fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943472800 0x559943480010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943482ba0 0x559943480550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559943239890 con 0x559943471ee0 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559943372d40 con 0x559943482ba0 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559943485850 con 0x559943472800 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994347fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0ee71740 10 client.0 _ll_register_callbacks cb 0x5599433d6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994347fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37962/0 (socket says 172.21.15.16:37962) 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 -- 172.21.15.16:0/1212715716 learned_addr learned my addr 172.21.15.16:0/1212715716 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943482ba0 0x559943480550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943472800 0x559943480010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 -- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943472800 msgr2=0x559943480010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943472800 0x559943480010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 -- 172.21.15.16:0/1212715716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943482ba0 msgr2=0x559943480550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943482ba0 0x559943480550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 -- 172.21.15.16:0/1212715716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994348ebb0 con 0x559943471ee0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5d0659c640 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994347fad0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8010f30 tx=0x7f5cf80198c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1479ef4e5231c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.810+0000 7f5cedffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5cedffb640 1 -- 172.21.15.16:0/1212715716 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8019c70 con 0x559943471ee0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5cedffb640 1 -- 172.21.15.16:0/1212715716 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5cf8019e10 con 0x559943471ee0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cf8010c80 con 0x559943471ee0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5cedffb640 1 -- 172.21.15.16:0/1212715716 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5cf8005050 con 0x559943471ee0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 10 client.16176 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599434914b0 con 0x559943471ee0 2024-09-10T23:44:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5cedffb640 1 -- 172.21.15.16:0/1212715716 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cf8010c80 con 0x559943471ee0 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5cedffb640 1 -- 172.21.15.16:0/1212715716 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5cf80046c0 con 0x559943471ee0 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 10 client.16176 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 20 client.16176 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5599434928b0 0x559943494ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 4 client.16176 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.811+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599433eadb0 con 0x5599434928b0 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.812+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5599434928b0 0x559943494ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.812+0000 7f5cedffb640 10 client.16176 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.812+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5599434928b0 0x559943494ca0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5456cfb8cd98e0a server_cookie=3b2bbc327bf2fe17 in_seq=0 out_seq=0 2024-09-10T23:44:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5cedffb640 1 -- 172.21.15.16:0/1212715716 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599433eadb0 con 0x5599434928b0 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5cedffb640 10 client.16176 handle_command_reply: tid=0 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 client.16176 shutdown 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 msgr2=0x55994347fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994347fad0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8010f30 tx=0x7f5cf80198c0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 shutdown_connections 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5599434928b0 0x559943494ca0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943482ba0 0x559943480550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5cedffb640 0 client.16176 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943472800 0x559943480010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1212715716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994347fad0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 >> 172.21.15.16:0/1212715716 conn(0x55994346fd10 msgr2=0x55994346ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 shutdown_connections 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1212715716 wait complete. 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.813+0000 7f5d0ee71740 20 client.16176 trim_cache size 0 max 16384 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 Processor -- start 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 -- start start 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943471ee0 0x559943471100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994349a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943482ba0 0x55994349a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081aed10 con 0x559943482ba0 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081ac5e0 con 0x559943472800 2024-09-10T23:44:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.831+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081aa430 con 0x559943471ee0 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943482ba0 0x55994349a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943471ee0 0x559943471100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943471ee0 0x559943471100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:49858/0 (socket says 172.21.15.16:49858) 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943482ba0 0x55994349a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37966/0 (socket says 172.21.15.16:37966) 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 -- 172.21.15.16:0/2259892497 learned_addr learned my addr 172.21.15.16:0/2259892497 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994349a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 -- 172.21.15.16:0/2259892497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 msgr2=0x55994349a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994349a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 -- 172.21.15.16:0/2259892497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943482ba0 msgr2=0x55994349a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943482ba0 0x55994349a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 -- 172.21.15.16:0/2259892497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559943478040 con 0x559943471ee0 2024-09-10T23:44:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943482ba0 0x55994349a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.832+0000 7f5d0659c640 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943471ee0 0x559943471100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800ec20 tx=0x7f5cf8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4daa0cd1f7b880f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5ceffff640 1 -- 172.21.15.16:0/2259892497 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8032030 con 0x559943471ee0 2024-09-10T23:44:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5ceffff640 1 -- 172.21.15.16:0/2259892497 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cf80056a0 con 0x559943471ee0 2024-09-10T23:44:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5ceffff640 1 -- 172.21.15.16:0/2259892497 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf801e020 con 0x559943471ee0 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 -- 172.21.15.16:0/2259892497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943471ee0 msgr2=0x559943471100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943471ee0 0x559943471100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800ec20 tx=0x7f5cf8000bc0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 -- 172.21.15.16:0/2259892497 shutdown_connections 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943482ba0 0x55994349a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994349a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/2259892497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943471ee0 0x559943471100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 -- 172.21.15.16:0/2259892497 >> 172.21.15.16:0/2259892497 conn(0x55994346fd10 msgr2=0x5599434709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 -- 172.21.15.16:0/2259892497 shutdown_connections 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.833+0000 7f5d0ee71740 1 -- 172.21.15.16:0/2259892497 wait complete. 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 -- start start 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 Processor -- start 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994348aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994348b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943485aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081aaaa0 con 0x559943471ee0 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081abf10 con 0x559943472800 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081ab170 con 0x559943482ba0 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0ee71740 10 client.0 _ll_register_callbacks cb 0x7f5cf8014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994348aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994348aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37968/0 (socket says 172.21.15.16:37968) 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0659c640 1 -- 172.21.15.16:0/1644478430 learned_addr learned my addr 172.21.15.16:0/1644478430 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994348b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d06d9d640 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943485aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0659c640 1 -- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 msgr2=0x559943485aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.834+0000 7f5d0659c640 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943485aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5d0659c640 1 -- 172.21.15.16:0/1644478430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 msgr2=0x55994348b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5d0659c640 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994348b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5d0659c640 1 -- 172.21.15.16:0/1644478430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994348b6a0 con 0x559943471ee0 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5d0659c640 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994348aaf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800c770 tx=0x7f5cf800c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bfe91f85c7e10a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5cedffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5cedffb640 1 -- 172.21.15.16:0/1644478430 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf803b030 con 0x559943471ee0 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5cedffb640 1 -- 172.21.15.16:0/1644478430 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5cf8021040 con 0x559943471ee0 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cf80056a0 con 0x559943471ee0 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5cedffb640 1 -- 172.21.15.16:0/1644478430 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5cf8045050 con 0x559943471ee0 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5d0ee71740 10 client.16182 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559943510b60 con 0x559943471ee0 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5cedffb640 1 -- 172.21.15.16:0/1644478430 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cf80056a0 con 0x559943471ee0 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.835+0000 7f5cedffb640 1 -- 172.21.15.16:0/1644478430 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5cf80035f0 con 0x559943471ee0 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d0ee71740 10 client.16182 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d0ee71740 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d0ee71740 20 client.16182 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559943511180 0x5599435135a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d0ee71740 4 client.16182 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5599433e6860 con 0x559943511180 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559943511180 0x5599435135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5d05d9b640 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559943511180 0x5599435135a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e154dd298fde5b1 server_cookie=d00b5735f0eb3d80 in_seq=0 out_seq=0 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.836+0000 7f5cedffb640 10 client.16182 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5cedffb640 1 -- 172.21.15.16:0/1644478430 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599433e6860 con 0x559943511180 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5cedffb640 10 client.16182 handle_command_reply: tid=0 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 client.16182 shutdown 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 msgr2=0x55994348aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994348aaf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800c770 tx=0x7f5cf800c4f0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 shutdown_connections 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559943511180 0x5599435135a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559943482ba0 0x559943485aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559943472800 0x55994348b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5cedffb640 0 client.16182 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 --2- 172.21.15.16:0/1644478430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559943471ee0 0x55994348aaf0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 >> 172.21.15.16:0/1644478430 conn(0x55994346fd10 msgr2=0x55994348da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 shutdown_connections 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 1 -- 172.21.15.16:0/1644478430 wait complete. 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.838+0000 7f5d0ee71740 20 client.16182 trim_cache size 0 max 16384 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:44:08.856 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:44:08.857 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d", 2024-09-10T23:44:08.857 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:44:08.857 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:44:08.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cf00b5450 msgr2=0x7f5cf00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cf00b5450 0x7f5cf00b7910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009430 tx=0x7f5d00009360 comp rx=0 tx=0).stop 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d081076a0 msgr2=0x7f5d081997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d081076a0 0x7f5d081997a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c970 tx=0x7f5cfc00ce30 comp rx=0 tx=0).stop 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 shutdown_connections 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cf00b5450 0x7f5cf00b7910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d08108020 0x7f5d0819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d081076a0 0x7f5d081997a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 --2- 172.21.15.16:0/3250491371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d08101c90 0x7f5d08199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 >> 172.21.15.16:0/3250491371 conn(0x7f5d080fd700 msgr2=0x7f5d0806adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 shutdown_connections 2024-09-10T23:44:08.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:08.839+0000 7f5d0ca9c640 1 -- 172.21.15.16:0/3250491371 wait complete. 2024-09-10T23:44:09.620 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:44:09.880 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:10.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:10 smithi016 ceph-mon[30855]: pgmap v438: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:44:10.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:10 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:44:10.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:10 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:10.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:10 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:44:10.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:10 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:10.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 -- 172.21.15.16:0/3477665297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec101c90 msgr2=0x7f60ec102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/3477665297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec101c90 0x7f60ec102070 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009900 tx=0x7f60dc02a410 comp rx=0 tx=0).stop 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 -- 172.21.15.16:0/3477665297 shutdown_connections 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/3477665297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec108020 0x7f60ec10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/3477665297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ec1076a0 0x7f60ec107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/3477665297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec101c90 0x7f60ec102070 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 -- 172.21.15.16:0/3477665297 >> 172.21.15.16:0/3477665297 conn(0x7f60ec0fd700 msgr2=0x7f60ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 -- 172.21.15.16:0/3477665297 shutdown_connections 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 -- 172.21.15.16:0/3477665297 wait complete. 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 Processor -- start 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.384+0000 7f60f2a7d640 1 -- start start 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f2a7d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ec101c90 0x7f60ec199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f2a7d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec1076a0 0x7f60ec199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f2a7d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec108020 0x7f60ec19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f2a7d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec112e00 con 0x7f60ec1076a0 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f2a7d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec112c80 con 0x7f60ec108020 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f2a7d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec112f80 con 0x7f60ec101c90 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec1076a0 0x7f60ec199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec1076a0 0x7f60ec199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37992/0 (socket says 172.21.15.16:37992) 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 -- 172.21.15.16:0/1963900375 learned_addr learned my addr 172.21.15.16:0/1963900375 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f0819640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ec101c90 0x7f60ec199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60f101a640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec108020 0x7f60ec19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 -- 172.21.15.16:0/1963900375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ec101c90 msgr2=0x7f60ec199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ec101c90 0x7f60ec199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 -- 172.21.15.16:0/1963900375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec108020 msgr2=0x7f60ec19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec108020 0x7f60ec19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 -- 172.21.15.16:0/1963900375 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec19f3e0 con 0x7f60ec1076a0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.385+0000 7f60ebfff640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec1076a0 0x7f60ec199870 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f60e000c890 tx=0x7f60e000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.386+0000 7f60e9ffb640 1 -- 172.21.15.16:0/1963900375 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0004220 con 0x7f60ec1076a0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.386+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec19f6d0 con 0x7f60ec1076a0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.386+0000 7f60e9ffb640 1 -- 172.21.15.16:0/1963900375 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e00043c0 con 0x7f60ec1076a0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.386+0000 7f60e9ffb640 1 -- 172.21.15.16:0/1963900375 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0004a00 con 0x7f60ec1076a0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.386+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec1a5f60 con 0x7f60ec1076a0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.388+0000 7f60e9ffb640 1 -- 172.21.15.16:0/1963900375 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f60e00079b0 con 0x7f60ec1076a0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.388+0000 7f60f4e52740 1 Processor -- start 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.388+0000 7f60f4e52740 1 -- start start 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f4e52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55908b548e50 con 0x55908b5d2da0 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f4e52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55908b538280 con 0x55908b5ded30 2024-09-10T23:44:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f4e52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55908b53c090 con 0x55908b5d2480 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5de7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5de7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37998/0 (socket says 172.21.15.16:37998) 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 -- 172.21.15.16:0/1867069075 learned_addr learned my addr 172.21.15.16:0/1867069075 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f101a640 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60ebfff640 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 -- 172.21.15.16:0/1867069075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 msgr2=0x55908b5d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 -- 172.21.15.16:0/1867069075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 msgr2=0x55908b5e1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 -- 172.21.15.16:0/1867069075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55908b296650 con 0x55908b5d2da0 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60e9ffb640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60d40b5450 0x7f60d40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f0819640 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5de7f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009900 tx=0x7f60dc031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c070e2d2e4b69e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.389+0000 7f60f101a640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60d40b5450 0x7f60d40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60e9ffb640 1 -- 172.21.15.16:0/1963900375 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f60e00e5d80 con 0x7f60ec1076a0 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60d2ffd640 1 -- 172.21.15.16:0/1867069075 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc040070 con 0x55908b5d2da0 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60d2ffd640 1 -- 172.21.15.16:0/1867069075 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60dc0316a0 con 0x55908b5d2da0 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60d2ffd640 1 -- 172.21.15.16:0/1867069075 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc035040 con 0x55908b5d2da0 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 -- 172.21.15.16:0/1867069075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 msgr2=0x55908b5de7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5de7f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009900 tx=0x7f60dc031de0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f101a640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60d40b5450 0x7f60d40b7910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b4d0 tx=0x7f60e400e040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 -- 172.21.15.16:0/1867069075 shutdown_connections 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5de7f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 --2- 172.21.15.16:0/1867069075 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 -- 172.21.15.16:0/1867069075 >> 172.21.15.16:0/1867069075 conn(0x55908b5d02b0 msgr2=0x55908b5d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 -- 172.21.15.16:0/1867069075 shutdown_connections 2024-09-10T23:44:10.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.390+0000 7f60f4e52740 1 -- 172.21.15.16:0/1867069075 wait complete. 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 -- start start 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 Processor -- start 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2480 0x55908b5de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5dba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5ded30 0x55908b5dbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55908b399700 con 0x55908b5d2da0 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55908b4d3110 con 0x55908b5d2480 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.391+0000 7f60f4e52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55908b5e1950 con 0x55908b5ded30 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60f4e52740 10 client.0 _ll_register_callbacks cb 0x55908b4ec990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5dba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5dba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38010/0 (socket says 172.21.15.16:38010) 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 -- 172.21.15.16:0/853159063 learned_addr learned my addr 172.21.15.16:0/853159063 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:10.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60f0819640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2480 0x55908b5de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60f101a640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5ded30 0x55908b5dbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 -- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5ded30 msgr2=0x55908b5dbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5ded30 0x55908b5dbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 -- 172.21.15.16:0/853159063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2480 msgr2=0x55908b5de5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2480 0x55908b5de5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 -- 172.21.15.16:0/853159063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55908b500c40 con 0x55908b5d2da0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60f101a640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5ded30 0x55908b5dbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60ebfff640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5dba10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f60e0091fd0 tx=0x7f60e00abfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cd7afa5355cf0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60cbfff640 1 -- 172.21.15.16:0/853159063 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e00e7070 con 0x55908b5d2da0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60cbfff640 1 -- 172.21.15.16:0/853159063 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f60e00e9360 con 0x55908b5d2da0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60dc0316a0 con 0x55908b5d2da0 2024-09-10T23:44:10.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60cbfff640 1 -- 172.21.15.16:0/853159063 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60e001d040 con 0x55908b5d2da0 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60f4e52740 10 client.16194 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.392+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55908b5ed280 con 0x55908b5d2da0 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60cbfff640 1 -- 172.21.15.16:0/853159063 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60dc0316a0 con 0x55908b5d2da0 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60cbfff640 1 -- 172.21.15.16:0/853159063 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60e00cdbe0 con 0x55908b5d2da0 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60f4e52740 10 client.16194 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60f4e52740 10 client.16194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60f4e52740 20 client.16194 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60f4e52740 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b5f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60f4e52740 4 client.16194 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55908b54ada0 con 0x55908b5ee7e0 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.393+0000 7f60f0819640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b5f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.394+0000 7f60cbfff640 10 client.16194 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.394+0000 7f60f0819640 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b5f0c10 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a6456b4b9606e84 server_cookie=90989f9265c877b6 in_seq=0 out_seq=0 2024-09-10T23:44:10.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.394+0000 7f60cbfff640 1 -- 172.21.15.16:0/853159063 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55908b54ada0 con 0x55908b5ee7e0 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.394+0000 7f60cbfff640 10 client.16194 handle_command_reply: tid=0 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.394+0000 7f60f4e52740 1 client.16194 shutdown 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 msgr2=0x55908b5dba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5dba10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f60e0091fd0 tx=0x7f60e00abfd0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 shutdown_connections 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b5f0c10 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60cbfff640 0 client.16194 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5ded30 0x55908b5dbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2da0 0x55908b5dba10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 --2- 172.21.15.16:0/853159063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2480 0x55908b5de5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 >> 172.21.15.16:0/853159063 conn(0x55908b5d02b0 msgr2=0x55908b5d5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 shutdown_connections 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 1 -- 172.21.15.16:0/853159063 wait complete. 2024-09-10T23:44:10.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.395+0000 7f60f4e52740 20 client.16194 trim_cache size 0 max 16384 2024-09-10T23:44:10.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.412+0000 7f60f4e52740 1 Processor -- start 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f4e52740 1 -- start start 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2480 0x55908b5cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2da0 0x55908b5dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f4e52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1b0f60 con 0x55908b5d2480 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f4e52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1ae830 con 0x55908b5ded30 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f4e52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1ac680 con 0x55908b5d2da0 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2480 0x55908b5cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2480 0x55908b5cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38016/0 (socket says 172.21.15.16:38016) 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 -- 172.21.15.16:0/3038499721 learned_addr learned my addr 172.21.15.16:0/3038499721 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f101a640 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60ebfff640 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2da0 0x55908b5dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 -- 172.21.15.16:0/3038499721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2da0 msgr2=0x55908b5dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2da0 0x55908b5dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 -- 172.21.15.16:0/3038499721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 msgr2=0x55908b5e0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f0819640 1 -- 172.21.15.16:0/3038499721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55908b5d0d30 con 0x55908b5d2480 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.413+0000 7f60f101a640 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f0819640 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2480 0x55908b5cfbc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f60dc003950 tx=0x7f60dc031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd47cda394ff7ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60d27fc640 1 -- 172.21.15.16:0/3038499721 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc040030 con 0x55908b5d2480 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60d27fc640 1 -- 172.21.15.16:0/3038499721 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60dc005040 con 0x55908b5d2480 2024-09-10T23:44:10.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60d27fc640 1 -- 172.21.15.16:0/3038499721 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc035040 con 0x55908b5d2480 2024-09-10T23:44:10.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f4e52740 1 -- 172.21.15.16:0/3038499721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2480 msgr2=0x55908b5cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2480 0x55908b5cfbc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f60dc003950 tx=0x7f60dc031400 comp rx=0 tx=0).stop 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f4e52740 1 -- 172.21.15.16:0/3038499721 shutdown_connections 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5ded30 0x55908b5e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2da0 0x55908b5dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3038499721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5d2480 0x55908b5cfbc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.414+0000 7f60f4e52740 1 -- 172.21.15.16:0/3038499721 >> 172.21.15.16:0/3038499721 conn(0x55908b5d02b0 msgr2=0x55908b5dd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 -- 172.21.15.16:0/3038499721 shutdown_connections 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 -- 172.21.15.16:0/3038499721 wait complete. 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 -- start start 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 Processor -- start 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2da0 0x55908b5f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5ded30 0x55908b5f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1accf0 con 0x55908b5ded30 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1ae160 con 0x55908b5d2da0 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec1ad3c0 con 0x55908b5d2480 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.415+0000 7f60f4e52740 10 client.0 _ll_register_callbacks cb 0x7f60e0004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f101a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5ded30 0x55908b5f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5e75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:49898/0 (socket says 172.21.15.16:49898) 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 -- 172.21.15.16:0/3198793533 learned_addr learned my addr 172.21.15.16:0/3198793533 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60ebfff640 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2da0 0x55908b5f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 -- 172.21.15.16:0/3198793533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2da0 msgr2=0x55908b5f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2da0 0x55908b5f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 -- 172.21.15.16:0/3198793533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5ded30 msgr2=0x55908b5f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:10.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5ded30 0x55908b5f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 -- 172.21.15.16:0/3198793533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55908b5e6240 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f101a640 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5ded30 0x55908b5f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f0819640 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5e75e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009850 tx=0x7f60dc02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b21fdbd84ab819fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60cbfff640 1 -- 172.21.15.16:0/3198793533 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc040030 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60dc005040 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60cbfff640 1 -- 172.21.15.16:0/3198793533 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f60dc04b040 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60cbfff640 1 -- 172.21.15.16:0/3198793533 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60dc035040 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f4e52740 10 client.25810 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.416+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55908b65b900 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60cbfff640 1 -- 172.21.15.16:0/3198793533 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60dc005040 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60cbfff640 1 -- 172.21.15.16:0/3198793533 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60dc004c50 con 0x55908b5d2480 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60f4e52740 10 client.25810 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60f4e52740 10 client.25810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:10.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60f4e52740 20 client.25810 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b65dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60f4e52740 4 client.25810 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55908b546850 con 0x55908b5ee7e0 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.417+0000 7f60ebfff640 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b65dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60ebfff640 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b65dc20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff177a82c07e4aaa server_cookie=5e14034aef79bbc7 in_seq=0 out_seq=0 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60cbfff640 10 client.25810 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60cbfff640 1 -- 172.21.15.16:0/3198793533 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55908b546850 con 0x55908b5ee7e0 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60cbfff640 10 client.25810 handle_command_reply: tid=0 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 client.25810 shutdown 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 msgr2=0x55908b5e75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5e75e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009850 tx=0x7f60dc02a410 comp rx=0 tx=0).stop 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 shutdown_connections 2024-09-10T23:44:10.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55908b5ee7e0 0x55908b65dc20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55908b5ded30 0x55908b5f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55908b5d2da0 0x55908b5f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 --2- 172.21.15.16:0/3198793533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55908b5d2480 0x55908b5e75e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60cbfff640 0 client.25810 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 >> 172.21.15.16:0/3198793533 conn(0x55908b5d02b0 msgr2=0x55908b5dd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 shutdown_connections 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.418+0000 7f60f4e52740 1 -- 172.21.15.16:0/3198793533 wait complete. 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f4e52740 20 client.25810 trim_cache size 0 max 16384 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:44:10.424 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d", 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:44:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:44:10.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:44:10.430 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:44:10.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60d40b5450 msgr2=0x7f60d40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60d40b5450 0x7f60d40b7910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b4d0 tx=0x7f60e400e040 comp rx=0 tx=0).stop 2024-09-10T23:44:10.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec1076a0 msgr2=0x7f60ec199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:10.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec1076a0 0x7f60ec199870 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f60e000c890 tx=0x7f60e000cd50 comp rx=0 tx=0).stop 2024-09-10T23:44:10.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 shutdown_connections 2024-09-10T23:44:10.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f60d40b5450 0x7f60d40b7910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec108020 0x7f60ec19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60ec1076a0 0x7f60ec199870 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 --2- 172.21.15.16:0/1963900375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60ec101c90 0x7f60ec199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:10.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 >> 172.21.15.16:0/1963900375 conn(0x7f60ec0fd700 msgr2=0x7f60ec0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:10.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 shutdown_connections 2024-09-10T23:44:10.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:10.419+0000 7f60f2a7d640 1 -- 172.21.15.16:0/1963900375 wait complete. 2024-09-10T23:44:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:10 smithi071 ceph-mon[35018]: pgmap v438: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:44:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:10 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:44:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:10 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:10 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:44:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:10 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:10.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:10 smithi066 ceph-mon[34761]: pgmap v438: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:44:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:10 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:44:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:10 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:10 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:44:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:10 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:11.346 INFO:tasks.cephfs.filesystem:scrub status for tag:8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d - {'path': '/', 'tag': '8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d', 'options': 'recursive,force'} 2024-09-10T23:44:12.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:12 smithi016 ceph-mon[30855]: pgmap v439: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:12 smithi071 ceph-mon[35018]: pgmap v439: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:12 smithi066 ceph-mon[34761]: pgmap v439: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:44:13.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:13 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:44:13.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:13 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:44:13.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:13 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:44:14.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:14 smithi016 ceph-mon[30855]: pgmap v440: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:44:14.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:14 smithi071 ceph-mon[35018]: pgmap v440: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:44:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:14 smithi066 ceph-mon[34761]: pgmap v440: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:44:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:16 smithi016 ceph-mon[30855]: pgmap v441: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:44:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:16 smithi071 ceph-mon[35018]: pgmap v441: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:44:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:16 smithi066 ceph-mon[34761]: pgmap v441: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:44:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:18 smithi016 ceph-mon[30855]: pgmap v442: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:44:18.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:18 smithi071 ceph-mon[35018]: pgmap v442: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:44:18.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:18 smithi066 ceph-mon[34761]: pgmap v442: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:44:20.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:20 smithi016 ceph-mon[30855]: pgmap v443: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:44:20.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:20 smithi071 ceph-mon[35018]: pgmap v443: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:44:20.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:20 smithi066 ceph-mon[34761]: pgmap v443: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:44:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:22 smithi016 ceph-mon[30855]: pgmap v444: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:44:22.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:22 smithi071 ceph-mon[35018]: pgmap v444: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:44:22.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:22 smithi066 ceph-mon[34761]: pgmap v444: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:44:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:24 smithi016 ceph-mon[30855]: pgmap v445: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:44:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:24 smithi071 ceph-mon[35018]: pgmap v445: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:44:24.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:24 smithi066 ceph-mon[34761]: pgmap v445: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:44:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:26 smithi016 ceph-mon[30855]: pgmap v446: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:44:26.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:26 smithi071 ceph-mon[35018]: pgmap v446: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:44:26.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:26 smithi066 ceph-mon[34761]: pgmap v446: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:44:27.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:27 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:27.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:27 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:27.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:27 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:28 smithi016 ceph-mon[30855]: pgmap v447: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:44:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:44:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:44:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:28 smithi071 ceph-mon[35018]: pgmap v447: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:44:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:44:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:44:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:28 smithi066 ceph-mon[34761]: pgmap v447: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:44:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:44:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:44:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:30 smithi016 ceph-mon[30855]: pgmap v448: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:30.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:30 smithi071 ceph-mon[35018]: pgmap v448: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:30.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:30 smithi066 ceph-mon[34761]: pgmap v448: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:32 smithi016 ceph-mon[30855]: pgmap v449: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:32 smithi071 ceph-mon[35018]: pgmap v449: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:32.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:32 smithi066 ceph-mon[34761]: pgmap v449: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:34 smithi016 ceph-mon[30855]: pgmap v450: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:44:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:34 smithi071 ceph-mon[35018]: pgmap v450: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:44:34.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:34 smithi066 ceph-mon[34761]: pgmap v450: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:44:36.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:36 smithi016 ceph-mon[30855]: pgmap v451: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:44:36.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:36 smithi071 ceph-mon[35018]: pgmap v451: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:44:36.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:36 smithi066 ceph-mon[34761]: pgmap v451: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:44:38.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:38 smithi016 ceph-mon[30855]: pgmap v452: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:38.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:38 smithi071 ceph-mon[35018]: pgmap v452: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:38 smithi066 ceph-mon[34761]: pgmap v452: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:40 smithi016 ceph-mon[30855]: pgmap v453: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:40.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:40 smithi071 ceph-mon[35018]: pgmap v453: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:40.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:40 smithi066 ceph-mon[34761]: pgmap v453: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:41.346 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:44:41.622 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 -- 172.21.15.16:0/2817071860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc103b30 msgr2=0x7fd4fc103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 --2- 172.21.15.16:0/2817071860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc103b30 0x7fd4fc103f10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009900 tx=0x7fd4ec02a410 comp rx=0 tx=0).stop 2024-09-10T23:44:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 -- 172.21.15.16:0/2817071860 shutdown_connections 2024-09-10T23:44:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 --2- 172.21.15.16:0/2817071860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4fc10d0e0 0x7fd4fc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 --2- 172.21.15.16:0/2817071860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4fc104530 0x7fd4fc10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 --2- 172.21.15.16:0/2817071860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc103b30 0x7fd4fc103f10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 -- 172.21.15.16:0/2817071860 >> 172.21.15.16:0/2817071860 conn(0x7fd4fc0fd700 msgr2=0x7fd4fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 -- 172.21.15.16:0/2817071860 shutdown_connections 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 -- 172.21.15.16:0/2817071860 wait complete. 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.146+0000 7fd5028a1640 1 Processor -- start 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd5028a1640 1 -- start start 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd5028a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4fc103b30 0x7fd4fc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd5028a1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc104530 0x7fd4fc199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd5028a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4fc10d0e0 0x7fd4fc19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd5028a1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc112d60 con 0x7fd4fc104530 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd5028a1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc112be0 con 0x7fd4fc10d0e0 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd5028a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc112ee0 con 0x7fd4fc103b30 2024-09-10T23:44:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc104530 0x7fd4fc199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc104530 0x7fd4fc199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57182/0 (socket says 172.21.15.16:57182) 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/284808484 learned_addr learned my addr 172.21.15.16:0/284808484 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd500e3e640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4fc10d0e0 0x7fd4fc19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4fc103b30 0x7fd4fc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/284808484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4fc103b30 msgr2=0x7fd4fc1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4fc103b30 0x7fd4fc1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/284808484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4fc10d0e0 msgr2=0x7fd4fc19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4fc10d0e0 0x7fd4fc19ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/284808484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc19f2a0 con 0x7fd4fc104530 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.147+0000 7fd500e3e640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4fc10d0e0 0x7fd4fc19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.148+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc104530 0x7fd4fc199730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000d770 tx=0x7fd4f000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.148+0000 7fd4f97fa640 1 -- 172.21.15.16:0/284808484 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0017070 con 0x7fd4fc104530 2024-09-10T23:44:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.148+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4fc19f590 con 0x7fd4fc104530 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.148+0000 7fd4f97fa640 1 -- 172.21.15.16:0/284808484 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f00054d0 con 0x7fd4fc104530 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.148+0000 7fd4f97fa640 1 -- 172.21.15.16:0/284808484 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0004c30 con 0x7fd4fc104530 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.148+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4fc1a5c50 con 0x7fd4fc104530 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 Processor -- start 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 -- start start 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd4f97fa640 1 -- 172.21.15.16:0/284808484 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd4f0004e10 con 0x7fd4fc104530 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604fda0 0x55b79605fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b796060140 0x55b796062530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b795fc5e50 con 0x55b796060140 2024-09-10T23:44:42.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b795fb5280 con 0x55b79604fda0 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd504c76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b795fb9090 con 0x55b79604f480 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.151+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b796060140 0x55b796062530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b796060140 0x55b796062530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57184/0 (socket says 172.21.15.16:57184) 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2162096156 learned_addr learned my addr 172.21.15.16:0/2162096156 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604fda0 0x55b79605fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd500e3e640 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2162096156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 msgr2=0x55b79604f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2162096156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604fda0 msgr2=0x55b79605fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604fda0 0x55b79605fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2162096156 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b795d13650 con 0x55b796060140 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b796060140 0x55b796062530 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00e3220 tx=0x7fd4f00ee670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7011658acbff3661 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:42.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4e27fc640 1 -- 172.21.15.16:0/2162096156 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00f5020 con 0x55b796060140 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4f97fa640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4e40b5450 0x7fd4e40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4e27fc640 1 -- 172.21.15.16:0/2162096156 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f00f1ad0 con 0x55b796060140 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.152+0000 7fd4e27fc640 1 -- 172.21.15.16:0/2162096156 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00a8660 con 0x55b796060140 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd500e3e640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4e40b5450 0x7fd4e40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd4f97fa640 1 -- 172.21.15.16:0/284808484 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd4f00e5b30 con 0x7fd4fc104530 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 -- 172.21.15.16:0/2162096156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b796060140 msgr2=0x55b796062530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd500e3e640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4e40b5450 0x7fd4e40b7910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4007f90 tx=0x7fd4f4007720 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b796060140 0x55b796062530 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00e3220 tx=0x7fd4f00ee670 comp rx=0 tx=0).stop 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 -- 172.21.15.16:0/2162096156 shutdown_connections 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b796060140 0x55b796062530 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604fda0 0x55b79605fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 --2- 172.21.15.16:0/2162096156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 -- 172.21.15.16:0/2162096156 >> 172.21.15.16:0/2162096156 conn(0x55b79604d2b0 msgr2=0x55b79604e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 -- 172.21.15.16:0/2162096156 shutdown_connections 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.153+0000 7fd504c76740 1 -- 172.21.15.16:0/2162096156 wait complete. 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 -- start start 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 Processor -- start 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604f480 0x55b79605f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79605cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b796060140 0x55b79605d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b795e16700 con 0x55b79604fda0 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b795f50110 con 0x55b79604f480 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b796062df0 con 0x55b796060140 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd504c76740 10 client.0 _ll_register_callbacks cb 0x55b795f69990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79605cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79605cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57190/0 (socket says 172.21.15.16:57190) 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.154+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2117539104 learned_addr learned my addr 172.21.15.16:0/2117539104 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604f480 0x55b79605f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd500e3e640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b796060140 0x55b79605d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b796060140 msgr2=0x55b79605d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b796060140 0x55b79605d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2117539104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604f480 msgr2=0x55b79605f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604f480 0x55b79605f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2117539104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b795f7dc40 con 0x55b79604fda0 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604f480 0x55b79605f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd500e3e640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b796060140 0x55b79605d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79605cda0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00abfa0 tx=0x7fd4f00f0420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7c73fe1755825c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2117539104 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00ab960 con 0x55b79604fda0 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2117539104 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd4f00f1c80 con 0x55b79604fda0 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4f00f1ad0 con 0x55b79604fda0 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2117539104 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4f00f5020 con 0x55b79604fda0 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd504c76740 10 client.16212 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.155+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b79606e640 con 0x55b79604fda0 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2117539104 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f00f1ad0 con 0x55b79604fda0 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2117539104 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4f00e3560 con 0x55b79604fda0 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd504c76740 10 client.16212 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd504c76740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd504c76740 20 client.16212 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd504c76740 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b79606f990 0x55b796071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd504c76740 4 client.16212 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b795fc7da0 con 0x55b79606f990 2024-09-10T23:44:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b79606f990 0x55b796071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd4db7fe640 10 client.16212 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.156+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b79606f990 0x55b796071d80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21578ed17167f4c server_cookie=5c61e461cc2b8fb0 in_seq=0 out_seq=0 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2117539104 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b795fc7da0 con 0x55b79606f990 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd4db7fe640 10 client.16212 handle_command_reply: tid=0 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 client.16212 shutdown 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 msgr2=0x55b79605cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79605cda0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00abfa0 tx=0x7fd4f00f0420 comp rx=0 tx=0).stop 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 shutdown_connections 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b79606f990 0x55b796071d80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b796060140 0x55b79605d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79605cda0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd4db7fe640 0 client.16212 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:42.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 --2- 172.21.15.16:0/2117539104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b79604f480 0x55b79605f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.157+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 >> 172.21.15.16:0/2117539104 conn(0x55b79604d2b0 msgr2=0x55b79604c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:42.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.158+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 shutdown_connections 2024-09-10T23:44:42.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.158+0000 7fd504c76740 1 -- 172.21.15.16:0/2117539104 wait complete. 2024-09-10T23:44:42.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.158+0000 7fd504c76740 20 client.16212 trim_cache size 0 max 16384 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.175+0000 7fd504c76740 1 Processor -- start 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.175+0000 7fd504c76740 1 -- start start 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd504c76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd504c76740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79604e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd504c76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b796074da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd504c76740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc1aec10 con 0x55b79604fda0 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd504c76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc1ac4e0 con 0x55b796060140 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd504c76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc1aa330 con 0x55b79604f480 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79604e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79604e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57196/0 (socket says 172.21.15.16:57196) 2024-09-10T23:44:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/3065084803 learned_addr learned my addr 172.21.15.16:0/3065084803 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:42.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd500e3e640 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b796074da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/3065084803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 msgr2=0x55b79604e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/3065084803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 msgr2=0x55b796074da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b796074da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/3065084803 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b79604fbd0 con 0x55b79604fda0 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79604e840 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000d740 tx=0x7fd4f000de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d0d823e0fb9fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4e1ffb640 1 -- 172.21.15.16:0/3065084803 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0020030 con 0x55b79604fda0 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.176+0000 7fd4e1ffb640 1 -- 172.21.15.16:0/3065084803 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f00eeb70 con 0x55b79604fda0 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd4e1ffb640 1 -- 172.21.15.16:0/3065084803 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00abb50 con 0x55b79604fda0 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 -- 172.21.15.16:0/3065084803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 msgr2=0x55b79604e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79604e840 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000d740 tx=0x7fd4f000de80 comp rx=0 tx=0).stop 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 -- 172.21.15.16:0/3065084803 shutdown_connections 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b796074da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b79604e840 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 --2- 172.21.15.16:0/3065084803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b79604e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 -- 172.21.15.16:0/3065084803 >> 172.21.15.16:0/3065084803 conn(0x55b79604d2b0 msgr2=0x55b796061e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 -- 172.21.15.16:0/3065084803 shutdown_connections 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.177+0000 7fd504c76740 1 -- 172.21.15.16:0/3065084803 wait complete. 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 -- start start 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 Processor -- start 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b7960756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b796072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b7960732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc1aa9a0 con 0x55b79604fda0 2024-09-10T23:44:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc1abe10 con 0x55b796060140 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc1ab070 con 0x55b79604f480 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd504c76740 10 client.0 _ll_register_callbacks cb 0x7fd4ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b796072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b796072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57198/0 (socket says 172.21.15.16:57198) 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd4fbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b7960756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2011815004 learned_addr learned my addr 172.21.15.16:0/2011815004 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.178+0000 7fd500e3e640 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b7960732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 msgr2=0x55b7960756a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b7960756a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2011815004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 msgr2=0x55b7960732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b7960732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4fb7fe640 1 -- 172.21.15.16:0/2011815004 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7960db500 con 0x55b79604fda0 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b7960756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:42.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4fb7fe640 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b796072c30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00a8680 tx=0x7fd4f00e9a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e99b249decde08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2011815004 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00abde0 con 0x55b79604fda0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2011815004 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd4f00bfb60 con 0x55b79604fda0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4f00eeb70 con 0x55b79604fda0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2011815004 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4f00a7780 con 0x55b79604fda0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd504c76740 10 client.16218 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b7960dc6b0 con 0x55b79604fda0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.179+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2011815004 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f00eeb70 con 0x55b79604fda0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2011815004 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4f0005130 con 0x55b79604fda0 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd504c76740 10 client.16218 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd504c76740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd504c76740 20 client.16218 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd504c76740 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b7960dc9e0 0x55b7960dee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd504c76740 4 client.16218 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:44:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b795fc3850 con 0x55b7960dc9e0 2024-09-10T23:44:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b7960dc9e0 0x55b7960dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:42.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd4fbfff640 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b7960dc9e0 0x55b7960dee00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9c6878bcac29e38 server_cookie=9db7c4bf20cf4b2e in_seq=0 out_seq=0 2024-09-10T23:44:42.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd4db7fe640 10 client.16218 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:42.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.180+0000 7fd4db7fe640 1 -- 172.21.15.16:0/2011815004 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55b795fc3850 con 0x55b7960dc9e0 2024-09-10T23:44:42.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd4db7fe640 10 client.16218 handle_command_reply: tid=0 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 client.16218 shutdown 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 msgr2=0x55b796072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b796072c30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00a8680 tx=0x7fd4f00e9a70 comp rx=0 tx=0).stop 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 shutdown_connections 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b7960dc9e0 0x55b7960dee00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b796060140 0x55b7960732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b79604fda0 0x55b796072c30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 --2- 172.21.15.16:0/2011815004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b79604f480 0x55b7960756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 >> 172.21.15.16:0/2011815004 conn(0x55b79604d2b0 msgr2=0x55b79604e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd4db7fe640 0 client.16218 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 shutdown_connections 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 1 -- 172.21.15.16:0/2011815004 wait complete. 2024-09-10T23:44:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.181+0000 7fd504c76740 20 client.16218 trim_cache size 0 max 16384 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.188 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:44:42.189 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:42.190 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.191 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:42.192 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:44:42.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:44:42.193 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:44:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4e40b5450 msgr2=0x7fd4e40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4e40b5450 0x7fd4e40b7910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4007f90 tx=0x7fd4f4007720 comp rx=0 tx=0).stop 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc104530 msgr2=0x7fd4fc199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc104530 0x7fd4fc199730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000d770 tx=0x7fd4f000dc30 comp rx=0 tx=0).stop 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 shutdown_connections 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4e40b5450 0x7fd4e40b7910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4fc10d0e0 0x7fd4fc19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4fc104530 0x7fd4fc199730 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 --2- 172.21.15.16:0/284808484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4fc103b30 0x7fd4fc1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 >> 172.21.15.16:0/284808484 conn(0x7fd4fc0fd700 msgr2=0x7fd4fc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 shutdown_connections 2024-09-10T23:44:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:42.182+0000 7fd5028a1640 1 -- 172.21.15.16:0/284808484 wait complete. 2024-09-10T23:44:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:42 smithi016 ceph-mon[30855]: pgmap v454: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:42.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:42 smithi071 ceph-mon[35018]: pgmap v454: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:42.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:42 smithi066 ceph-mon[34761]: pgmap v454: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:43.017 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:44:43.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:44:43.276 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:43.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 -- 172.21.15.16:0/168672977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8103b70 msgr2=0x7f24d8103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 --2- 172.21.15.16:0/168672977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8103b70 0x7f24d8103f50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009900 tx=0x7f24d402a410 comp rx=0 tx=0).stop 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 -- 172.21.15.16:0/168672977 shutdown_connections 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 --2- 172.21.15.16:0/168672977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24d810d120 0x7f24d810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 --2- 172.21.15.16:0/168672977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d8104570 0x7f24d810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 --2- 172.21.15.16:0/168672977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8103b70 0x7f24d8103f50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 -- 172.21.15.16:0/168672977 >> 172.21.15.16:0/168672977 conn(0x7f24d80fd700 msgr2=0x7f24d80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 -- 172.21.15.16:0/168672977 shutdown_connections 2024-09-10T23:44:43.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.761+0000 7f24dedaa640 1 -- 172.21.15.16:0/168672977 wait complete. 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 Processor -- start 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 -- start start 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d8103b70 0x7f24d819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24d8104570 0x7f24d819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d810d120 0x7f24d81a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8112da0 con 0x7f24d810d120 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8112c20 con 0x7f24d8104570 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dedaa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8112f20 con 0x7f24d8103b70 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dd347640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d810d120 0x7f24d81a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:43.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dd347640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d810d120 0x7f24d81a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58242/0 (socket says 172.21.15.16:58242) 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dd347640 1 -- 172.21.15.16:0/1332448727 learned_addr learned my addr 172.21.15.16:0/1332448727 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dcb46640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d8103b70 0x7f24d819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24cffff640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24d8104570 0x7f24d819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dd347640 1 -- 172.21.15.16:0/1332448727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d8103b70 msgr2=0x7f24d819b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.762+0000 7f24dd347640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d8103b70 0x7f24d819b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24dd347640 1 -- 172.21.15.16:0/1332448727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24d8104570 msgr2=0x7f24d819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24dd347640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24d8104570 0x7f24d819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24dd347640 1 -- 172.21.15.16:0/1332448727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d81a1520 con 0x7f24d810d120 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24dcb46640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d8103b70 0x7f24d819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24dd347640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d810d120 0x7f24d81a0d50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009fd0 tx=0x7f24d000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24cdffb640 1 -- 172.21.15.16:0/1332448727 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0017070 con 0x7f24d810d120 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24cdffb640 1 -- 172.21.15.16:0/1332448727 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24d0003e20 con 0x7f24d810d120 2024-09-10T23:44:43.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d81a1810 con 0x7f24d810d120 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24cdffb640 1 -- 172.21.15.16:0/1332448727 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0010460 con 0x7f24d810d120 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.763+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d81a7ed0 con 0x7f24d810d120 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.764+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d8103f50 con 0x7f24d810d120 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.765+0000 7f24cdffb640 1 -- 172.21.15.16:0/1332448727 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f24d0003970 con 0x7f24d810d120 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.766+0000 7f24cdffb640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f24c00b54d0 0x7f24c00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.766+0000 7f24dcb46640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f24c00b54d0 0x7f24c00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.766+0000 7f24cdffb640 1 -- 172.21.15.16:0/1332448727 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f24d00e5cb0 con 0x7f24d810d120 2024-09-10T23:44:43.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.767+0000 7f24dcb46640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f24c00b54d0 0x7f24c00b7990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24d4031440 tx=0x7f24d4005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:43.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.770+0000 7f24cdffb640 1 -- 172.21.15.16:0/1332448727 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f24d00ac890 con 0x7f24d810d120 2024-09-10T23:44:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.992+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24d81a82a0 con 0x7f24d810d120 2024-09-10T23:44:43.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.992+0000 7f24cdffb640 1 -- 172.21.15.16:0/1332448727 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f24d00ac190 con 0x7f24d810d120 2024-09-10T23:44:43.994 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:44:43.995 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:44:43.995 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.994+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f24c00b54d0 msgr2=0x7f24c00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.994+0000 7f24dedaa640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f24c00b54d0 0x7f24c00b7990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24d4031440 tx=0x7f24d4005a20 comp rx=0 tx=0).stop 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.994+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d810d120 msgr2=0x7f24d81a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.994+0000 7f24dedaa640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d810d120 0x7f24d81a0d50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009fd0 tx=0x7f24d000b260 comp rx=0 tx=0).stop 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 shutdown_connections 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d810d120 0x7f24d81a0d50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f24c00b54d0 0x7f24c00b7990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24d8104570 0x7f24d819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 --2- 172.21.15.16:0/1332448727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d8103b70 0x7f24d819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 >> 172.21.15.16:0/1332448727 conn(0x7f24d80fd700 msgr2=0x7f24d80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 shutdown_connections 2024-09-10T23:44:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:43.995+0000 7f24dedaa640 1 -- 172.21.15.16:0/1332448727 wait complete. 2024-09-10T23:44:44.366 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:44 smithi016 ceph-mon[30855]: pgmap v455: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:44:44.367 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:44 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1332448727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:44 smithi071 ceph-mon[35018]: pgmap v455: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:44:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:44 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1332448727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:44.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:44 smithi066 ceph-mon[34761]: pgmap v455: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:44:44.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:44 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1332448727' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:44.844 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:44:45.108 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:45.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 -- 172.21.15.16:0/682836144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c1087d0 msgr2=0x7fba0c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 --2- 172.21.15.16:0/682836144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c1087d0 0x7fba0c108c10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009900 tx=0x7fb9f402a410 comp rx=0 tx=0).stop 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 -- 172.21.15.16:0/682836144 shutdown_connections 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 --2- 172.21.15.16:0/682836144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba0c109150 0x7fba0c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 --2- 172.21.15.16:0/682836144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c1087d0 0x7fba0c108c10 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 --2- 172.21.15.16:0/682836144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba0c102dc0 0x7fba0c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 -- 172.21.15.16:0/682836144 >> 172.21.15.16:0/682836144 conn(0x7fba0c0fe830 msgr2=0x7fba0c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 -- 172.21.15.16:0/682836144 shutdown_connections 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.614+0000 7fba1277c640 1 -- 172.21.15.16:0/682836144 wait complete. 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 Processor -- start 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 -- start start 2024-09-10T23:44:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c102dc0 0x7fba0c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba0c1087d0 0x7fba0c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba0c109150 0x7fba0c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c112e10 con 0x7fba0c102dc0 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c112c90 con 0x7fba0c109150 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba1277c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c112f90 con 0x7fba0c1087d0 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c102dc0 0x7fba0c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c102dc0 0x7fba0c199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58254/0 (socket says 172.21.15.16:58254) 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba0bfff640 1 -- 172.21.15.16:0/1751289009 learned_addr learned my addr 172.21.15.16:0/1751289009 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba03fff640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba0c1087d0 0x7fba0c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.615+0000 7fba10d19640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba0c109150 0x7fba0c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba0bfff640 1 -- 172.21.15.16:0/1751289009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba0c1087d0 msgr2=0x7fba0c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba0bfff640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba0c1087d0 0x7fba0c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba0bfff640 1 -- 172.21.15.16:0/1751289009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba0c109150 msgr2=0x7fba0c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba0bfff640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba0c109150 0x7fba0c19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba0bfff640 1 -- 172.21.15.16:0/1751289009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c19f3f0 con 0x7fba0c102dc0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba10d19640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba0c109150 0x7fba0c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba0bfff640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c102dc0 0x7fba0c199340 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00e9f0 tx=0x7fb9fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba09ffb640 1 -- 172.21.15.16:0/1751289009 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00cd80 con 0x7fba0c102dc0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba09ffb640 1 -- 172.21.15.16:0/1751289009 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9fc0108e0 con 0x7fba0c102dc0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c19f6e0 con 0x7fba0c102dc0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba09ffb640 1 -- 172.21.15.16:0/1751289009 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc018980 con 0x7fba0c102dc0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.616+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c1a5da0 con 0x7fba0c102dc0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.618+0000 7fba14b51740 1 Processor -- start 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.618+0000 7fba14b51740 1 -- start start 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.618+0000 7fba09ffb640 1 -- 172.21.15.16:0/1751289009 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb9fc010430 con 0x7fba0c102dc0 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba14b51740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5ec4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba14b51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5fc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba14b51740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5ff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba14b51740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555a9e562ea0 con 0x555a9e5fcdb0 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba14b51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a9e5522d0 con 0x555a9e5eca10 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba14b51740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555a9e5560e0 con 0x555a9e5ec0f0 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5ff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba10d19640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5ec4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5ff1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58260/0 (socket says 172.21.15.16:58260) 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 -- 172.21.15.16:0/2007095354 learned_addr learned my addr 172.21.15.16:0/2007095354 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba0bfff640 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 -- 172.21.15.16:0/2007095354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 msgr2=0x555a9e5ec4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5ec4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 -- 172.21.15.16:0/2007095354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 msgr2=0x555a9e5fc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5fc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 -- 172.21.15.16:0/2007095354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9e2b0650 con 0x555a9e5fcdb0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba10d19640 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5ec4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.619+0000 7fba03fff640 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5ff1a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009900 tx=0x7fb9f4032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3070672387f2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba09ffb640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb9f80b5450 0x7fb9f80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba10d19640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb9f80b5450 0x7fb9f80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba027fc640 1 -- 172.21.15.16:0/2007095354 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f403f070 con 0x555a9e5fcdb0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba027fc640 1 -- 172.21.15.16:0/2007095354 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9f4032e40 con 0x555a9e5fcdb0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba09ffb640 1 -- 172.21.15.16:0/1751289009 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb9fc0e6490 con 0x7fba0c102dc0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba027fc640 1 -- 172.21.15.16:0/2007095354 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4035070 con 0x555a9e5fcdb0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba14b51740 1 -- 172.21.15.16:0/2007095354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 msgr2=0x555a9e5ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba10d19640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb9f80b5450 0x7fb9f80b7910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fba04009370 tx=0x7fba04009720 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.620+0000 7fba14b51740 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5ff1a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009900 tx=0x7fb9f4032b90 comp rx=0 tx=0).stop 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- 172.21.15.16:0/2007095354 shutdown_connections 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5ff1a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5fc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 --2- 172.21.15.16:0/2007095354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5ec4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- 172.21.15.16:0/2007095354 >> 172.21.15.16:0/2007095354 conn(0x555a9e5e9f20 msgr2=0x555a9e5eb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- 172.21.15.16:0/2007095354 shutdown_connections 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- 172.21.15.16:0/2007095354 wait complete. 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- start start 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 Processor -- start 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5fc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555a9e3b3700 con 0x555a9e5fcdb0 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a9e4ed160 con 0x555a9e5eca10 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.621+0000 7fba14b51740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555a9e5ffa50 con 0x555a9e5ec0f0 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba14b51740 10 client.0 _ll_register_callbacks cb 0x555a9e5069e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5f9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58268/0 (socket says 172.21.15.16:58268) 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 -- 172.21.15.16:0/2365866296 learned_addr learned my addr 172.21.15.16:0/2365866296 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba03fff640 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba0bfff640 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 -- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 msgr2=0x555a9e5fc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5fc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 -- 172.21.15.16:0/2365866296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 msgr2=0x555a9e5f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 -- 172.21.15.16:0/2365866296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9e51ac90 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fba10d19640 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5f9ff0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba04009fd0 tx=0x7fba04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3529ea2850f1230a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.622+0000 7fb9eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2365866296 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04023070 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2365866296 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fba04003d80 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a9e564df0 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2365866296 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba0402f050 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fba14b51740 10 client.16236 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555a9e60b390 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2365866296 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555a9e564df0 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2365866296 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba0400f040 con 0x555a9e5fcdb0 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fba14b51740 10 client.16236 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fba14b51740 10 client.16236 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:44:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.623+0000 7fba14b51740 20 client.16236 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.624+0000 7fba14b51740 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e60c7f0 0x555a9e60ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.624+0000 7fba14b51740 4 client.16236 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.624+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a9e5608a0 con 0x555a9e60c7f0 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.624+0000 7fba0bfff640 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e60c7f0 0x555a9e60ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.624+0000 7fba0bfff640 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e60c7f0 0x555a9e60ebe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31243af4bea51f87 server_cookie=9ddd44ac5c1c8cd6 in_seq=0 out_seq=0 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.624+0000 7fb9eb7fe640 10 client.16236 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2365866296 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a9e5608a0 con 0x555a9e60c7f0 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fb9eb7fe640 10 client.16236 handle_command_reply: tid=0 2024-09-10T23:44:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 client.16236 shutdown 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 msgr2=0x555a9e5f9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5f9ff0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba04009fd0 tx=0x7fba04004a40 comp rx=0 tx=0).stop 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 shutdown_connections 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e60c7f0 0x555a9e60ebe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e5f9ff0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fb9eb7fe640 0 client.16236 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5eca10 0x555a9e5f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 --2- 172.21.15.16:0/2365866296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5ec0f0 0x555a9e5fc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 >> 172.21.15.16:0/2365866296 conn(0x555a9e5e9f20 msgr2=0x555a9e5efa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 shutdown_connections 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.625+0000 7fba14b51740 1 -- 172.21.15.16:0/2365866296 wait complete. 2024-09-10T23:44:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.626+0000 7fba14b51740 20 client.16236 trim_cache size 0 max 16384 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 Processor -- start 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 -- start start 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e608cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5eca10 0x555a9e5fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e6144f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1aee00 con 0x555a9e5fcdb0 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1ac6d0 con 0x555a9e5ec0f0 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba14b51740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1aa520 con 0x555a9e5eca10 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba10d19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e6144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba03fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5eca10 0x555a9e5fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba10d19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e6144f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58282/0 (socket says 172.21.15.16:58282) 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba10d19640 1 -- 172.21.15.16:0/2750873597 learned_addr learned my addr 172.21.15.16:0/2750873597 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:45.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba0bfff640 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e608cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.639+0000 7fba03fff640 1 -- 172.21.15.16:0/2750873597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 msgr2=0x555a9e608cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba03fff640 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e608cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba03fff640 1 -- 172.21.15.16:0/2750873597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 msgr2=0x555a9e6144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba03fff640 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e6144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba03fff640 1 -- 172.21.15.16:0/2750873597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9e5f2250 con 0x555a9e5eca10 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba10d19640 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e6144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba03fff640 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5eca10 0x555a9e5fb7b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4005c40 tx=0x7fb9f4005180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1681928c4f729ada server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba01ffb640 1 -- 172.21.15.16:0/2750873597 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f404b070 con 0x555a9e5eca10 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba01ffb640 1 -- 172.21.15.16:0/2750873597 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9f40053f0 con 0x555a9e5eca10 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.640+0000 7fba01ffb640 1 -- 172.21.15.16:0/2750873597 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f403f070 con 0x555a9e5eca10 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 -- 172.21.15.16:0/2750873597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5eca10 msgr2=0x555a9e5fb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5eca10 0x555a9e5fb7b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4005c40 tx=0x7fb9f4005180 comp rx=0 tx=0).stop 2024-09-10T23:44:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 -- 172.21.15.16:0/2750873597 shutdown_connections 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5fcdb0 0x555a9e6144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5eca10 0x555a9e5fb7b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 --2- 172.21.15.16:0/2750873597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e608cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 -- 172.21.15.16:0/2750873597 >> 172.21.15.16:0/2750873597 conn(0x555a9e5e9f20 msgr2=0x555a9e5fb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 -- 172.21.15.16:0/2750873597 shutdown_connections 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 -- 172.21.15.16:0/2750873597 wait complete. 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 -- start start 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.641+0000 7fba14b51740 1 Processor -- start 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba14b51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e605030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba14b51740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5eca10 0x555a9e6055b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba14b51740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5fcdb0 0x555a9e601dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba14b51740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1aab90 con 0x555a9e5eca10 2024-09-10T23:44:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba14b51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1ac000 con 0x555a9e5ec0f0 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba14b51740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1ab260 con 0x555a9e5fcdb0 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba14b51740 10 client.0 _ll_register_callbacks cb 0x7fba04009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5eca10 0x555a9e6055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba10d19640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5fcdb0 0x555a9e601dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba0bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e605030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5eca10 0x555a9e6055b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58288/0 (socket says 172.21.15.16:58288) 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba03fff640 1 -- 172.21.15.16:0/2293049426 learned_addr learned my addr 172.21.15.16:0/2293049426 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba10d19640 1 -- 172.21.15.16:0/2293049426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 msgr2=0x555a9e605030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba10d19640 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e605030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba10d19640 1 -- 172.21.15.16:0/2293049426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5eca10 msgr2=0x555a9e6055b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba10d19640 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5eca10 0x555a9e6055b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba10d19640 1 -- 172.21.15.16:0/2293049426 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9e602600 con 0x555a9e5fcdb0 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba03fff640 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5eca10 0x555a9e6055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:45.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fba10d19640 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5fcdb0 0x555a9e601dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba040045a0 tx=0x7fba04005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=367791e2ee380fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.642+0000 7fb9eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2293049426 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04023040 con 0x555a9e5fcdb0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9f40053f0 con 0x555a9e5fcdb0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2293049426 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fba0400f810 con 0x555a9e5fcdb0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2293049426 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba04044050 con 0x555a9e5fcdb0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 10 client.25849 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555a9e67a2e0 con 0x555a9e5fcdb0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2293049426 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9f40053f0 con 0x555a9e5fcdb0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2293049426 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba04003da0 con 0x555a9e5fcdb0 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 10 client.25849 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 10 client.25849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 20 client.25849 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e67aa90 0x555a9e67ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 4 client.25849 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.643+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a9e55dcd0 con 0x555a9e67aa90 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba0bfff640 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e67aa90 0x555a9e67ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba0bfff640 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e67aa90 0x555a9e67ceb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=530a1ac4ac9fa613 server_cookie=2da8ce87947bbbcd in_seq=0 out_seq=0 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fb9eb7fe640 10 client.25849 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fb9eb7fe640 1 -- 172.21.15.16:0/2293049426 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a9e55dcd0 con 0x555a9e67aa90 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fb9eb7fe640 10 client.25849 handle_command_reply: tid=0 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 client.25849 shutdown 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5fcdb0 msgr2=0x555a9e601dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5fcdb0 0x555a9e601dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba040045a0 tx=0x7fba04005bc0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 shutdown_connections 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x555a9e67aa90 0x555a9e67ceb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555a9e5fcdb0 0x555a9e601dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555a9e5eca10 0x555a9e6055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 --2- 172.21.15.16:0/2293049426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9e5ec0f0 0x555a9e605030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fb9eb7fe640 0 client.25849 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:45.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 >> 172.21.15.16:0/2293049426 conn(0x555a9e5e9f20 msgr2=0x555a9e5eb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:45.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 shutdown_connections 2024-09-10T23:44:45.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.644+0000 7fba14b51740 1 -- 172.21.15.16:0/2293049426 wait complete. 2024-09-10T23:44:45.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba14b51740 20 client.25849 trim_cache size 0 max 16384 2024-09-10T23:44:45.653 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:45.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb9f80b5450 msgr2=0x7fb9f80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb9f80b5450 0x7fb9f80b7910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fba04009370 tx=0x7fba04009720 comp rx=0 tx=0).stop 2024-09-10T23:44:45.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c102dc0 msgr2=0x7fba0c199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:45.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c102dc0 0x7fba0c199340 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00e9f0 tx=0x7fb9fc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 shutdown_connections 2024-09-10T23:44:45.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb9f80b5450 0x7fb9f80b7910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba0c109150 0x7fba0c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba0c1087d0 0x7fba0c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 --2- 172.21.15.16:0/1751289009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba0c102dc0 0x7fba0c199340 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:45.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 >> 172.21.15.16:0/1751289009 conn(0x7fba0c0fe830 msgr2=0x7fba0c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:45.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 shutdown_connections 2024-09-10T23:44:45.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:45.645+0000 7fba1277c640 1 -- 172.21.15.16:0/1751289009 wait complete. 2024-09-10T23:44:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:46 smithi016 ceph-mon[30855]: pgmap v456: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:44:46.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:46 smithi071 ceph-mon[35018]: pgmap v456: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:44:46.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:44:46.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:46 smithi066 ceph-mon[34761]: pgmap v456: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:44:46.810 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 -- 172.21.15.16:0/221324046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 msgr2=0x7f547c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 --2- 172.21.15.16:0/221324046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c10f560 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5474009900 tx=0x7f547402a410 comp rx=0 tx=0).stop 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 -- 172.21.15.16:0/221324046 shutdown_connections 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 --2- 172.21.15.16:0/221324046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c10f560 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 --2- 172.21.15.16:0/221324046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f547c1045c0 0x7f547c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 --2- 172.21.15.16:0/221324046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547c103ca0 0x7f547c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 -- 172.21.15.16:0/221324046 >> 172.21.15.16:0/221324046 conn(0x7f547c0fd700 msgr2=0x7f547c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:47.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 -- 172.21.15.16:0/221324046 shutdown_connections 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 -- 172.21.15.16:0/221324046 wait complete. 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 Processor -- start 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.374+0000 7f54818da640 1 -- start start 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f54818da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547c103ca0 0x7f547c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f54818da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f547c1045c0 0x7f547c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f54818da640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f54818da640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f547c112d70 con 0x7f547c10d100 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f54818da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f547c112bf0 con 0x7f547c1045c0 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f54818da640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f547c112ef0 con 0x7f547c103ca0 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58310/0 (socket says 172.21.15.16:58310) 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 -- 172.21.15.16:0/2859874925 learned_addr learned my addr 172.21.15.16:0/2859874925 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:47.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547affd640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547c103ca0 0x7f547c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547a7fc640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f547c1045c0 0x7f547c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 -- 172.21.15.16:0/2859874925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547c103ca0 msgr2=0x7f547c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547c103ca0 0x7f547c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 -- 172.21.15.16:0/2859874925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f547c1045c0 msgr2=0x7f547c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f547c1045c0 0x7f547c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 -- 172.21.15.16:0/2859874925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c19f310 con 0x7f547c10d100 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.375+0000 7f547b7fe640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c19eb40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5474004770 tx=0x7f5474004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.376+0000 7f54808d8640 1 -- 172.21.15.16:0/2859874925 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547403f030 con 0x7f547c10d100 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.376+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c19f5a0 con 0x7f547c10d100 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.376+0000 7f54808d8640 1 -- 172.21.15.16:0/2859874925 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5474003aa0 con 0x7f547c10d100 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.376+0000 7f54808d8640 1 -- 172.21.15.16:0/2859874925 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474035070 con 0x7f547c10d100 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.376+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c1a5cc0 con 0x7f547c10d100 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.378+0000 7f5483caf740 1 Processor -- start 2024-09-10T23:44:47.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.378+0000 7f54808d8640 1 -- 172.21.15.16:0/2859874925 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f547403bb80 con 0x7f547c10d100 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.378+0000 7f5483caf740 1 -- start start 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.378+0000 7f5483caf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.378+0000 7f5483caf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2dbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f5483caf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f5483caf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56337d241ea0 con 0x56337d2dc190 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f5483caf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56337d2312d0 con 0x56337d2cb4d0 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f5483caf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56337d2350e0 con 0x56337d2cbdf0 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58320/0 (socket says 172.21.15.16:58320) 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 -- 172.21.15.16:0/3145252713 learned_addr learned my addr 172.21.15.16:0/3145252713 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547affd640 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2dbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 -- 172.21.15.16:0/3145252713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 msgr2=0x56337d2dbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2dbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 -- 172.21.15.16:0/3145252713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 msgr2=0x56337d2cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 -- 172.21.15.16:0/3145252713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56337cf8f650 con 0x56337d2dc190 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f54808d8640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f54640b5450 0x7f54640b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547a7fc640 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2de580 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5470012780 tx=0x7f5470004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec93c99802e4d2be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f547affd640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f54640b5450 0x7f54640b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f54808d8640 1 -- 172.21.15.16:0/2859874925 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5474106410 con 0x7f547c10d100 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.379+0000 7f5461ffb640 1 -- 172.21.15.16:0/3145252713 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470012d00 con 0x56337d2dc190 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5461ffb640 1 -- 172.21.15.16:0/3145252713 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5470010770 con 0x56337d2dc190 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5461ffb640 1 -- 172.21.15.16:0/3145252713 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54700044e0 con 0x56337d2dc190 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 -- 172.21.15.16:0/3145252713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 msgr2=0x56337d2de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2de580 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5470012780 tx=0x7f5470004730 comp rx=0 tx=0).stop 2024-09-10T23:44:47.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f547affd640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f54640b5450 0x7f54640b7910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56337d2cf710 tx=0x7f546c009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 -- 172.21.15.16:0/3145252713 shutdown_connections 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2de580 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2dbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 --2- 172.21.15.16:0/3145252713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 -- 172.21.15.16:0/3145252713 >> 172.21.15.16:0/3145252713 conn(0x56337d2c9300 msgr2=0x56337d2ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 -- 172.21.15.16:0/3145252713 shutdown_connections 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.380+0000 7f5483caf740 1 -- 172.21.15.16:0/3145252713 wait complete. 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 -- start start 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 Processor -- start 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2dba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2d93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56337d092700 con 0x56337d2dc190 2024-09-10T23:44:47.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56337d1cc160 con 0x56337d2cb4d0 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56337d2dee40 con 0x56337d2cbdf0 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f5483caf740 10 client.0 _ll_register_callbacks cb 0x56337d1e59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2d93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2d93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58332/0 (socket says 172.21.15.16:58332) 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f547b7fe640 1 -- 172.21.15.16:0/1221372925 learned_addr learned my addr 172.21.15.16:0/1221372925 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f547affd640 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.381+0000 7f547a7fc640 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f547b7fe640 1 -- 172.21.15.16:0/1221372925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 msgr2=0x56337d2d8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f547b7fe640 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2d8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f547b7fe640 1 -- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 msgr2=0x56337d2dba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f547b7fe640 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2dba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f547b7fe640 1 -- 172.21.15.16:0/1221372925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337d1f9c90 con 0x56337d2dc190 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f547b7fe640 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2d93d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5474031440 tx=0x7f54740c9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4f727ba28ea39d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:47.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f545affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f545affd640 1 -- 172.21.15.16:0/1221372925 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474049040 con 0x56337d2dc190 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f545affd640 1 -- 172.21.15.16:0/1221372925 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f54740ccc00 con 0x56337d2dc190 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5470010770 con 0x56337d2dc190 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f545affd640 1 -- 172.21.15.16:0/1221372925 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f54740cc2f0 con 0x56337d2dc190 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f5483caf740 10 client.16254 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56337d2ea750 con 0x56337d2dc190 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.382+0000 7f545affd640 1 -- 172.21.15.16:0/1221372925 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54740b6020 con 0x56337d2dc190 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f545affd640 1 -- 172.21.15.16:0/1221372925 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f54740d59f0 con 0x56337d2dc190 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f5483caf740 10 client.16254 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f5483caf740 10 client.16254 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f5483caf740 20 client.16254 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f5483caf740 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d2ebca0 0x56337d2ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f5483caf740 4 client.16254 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56337d243df0 con 0x56337d2ebca0 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f547affd640 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d2ebca0 0x56337d2ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f545affd640 10 client.16254 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.383+0000 7f547affd640 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d2ebca0 0x56337d2ee0d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13064de1b9b050b server_cookie=c98e271b011d7e0a in_seq=0 out_seq=0 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f545affd640 1 -- 172.21.15.16:0/1221372925 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56337d243df0 con 0x56337d2ebca0 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f545affd640 10 client.16254 handle_command_reply: tid=0 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 client.16254 shutdown 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 msgr2=0x56337d2d93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2d93d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5474031440 tx=0x7f54740c9070 comp rx=0 tx=0).stop 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 shutdown_connections 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d2ebca0 0x56337d2ee0d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2dc190 0x56337d2d93d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f545affd640 0 client.16254 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2d8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 --2- 172.21.15.16:0/1221372925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cb4d0 0x56337d2dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 >> 172.21.15.16:0/1221372925 conn(0x56337d2c9300 msgr2=0x56337d2cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:47.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 shutdown_connections 2024-09-10T23:44:47.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.384+0000 7f5483caf740 1 -- 172.21.15.16:0/1221372925 wait complete. 2024-09-10T23:44:47.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.385+0000 7f5483caf740 20 client.16254 trim_cache size 0 max 16384 2024-09-10T23:44:47.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 Processor -- start 2024-09-10T23:44:47.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 -- start start 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2dc190 0x56337d2ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1aec10 con 0x56337d2cb4d0 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1ac4e0 con 0x56337d2dc190 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f5483caf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1aa350 con 0x56337d2cbdf0 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f547affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f547affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58348/0 (socket says 172.21.15.16:58348) 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.398+0000 7f547affd640 1 -- 172.21.15.16:0/2059140331 learned_addr learned my addr 172.21.15.16:0/2059140331 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547a7fc640 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547b7fe640 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2dc190 0x56337d2ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547affd640 1 -- 172.21.15.16:0/2059140331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 msgr2=0x56337d2ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547affd640 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547affd640 1 -- 172.21.15.16:0/2059140331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2dc190 msgr2=0x56337d2ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547affd640 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2dc190 0x56337d2ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547affd640 1 -- 172.21.15.16:0/2059140331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56337d2ee750 con 0x56337d2cb4d0 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547a7fc640 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547b7fe640 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2dc190 0x56337d2ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f547affd640 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e80d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f546c003b50 tx=0x7f546c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972ded2cb3a6fca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f54617fa640 1 -- 172.21.15.16:0/2059140331 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c02f070 con 0x56337d2cb4d0 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f54617fa640 1 -- 172.21.15.16:0/2059140331 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c003b80 con 0x56337d2cb4d0 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.399+0000 7f54617fa640 1 -- 172.21.15.16:0/2059140331 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c0209b0 con 0x56337d2cb4d0 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 -- 172.21.15.16:0/2059140331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 msgr2=0x56337d2e80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e80d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f546c003b50 tx=0x7f546c016000 comp rx=0 tx=0).stop 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 -- 172.21.15.16:0/2059140331 shutdown_connections 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2dc190 0x56337d2ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2cbdf0 0x56337d2ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 --2- 172.21.15.16:0/2059140331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e80d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 -- 172.21.15.16:0/2059140331 >> 172.21.15.16:0/2059140331 conn(0x56337d2c9300 msgr2=0x56337d2ddf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 -- 172.21.15.16:0/2059140331 shutdown_connections 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 -- 172.21.15.16:0/2059140331 wait complete. 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.400+0000 7f5483caf740 1 -- start start 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 1 Processor -- start 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cbdf0 0x56337d2e4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2dc190 0x56337d2e1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1aa9a0 con 0x56337d2cb4d0 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1abe10 con 0x56337d2cbdf0 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f547c1ab070 con 0x56337d2dc190 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f5483caf740 10 client.0 _ll_register_callbacks cb 0x7f547403b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58364/0 (socket says 172.21.15.16:58364) 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 -- 172.21.15.16:0/283700617 learned_addr learned my addr 172.21.15.16:0/283700617 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547b7fe640 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2dc190 0x56337d2e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547a7fc640 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cbdf0 0x56337d2e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 -- 172.21.15.16:0/283700617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2dc190 msgr2=0x56337d2e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2dc190 0x56337d2e1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 -- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cbdf0 msgr2=0x56337d2e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cbdf0 0x56337d2e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.401+0000 7f547affd640 1 -- 172.21.15.16:0/283700617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337d2e4ee0 con 0x56337d2cb4d0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f547affd640 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e4130 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f546c003de0 tx=0x7f546c004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f619bf4cd05981d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f545affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f545affd640 1 -- 172.21.15.16:0/283700617 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c025030 con 0x56337d2cb4d0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f545affd640 1 -- 172.21.15.16:0/283700617 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f546c020730 con 0x56337d2cb4d0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c003b80 con 0x56337d2cb4d0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f545affd640 1 -- 172.21.15.16:0/283700617 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f546c02f040 con 0x56337d2cb4d0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f5483caf740 10 client.16260 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56337d3591c0 con 0x56337d2cb4d0 2024-09-10T23:44:47.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f545affd640 1 -- 172.21.15.16:0/283700617 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c003b80 con 0x56337d2cb4d0 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f545affd640 1 -- 172.21.15.16:0/283700617 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f546c00f040 con 0x56337d2cb4d0 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f5483caf740 10 client.16260 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f5483caf740 10 client.16260 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f5483caf740 20 client.16260 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.402+0000 7f5483caf740 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d359820 0x56337d35bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f5483caf740 4 client.16260 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56337d23f8a0 con 0x56337d359820 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f547a7fc640 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d359820 0x56337d35bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f545affd640 10 client.16260 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f547a7fc640 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d359820 0x56337d35bc10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b35bdf50dbd7c595 server_cookie=2bf480e052a0d2c8 in_seq=0 out_seq=0 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f545affd640 1 -- 172.21.15.16:0/283700617 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56337d23f8a0 con 0x56337d359820 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f545affd640 10 client.16260 handle_command_reply: tid=0 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.403+0000 7f5483caf740 1 client.16260 shutdown 2024-09-10T23:44:47.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 msgr2=0x56337d2e4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e4130 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f546c003de0 tx=0x7f546c004db0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 shutdown_connections 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x56337d359820 0x56337d35bc10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56337d2dc190 0x56337d2e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56337d2cbdf0 0x56337d2e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f545affd640 0 client.16260 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 --2- 172.21.15.16:0/283700617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56337d2cb4d0 0x56337d2e4130 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 >> 172.21.15.16:0/283700617 conn(0x56337d2c9300 msgr2=0x56337d2ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 shutdown_connections 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 1 -- 172.21.15.16:0/283700617 wait complete. 2024-09-10T23:44:47.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f5483caf740 20 client.16260 trim_cache size 0 max 16384 2024-09-10T23:44:47.413 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:47.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f54640b5450 msgr2=0x7f54640b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f54640b5450 0x7f54640b7910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56337d2cf710 tx=0x7f546c009680 comp rx=0 tx=0).stop 2024-09-10T23:44:47.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 msgr2=0x7f547c19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c19eb40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5474004770 tx=0x7f5474004270 comp rx=0 tx=0).stop 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 shutdown_connections 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f547c10d100 0x7f547c19eb40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f54640b5450 0x7f54640b7910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f547c1045c0 0x7f547c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 --2- 172.21.15.16:0/2859874925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547c103ca0 0x7f547c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.404+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 >> 172.21.15.16:0/2859874925 conn(0x7f547c0fd700 msgr2=0x7f547c10f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.405+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 shutdown_connections 2024-09-10T23:44:47.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:47.405+0000 7f54818da640 1 -- 172.21.15.16:0/2859874925 wait complete. 2024-09-10T23:44:48.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:44:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:48 smithi071 ceph-mon[35018]: pgmap v457: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:48.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:48 smithi066 ceph-mon[34761]: pgmap v457: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:48.565 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:48.687 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:48 smithi016 ceph-mon[30855]: pgmap v457: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:44:49.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 -- 172.21.15.16:0/3567783876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11810d140 msgr2=0x7fd11810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 --2- 172.21.15.16:0/3567783876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11810d140 0x7fd11810f5a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd110009ca0 tx=0x7fd11002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 -- 172.21.15.16:0/3567783876 shutdown_connections 2024-09-10T23:44:49.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 --2- 172.21.15.16:0/3567783876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11810d140 0x7fd11810f5a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 --2- 172.21.15.16:0/3567783876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd118104600 0x7fd11810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 --2- 172.21.15.16:0/3567783876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd118103ce0 0x7fd1181040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 -- 172.21.15.16:0/3567783876 >> 172.21.15.16:0/3567783876 conn(0x7fd1180fd700 msgr2=0x7fd1180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 -- 172.21.15.16:0/3567783876 shutdown_connections 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.000+0000 7fd11d29a640 1 -- 172.21.15.16:0/3567783876 wait complete. 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 Processor -- start 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 -- start start 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd118103ce0 0x7fd118101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd118104600 0x7fd118101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11810d140 0x7fd118102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd118112db0 con 0x7fd118103ce0 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd118112c30 con 0x7fd118104600 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd11d29a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd118112f30 con 0x7fd11810d140 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.001+0000 7fd116ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd118103ce0 0x7fd118101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd118103ce0 0x7fd118101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58378/0 (socket says 172.21.15.16:58378) 2024-09-10T23:44:49.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 -- 172.21.15.16:0/2271048399 learned_addr learned my addr 172.21.15.16:0/2271048399 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd1177fe640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11810d140 0x7fd118102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd1167fc640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd118104600 0x7fd118101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 -- 172.21.15.16:0/2271048399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11810d140 msgr2=0x7fd118102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11810d140 0x7fd118102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 -- 172.21.15.16:0/2271048399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd118104600 msgr2=0x7fd118101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd118104600 0x7fd118101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 -- 172.21.15.16:0/2271048399 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1181a7680 con 0x7fd118103ce0 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd1167fc640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd118104600 0x7fd118101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd116ffd640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd118103ce0 0x7fd118101990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd10800d950 tx=0x7fd10800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd0fffff640 1 -- 172.21.15.16:0/2271048399 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108017030 con 0x7fd118103ce0 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1181a7970 con 0x7fd118103ce0 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd0fffff640 1 -- 172.21.15.16:0/2271048399 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd108004020 con 0x7fd118103ce0 2024-09-10T23:44:49.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd0fffff640 1 -- 172.21.15.16:0/2271048399 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1080047a0 con 0x7fd118103ce0 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.002+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1181a7f00 con 0x7fd118103ce0 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 Processor -- start 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 -- start start 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd0fffff640 1 -- 172.21.15.16:0/2271048399 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd108009a30 con 0x7fd118103ce0 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d9140c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91418840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555d91382ea0 con 0x555d9140c4d0 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555d913722d0 con 0x555d9140cdf0 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd11f66f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555d913760e0 con 0x555d91418d80 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d9140c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.005+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d9140c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58392/0 (socket says 172.21.15.16:58392) 2024-09-10T23:44:49.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1177fe640 1 -- 172.21.15.16:0/153379947 learned_addr learned my addr 172.21.15.16:0/153379947 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd116ffd640 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91418840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1167fc640 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1177fe640 1 -- 172.21.15.16:0/153379947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 msgr2=0x555d9141b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1177fe640 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1177fe640 1 -- 172.21.15.16:0/153379947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 msgr2=0x555d91418840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1177fe640 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91418840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1177fe640 1 -- 172.21.15.16:0/153379947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d910d0650 con 0x555d9140c4d0 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd0fffff640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1000b5450 0x7fd1000b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd1177fe640 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d9140c8b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd110009ca0 tx=0x7fd1100098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6418cc97a333c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd116ffd640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1000b5450 0x7fd1000b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd0fd7fa640 1 -- 172.21.15.16:0/153379947 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110031db0 con 0x555d9140c4d0 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd0fd7fa640 1 -- 172.21.15.16:0/153379947 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd110036030 con 0x555d9140c4d0 2024-09-10T23:44:49.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd0fd7fa640 1 -- 172.21.15.16:0/153379947 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110004240 con 0x555d9140c4d0 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.006+0000 7fd0fffff640 1 -- 172.21.15.16:0/2271048399 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd1080e5a60 con 0x7fd118103ce0 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 -- 172.21.15.16:0/153379947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 msgr2=0x555d9140c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd116ffd640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1000b5450 0x7fd1000b7910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd1080e32c0 tx=0x7fd108093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d9140c8b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd110009ca0 tx=0x7fd1100098b0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 -- 172.21.15.16:0/153379947 shutdown_connections 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91418840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 --2- 172.21.15.16:0/153379947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d9140c8b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 -- 172.21.15.16:0/153379947 >> 172.21.15.16:0/153379947 conn(0x555d9140a300 msgr2=0x555d9140b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 -- 172.21.15.16:0/153379947 shutdown_connections 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.007+0000 7fd11f66f740 1 -- 172.21.15.16:0/153379947 wait complete. 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 -- start start 2024-09-10T23:44:49.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 Processor -- start 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91418640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91415a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d91416070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555d911d3700 con 0x555d9140c4d0 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555d9130d160 con 0x555d9140cdf0 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555d9141b820 con 0x555d91418d80 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd11f66f740 10 client.0 _ll_register_callbacks cb 0x555d913269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91418640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91418640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58406/0 (socket says 172.21.15.16:58406) 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 -- 172.21.15.16:0/3683232750 learned_addr learned my addr 172.21.15.16:0/3683232750 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d91416070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1167fc640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91415a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 -- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 msgr2=0x555d91416070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d91416070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 -- 172.21.15.16:0/3683232750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 msgr2=0x555d91415a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91415a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1177fe640 1 -- 172.21.15.16:0/3683232750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9133ac90 con 0x555d9140c4d0 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.008+0000 7fd1167fc640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91415a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd1177fe640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91418640 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd110009620 tx=0x7fd110003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e064326822ccf23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd0faff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd0faff5640 1 -- 172.21.15.16:0/3683232750 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110058060 con 0x555d9140c4d0 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd0faff5640 1 -- 172.21.15.16:0/3683232750 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd11002f660 con 0x555d9140c4d0 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd110036030 con 0x555d9140c4d0 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd0faff5640 1 -- 172.21.15.16:0/3683232750 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd11002f860 con 0x555d9140c4d0 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 10 client.16272 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d91427120 con 0x555d9140c4d0 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd0faff5640 1 -- 172.21.15.16:0/3683232750 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd110036030 con 0x555d9140c4d0 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd0faff5640 1 -- 172.21.15.16:0/3683232750 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd110043070 con 0x555d9140c4d0 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 10 client.16272 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 20 client.16272 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91428470 0x555d9142a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 4 client.16272 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.009+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d91384df0 con 0x555d91428470 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.010+0000 7fd1167fc640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91428470 0x555d9142a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.010+0000 7fd1167fc640 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91428470 0x555d9142a860 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9debaae4be9502ba server_cookie=a789f28e8501c1bc in_seq=0 out_seq=0 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.010+0000 7fd0faff5640 10 client.16272 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd0faff5640 1 -- 172.21.15.16:0/3683232750 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d91384df0 con 0x555d91428470 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd0faff5640 10 client.16272 handle_command_reply: tid=0 2024-09-10T23:44:49.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 client.16272 shutdown 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 msgr2=0x555d91418640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91418640 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd110009620 tx=0x7fd110003ce0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 shutdown_connections 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91428470 0x555d9142a860 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d91416070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91415a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd0faff5640 0 client.16272 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 --2- 172.21.15.16:0/3683232750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91418640 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 >> 172.21.15.16:0/3683232750 conn(0x555d9140a300 msgr2=0x555d9140fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 shutdown_connections 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 1 -- 172.21.15.16:0/3683232750 wait complete. 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.011+0000 7fd11f66f740 20 client.16272 trim_cache size 0 max 16384 2024-09-10T23:44:49.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.024+0000 7fd11f66f740 1 Processor -- start 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.024+0000 7fd11f66f740 1 -- start start 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d9140c4d0 0x555d91424a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d9140bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d91418d80 0x555d9141a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd11f66f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b3030 con 0x555d91418d80 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd11f66f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b0900 con 0x555d9140cdf0 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd11f66f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181ae750 con 0x555d9140c4d0 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d91418d80 0x555d9141a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d91418d80 0x555d9141a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58410/0 (socket says 172.21.15.16:58410) 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 -- 172.21.15.16:0/439318809 learned_addr learned my addr 172.21.15.16:0/439318809 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1167fc640 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d9140bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d9140c4d0 0x555d91424a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 -- 172.21.15.16:0/439318809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d9140c4d0 msgr2=0x555d91424a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d9140c4d0 0x555d91424a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 -- 172.21.15.16:0/439318809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 msgr2=0x555d9140bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d9140bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 -- 172.21.15.16:0/439318809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d91413f90 con 0x555d91418d80 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd1177fe640 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d91418d80 0x555d9141a170 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd11002ade0 tx=0x7fd11002f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3914ef80b69cfc24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd0fcff9640 1 -- 172.21.15.16:0/439318809 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110005cc0 con 0x555d91418d80 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd0fcff9640 1 -- 172.21.15.16:0/439318809 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd110036040 con 0x555d91418d80 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.025+0000 7fd0fcff9640 1 -- 172.21.15.16:0/439318809 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110003d50 con 0x555d91418d80 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 -- 172.21.15.16:0/439318809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d91418d80 msgr2=0x555d9141a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d91418d80 0x555d9141a170 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd11002ade0 tx=0x7fd11002f310 comp rx=0 tx=0).stop 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 -- 172.21.15.16:0/439318809 shutdown_connections 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d91418d80 0x555d9141a170 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d9140bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 --2- 172.21.15.16:0/439318809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d9140c4d0 0x555d91424a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 -- 172.21.15.16:0/439318809 >> 172.21.15.16:0/439318809 conn(0x555d9140a300 msgr2=0x555d9140b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 -- 172.21.15.16:0/439318809 shutdown_connections 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 -- 172.21.15.16:0/439318809 wait complete. 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.026+0000 7fd11f66f740 1 -- start start 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 1 Processor -- start 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91420ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91421000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181aedc0 con 0x555d9140c4d0 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181b0230 con 0x555d9140cdf0 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181af490 con 0x555d91418d80 2024-09-10T23:44:49.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd11f66f740 10 client.0 _ll_register_callbacks cb 0x7fd1080e9480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91420ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91420ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58412/0 (socket says 172.21.15.16:58412) 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 -- 172.21.15.16:0/2000479824 learned_addr learned my addr 172.21.15.16:0/2000479824 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1167fc640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91421000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 -- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 msgr2=0x555d9141ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 -- 172.21.15.16:0/2000479824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 msgr2=0x555d91421000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91421000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1177fe640 1 -- 172.21.15.16:0/2000479824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9141bfb0 con 0x555d9140c4d0 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.027+0000 7fd1167fc640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91421000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:49.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd1177fe640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91420ac0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd110009430 tx=0x7fd11002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddb7479ce0d7cea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd0faff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd0faff5640 1 -- 172.21.15.16:0/2000479824 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110031450 con 0x555d9140c4d0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd0faff5640 1 -- 172.21.15.16:0/2000479824 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd11002fb10 con 0x555d9140c4d0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd110036040 con 0x555d9140c4d0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd0faff5640 1 -- 172.21.15.16:0/2000479824 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd11002fd10 con 0x555d9140c4d0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 10 client.16278 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d91495910 con 0x555d9140c4d0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd0faff5640 1 -- 172.21.15.16:0/2000479824 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd110036040 con 0x555d9140c4d0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd0faff5640 1 -- 172.21.15.16:0/2000479824 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd110043070 con 0x555d9140c4d0 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 10 client.16278 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 20 client.16278 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91495dc0 0x555d914981e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 4 client.16278 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.028+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d913808a0 con 0x555d91495dc0 2024-09-10T23:44:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.029+0000 7fd1167fc640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91495dc0 0x555d914981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.029+0000 7fd0faff5640 10 client.16278 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.029+0000 7fd1167fc640 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91495dc0 0x555d914981e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71ef171e47f69e9 server_cookie=c54665428c2da791 in_seq=0 out_seq=0 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.029+0000 7fd0faff5640 1 -- 172.21.15.16:0/2000479824 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d913808a0 con 0x555d91495dc0 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.029+0000 7fd0faff5640 10 client.16278 handle_command_reply: tid=0 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.029+0000 7fd11f66f740 1 client.16278 shutdown 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 msgr2=0x555d91420ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91420ac0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd110009430 tx=0x7fd11002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 shutdown_connections 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555d91495dc0 0x555d914981e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555d91418d80 0x555d9141ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555d9140cdf0 0x555d91421000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd0faff5640 0 client.16278 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 --2- 172.21.15.16:0/2000479824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d9140c4d0 0x555d91420ac0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 >> 172.21.15.16:0/2000479824 conn(0x555d9140a300 msgr2=0x555d914170c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 shutdown_connections 2024-09-10T23:44:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 1 -- 172.21.15.16:0/2000479824 wait complete. 2024-09-10T23:44:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11f66f740 20 client.16278 trim_cache size 0 max 16384 2024-09-10T23:44:49.049 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1000b5450 msgr2=0x7fd1000b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11d29a640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1000b5450 0x7fd1000b7910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd1080e32c0 tx=0x7fd108093040 comp rx=0 tx=0).stop 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd118103ce0 msgr2=0x7fd118101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.030+0000 7fd11d29a640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd118103ce0 0x7fd118101990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd10800d950 tx=0x7fd10800de10 comp rx=0 tx=0).stop 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 shutdown_connections 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd11810d140 0x7fd118102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1000b5450 0x7fd1000b7910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd118104600 0x7fd118101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 --2- 172.21.15.16:0/2271048399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd118103ce0 0x7fd118101990 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 >> 172.21.15.16:0/2271048399 conn(0x7fd1180fd700 msgr2=0x7fd1180fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 shutdown_connections 2024-09-10T23:44:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:49.031+0000 7fd11d29a640 1 -- 172.21.15.16:0/2271048399 wait complete. 2024-09-10T23:44:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:50 smithi071 ceph-mon[35018]: pgmap v458: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:50.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:50 smithi066 ceph-mon[34761]: pgmap v458: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:50.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:50 smithi016 ceph-mon[30855]: pgmap v458: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:44:50.884 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:44:50.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:44:51.154 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:51.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 -- 172.21.15.16:0/4978616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 msgr2=0x7fb8fc101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 --2- 172.21.15.16:0/4978616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc101bf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009ca0 tx=0x7fb8ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 -- 172.21.15.16:0/4978616 shutdown_connections 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 --2- 172.21.15.16:0/4978616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8fc10d250 0x7fb8fc10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 --2- 172.21.15.16:0/4978616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8fc10a920 0x7fb8fc10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 --2- 172.21.15.16:0/4978616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc101bf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 -- 172.21.15.16:0/4978616 >> 172.21.15.16:0/4978616 conn(0x7fb8fc076f50 msgr2=0x7fb8fc077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 -- 172.21.15.16:0/4978616 shutdown_connections 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 -- 172.21.15.16:0/4978616 wait complete. 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.648+0000 7fb900c7b640 1 Processor -- start 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb900c7b640 1 -- start start 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb900c7b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb900c7b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8fc10a920 0x7fb8fc199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb900c7b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8fc10d250 0x7fb8fc19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb900c7b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc112d90 con 0x7fb8fc101810 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb900c7b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc112c10 con 0x7fb8fc10a920 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb900c7b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc112f10 con 0x7fb8fc10d250 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58428/0 (socket says 172.21.15.16:58428) 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 -- 172.21.15.16:0/2782822275 learned_addr learned my addr 172.21.15.16:0/2782822275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8fc10d250 0x7fb8fc19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8fc10a920 0x7fb8fc199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 -- 172.21.15.16:0/2782822275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8fc10d250 msgr2=0x7fb8fc19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8fc10d250 0x7fb8fc19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 -- 172.21.15.16:0/2782822275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8fc10a920 msgr2=0x7fb8fc199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8fc10a920 0x7fb8fc199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 -- 172.21.15.16:0/2782822275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc19f2f0 con 0x7fb8fc101810 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8fc10d250 0x7fb8fc19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.649+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc199240 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec006010 tx=0x7fb8ec0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.650+0000 7fb8eb7fe640 1 -- 172.21.15.16:0/2782822275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec003bf0 con 0x7fb8fc101810 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.650+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc19f580 con 0x7fb8fc101810 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.650+0000 7fb8eb7fe640 1 -- 172.21.15.16:0/2782822275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8ec003d90 con 0x7fb8fc101810 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.650+0000 7fb8eb7fe640 1 -- 172.21.15.16:0/2782822275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec02fc20 con 0x7fb8fc101810 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.650+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc1a5ca0 con 0x7fb8fc101810 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.652+0000 7fb8eb7fe640 1 -- 172.21.15.16:0/2782822275 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb8ec0046a0 con 0x7fb8fc101810 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.652+0000 7fb903050740 1 Processor -- start 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb903050740 1 -- start start 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb903050740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db8f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb903050740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db9b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb903050740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34db9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb903050740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d34db05e60 con 0x55d34db8eee0 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb903050740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d34daf5290 con 0x55d34db8f800 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb903050740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d34daf90a0 con 0x55d34db9b790 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db8f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db8f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58434/0 (socket says 172.21.15.16:58434) 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fad9d640 1 -- 172.21.15.16:0/2790269459 learned_addr learned my addr 172.21.15.16:0/2790269459 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db9b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34db9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fad9d640 1 -- 172.21.15.16:0/2790269459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 msgr2=0x55d34db9db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34db9db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fad9d640 1 -- 172.21.15.16:0/2790269459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 msgr2=0x55d34db9b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8eb7fe640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8e40b5450 0x7fb8e40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.653+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db9b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8fad9d640 1 -- 172.21.15.16:0/2790269459 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34d853930 con 0x55d34db8eee0 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db9b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8eb7fe640 1 -- 172.21.15.16:0/2782822275 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb8ec1073e0 con 0x7fb8fc101810 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8e40b5450 0x7fb8e40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db8f2c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400bd20 tx=0x7fb8f400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ae6d8290773134 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8e8ff9640 1 -- 172.21.15.16:0/2790269459 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4021070 con 0x55d34db8eee0 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8e8ff9640 1 -- 172.21.15.16:0/2790269459 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f401bd90 con 0x55d34db8eee0 2024-09-10T23:44:51.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.654+0000 7fb8e8ff9640 1 -- 172.21.15.16:0/2790269459 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4015070 con 0x55d34db8eee0 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 -- 172.21.15.16:0/2790269459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 msgr2=0x55d34db8f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db8f2c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400bd20 tx=0x7fb8f400f730 comp rx=0 tx=0).stop 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8e40b5450 0x7fb8e40b7910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400bfd0 tx=0x7fb8f4021000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 -- 172.21.15.16:0/2790269459 shutdown_connections 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34db9db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db9b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 --2- 172.21.15.16:0/2790269459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db8f2c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 -- 172.21.15.16:0/2790269459 >> 172.21.15.16:0/2790269459 conn(0x55d34db8cd10 msgr2=0x55d34db8deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 -- 172.21.15.16:0/2790269459 shutdown_connections 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 -- 172.21.15.16:0/2790269459 wait complete. 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 -- start start 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.655+0000 7fb903050740 1 Processor -- start 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb903050740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8eee0 0x55d34db98750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb903050740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8f800 0x55d34db98c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb903050740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db9b790 0x55d34db991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb903050740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d34d956890 con 0x55d34db9b790 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb903050740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d34da8fd40 con 0x55d34db8eee0 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb903050740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d34db9e440 con 0x55d34db8f800 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb903050740 10 client.0 _ll_register_callbacks cb 0x55d34daf3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db9b790 0x55d34db991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db9b790 0x55d34db991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58446/0 (socket says 172.21.15.16:58446) 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 -- 172.21.15.16:0/621522149 learned_addr learned my addr 172.21.15.16:0/621522149 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8f800 0x55d34db98c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8eee0 0x55d34db98750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 -- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8f800 msgr2=0x55d34db98c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8f800 0x55d34db98c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 -- 172.21.15.16:0/621522149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8eee0 msgr2=0x55d34db98750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8eee0 0x55d34db98750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 -- 172.21.15.16:0/621522149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34dba7850 con 0x55d34db9b790 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db9b790 0x55d34db991d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb8f401bf80 tx=0x7fb8f400b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d974e5d8ad6beb46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.656+0000 7fb8e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/621522149 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4015070 con 0x55d34db9b790 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/621522149 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb8f4010b20 con 0x55d34db9b790 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8f401bd90 con 0x55d34db9b790 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/621522149 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8f4010d20 con 0x55d34db9b790 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 10 client.16290 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d34dbaa200 con 0x55d34db9b790 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/621522149 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f401bd90 con 0x55d34db9b790 2024-09-10T23:44:51.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/621522149 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8f402d070 con 0x55d34db9b790 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 10 client.16290 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 20 client.16290 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dbab5b0 0x55d34dbad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 4 client.16290 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.657+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d34db07db0 con 0x55d34dbab5b0 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.658+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dbab5b0 0x55d34dbad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.658+0000 7fb8e1ffb640 10 client.16290 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.658+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dbab5b0 0x55d34dbad9c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8114acd0646ab412 server_cookie=8fe444976717b96f in_seq=0 out_seq=0 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/621522149 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d34db07db0 con 0x55d34dbab5b0 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb8e1ffb640 10 client.16290 handle_command_reply: tid=0 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 client.16290 shutdown 2024-09-10T23:44:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db9b790 msgr2=0x55d34db991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db9b790 0x55d34db991d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb8f401bf80 tx=0x7fb8f400b7a0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 shutdown_connections 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dbab5b0 0x55d34dbad9c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db9b790 0x55d34db991d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb8e1ffb640 0 client.16290 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8f800 0x55d34db98c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 --2- 172.21.15.16:0/621522149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8eee0 0x55d34db98750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 >> 172.21.15.16:0/621522149 conn(0x55d34db8cd10 msgr2=0x55d34db8bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 shutdown_connections 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 1 -- 172.21.15.16:0/621522149 wait complete. 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.659+0000 7fb903050740 20 client.16290 trim_cache size 0 max 16384 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.676+0000 7fb903050740 1 Processor -- start 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb903050740 1 -- start start 2024-09-10T23:44:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb903050740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db95960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb903050740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db95ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb903050740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34dbb3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb903050740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1b0e80 con 0x55d34db8eee0 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb903050740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1ae750 con 0x55d34db8f800 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb903050740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1ac5a0 con 0x55d34db9b790 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db95960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db95960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58456/0 (socket says 172.21.15.16:58456) 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 -- 172.21.15.16:0/1113039659 learned_addr learned my addr 172.21.15.16:0/1113039659 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34dbb3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db95ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 -- 172.21.15.16:0/1113039659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 msgr2=0x55d34dbb3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34dbb3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 -- 172.21.15.16:0/1113039659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 msgr2=0x55d34db95ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db95ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 -- 172.21.15.16:0/1113039659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34db92f80 con 0x55d34db8eee0 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db95ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.677+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db95960 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0caad0 tx=0x7fb8ec109830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dce62e51a8223f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb8e3fff640 1 -- 172.21.15.16:0/1113039659 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0cd1b0 con 0x55d34db8eee0 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb8e3fff640 1 -- 172.21.15.16:0/1113039659 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8ec036040 con 0x55d34db8eee0 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb8e3fff640 1 -- 172.21.15.16:0/1113039659 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0ccfd0 con 0x55d34db8eee0 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 -- 172.21.15.16:0/1113039659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 msgr2=0x55d34db95960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db95960 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0caad0 tx=0x7fb8ec109830 comp rx=0 tx=0).stop 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 -- 172.21.15.16:0/1113039659 shutdown_connections 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db9b790 0x55d34dbb3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db8f800 0x55d34db95ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 --2- 172.21.15.16:0/1113039659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8eee0 0x55d34db95960 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 -- 172.21.15.16:0/1113039659 >> 172.21.15.16:0/1113039659 conn(0x55d34db8cd10 msgr2=0x55d34db9a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 -- 172.21.15.16:0/1113039659 shutdown_connections 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.678+0000 7fb903050740 1 -- 172.21.15.16:0/1113039659 wait complete. 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 -- start start 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 Processor -- start 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8eee0 0x55d34dba00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8f800 0x55d34dba0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db9b790 0x55d34dc11540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1acc10 con 0x55d34db8f800 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1ae080 con 0x55d34db9b790 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1ad2e0 con 0x55d34db8eee0 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb903050740 10 client.0 _ll_register_callbacks cb 0x7fb8f401f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb8f9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8f800 0x55d34dba0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb8f9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8f800 0x55d34dba0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58460/0 (socket says 172.21.15.16:58460) 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb8f9d9b640 1 -- 172.21.15.16:0/3432734781 learned_addr learned my addr 172.21.15.16:0/3432734781 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb8fad9d640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db9b790 0x55d34dc11540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.679+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8eee0 0x55d34dba00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8f9d9b640 1 -- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8eee0 msgr2=0x55d34dba00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8eee0 0x55d34dba00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8f9d9b640 1 -- 172.21.15.16:0/3432734781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db9b790 msgr2=0x55d34dc11540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db9b790 0x55d34dc11540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8f9d9b640 1 -- 172.21.15.16:0/3432734781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d34dc11c80 con 0x55d34db8f800 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8eee0 0x55d34dba00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8f9d9b640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8f800 0x55d34dba0690 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009d60 tx=0x7fb8f00127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ec921baf27efdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/3432734781 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0020060 con 0x55d34db8f800 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8ec036040 con 0x55d34db8f800 2024-09-10T23:44:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/3432734781 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb8f00105e0 con 0x55d34db8f800 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/3432734781 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8f00107e0 con 0x55d34db8f800 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb903050740 10 client.16296 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d34dc19090 con 0x55d34db8f800 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/3432734781 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8ec036040 con 0x55d34db8f800 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/3432734781 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8f000f040 con 0x55d34db8f800 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb903050740 10 client.16296 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.680+0000 7fb903050740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.681+0000 7fb903050740 20 client.16296 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.681+0000 7fb903050740 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dc19870 0x55d34dc1bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.681+0000 7fb903050740 4 client.16296 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.681+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d34db03860 con 0x55d34dc19870 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.681+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dc19870 0x55d34dc1bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.681+0000 7fb8e1ffb640 10 client.16296 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.681+0000 7fb8fa59c640 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dc19870 0x55d34dc1bc90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821b1d30fbc8d42a server_cookie=2e1cf97fa80d0ff4 in_seq=0 out_seq=0 2024-09-10T23:44:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb8e1ffb640 1 -- 172.21.15.16:0/3432734781 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d34db03860 con 0x55d34dc19870 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb8e1ffb640 10 client.16296 handle_command_reply: tid=0 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 client.16296 shutdown 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8f800 msgr2=0x55d34dba0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8f800 0x55d34dba0690 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009d60 tx=0x7fb8f00127c0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 shutdown_connections 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d34dc19870 0x55d34dc1bc90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d34db9b790 0x55d34dc11540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d34db8f800 0x55d34dba0690 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 --2- 172.21.15.16:0/3432734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d34db8eee0 0x55d34dba00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 >> 172.21.15.16:0/3432734781 conn(0x55d34db8cd10 msgr2=0x55d34db8b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb8e1ffb640 0 client.16296 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.683+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 shutdown_connections 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb903050740 1 -- 172.21.15.16:0/3432734781 wait complete. 2024-09-10T23:44:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb903050740 20 client.16296 trim_cache size 0 max 16384 2024-09-10T23:44:51.709 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:44:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:44:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "69534c25-e99f-40d5-a5d4-5ef1d97f7982", 2024-09-10T23:44:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:44:51.709 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8e40b5450 msgr2=0x7fb8e40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8e40b5450 0x7fb8e40b7910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400bfd0 tx=0x7fb8f4021000 comp rx=0 tx=0).stop 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 msgr2=0x7fb8fc199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc199240 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec006010 tx=0x7fb8ec0319f0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 shutdown_connections 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8fc10d250 0x7fb8fc19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8e40b5450 0x7fb8e40b7910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8fc10a920 0x7fb8fc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 --2- 172.21.15.16:0/2782822275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8fc101810 0x7fb8fc199240 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 >> 172.21.15.16:0/2782822275 conn(0x7fb8fc076f50 msgr2=0x7fb8fc1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 shutdown_connections 2024-09-10T23:44:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:51.684+0000 7fb900c7b640 1 -- 172.21.15.16:0/2782822275 wait complete. 2024-09-10T23:44:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:52 smithi016 ceph-mon[30855]: pgmap v459: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:52.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:52 smithi071 ceph-mon[35018]: pgmap v459: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:52.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:44:52.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:52 smithi066 ceph-mon[34761]: pgmap v459: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:44:52.806 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 -- 172.21.15.16:0/860330608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198103ce0 msgr2=0x7fe1981040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 --2- 172.21.15.16:0/860330608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198103ce0 0x7fe1981040c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe188009900 tx=0x7fe18802a410 comp rx=0 tx=0).stop 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 -- 172.21.15.16:0/860330608 shutdown_connections 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 --2- 172.21.15.16:0/860330608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe19810d140 0x7fe19810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 --2- 172.21.15.16:0/860330608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe198104600 0x7fe19810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 --2- 172.21.15.16:0/860330608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198103ce0 0x7fe1981040c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 -- 172.21.15.16:0/860330608 >> 172.21.15.16:0/860330608 conn(0x7fe1980fd720 msgr2=0x7fe1980ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 -- 172.21.15.16:0/860330608 shutdown_connections 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.293+0000 7fe19e89b640 1 -- 172.21.15.16:0/860330608 wait complete. 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 Processor -- start 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 -- start start 2024-09-10T23:44:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe198103ce0 0x7fe198199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198104600 0x7fe198199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19810d140 0x7fe19819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe198112df0 con 0x7fe198104600 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe198112c70 con 0x7fe19810d140 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.294+0000 7fe19e89b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe198112f70 con 0x7fe198103ce0 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198104600 0x7fe198199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198104600 0x7fe198199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58480/0 (socket says 172.21.15.16:58480) 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 -- 172.21.15.16:0/1494725094 learned_addr learned my addr 172.21.15.16:0/1494725094 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe197fff640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe198103ce0 0x7fe198199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe19ce38640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19810d140 0x7fe19819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 -- 172.21.15.16:0/1494725094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe198103ce0 msgr2=0x7fe198199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe198103ce0 0x7fe198199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 -- 172.21.15.16:0/1494725094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19810d140 msgr2=0x7fe19819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19810d140 0x7fe19819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 -- 172.21.15.16:0/1494725094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19819f3d0 con 0x7fe198104600 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1977fe640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198104600 0x7fe198199860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00d750 tx=0x7fe18c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1957fa640 1 -- 172.21.15.16:0/1494725094 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c017070 con 0x7fe198104600 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19819f6c0 con 0x7fe198104600 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1957fa640 1 -- 172.21.15.16:0/1494725094 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe18c004020 con 0x7fe198104600 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe1957fa640 1 -- 172.21.15.16:0/1494725094 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c003c00 con 0x7fe198104600 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.295+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1981a5f50 con 0x7fe198104600 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 Processor -- start 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 -- start start 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1957fa640 1 -- 172.21.15.16:0/1494725094 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe18c009a30 con 0x7fe198104600 2024-09-10T23:44:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc2c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dc3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56475dba2e50 con 0x56475dc2c480 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56475db92280 con 0x56475dc2cda0 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.298+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56475db96090 con 0x56475dc38d30 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc2c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc2c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58490/0 (socket says 172.21.15.16:58490) 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 -- 172.21.15.16:0/2180872867 learned_addr learned my addr 172.21.15.16:0/2180872867 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe1977fe640 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dc3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe197fff640 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 -- 172.21.15.16:0/2180872867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 msgr2=0x56475dc3b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dc3b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 -- 172.21.15.16:0/2180872867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 msgr2=0x56475dc387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 -- 172.21.15.16:0/2180872867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475d8f0650 con 0x56475dc2c480 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe19ce38640 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc2c860 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe19000a430 tx=0x7fe190009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6753e753d0160f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe1957fa640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1800b5450 0x7fe1800b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe17e7fc640 1 -- 172.21.15.16:0/2180872867 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190013790 con 0x56475dc2c480 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe197fff640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1800b5450 0x7fe1800b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe17e7fc640 1 -- 172.21.15.16:0/2180872867 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe190019070 con 0x56475dc2c480 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe17e7fc640 1 -- 172.21.15.16:0/2180872867 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190014ce0 con 0x56475dc2c480 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.299+0000 7fe1957fa640 1 -- 172.21.15.16:0/1494725094 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe18c0e57b0 con 0x7fe198104600 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2180872867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 msgr2=0x56475dc2c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe197fff640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1800b5450 0x7fe1800b7910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe188031440 tx=0x7fe188005890 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc2c860 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe19000a430 tx=0x7fe190009650 comp rx=0 tx=0).stop 2024-09-10T23:44:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2180872867 shutdown_connections 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dc3b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2180872867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc2c860 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2180872867 >> 172.21.15.16:0/2180872867 conn(0x56475dc2a2b0 msgr2=0x56475dc2b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2180872867 shutdown_connections 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.300+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2180872867 wait complete. 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 -- start start 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 Processor -- start 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2c480 0x56475dc38560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc359b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc38d30 0x56475dc35ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56475d9f3700 con 0x56475dc38d30 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56475db2d110 con 0x56475dc2cda0 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56475dc3b9b0 con 0x56475dc2c480 2024-09-10T23:44:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1a0c70740 10 client.0 _ll_register_callbacks cb 0x56475db46990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe19ce38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc38d30 0x56475dc35ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe19ce38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc38d30 0x56475dc35ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58502/0 (socket says 172.21.15.16:58502) 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe19ce38640 1 -- 172.21.15.16:0/2151480148 learned_addr learned my addr 172.21.15.16:0/2151480148 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe197fff640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2c480 0x56475dc38560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.301+0000 7fe1977fe640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe19ce38640 1 -- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2c480 msgr2=0x56475dc38560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe19ce38640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2c480 0x56475dc38560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe19ce38640 1 -- 172.21.15.16:0/2151480148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 msgr2=0x56475dc359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe19ce38640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc359b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe19ce38640 1 -- 172.21.15.16:0/2151480148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475db5ac40 con 0x56475dc38d30 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1977fe640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc359b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe19ce38640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc38d30 0x56475dc35ef0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe190014860 tx=0x7fe190009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4a67f6f6b8e3d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1777fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1777fe640 1 -- 172.21.15.16:0/2151480148 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190013590 con 0x56475dc38d30 2024-09-10T23:44:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1777fe640 1 -- 172.21.15.16:0/2151480148 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe190013730 con 0x56475dc38d30 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe190019070 con 0x56475dc38d30 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1777fe640 1 -- 172.21.15.16:0/2151480148 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe190013930 con 0x56475dc38d30 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1a0c70740 10 client.16308 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56475dc47250 con 0x56475dc38d30 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.302+0000 7fe1777fe640 1 -- 172.21.15.16:0/2151480148 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe190019070 con 0x56475dc38d30 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1777fe640 1 -- 172.21.15.16:0/2151480148 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe190031af0 con 0x56475dc38d30 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1a0c70740 10 client.16308 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1a0c70740 10 client.16308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1a0c70740 20 client.16308 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dc4a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1a0c70740 4 client.16308 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56475dba4da0 con 0x56475dc48600 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe197fff640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dc4a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe1777fe640 10 client.16308 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.303+0000 7fe197fff640 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dc4a9f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3975ae3dd45b750 server_cookie=7be53abb1d52b408 in_seq=0 out_seq=0 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.304+0000 7fe1777fe640 1 -- 172.21.15.16:0/2151480148 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56475dba4da0 con 0x56475dc48600 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.304+0000 7fe1777fe640 10 client.16308 handle_command_reply: tid=0 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.304+0000 7fe1a0c70740 1 client.16308 shutdown 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.304+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc38d30 msgr2=0x56475dc35ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.304+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc38d30 0x56475dc35ef0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe190014860 tx=0x7fe190009ce0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 shutdown_connections 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dc4a9f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1777fe640 0 client.16308 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc38d30 0x56475dc35ef0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc359b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/2151480148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2c480 0x56475dc38560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 >> 172.21.15.16:0/2151480148 conn(0x56475dc2a2b0 msgr2=0x56475dc2fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 shutdown_connections 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 1 -- 172.21.15.16:0/2151480148 wait complete. 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.305+0000 7fe1a0c70740 20 client.16308 trim_cache size 0 max 16384 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.322+0000 7fe1a0c70740 1 Processor -- start 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.322+0000 7fe1a0c70740 1 -- start start 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc376f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2cda0 0x56475dc32bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc38d30 0x56475dc33100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981b1020 con 0x56475dc2c480 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981ae8f0 con 0x56475dc38d30 2024-09-10T23:44:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981ac740 con 0x56475dc2cda0 2024-09-10T23:44:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc376f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58514/0 (socket says 172.21.15.16:58514) 2024-09-10T23:44:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 -- 172.21.15.16:0/341324934 learned_addr learned my addr 172.21.15.16:0/341324934 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe1977fe640 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2cda0 0x56475dc32bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe19ce38640 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc38d30 0x56475dc33100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 -- 172.21.15.16:0/341324934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2cda0 msgr2=0x56475dc32bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2cda0 0x56475dc32bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 -- 172.21.15.16:0/341324934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc38d30 msgr2=0x56475dc33100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc38d30 0x56475dc33100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 -- 172.21.15.16:0/341324934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475dc388d0 con 0x56475dc2c480 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.323+0000 7fe197fff640 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc376f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe18802a930 tx=0x7fe18803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6b4f310c8b53ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe17dffb640 1 -- 172.21.15.16:0/341324934 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188035040 con 0x56475dc2c480 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe17dffb640 1 -- 172.21.15.16:0/341324934 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1880043c0 con 0x56475dc2c480 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe17dffb640 1 -- 172.21.15.16:0/341324934 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18805a7e0 con 0x56475dc2c480 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 -- 172.21.15.16:0/341324934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 msgr2=0x56475dc376f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc376f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe18802a930 tx=0x7fe18803e000 comp rx=0 tx=0).stop 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 -- 172.21.15.16:0/341324934 shutdown_connections 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc38d30 0x56475dc33100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc2cda0 0x56475dc32bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/341324934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc376f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 -- 172.21.15.16:0/341324934 >> 172.21.15.16:0/341324934 conn(0x56475dc2a2b0 msgr2=0x56475dc36fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 -- 172.21.15.16:0/341324934 shutdown_connections 2024-09-10T23:44:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.324+0000 7fe1a0c70740 1 -- 172.21.15.16:0/341324934 wait complete. 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 -- start start 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 Processor -- start 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc3d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc3d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dcb4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981acdb0 con 0x56475dc2c480 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981ae220 con 0x56475dc2cda0 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe1a0c70740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981ad480 con 0x56475dc38d30 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe197fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc3d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.325+0000 7fe197fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc3d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58526/0 (socket says 172.21.15.16:58526) 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe197fff640 1 -- 172.21.15.16:0/3185222487 learned_addr learned my addr 172.21.15.16:0/3185222487 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1a0c70740 10 client.0 _ll_register_callbacks cb 0x7fe190009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1977fe640 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc3d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe19ce38640 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dcb4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe197fff640 1 -- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 msgr2=0x56475dcb4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe197fff640 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dcb4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe197fff640 1 -- 172.21.15.16:0/3185222487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 msgr2=0x56475dc3d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe197fff640 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc3d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe197fff640 1 -- 172.21.15.16:0/3185222487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475dcb4790 con 0x56475dc2c480 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe197fff640 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc3d060 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe188003f90 tx=0x7fe1880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6782fdddf3c76d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1777fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1777fe640 1 -- 172.21.15.16:0/3185222487 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188062020 con 0x56475dc2c480 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1777fe640 1 -- 172.21.15.16:0/3185222487 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe188003a00 con 0x56475dc2c480 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1880043c0 con 0x56475dc2c480 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1777fe640 1 -- 172.21.15.16:0/3185222487 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe188003c00 con 0x56475dc2c480 2024-09-10T23:44:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1a0c70740 10 client.16314 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.326+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56475dcb5a30 con 0x56475dc2c480 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1777fe640 1 -- 172.21.15.16:0/3185222487 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1880043c0 con 0x56475dc2c480 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1777fe640 1 -- 172.21.15.16:0/3185222487 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe188058020 con 0x56475dc2c480 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1a0c70740 10 client.16314 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1a0c70740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1a0c70740 20 client.16314 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dcb8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1a0c70740 4 client.16314 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56475dba0850 con 0x56475dc48600 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.327+0000 7fe1977fe640 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dcb8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1977fe640 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dcb8100 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=134e943aca915f83 server_cookie=a43628202e32aee1 in_seq=0 out_seq=0 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1777fe640 10 client.16314 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1777fe640 1 -- 172.21.15.16:0/3185222487 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x56475dba0850 con 0x56475dc48600 2024-09-10T23:44:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1777fe640 10 client.16314 handle_command_reply: tid=0 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 client.16314 shutdown 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 msgr2=0x56475dc3d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc3d060 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe188003f90 tx=0x7fe1880046c0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 shutdown_connections 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56475dc48600 0x56475dcb8100 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56475dc38d30 0x56475dcb4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56475dc2cda0 0x56475dc3d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 --2- 172.21.15.16:0/3185222487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56475dc2c480 0x56475dc3d060 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1777fe640 0 client.16314 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 >> 172.21.15.16:0/3185222487 conn(0x56475dc2a2b0 msgr2=0x56475dc37800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 shutdown_connections 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 1 -- 172.21.15.16:0/3185222487 wait complete. 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.328+0000 7fe1a0c70740 20 client.16314 trim_cache size 0 max 16384 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:44:53.345 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.346 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.347 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:44:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:44:53.350 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:44:53.351 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:44:53.351 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:44:53.351 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:44:53.351 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:44:53.351 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:44:53.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1800b5450 msgr2=0x7fe1800b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1800b5450 0x7fe1800b7910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe188031440 tx=0x7fe188005890 comp rx=0 tx=0).stop 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198104600 msgr2=0x7fe198199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198104600 0x7fe198199860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00d750 tx=0x7fe18c00dc10 comp rx=0 tx=0).stop 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 shutdown_connections 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1800b5450 0x7fe1800b7910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe19810d140 0x7fe19819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198104600 0x7fe198199860 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 --2- 172.21.15.16:0/1494725094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe198103ce0 0x7fe198199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 >> 172.21.15.16:0/1494725094 conn(0x7fe1980fd720 msgr2=0x7fe1980fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 shutdown_connections 2024-09-10T23:44:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:53.329+0000 7fe19e89b640 1 -- 172.21.15.16:0/1494725094 wait complete. 2024-09-10T23:44:53.488 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:53 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:44:53.489 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:53 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:53.489 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:53 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:44:53.489 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:53 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:53.489 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:53 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:44:53.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:53 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:44:53.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:53 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:53 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:44:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:53 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:53 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:44:53.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:53 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:44:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:53 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:53 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:44:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:53 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:44:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:53 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:44:53.975 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:44:53.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:44:54.233 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:54.513 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:54 smithi016 ceph-mon[30855]: pgmap v460: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:44:54.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:54 smithi071 ceph-mon[35018]: pgmap v460: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:44:54.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:54 smithi066 ceph-mon[34761]: pgmap v460: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 -- 172.21.15.16:0/3678695677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344101c90 msgr2=0x7f6344102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3678695677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344101c90 0x7f6344102070 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6334009900 tx=0x7f633402a410 comp rx=0 tx=0).stop 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 -- 172.21.15.16:0/3678695677 shutdown_connections 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3678695677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6344108020 0x7f634410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3678695677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63441076a0 0x7f6344107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3678695677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344101c90 0x7f6344102070 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 -- 172.21.15.16:0/3678695677 >> 172.21.15.16:0/3678695677 conn(0x7f63440fd700 msgr2=0x7f63440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 -- 172.21.15.16:0/3678695677 shutdown_connections 2024-09-10T23:44:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.713+0000 7f634a2d0640 1 -- 172.21.15.16:0/3678695677 wait complete. 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 Processor -- start 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 -- start start 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6344101c90 0x7f63441992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63441076a0 0x7f63441997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344108020 0x7f634419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112dc0 con 0x7f6344108020 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112c40 con 0x7f63441076a0 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634a2d0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112f40 con 0x7f6344101c90 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344108020 0x7f634419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344108020 0x7f634419eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47038/0 (socket says 172.21.15.16:47038) 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 -- 172.21.15.16:0/3743985168 learned_addr learned my addr 172.21.15.16:0/3743985168 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f633bfff640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63441076a0 0x7f63441997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f6343fff640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6344101c90 0x7f63441992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 -- 172.21.15.16:0/3743985168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6344101c90 msgr2=0x7f63441992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6344101c90 0x7f63441992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 -- 172.21.15.16:0/3743985168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63441076a0 msgr2=0x7f63441997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63441076a0 0x7f63441997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 -- 172.21.15.16:0/3743985168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634419f360 con 0x7f6344108020 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.714+0000 7f634886d640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344108020 0x7f634419eb90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f633c00eaa0 tx=0x7f633c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.715+0000 7f6341ffb640 1 -- 172.21.15.16:0/3743985168 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00cdb0 con 0x7f6344108020 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.715+0000 7f6341ffb640 1 -- 172.21.15.16:0/3743985168 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633c005020 con 0x7f6344108020 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.715+0000 7f6341ffb640 1 -- 172.21.15.16:0/3743985168 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c0116d0 con 0x7f6344108020 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.715+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634419f650 con 0x7f6344108020 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.715+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441a5d10 con 0x7f6344108020 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.716+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6344102070 con 0x7f6344108020 2024-09-10T23:44:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.718+0000 7f6341ffb640 1 -- 172.21.15.16:0/3743985168 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f633c00f040 con 0x7f6344108020 2024-09-10T23:44:54.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.719+0000 7f6341ffb640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63300b54d0 0x7f63300b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:54.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.719+0000 7f6343fff640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63300b54d0 0x7f63300b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:54.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.719+0000 7f6341ffb640 1 -- 172.21.15.16:0/3743985168 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f633c0e6060 con 0x7f6344108020 2024-09-10T23:44:54.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.719+0000 7f6343fff640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63300b54d0 0x7f63300b7990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6334031440 tx=0x7f63340095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:54.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.722+0000 7f6341ffb640 1 -- 172.21.15.16:0/3743985168 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f633c016030 con 0x7f6344108020 2024-09-10T23:44:54.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.944+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f634402e5c0 con 0x7f6344108020 2024-09-10T23:44:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.945+0000 7f6341ffb640 1 -- 172.21.15.16:0/3743985168 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f633c0acd60 con 0x7f6344108020 2024-09-10T23:44:54.947 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:44:54.947 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:44:54.947 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:44:54.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63300b54d0 msgr2=0x7f63300b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:54.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63300b54d0 0x7f63300b7990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6334031440 tx=0x7f63340095f0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344108020 msgr2=0x7f634419eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344108020 0x7f634419eb90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f633c00eaa0 tx=0x7f633c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 shutdown_connections 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6344108020 0x7f634419eb90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f63300b54d0 0x7f63300b7990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63441076a0 0x7f63441997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 --2- 172.21.15.16:0/3743985168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6344101c90 0x7f63441992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 >> 172.21.15.16:0/3743985168 conn(0x7f63440fd700 msgr2=0x7f63440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 shutdown_connections 2024-09-10T23:44:54.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:54.947+0000 7f634a2d0640 1 -- 172.21.15.16:0/3743985168 wait complete. 2024-09-10T23:44:55.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:55 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3743985168' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:55.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:55 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3743985168' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:55.722 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:55 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3743985168' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:44:55.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:44:56.007 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:56.459 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:56 smithi016 ceph-mon[30855]: pgmap v461: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:44:56.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:56 smithi071 ceph-mon[35018]: pgmap v461: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:44:56.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:56 smithi066 ceph-mon[34761]: pgmap v461: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.542+0000 7f5a4219d640 1 -- 172.21.15.16:0/2542839778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c104420 msgr2=0x7f5a3c10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.542+0000 7f5a4219d640 1 --2- 172.21.15.16:0/2542839778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c104420 0x7f5a3c10c910 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009900 tx=0x7f5a2c02a410 comp rx=0 tx=0).stop 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 -- 172.21.15.16:0/2542839778 shutdown_connections 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 --2- 172.21.15.16:0/2542839778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c10cf60 0x7f5a3c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 --2- 172.21.15.16:0/2542839778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c104420 0x7f5a3c10c910 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 --2- 172.21.15.16:0/2542839778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a3c103b00 0x7f5a3c103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 -- 172.21.15.16:0/2542839778 >> 172.21.15.16:0/2542839778 conn(0x7f5a3c0fd560 msgr2=0x7f5a3c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 -- 172.21.15.16:0/2542839778 shutdown_connections 2024-09-10T23:44:56.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 -- 172.21.15.16:0/2542839778 wait complete. 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 Processor -- start 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.543+0000 7f5a4219d640 1 -- start start 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c103b00 0x7f5a3c1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a3c104420 0x7f5a3c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c10cf60 0x7f5a3c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c112bd0 con 0x7f5a3c103b00 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c112a50 con 0x7f5a3c104420 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c112d50 con 0x7f5a3c10cf60 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c103b00 0x7f5a3c1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c103b00 0x7f5a3c1990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47052/0 (socket says 172.21.15.16:47052) 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 -- 172.21.15.16:0/884670787 learned_addr learned my addr 172.21.15.16:0/884670787 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4199c640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c10cf60 0x7f5a3c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4099a640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a3c104420 0x7f5a3c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 -- 172.21.15.16:0/884670787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c10cf60 msgr2=0x7f5a3c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c10cf60 0x7f5a3c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 -- 172.21.15.16:0/884670787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a3c104420 msgr2=0x7f5a3c1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a3c104420 0x7f5a3c1995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 -- 172.21.15.16:0/884670787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c19f150 con 0x7f5a3c103b00 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4199c640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c10cf60 0x7f5a3c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4119b640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c103b00 0x7f5a3c1990a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800e9f0 tx=0x7f5a3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a327fc640 1 -- 172.21.15.16:0/884670787 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800cd80 con 0x7f5a3c103b00 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a327fc640 1 -- 172.21.15.16:0/884670787 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a380108e0 con 0x7f5a3c103b00 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c19f440 con 0x7f5a3c103b00 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a327fc640 1 -- 172.21.15.16:0/884670787 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38018980 con 0x7f5a3c103b00 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.544+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c1a5b00 con 0x7f5a3c103b00 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 Processor -- start 2024-09-10T23:44:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a327fc640 1 -- 172.21.15.16:0/884670787 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f5a38010430 con 0x7f5a3c103b00 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 -- start start 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc5e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc6a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56357fbd4ea0 con 0x56357fc5ebf0 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56357fbc42d0 con 0x56357fc6ab80 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a457d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56357fbc80e0 con 0x56357fc5e2d0 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.547+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc6a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc6a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47062/0 (socket says 172.21.15.16:47062) 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:53498/0 (socket says 172.21.15.16:53498) 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4119b640 1 -- 172.21.15.16:0/3852641146 learned_addr learned my addr 172.21.15.16:0/3852641146 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4199c640 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc5e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 -- 172.21.15.16:0/3852641146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 msgr2=0x56357fc5e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc5e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 -- 172.21.15.16:0/3852641146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 msgr2=0x56357fc6a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc6a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 -- 172.21.15.16:0/3852641146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357f922650 con 0x56357fc6ab80 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4119b640 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc6a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a327fc640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a280b5500 0x7f5a280b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4099a640 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6cf70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c10f5b0 tx=0x7f5a2c032ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54acfb17fe7f3a64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a4199c640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a280b5500 0x7f5a280b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a327fc640 1 -- 172.21.15.16:0/884670787 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5a380e63d0 con 0x7f5a3c103b00 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a277fe640 1 -- 172.21.15.16:0/3852641146 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c03f030 con 0x56357fc6ab80 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a277fe640 1 -- 172.21.15.16:0/3852641146 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a2c032e50 con 0x56357fc6ab80 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.548+0000 7f5a277fe640 1 -- 172.21.15.16:0/3852641146 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c035070 con 0x56357fc6ab80 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 -- 172.21.15.16:0/3852641146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 msgr2=0x56357fc6cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a4199c640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a280b5500 0x7f5a280b79c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a34005fd0 tx=0x7f5a34009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6cf70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c10f5b0 tx=0x7f5a2c032ba0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 -- 172.21.15.16:0/3852641146 shutdown_connections 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6cf70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc6a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3852641146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc5e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 -- 172.21.15.16:0/3852641146 >> 172.21.15.16:0/3852641146 conn(0x56357fc5c100 msgr2=0x56357fc5d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 -- 172.21.15.16:0/3852641146 shutdown_connections 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.549+0000 7f5a457d4740 1 -- 172.21.15.16:0/3852641146 wait complete. 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 -- start start 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 Processor -- start 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc6a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc67900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc67f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56357fa25700 con 0x56357fc5ebf0 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56357fb5f160 con 0x56357fc6ab80 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56357fc6d7a0 con 0x56357fc5e2d0 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a457d4740 10 client.0 _ll_register_callbacks cb 0x56357fb789e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a4099a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc67900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a4099a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc67900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47074/0 (socket says 172.21.15.16:47074) 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a4099a640 1 -- 172.21.15.16:0/2487550745 learned_addr learned my addr 172.21.15.16:0/2487550745 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a4199c640 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc67f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.550+0000 7f5a4119b640 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc6a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a4099a640 1 -- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 msgr2=0x56357fc6a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a4099a640 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc6a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a4099a640 1 -- 172.21.15.16:0/2487550745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 msgr2=0x56357fc67f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a4099a640 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc67f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a4099a640 1 -- 172.21.15.16:0/2487550745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357fb8cc90 con 0x56357fc5ebf0 2024-09-10T23:44:56.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a4099a640 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc67900 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0092a0 tx=0x7f5a2c0317f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec32ca90445a020a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a24ff9640 1 -- 172.21.15.16:0/2487550745 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c035050 con 0x56357fc5ebf0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a24ff9640 1 -- 172.21.15.16:0/2487550745 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5a2c004240 con 0x56357fc5ebf0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a2c032e50 con 0x56357fc5ebf0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a24ff9640 1 -- 172.21.15.16:0/2487550745 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5a2c03f040 con 0x56357fc5ebf0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a457d4740 10 client.16332 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56357fc79110 con 0x56357fc5ebf0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.551+0000 7f5a24ff9640 1 -- 172.21.15.16:0/2487550745 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a2c032e50 con 0x56357fc5ebf0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a24ff9640 1 -- 172.21.15.16:0/2487550745 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5a2c004a20 con 0x56357fc5ebf0 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a457d4740 10 client.16332 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a457d4740 10 client.16332 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a457d4740 20 client.16332 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a457d4740 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fc7a460 0x56357fc7c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a457d4740 4 client.16332 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56357fbd6df0 con 0x56357fc7a460 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a4119b640 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fc7a460 0x56357fc7c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a4119b640 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fc7a460 0x56357fc7c850 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=569c173c69040c6d server_cookie=d4ee67940bee17af in_seq=0 out_seq=0 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.552+0000 7f5a24ff9640 10 client.16332 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a24ff9640 1 -- 172.21.15.16:0/2487550745 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56357fbd6df0 con 0x56357fc7a460 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a24ff9640 10 client.16332 handle_command_reply: tid=0 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 client.16332 shutdown 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 msgr2=0x56357fc67900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc67900 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0092a0 tx=0x7f5a2c0317f0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 shutdown_connections 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fc7a460 0x56357fc7c850 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc67f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5ebf0 0x56357fc67900 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a24ff9640 0 client.16332 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 --2- 172.21.15.16:0/2487550745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5e2d0 0x56357fc6a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.553+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 >> 172.21.15.16:0/2487550745 conn(0x56357fc5c100 msgr2=0x56357fc61ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.554+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 shutdown_connections 2024-09-10T23:44:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.554+0000 7f5a457d4740 1 -- 172.21.15.16:0/2487550745 wait complete. 2024-09-10T23:44:56.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.554+0000 7f5a457d4740 20 client.16332 trim_cache size 0 max 16384 2024-09-10T23:44:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 Processor -- start 2024-09-10T23:44:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 -- start start 2024-09-10T23:44:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc5d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc5b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1b0d10 con 0x56357fc5e2d0 2024-09-10T23:44:56.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1ae5e0 con 0x56357fc6ab80 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a457d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1ac430 con 0x56357fc5ebf0 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc5d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc5d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47078/0 (socket says 172.21.15.16:47078) 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a4119b640 1 -- 172.21.15.16:0/1901390568 learned_addr learned my addr 172.21.15.16:0/1901390568 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a4099a640 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.567+0000 7f5a4199c640 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc5b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a4119b640 1 -- 172.21.15.16:0/1901390568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 msgr2=0x56357fc769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a4119b640 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc769d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a4119b640 1 -- 172.21.15.16:0/1901390568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 msgr2=0x56357fc5b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a4119b640 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc5b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a4119b640 1 -- 172.21.15.16:0/1901390568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357fc5cb80 con 0x56357fc5e2d0 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a4099a640 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a4119b640 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc5d830 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5a380ac840 tx=0x7f5a380e88e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b2a43871b0e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:56.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a26ffd640 1 -- 172.21.15.16:0/1901390568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380b1020 con 0x56357fc5e2d0 2024-09-10T23:44:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a26ffd640 1 -- 172.21.15.16:0/1901390568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a380ac3c0 con 0x56357fc5e2d0 2024-09-10T23:44:56.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.568+0000 7f5a26ffd640 1 -- 172.21.15.16:0/1901390568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380ac020 con 0x56357fc5e2d0 2024-09-10T23:44:56.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 -- 172.21.15.16:0/1901390568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 msgr2=0x56357fc5d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc5d830 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5a380ac840 tx=0x7f5a380e88e0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 -- 172.21.15.16:0/1901390568 shutdown_connections 2024-09-10T23:44:56.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc5b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 --2- 172.21.15.16:0/1901390568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc5d830 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 -- 172.21.15.16:0/1901390568 >> 172.21.15.16:0/1901390568 conn(0x56357fc5c100 msgr2=0x56357fc5aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 -- 172.21.15.16:0/1901390568 shutdown_connections 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 -- 172.21.15.16:0/1901390568 wait complete. 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 -- start start 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.569+0000 7f5a457d4740 1 Processor -- start 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc73100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc6d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a457d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a457d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1acaa0 con 0x56357fc5e2d0 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a457d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1adf10 con 0x56357fc6ab80 2024-09-10T23:44:56.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a457d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1ad170 con 0x56357fc5ebf0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a457d4740 10 client.0 _ll_register_callbacks cb 0x7f5a380e9df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc73100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc73100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47088/0 (socket says 172.21.15.16:47088) 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 -- 172.21.15.16:0/3045469836 learned_addr learned my addr 172.21.15.16:0/3045469836 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4099a640 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc6d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4199c640 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 -- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 msgr2=0x56357fc6d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc6d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 -- 172.21.15.16:0/3045469836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 msgr2=0x56357fc6df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 -- 172.21.15.16:0/3045469836 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357fc6e6a0 con 0x56357fc5e2d0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a4119b640 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc73100 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5a38018460 tx=0x7f5a380ac200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e388e9bf553409bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:56.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.570+0000 7f5a24ff9640 1 -- 172.21.15.16:0/3045469836 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380b1040 con 0x56357fc5e2d0 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a24ff9640 1 -- 172.21.15.16:0/3045469836 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5a380adbe0 con 0x56357fc5e2d0 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a380ac3c0 con 0x56357fc5e2d0 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a24ff9640 1 -- 172.21.15.16:0/3045469836 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5a380ac020 con 0x56357fc5e2d0 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 10 client.16338 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56357fce7fd0 con 0x56357fc5e2d0 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a24ff9640 1 -- 172.21.15.16:0/3045469836 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a380ac3c0 con 0x56357fc5e2d0 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a24ff9640 1 -- 172.21.15.16:0/3045469836 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5a38018b20 con 0x56357fc5e2d0 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 10 client.16338 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 10 client.16338 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 20 client.16338 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fce8780 0x56357fceaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 4 client.16338 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56357fbd28a0 con 0x56357fce8780 2024-09-10T23:44:56.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.571+0000 7f5a4099a640 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fce8780 0x56357fceaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a4099a640 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fce8780 0x56357fceaba0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=68769bd2e407b764 server_cookie=f6d9563d91f8359e in_seq=0 out_seq=0 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a24ff9640 10 client.16338 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a24ff9640 1 -- 172.21.15.16:0/3045469836 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56357fbd28a0 con 0x56357fce8780 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a24ff9640 10 client.16338 handle_command_reply: tid=0 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 client.16338 shutdown 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 msgr2=0x56357fc73100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc73100 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5a38018460 tx=0x7f5a380ac200 comp rx=0 tx=0).stop 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 shutdown_connections 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56357fce8780 0x56357fceaba0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56357fc6ab80 0x56357fc6df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a24ff9640 0 client.16338 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56357fc5ebf0 0x56357fc6d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 --2- 172.21.15.16:0/3045469836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56357fc5e2d0 0x56357fc73100 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 >> 172.21.15.16:0/3045469836 conn(0x56357fc5c100 msgr2=0x56357fc5cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:56.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 shutdown_connections 2024-09-10T23:44:56.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 1 -- 172.21.15.16:0/3045469836 wait complete. 2024-09-10T23:44:56.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.572+0000 7f5a457d4740 20 client.16338 trim_cache size 0 max 16384 2024-09-10T23:44:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a280b5500 msgr2=0x7f5a280b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a280b5500 0x7f5a280b79c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a34005fd0 tx=0x7f5a34009680 comp rx=0 tx=0).stop 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c103b00 msgr2=0x7f5a3c1990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c103b00 0x7f5a3c1990a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800e9f0 tx=0x7f5a3800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 shutdown_connections 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5a3c10cf60 0x7f5a3c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5a280b5500 0x7f5a280b79c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a3c104420 0x7f5a3c1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 --2- 172.21.15.16:0/884670787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a3c103b00 0x7f5a3c1990a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 >> 172.21.15.16:0/884670787 conn(0x7f5a3c0fd560 msgr2=0x7f5a3c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:56.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 shutdown_connections 2024-09-10T23:44:56.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:56.573+0000 7f5a4219d640 1 -- 172.21.15.16:0/884670787 wait complete. 2024-09-10T23:44:57.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:44:57.751 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:58.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 -- 172.21.15.16:0/3466378737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 msgr2=0x7f80f410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/3466378737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f410f550 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009ca0 tx=0x7f80ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 -- 172.21.15.16:0/3466378737 shutdown_connections 2024-09-10T23:44:58.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/3466378737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f410f550 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/3466378737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f4104530 0x7f80f410cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/3466378737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80f4103b30 0x7f80f4103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 -- 172.21.15.16:0/3466378737 >> 172.21.15.16:0/3466378737 conn(0x7f80f40fd700 msgr2=0x7f80f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 -- 172.21.15.16:0/3466378737 shutdown_connections 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.226+0000 7f80f8c2c640 1 -- 172.21.15.16:0/3466378737 wait complete. 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 Processor -- start 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 -- start start 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f4103b30 0x7f80f41019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80f4104530 0x7f80f4101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f4102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4112d60 con 0x7f80f410d0e0 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4112be0 con 0x7f80f4104530 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f8c2c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4112ee0 con 0x7f80f4103b30 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f4102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f4102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47098/0 (socket says 172.21.15.16:47098) 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2858756417 learned_addr learned my addr 172.21.15.16:0/2858756417 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80f259c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f4103b30 0x7f80f41019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.227+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80f4104530 0x7f80f4101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2858756417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f4103b30 msgr2=0x7f80f41019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f4103b30 0x7f80f41019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2858756417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80f4104530 msgr2=0x7f80f4101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80f4104530 0x7f80f4101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2858756417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f41a7630 con 0x7f80f410d0e0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f4102430 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0098d0 tx=0x7f80ec0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80ebfff640 1 -- 172.21.15.16:0/2858756417 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec003b70 con 0x7f80f410d0e0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f41a78c0 con 0x7f80f410d0e0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80ebfff640 1 -- 172.21.15.16:0/2858756417 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80ec003d10 con 0x7f80f410d0e0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80ebfff640 1 -- 172.21.15.16:0/2858756417 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec02fa20 con 0x7f80f410d0e0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.228+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f41a7e50 con 0x7f80f410d0e0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 Processor -- start 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80ebfff640 1 -- 172.21.15.16:0/2858756417 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f80ec02fc40 con 0x7f80f410d0e0 2024-09-10T23:44:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 -- start start 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feac68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac6df0 0x55d3fead2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d3fea3cea0 con 0x55d3fead2d80 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3fea2c2d0 con 0x55d3feac64d0 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.231+0000 7f80fb001740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d3fea300e0 con 0x55d3feac6df0 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47106/0 (socket says 172.21.15.16:47106) 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 -- 172.21.15.16:0/3383744802 learned_addr learned my addr 172.21.15.16:0/3383744802 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feac68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80f259c640 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac6df0 0x55d3fead2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 -- 172.21.15.16:0/3383744802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac6df0 msgr2=0x55d3fead2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac6df0 0x55d3fead2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 -- 172.21.15.16:0/3383744802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 msgr2=0x55d3feac68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feac68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 -- 172.21.15.16:0/3383744802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fe78a650 con 0x55d3fead2d80 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80ebfff640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80e00b5450 0x7f80e00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80f259c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80e00b5450 0x7f80e00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80ebfff640 1 -- 172.21.15.16:0/2858756417 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f80ec107380 con 0x7f80f410d0e0 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5170 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0149b0 tx=0x7f80dc00c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9aaad0641e3c724 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e8d99640 1 -- 172.21.15.16:0/3383744802 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0142d0 con 0x55d3fead2d80 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.232+0000 7f80e8d99640 1 -- 172.21.15.16:0/3383744802 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80dc0054d0 con 0x55d3fead2d80 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80e8d99640 1 -- 172.21.15.16:0/3383744802 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00f760 con 0x55d3fead2d80 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 -- 172.21.15.16:0/3383744802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 msgr2=0x55d3fead5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80f259c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80e00b5450 0x7f80e00b7910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55d3feac51e0 tx=0x7f80e4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5170 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0149b0 tx=0x7f80dc00c4b0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 -- 172.21.15.16:0/3383744802 shutdown_connections 2024-09-10T23:44:58.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5170 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac6df0 0x55d3fead2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 --2- 172.21.15.16:0/3383744802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feac68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 -- 172.21.15.16:0/3383744802 >> 172.21.15.16:0/3383744802 conn(0x55d3feac4300 msgr2=0x55d3feac54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 -- 172.21.15.16:0/3383744802 shutdown_connections 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.233+0000 7f80fb001740 1 -- 172.21.15.16:0/3383744802 wait complete. 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 -- start start 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 Processor -- start 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3fead2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feacfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d3fe88d700 con 0x55d3fead2d80 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3fe9c7160 con 0x55d3feac6df0 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d3fead5a00 con 0x55d3feac64d0 2024-09-10T23:44:58.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80fb001740 10 client.0 _ll_register_callbacks cb 0x55d3fe9e09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47118/0 (socket says 172.21.15.16:47118) 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2306747364 learned_addr learned my addr 172.21.15.16:0/2306747364 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80f259c640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3fead2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.234+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feacfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2306747364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 msgr2=0x55d3fead2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3fead2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 msgr2=0x55d3feacfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feacfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2306747364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3fe9f4c90 con 0x55d3fead2d80 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feacfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead0110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0caad0 tx=0x7f80ec0cd270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994bc08a136eaead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:58.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2306747364 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0cdcc0 con 0x55d3fead2d80 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2306747364 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f80ec0d6960 con 0x55d3fead2d80 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80dc0054d0 con 0x55d3fead2d80 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2306747364 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f80ec0cd860 con 0x55d3fead2d80 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 10 client.16350 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d3feae13c0 con 0x55d3fead2d80 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2306747364 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80dc0054d0 con 0x55d3fead2d80 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2306747364 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f80ec0f0bb0 con 0x55d3fead2d80 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 10 client.16350 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 10 client.16350 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 20 client.16350 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feae28c0 0x55d3feae4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 4 client.16350 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.235+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3fea3edf0 con 0x55d3feae28c0 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.236+0000 7f80f259c640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feae28c0 0x55d3feae4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.236+0000 7f80f259c640 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feae28c0 0x55d3feae4d10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4c927c31182042e server_cookie=9b41b4b5807987c3 in_seq=0 out_seq=0 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.236+0000 7f80d9ffb640 10 client.16350 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2306747364 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3fea3edf0 con 0x55d3feae28c0 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80d9ffb640 10 client.16350 handle_command_reply: tid=0 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 client.16350 shutdown 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 msgr2=0x55d3fead0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead0110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0caad0 tx=0x7f80ec0cd270 comp rx=0 tx=0).stop 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 shutdown_connections 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feae28c0 0x55d3feae4d10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead0110 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feacfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 --2- 172.21.15.16:0/2306747364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3fead2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 >> 172.21.15.16:0/2306747364 conn(0x55d3feac4300 msgr2=0x55d3feac9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80d9ffb640 0 client.16350 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 shutdown_connections 2024-09-10T23:44:58.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 1 -- 172.21.15.16:0/2306747364 wait complete. 2024-09-10T23:44:58.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.237+0000 7f80fb001740 20 client.16350 trim_cache size 0 max 16384 2024-09-10T23:44:58.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.250+0000 7f80fb001740 1 Processor -- start 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.250+0000 7f80fb001740 1 -- start start 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80fb001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feadec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80fb001740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3feac6df0 0x55d3fead4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80fb001740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3fead2d80 0x55d3fead46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80fb001740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41b3030 con 0x55d3feac6df0 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80fb001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41b0900 con 0x55d3feac64d0 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80fb001740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41ae750 con 0x55d3fead2d80 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3feac6df0 0x55d3fead4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3feac6df0 0x55d3fead4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47122/0 (socket says 172.21.15.16:47122) 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 -- 172.21.15.16:0/4146678450 learned_addr learned my addr 172.21.15.16:0/4146678450 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:58.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80f259c640 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feadec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3fead2d80 0x55d3fead46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 -- 172.21.15.16:0/4146678450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3fead2d80 msgr2=0x55d3fead46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3fead2d80 0x55d3fead46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 -- 172.21.15.16:0/4146678450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 msgr2=0x55d3feadec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feadec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 -- 172.21.15.16:0/4146678450 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fead58e0 con 0x55d3feac6df0 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3fead2d80 0x55d3fead46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.251+0000 7f80e9d9b640 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3feac6df0 0x55d3fead4170 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f80dc014950 tx=0x7f80dc005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a0f9da7666c550 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80dbfff640 1 -- 172.21.15.16:0/4146678450 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0140c0 con 0x55d3feac6df0 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80dbfff640 1 -- 172.21.15.16:0/4146678450 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80dc014260 con 0x55d3feac6df0 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80dbfff640 1 -- 172.21.15.16:0/4146678450 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0035f0 con 0x55d3feac6df0 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 -- 172.21.15.16:0/4146678450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3feac6df0 msgr2=0x55d3fead4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3feac6df0 0x55d3fead4170 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f80dc014950 tx=0x7f80dc005cc0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 -- 172.21.15.16:0/4146678450 shutdown_connections 2024-09-10T23:44:58.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3fead2d80 0x55d3fead46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3feac6df0 0x55d3fead4170 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 --2- 172.21.15.16:0/4146678450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac64d0 0x55d3feadec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 -- 172.21.15.16:0/4146678450 >> 172.21.15.16:0/4146678450 conn(0x55d3feac4300 msgr2=0x55d3fead1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:58.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 -- 172.21.15.16:0/4146678450 shutdown_connections 2024-09-10T23:44:58.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.252+0000 7f80fb001740 1 -- 172.21.15.16:0/4146678450 wait complete. 2024-09-10T23:44:58.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 -- start start 2024-09-10T23:44:58.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 Processor -- start 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3feadaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feadb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41aedc0 con 0x55d3fead2d80 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41b0230 con 0x55d3feac6df0 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41af490 con 0x55d3feac64d0 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80fb001740 10 client.0 _ll_register_callbacks cb 0x7f80ec02ff60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feadb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80f259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3feadaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80e9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feadb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:53598/0 (socket says 172.21.15.16:53598) 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80f259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3feadaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:57446/0 (socket says 172.21.15.16:57446) 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80e9d9b640 1 -- 172.21.15.16:0/2639321178 learned_addr learned my addr 172.21.15.16:0/2639321178 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.253+0000 7f80f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47130/0 (socket says 172.21.15.16:47130) 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.254+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2639321178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 msgr2=0x55d3feadaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.254+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3feadaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.254+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2639321178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 msgr2=0x55d3feadb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.254+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feadb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.254+0000 7f80f2d9d640 1 -- 172.21.15.16:0/2639321178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3fead64e0 con 0x55d3fead2d80 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.254+0000 7f80f2d9d640 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5cb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f80ec003f70 tx=0x7f80ec0ce020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2408b53bdf427df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.254+0000 7f80d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.256+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2639321178 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0d2340 con 0x55d3fead2d80 2024-09-10T23:44:58.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.256+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2639321178 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f80ec092300 con 0x55d3fead2d80 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.256+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80dc014260 con 0x55d3fead2d80 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2639321178 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f80ec092500 con 0x55d3fead2d80 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 10 client.16356 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d3feb50270 con 0x55d3fead2d80 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2639321178 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80dc014260 con 0x55d3fead2d80 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2639321178 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f80ec0ccac0 con 0x55d3fead2d80 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 10 client.16356 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 10 client.16356 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 20 client.16356 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feb508b0 0x55d3feb52cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 4 client.16356 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d3feae50a0 con 0x55d3feb508b0 2024-09-10T23:44:58.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.257+0000 7f80f259c640 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feb508b0 0x55d3feb52cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:58.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80f259c640 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feb508b0 0x55d3feb52cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88ae8a0c531a6336 server_cookie=5ad8df3f3cf2c02 in_seq=0 out_seq=0 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80d9ffb640 10 client.16356 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80d9ffb640 1 -- 172.21.15.16:0/2639321178 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d3feae50a0 con 0x55d3feb508b0 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80d9ffb640 10 client.16356 handle_command_reply: tid=0 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 client.16356 shutdown 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 msgr2=0x55d3fead5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5cb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f80ec003f70 tx=0x7f80ec0ce020 comp rx=0 tx=0).stop 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 shutdown_connections 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55d3feb508b0 0x55d3feb52cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d3fead2d80 0x55d3fead5cb0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3feac6df0 0x55d3feadb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 --2- 172.21.15.16:0/2639321178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3feac64d0 0x55d3feadaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 >> 172.21.15.16:0/2639321178 conn(0x55d3feac4300 msgr2=0x55d3feac2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:58.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80d9ffb640 0 client.16356 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:44:58.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 shutdown_connections 2024-09-10T23:44:58.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 1 -- 172.21.15.16:0/2639321178 wait complete. 2024-09-10T23:44:58.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.258+0000 7f80fb001740 20 client.16356 trim_cache size 0 max 16384 2024-09-10T23:44:58.264 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80e00b5450 msgr2=0x7f80e00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80e00b5450 0x7f80e00b7910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55d3feac51e0 tx=0x7f80e4005f90 comp rx=0 tx=0).stop 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 msgr2=0x7f80f4102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f4102430 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0098d0 tx=0x7f80ec0317b0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 shutdown_connections 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80f410d0e0 0x7f80f4102430 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f80e00b5450 0x7f80e00b7910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80f4104530 0x7f80f4101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 --2- 172.21.15.16:0/2858756417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80f4103b30 0x7f80f41019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 >> 172.21.15.16:0/2858756417 conn(0x7f80f40fd700 msgr2=0x7f80f40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 shutdown_connections 2024-09-10T23:44:58.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:58.259+0000 7f80f8c2c640 1 -- 172.21.15.16:0/2858756417 wait complete. 2024-09-10T23:44:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:44:58 smithi016 ceph-mon[30855]: pgmap v462: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:44:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:44:58 smithi071 ceph-mon[35018]: pgmap v462: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:44:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:44:58 smithi066 ceph-mon[34761]: pgmap v462: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:44:59.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:44:59.374 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:44:59.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 -- 172.21.15.16:0/983566872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 msgr2=0x7f5250108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 --2- 172.21.15.16:0/983566872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250108c10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5244009900 tx=0x7f524402a410 comp rx=0 tx=0).stop 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 -- 172.21.15.16:0/983566872 shutdown_connections 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 --2- 172.21.15.16:0/983566872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5250109150 0x7f525010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 --2- 172.21.15.16:0/983566872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250108c10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 --2- 172.21.15.16:0/983566872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5250102dc0 0x7f52501031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 -- 172.21.15.16:0/983566872 >> 172.21.15.16:0/983566872 conn(0x7f52500fe830 msgr2=0x7f5250100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 -- 172.21.15.16:0/983566872 shutdown_connections 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 -- 172.21.15.16:0/983566872 wait complete. 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.836+0000 7f5254b40640 1 Processor -- start 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f5254b40640 1 -- start start 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f5254b40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5250102dc0 0x7f5250199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f5254b40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f5254b40640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5250109150 0x7f525019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f5254b40640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5250112e10 con 0x7f52501087d0 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f5254b40640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5250112c90 con 0x7f5250102dc0 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f5254b40640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5250112f90 con 0x7f5250109150 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47156/0 (socket says 172.21.15.16:47156) 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 -- 172.21.15.16:0/1517648958 learned_addr learned my addr 172.21.15.16:0/1517648958 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524e59c640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5250102dc0 0x7f5250199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524ed9d640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5250109150 0x7f525019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 -- 172.21.15.16:0/1517648958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5250109150 msgr2=0x7f525019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5250109150 0x7f525019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 -- 172.21.15.16:0/1517648958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5250102dc0 msgr2=0x7f5250199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5250102dc0 0x7f5250199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.837+0000 7f524dd9b640 1 -- 172.21.15.16:0/1517648958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525019f3d0 con 0x7f52501087d0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.838+0000 7f524dd9b640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250199860 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5244005940 tx=0x7f52440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.838+0000 7f523f7fe640 1 -- 172.21.15.16:0/1517648958 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524403f030 con 0x7f52501087d0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.838+0000 7f523f7fe640 1 -- 172.21.15.16:0/1517648958 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5244003cb0 con 0x7f52501087d0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.838+0000 7f523f7fe640 1 -- 172.21.15.16:0/1517648958 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244035070 con 0x7f52501087d0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.838+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525019f660 con 0x7f52501087d0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.838+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52501a5d80 con 0x7f52501087d0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.840+0000 7f5256f15740 1 Processor -- start 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.840+0000 7f5256f15740 1 -- start start 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.840+0000 7f523f7fe640 1 -- 172.21.15.16:0/1517648958 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f524403bbf0 con 0x7f52501087d0 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f5256f15740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e64d0 0x5565b74e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f5256f15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f5256f15740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74f7190 0x5565b74f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f5256f15740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5565b745cea0 con 0x5565b74e64d0 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f5256f15740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5565b744c2d0 con 0x5565b74f7190 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f5256f15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565b74500e0 con 0x5565b74e6df0 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e64d0 0x5565b74e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e64d0 0x5565b74e68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47168/0 (socket says 172.21.15.16:47168) 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 -- 172.21.15.16:0/1727990116 learned_addr learned my addr 172.21.15.16:0/1727990116 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524e59c640 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 -- 172.21.15.16:0/1727990116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 msgr2=0x5565b74f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524dd9b640 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74f7190 0x5565b74f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 -- 172.21.15.16:0/1727990116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74f7190 msgr2=0x5565b74f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74f7190 0x5565b74f9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 -- 172.21.15.16:0/1727990116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b71aa650 con 0x5565b74e64d0 2024-09-10T23:44:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524dd9b640 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74f7190 0x5565b74f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f524ed9d640 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e64d0 0x5565b74e68b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f524800a430 tx=0x7f5248009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd86c7be412f082a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.841+0000 7f523f7fe640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f52380b54d0 0x7f52380b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f524e59c640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f52380b54d0 0x7f52380b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f523cff9640 1 -- 172.21.15.16:0/1727990116 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248013790 con 0x5565b74e64d0 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f523cff9640 1 -- 172.21.15.16:0/1727990116 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5248019070 con 0x5565b74e64d0 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f523f7fe640 1 -- 172.21.15.16:0/1517648958 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f52441065b0 con 0x7f52501087d0 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f523cff9640 1 -- 172.21.15.16:0/1727990116 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248014d00 con 0x5565b74e64d0 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f5256f15740 1 -- 172.21.15.16:0/1727990116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e64d0 msgr2=0x5565b74e68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f5256f15740 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e64d0 0x5565b74e68b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f524800a430 tx=0x7f5248009650 comp rx=0 tx=0).stop 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f524e59c640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f52380b54d0 0x7f52380b7990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5565b74ea710 tx=0x7f524000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f5256f15740 1 -- 172.21.15.16:0/1727990116 shutdown_connections 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f5256f15740 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74f7190 0x5565b74f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f5256f15740 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f5256f15740 1 --2- 172.21.15.16:0/1727990116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e64d0 0x5565b74e68b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.842+0000 7f5256f15740 1 -- 172.21.15.16:0/1727990116 >> 172.21.15.16:0/1727990116 conn(0x5565b74e4300 msgr2=0x5565b74e54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 -- 172.21.15.16:0/1727990116 shutdown_connections 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 -- 172.21.15.16:0/1727990116 wait complete. 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 -- start start 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 Processor -- start 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74f4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5565b72ad700 con 0x5565b74e6df0 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5565b73e7160 con 0x5565b74e64d0 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565b74f9e40 con 0x5565b74f7190 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f5256f15740 10 client.0 _ll_register_callbacks cb 0x5565b74009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f524dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f524dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47170/0 (socket says 172.21.15.16:47170) 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f524dd9b640 1 -- 172.21.15.16:0/178663933 learned_addr learned my addr 172.21.15.16:0/178663933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.843+0000 7f524e59c640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524ed9d640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524dd9b640 1 -- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 msgr2=0x5565b74f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524dd9b640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524dd9b640 1 -- 172.21.15.16:0/178663933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 msgr2=0x5565b74f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524dd9b640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524dd9b640 1 -- 172.21.15.16:0/178663933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b7414c90 con 0x5565b74e6df0 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524e59c640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f524dd9b640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74f3f10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f52440cc840 tx=0x7f5244032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25404cbeabdc5413 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:59.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5235ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5235ffb640 1 -- 172.21.15.16:0/178663933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244049070 con 0x5565b74e6df0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5235ffb640 1 -- 172.21.15.16:0/178663933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f52440ccfa0 con 0x5565b74e6df0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5248019070 con 0x5565b74e6df0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5235ffb640 1 -- 172.21.15.16:0/178663933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f52440cc490 con 0x5565b74e6df0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5256f15740 10 client.16368 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565b7505720 con 0x5565b74e6df0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5235ffb640 1 -- 172.21.15.16:0/178663933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5248019070 con 0x5565b74e6df0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.844+0000 7f5235ffb640 1 -- 172.21.15.16:0/178663933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f52440d5b90 con 0x5565b74e6df0 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f5256f15740 10 client.16368 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f5256f15740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f5256f15740 20 client.16368 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:59.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f5256f15740 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b7506ac0 0x5565b7508eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f5256f15740 4 client.16368 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565b745edf0 con 0x5565b7506ac0 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f524e59c640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b7506ac0 0x5565b7508eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f5235ffb640 10 client.16368 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.845+0000 7f524e59c640 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b7506ac0 0x5565b7508eb0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0eeb2d1ea85007 server_cookie=7092abc0184aa137 in_seq=0 out_seq=0 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5235ffb640 1 -- 172.21.15.16:0/178663933 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565b745edf0 con 0x5565b7506ac0 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5235ffb640 10 client.16368 handle_command_reply: tid=0 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 client.16368 shutdown 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 msgr2=0x5565b74f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74f3f10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f52440cc840 tx=0x7f5244032f60 comp rx=0 tx=0).stop 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 shutdown_connections 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b7506ac0 0x5565b7508eb0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5235ffb640 0 client.16368 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74f3f10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 --2- 172.21.15.16:0/178663933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.846+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 >> 172.21.15.16:0/178663933 conn(0x5565b74e4300 msgr2=0x5565b74e9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.847+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 shutdown_connections 2024-09-10T23:44:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.847+0000 7f5256f15740 1 -- 172.21.15.16:0/178663933 wait complete. 2024-09-10T23:44:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.847+0000 7f5256f15740 20 client.16368 trim_cache size 0 max 16384 2024-09-10T23:44:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.860+0000 7f5256f15740 1 Processor -- start 2024-09-10T23:44:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.860+0000 7f5256f15740 1 -- start start 2024-09-10T23:44:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.860+0000 7f5256f15740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b7503070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5256f15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5256f15740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74f7190 0x5565b74f9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5256f15740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f52501aed20 con 0x5565b74f7190 2024-09-10T23:44:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5256f15740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52501ac5f0 con 0x5565b74e64d0 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5256f15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f52501aa440 con 0x5565b74e6df0 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74f7190 0x5565b74f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74f7190 0x5565b74f9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47182/0 (socket says 172.21.15.16:47182) 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 -- 172.21.15.16:0/269433814 learned_addr learned my addr 172.21.15.16:0/269433814 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524e59c640 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b7503070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524dd9b640 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 -- 172.21.15.16:0/269433814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 msgr2=0x5565b74f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 -- 172.21.15.16:0/269433814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 msgr2=0x5565b7503070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b7503070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 -- 172.21.15.16:0/269433814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b74e6be0 con 0x5565b74f7190 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f524ed9d640 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74f7190 0x5565b74f9500 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f524800a430 tx=0x7f5248009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57652e480a1aae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5237fff640 1 -- 172.21.15.16:0/269433814 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248013910 con 0x5565b74f7190 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5237fff640 1 -- 172.21.15.16:0/269433814 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5248019040 con 0x5565b74f7190 2024-09-10T23:44:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.861+0000 7f5237fff640 1 -- 172.21.15.16:0/269433814 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248029de0 con 0x5565b74f7190 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 -- 172.21.15.16:0/269433814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74f7190 msgr2=0x5565b74f9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74f7190 0x5565b74f9500 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f524800a430 tx=0x7f5248009440 comp rx=0 tx=0).stop 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 -- 172.21.15.16:0/269433814 shutdown_connections 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74f7190 0x5565b74f9500 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74e6df0 0x5565b74f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 --2- 172.21.15.16:0/269433814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b7503070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 -- 172.21.15.16:0/269433814 >> 172.21.15.16:0/269433814 conn(0x5565b74e4300 msgr2=0x5565b74f80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 -- 172.21.15.16:0/269433814 shutdown_connections 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 -- 172.21.15.16:0/269433814 wait complete. 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.862+0000 7f5256f15740 1 -- start start 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 1 Processor -- start 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74ff0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f52501aaab0 con 0x5565b74e6df0 2024-09-10T23:44:59.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52501abf20 con 0x5565b74e64d0 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f52501ab180 con 0x5565b74f7190 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f5256f15740 10 client.0 _ll_register_callbacks cb 0x7f524403bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47184/0 (socket says 172.21.15.16:47184) 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 -- 172.21.15.16:0/2323794926 learned_addr learned my addr 172.21.15.16:0/2323794926 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524ed9d640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524e59c640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74ff0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 -- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 msgr2=0x5565b74fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 -- 172.21.15.16:0/2323794926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 msgr2=0x5565b74ff0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74ff0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524dd9b640 1 -- 172.21.15.16:0/2323794926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b74ffd90 con 0x5565b74e6df0 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.863+0000 7f524e59c640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:44:59.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f524dd9b640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74ff620 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f524403d040 tx=0x7f52440d1300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223c181425b1d832 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5235ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5235ffb640 1 -- 172.21.15.16:0/2323794926 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244049070 con 0x5565b74e6df0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5235ffb640 1 -- 172.21.15.16:0/2323794926 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f5244003800 con 0x5565b74e6df0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5248019040 con 0x5565b74e6df0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5235ffb640 1 -- 172.21.15.16:0/2323794926 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5244005d50 con 0x5565b74e6df0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 10 client.16374 fetch_fsmap learned FSMap version 25 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565b7573ef0 con 0x5565b74e6df0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5235ffb640 1 -- 172.21.15.16:0/2323794926 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5248019040 con 0x5565b74e6df0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5235ffb640 1 -- 172.21.15.16:0/2323794926 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f52441060d0 con 0x5565b74e6df0 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 10 client.16374 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 20 client.16374 populate_metadata read hostname 'smithi016' 2024-09-10T23:44:59.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b75744e0 0x5565b7576900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 4 client.16374 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.864+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565b745a8a0 con 0x5565b75744e0 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f524e59c640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b75744e0 0x5565b7576900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f524e59c640 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b75744e0 0x5565b7576900 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54ae988bd2c6a59 server_cookie=4d350660739b616 in_seq=0 out_seq=0 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5235ffb640 10 client.16374 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5235ffb640 1 -- 172.21.15.16:0/2323794926 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565b745a8a0 con 0x5565b75744e0 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5235ffb640 10 client.16374 handle_command_reply: tid=0 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 client.16374 shutdown 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 msgr2=0x5565b74ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74ff620 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f524403d040 tx=0x7f52440d1300 comp rx=0 tx=0).stop 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 shutdown_connections 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5565b75744e0 0x5565b7576900 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565b74f7190 0x5565b74fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565b74e6df0 0x5565b74ff620 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 --2- 172.21.15.16:0/2323794926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565b74e64d0 0x5565b74ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 >> 172.21.15.16:0/2323794926 conn(0x5565b74e4300 msgr2=0x5565b74f80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:59.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.865+0000 7f5235ffb640 0 client.16374 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:44:59.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 shutdown_connections 2024-09-10T23:44:59.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5256f15740 1 -- 172.21.15.16:0/2323794926 wait complete. 2024-09-10T23:44:59.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5256f15740 20 client.16374 trim_cache size 0 max 16384 2024-09-10T23:44:59.875 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:44:59.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f52380b54d0 msgr2=0x7f52380b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f52380b54d0 0x7f52380b7990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5565b74ea710 tx=0x7f524000b390 comp rx=0 tx=0).stop 2024-09-10T23:44:59.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 msgr2=0x7f5250199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250199860 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5244005940 tx=0x7f52440042f0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 shutdown_connections 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5250109150 0x7f525019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52501087d0 0x7f5250199860 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f52380b54d0 0x7f52380b7990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 --2- 172.21.15.16:0/1517648958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5250102dc0 0x7f5250199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 >> 172.21.15.16:0/1517648958 conn(0x7f52500fe830 msgr2=0x7f5250100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 shutdown_connections 2024-09-10T23:44:59.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:44:59.866+0000 7f5254b40640 1 -- 172.21.15.16:0/1517648958 wait complete. 2024-09-10T23:45:00.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:00 smithi071 ceph-mon[35018]: pgmap v463: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:45:00.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:00 smithi066 ceph-mon[34761]: pgmap v463: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:45:00.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:00 smithi016 ceph-mon[30855]: pgmap v463: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:45:01.779 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:45:01.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:45:02.050 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:02.447 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:02 smithi016 ceph-mon[30855]: pgmap v464: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:02 smithi071 ceph-mon[35018]: pgmap v464: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:02.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 -- 172.21.15.16:0/2136921335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c103b30 msgr2=0x7fd20c103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 --2- 172.21.15.16:0/2136921335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c103b30 0x7fd20c103f10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009900 tx=0x7fd1fc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 -- 172.21.15.16:0/2136921335 shutdown_connections 2024-09-10T23:45:02.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 --2- 172.21.15.16:0/2136921335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c10d0e0 0x7fd20c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 --2- 172.21.15.16:0/2136921335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c104530 0x7fd20c10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 --2- 172.21.15.16:0/2136921335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c103b30 0x7fd20c103f10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 -- 172.21.15.16:0/2136921335 >> 172.21.15.16:0/2136921335 conn(0x7fd20c0fd700 msgr2=0x7fd20c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:02.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 -- 172.21.15.16:0/2136921335 shutdown_connections 2024-09-10T23:45:02.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.531+0000 7fd211198640 1 -- 172.21.15.16:0/2136921335 wait complete. 2024-09-10T23:45:02.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 Processor -- start 2024-09-10T23:45:02.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 -- start start 2024-09-10T23:45:02.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c103b30 0x7fd20c1019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c104530 0x7fd20c101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c10d0e0 0x7fd20c102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112d60 con 0x7fd20c10d0e0 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112be0 con 0x7fd20c104530 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd211198640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112ee0 con 0x7fd20c103b30 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd20b59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c10d0e0 0x7fd20c102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd20ad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c103b30 0x7fd20c1019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd20ad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c103b30 0x7fd20c1019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:57528/0 (socket says 172.21.15.16:57528) 2024-09-10T23:45:02.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd20b59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c10d0e0 0x7fd20c102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47200/0 (socket says 172.21.15.16:47200) 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd20ad9d640 1 -- 172.21.15.16:0/2849506566 learned_addr learned my addr 172.21.15.16:0/2849506566 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.532+0000 7fd203fff640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c104530 0x7fd20c101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd20b59e640 1 -- 172.21.15.16:0/2849506566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c103b30 msgr2=0x7fd20c1019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd20b59e640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c103b30 0x7fd20c1019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd20b59e640 1 -- 172.21.15.16:0/2849506566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c104530 msgr2=0x7fd20c101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd20b59e640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c104530 0x7fd20c101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd20b59e640 1 -- 172.21.15.16:0/2849506566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c1a76d0 con 0x7fd20c10d0e0 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd203fff640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c104530 0x7fd20c101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd20b59e640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c10d0e0 0x7fd20c102430 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd20400da10 tx=0x7fd20400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd208d99640 1 -- 172.21.15.16:0/2849506566 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20400bd70 con 0x7fd20c10d0e0 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd208d99640 1 -- 172.21.15.16:0/2849506566 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd204003e20 con 0x7fd20c10d0e0 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c1a79c0 con 0x7fd20c10d0e0 2024-09-10T23:45:02.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd208d99640 1 -- 172.21.15.16:0/2849506566 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2040106c0 con 0x7fd20c10d0e0 2024-09-10T23:45:02.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.533+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1a7eb0 con 0x7fd20c10d0e0 2024-09-10T23:45:02.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.535+0000 7fd208d99640 1 -- 172.21.15.16:0/2849506566 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd204024060 con 0x7fd20c10d0e0 2024-09-10T23:45:02.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 Processor -- start 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 -- start start 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560c4e423e60 con 0x560c4e4ad800 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c4e413290 con 0x560c4e4b9790 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd21356d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560c4e4170a0 con 0x560c4e4acee0 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd20ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd20ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47216/0 (socket says 172.21.15.16:47216) 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd20ad9d640 1 -- 172.21.15.16:0/884296880 learned_addr learned my addr 172.21.15.16:0/884296880 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:02.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.536+0000 7fd203fff640 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd208d99640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd203fff640 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20ad9d640 1 -- 172.21.15.16:0/884296880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 msgr2=0x560c4e4ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20ad9d640 1 -- 172.21.15.16:0/884296880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 msgr2=0x560c4e4bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20ad9d640 1 -- 172.21.15.16:0/884296880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4e171930 con 0x560c4e4ad800 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20b59e640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd203fff640 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd208d99640 1 -- 172.21.15.16:0/2849506566 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd2040e6100 con 0x7fd20c10d0e0 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b9250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009a20 tx=0x7fd1fc031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69a9b09460aada server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd2017fa640 1 -- 172.21.15.16:0/884296880 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc040070 con 0x560c4e4ad800 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd2017fa640 1 -- 172.21.15.16:0/884296880 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1fc0316a0 con 0x560c4e4ad800 2024-09-10T23:45:02.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd2017fa640 1 -- 172.21.15.16:0/884296880 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc035040 con 0x560c4e4ad800 2024-09-10T23:45:02.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.537+0000 7fd20b59e640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd2040a8b50 tx=0x7fd2040cf040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:02.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 -- 172.21.15.16:0/884296880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 msgr2=0x560c4e4b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b9250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009a20 tx=0x7fd1fc031e60 comp rx=0 tx=0).stop 2024-09-10T23:45:02.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 -- 172.21.15.16:0/884296880 shutdown_connections 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b9250 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 --2- 172.21.15.16:0/884296880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 -- 172.21.15.16:0/884296880 >> 172.21.15.16:0/884296880 conn(0x560c4e4aad10 msgr2=0x560c4e4abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 -- 172.21.15.16:0/884296880 shutdown_connections 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.538+0000 7fd21356d740 1 -- 172.21.15.16:0/884296880 wait complete. 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 -- start start 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 Processor -- start 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560c4e274890 con 0x560c4e4ad800 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c4e3add40 con 0x560c4e4b9790 2024-09-10T23:45:02.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560c4e4bc3e0 con 0x560c4e4acee0 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd21356d740 10 client.0 _ll_register_callbacks cb 0x560c4e411c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47230/0 (socket says 172.21.15.16:47230) 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 -- 172.21.15.16:0/2470542549 learned_addr learned my addr 172.21.15.16:0/2470542549 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd203fff640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd203fff640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 -- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 msgr2=0x560c4e4b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 -- 172.21.15.16:0/2470542549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 msgr2=0x560c4e4b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd20ad9d640 1 -- 172.21.15.16:0/2470542549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c4e4c5840 con 0x560c4e4ad800 2024-09-10T23:45:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.539+0000 7fd203fff640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b6cb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc005130 tx=0x7fd1fc0052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757af8236287a583 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd1f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd1f27fc640 1 -- 172.21.15.16:0/2470542549 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc040030 con 0x560c4e4ad800 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd1f27fc640 1 -- 172.21.15.16:0/2470542549 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd1fc004050 con 0x560c4e4ad800 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1fc0316a0 con 0x560c4e4ad800 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd1f27fc640 1 -- 172.21.15.16:0/2470542549 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd1fc056050 con 0x560c4e4ad800 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd21356d740 10 client.16386 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c4e4c8160 con 0x560c4e4ad800 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd1f27fc640 1 -- 172.21.15.16:0/2470542549 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1fc0316a0 con 0x560c4e4ad800 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.540+0000 7fd1f27fc640 1 -- 172.21.15.16:0/2470542549 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd1fc0035f0 con 0x560c4e4ad800 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd21356d740 10 client.16386 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd21356d740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd21356d740 20 client.16386 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd21356d740 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4c94b0 0x560c4e4cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd21356d740 4 client.16386 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c4e425db0 con 0x560c4e4c94b0 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd203fff640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4c94b0 0x560c4e4cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd1f27fc640 10 client.16386 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.541+0000 7fd203fff640 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4c94b0 0x560c4e4cb8a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d497952b8529cba1 server_cookie=3e0eedce94026dcb in_seq=0 out_seq=0 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.542+0000 7fd1f27fc640 1 -- 172.21.15.16:0/2470542549 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c4e425db0 con 0x560c4e4c94b0 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.542+0000 7fd1f27fc640 10 client.16386 handle_command_reply: tid=0 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.542+0000 7fd21356d740 1 client.16386 shutdown 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 msgr2=0x560c4e4b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b6cb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc005130 tx=0x7fd1fc0052b0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 shutdown_connections 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4c94b0 0x560c4e4cb8a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4b9790 0x560c4e4b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b6cb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 --2- 172.21.15.16:0/2470542549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4acee0 0x560c4e4b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 >> 172.21.15.16:0/2470542549 conn(0x560c4e4aad10 msgr2=0x560c4e4a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd1f27fc640 0 client.16386 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 shutdown_connections 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 1 -- 172.21.15.16:0/2470542549 wait complete. 2024-09-10T23:45:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.543+0000 7fd21356d740 20 client.16386 trim_cache size 0 max 16384 2024-09-10T23:45:02.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:02 smithi066 ceph-mon[34761]: pgmap v464: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.560+0000 7fd21356d740 1 Processor -- start 2024-09-10T23:45:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.560+0000 7fd21356d740 1 -- start start 2024-09-10T23:45:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd21356d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd21356d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd21356d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd21356d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1b2ff0 con 0x560c4e4ad800 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd21356d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1b08c0 con 0x560c4e4acee0 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd21356d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1ae710 con 0x560c4e4aad10 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47246/0 (socket says 172.21.15.16:47246) 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 -- 172.21.15.16:0/2625240826 learned_addr learned my addr 172.21.15.16:0/2625240826 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 -- 172.21.15.16:0/2625240826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 msgr2=0x560c4e4b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 -- 172.21.15.16:0/2625240826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 msgr2=0x560c4e4b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 -- 172.21.15.16:0/2625240826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4e4ab790 con 0x560c4e4ad800 2024-09-10T23:45:02.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd203fff640 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b3ec0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd20c1034a0 tx=0x7fd1f400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72765f8fa95a438 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:02.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd200ff9640 1 -- 172.21.15.16:0/2625240826 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4012e60 con 0x560c4e4ad800 2024-09-10T23:45:02.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd200ff9640 1 -- 172.21.15.16:0/2625240826 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1f4010db0 con 0x560c4e4ad800 2024-09-10T23:45:02.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.561+0000 7fd200ff9640 1 -- 172.21.15.16:0/2625240826 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4004890 con 0x560c4e4ad800 2024-09-10T23:45:02.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 -- 172.21.15.16:0/2625240826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 msgr2=0x560c4e4b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b3ec0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd20c1034a0 tx=0x7fd1f400b3b0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 -- 172.21.15.16:0/2625240826 shutdown_connections 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e4b3ec0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 --2- 172.21.15.16:0/2625240826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 -- 172.21.15.16:0/2625240826 >> 172.21.15.16:0/2625240826 conn(0x560c4e4b2110 msgr2=0x560c4e4b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 -- 172.21.15.16:0/2625240826 shutdown_connections 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.562+0000 7fd21356d740 1 -- 172.21.15.16:0/2625240826 wait complete. 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 -- start start 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 Processor -- start 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4be680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e52f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1aed80 con 0x560c4e4ad800 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1b01f0 con 0x560c4e4acee0 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1af450 con 0x560c4e4aad10 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd21356d740 10 client.0 _ll_register_callbacks cb 0x7fd1f400b4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e52f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e52f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47250/0 (socket says 172.21.15.16:47250) 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 -- 172.21.15.16:0/1889888495 learned_addr learned my addr 172.21.15.16:0/1889888495 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 -- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 msgr2=0x560c4e4be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 -- 172.21.15.16:0/1889888495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 msgr2=0x560c4e4be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4be680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.563+0000 7fd203fff640 1 -- 172.21.15.16:0/1889888495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c4e4b7610 con 0x560c4e4ad800 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd203fff640 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e52f0d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400b6a0 tx=0x7fd1f4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a28dc5a38abe23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd1f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd1f27fc640 1 -- 172.21.15.16:0/1889888495 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f402e040 con 0x560c4e4ad800 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd1f27fc640 1 -- 172.21.15.16:0/1889888495 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd1f4004220 con 0x560c4e4ad800 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1f4010db0 con 0x560c4e4ad800 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd1f27fc640 1 -- 172.21.15.16:0/1889888495 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd1f4004420 con 0x560c4e4ad800 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 10 client.16392 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c4e536ad0 con 0x560c4e4ad800 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd1f27fc640 1 -- 172.21.15.16:0/1889888495 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1f4010db0 con 0x560c4e4ad800 2024-09-10T23:45:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd1f27fc640 1 -- 172.21.15.16:0/1889888495 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd1f40254f0 con 0x560c4e4ad800 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 10 client.16392 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 20 client.16392 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4b9790 0x560c4e539190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 4 client.16392 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.564+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c4e421860 con 0x560c4e4b9790 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.565+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4b9790 0x560c4e539190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.565+0000 7fd20ad9d640 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4b9790 0x560c4e539190 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f29dbd7859913955 server_cookie=910394ccc0304a8d in_seq=0 out_seq=0 2024-09-10T23:45:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.565+0000 7fd1f27fc640 10 client.16392 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd1f27fc640 1 -- 172.21.15.16:0/1889888495 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c4e421860 con 0x560c4e4b9790 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd1f27fc640 10 client.16392 handle_command_reply: tid=0 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 client.16392 shutdown 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 msgr2=0x560c4e52f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e52f0d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400b6a0 tx=0x7fd1f4005fd0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 shutdown_connections 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560c4e4b9790 0x560c4e539190 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560c4e4ad800 0x560c4e52f0d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c4e4acee0 0x560c4e4be680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 --2- 172.21.15.16:0/1889888495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560c4e4aad10 0x560c4e4be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 >> 172.21.15.16:0/1889888495 conn(0x560c4e4b2110 msgr2=0x560c4e4a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd1f27fc640 0 client.16392 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 shutdown_connections 2024-09-10T23:45:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 1 -- 172.21.15.16:0/1889888495 wait complete. 2024-09-10T23:45:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.567+0000 7fd21356d740 20 client.16392 trim_cache size 0 max 16384 2024-09-10T23:45:02.574 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:45:02.574 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:45:02.574 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "929418da-1031-4c88-ab22-3439cedacaf4", 2024-09-10T23:45:02.574 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:45:02.574 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:45:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 msgr2=0x7fd1f80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd2040a8b50 tx=0x7fd2040cf040 comp rx=0 tx=0).stop 2024-09-10T23:45:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c10d0e0 msgr2=0x7fd20c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c10d0e0 0x7fd20c102430 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd20400da10 tx=0x7fd20400ded0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 shutdown_connections 2024-09-10T23:45:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c10d0e0 0x7fd20c102430 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c104530 0x7fd20c101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 --2- 172.21.15.16:0/2849506566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c103b30 0x7fd20c1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:02.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 >> 172.21.15.16:0/2849506566 conn(0x7fd20c0fd700 msgr2=0x7fd20c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:02.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 shutdown_connections 2024-09-10T23:45:02.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:02.568+0000 7fd211198640 1 -- 172.21.15.16:0/2849506566 wait complete. 2024-09-10T23:45:03.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:45:03.515 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 -- 172.21.15.16:0/1050205025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 msgr2=0x7ff3081020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 --2- 172.21.15.16:0/1050205025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3081020b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff304009900 tx=0x7ff30402a410 comp rx=0 tx=0).stop 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 -- 172.21.15.16:0/1050205025 shutdown_connections 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 --2- 172.21.15.16:0/1050205025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff308108060 0x7ff30810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 --2- 172.21.15.16:0/1050205025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3081076e0 0x7ff308107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 --2- 172.21.15.16:0/1050205025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3081020b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 -- 172.21.15.16:0/1050205025 >> 172.21.15.16:0/1050205025 conn(0x7ff3080fd720 msgr2=0x7ff3080ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 -- 172.21.15.16:0/1050205025 shutdown_connections 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.990+0000 7ff310367640 1 -- 172.21.15.16:0/1050205025 wait complete. 2024-09-10T23:45:04.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 Processor -- start 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 -- start start 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3080fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3081076e0 0x7ff3080fe160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff308108060 0x7ff3080fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff308111d20 con 0x7ff308101cd0 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff308111ba0 con 0x7ff3081076e0 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff310367640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff308111ea0 con 0x7ff308108060 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3080fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3080fdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46726/0 (socket says 172.21.15.16:46726) 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 -- 172.21.15.16:0/2044164114 learned_addr learned my addr 172.21.15.16:0/2044164114 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e904640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff308108060 0x7ff3080fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30d902640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3081076e0 0x7ff3080fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 -- 172.21.15.16:0/2044164114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff308108060 msgr2=0x7ff3080fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff308108060 0x7ff3080fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 -- 172.21.15.16:0/2044164114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3081076e0 msgr2=0x7ff3080fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3081076e0 0x7ff3080fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30e103640 1 -- 172.21.15.16:0/2044164114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3081a77a0 con 0x7ff308101cd0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.991+0000 7ff30d902640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3081076e0 0x7ff3080fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.992+0000 7ff30e103640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3080fdc20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff304005940 tx=0x7ff3040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.992+0000 7ff2fb7fe640 1 -- 172.21.15.16:0/2044164114 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30403f030 con 0x7ff308101cd0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.992+0000 7ff2fb7fe640 1 -- 172.21.15.16:0/2044164114 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff304003cb0 con 0x7ff308101cd0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.992+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3081a7a30 con 0x7ff308101cd0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.992+0000 7ff2fb7fe640 1 -- 172.21.15.16:0/2044164114 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304035070 con 0x7ff308101cd0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.992+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081a7f60 con 0x7ff308101cd0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.994+0000 7ff2fb7fe640 1 -- 172.21.15.16:0/2044164114 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff30403bbf0 con 0x7ff308101cd0 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.994+0000 7ff31273c740 1 Processor -- start 2024-09-10T23:45:04.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff31273c740 1 -- start start 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff31273c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x56161953c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff31273c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x561619548410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff31273c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x56161954ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff31273c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5616194b2e50 con 0x561619548950 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff31273c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5616194a2280 con 0x56161953c0a0 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff31273c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5616194a6090 con 0x56161953c9c0 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x56161954ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x56161954ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46728/0 (socket says 172.21.15.16:46728) 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 -- 172.21.15.16:0/4264313522 learned_addr learned my addr 172.21.15.16:0/4264313522 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30e904640 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x56161953c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30e103640 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x561619548410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff2fb7fe640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff2f40b54d0 0x7ff2f40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 -- 172.21.15.16:0/4264313522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 msgr2=0x561619548410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x561619548410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 -- 172.21.15.16:0/4264313522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 msgr2=0x56161953c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x56161953c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30d902640 1 -- 172.21.15.16:0/4264313522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561619200650 con 0x561619548950 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.995+0000 7ff30e103640 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x561619548410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.996+0000 7ff30e904640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff2f40b54d0 0x7ff2f40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.996+0000 7ff2fb7fe640 1 -- 172.21.15.16:0/2044164114 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff304106b30 con 0x7ff308101cd0 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.996+0000 7ff30d902640 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x56161954ad40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00bd30 tx=0x7ff2fc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95dbe6a4d8cf9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.996+0000 7ff2f8de6640 1 -- 172.21.15.16:0/4264313522 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc015070 con 0x561619548950 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.996+0000 7ff2f8de6640 1 -- 172.21.15.16:0/4264313522 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2fc00be20 con 0x561619548950 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.996+0000 7ff30e904640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff2f40b54d0 0x7ff2f40b7990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff3080ffce0 tx=0x7ff30000c040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.996+0000 7ff2f8de6640 1 -- 172.21.15.16:0/4264313522 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0118e0 con 0x561619548950 2024-09-10T23:45:04.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 -- 172.21.15.16:0/4264313522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 msgr2=0x56161954ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x56161954ad40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00bd30 tx=0x7ff2fc00f730 comp rx=0 tx=0).stop 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 -- 172.21.15.16:0/4264313522 shutdown_connections 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x56161954ad40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x561619548410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 --2- 172.21.15.16:0/4264313522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x56161953c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 -- 172.21.15.16:0/4264313522 >> 172.21.15.16:0/4264313522 conn(0x561619539ed0 msgr2=0x56161953b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 -- 172.21.15.16:0/4264313522 shutdown_connections 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 -- 172.21.15.16:0/4264313522 wait complete. 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 -- start start 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.997+0000 7ff31273c740 1 Processor -- start 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x561619548270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x5616195456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619545cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561619303700 con 0x561619548950 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56161943d110 con 0x56161953c0a0 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56161954b5d0 con 0x56161953c9c0 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 10 client.0 _ll_register_callbacks cb 0x561619456990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619545cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619545cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46734/0 (socket says 172.21.15.16:46734) 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 -- 172.21.15.16:0/853339310 learned_addr learned my addr 172.21.15.16:0/853339310 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30d902640 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x5616195456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e103640 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x561619548270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 -- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 msgr2=0x5616195456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x5616195456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 -- 172.21.15.16:0/853339310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 msgr2=0x561619548270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x561619548270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 -- 172.21.15.16:0/853339310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56161946ac40 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff30e904640 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619545cf0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff30001ae60 tx=0x7ff30000e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd96e4f124c8e409 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff2f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/853339310 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300018bf0 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/853339310 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff300018d90 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.998+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2fc00be20 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/853339310 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff30001a020 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 10 client.16404 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561619556f00 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/853339310 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2fc00be20 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/853339310 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff300019410 con 0x561619548950 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 10 client.16404 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:04.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 20 client.16404 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195584b0 0x56161955a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 4 client.16404 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616194b4da0 con 0x5616195584b0 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:03.999+0000 7ff30e103640 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195584b0 0x56161955a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.000+0000 7ff30e103640 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195584b0 0x56161955a8e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa8b804aaf23b0b server_cookie=52a381488e6cd3d2 in_seq=0 out_seq=0 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.000+0000 7ff2f1ffb640 10 client.16404 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.000+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/853339310 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616194b4da0 con 0x5616195584b0 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.000+0000 7ff2f1ffb640 10 client.16404 handle_command_reply: tid=0 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.000+0000 7ff31273c740 1 client.16404 shutdown 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 msgr2=0x561619545cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619545cf0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff30001ae60 tx=0x7ff30000e040 comp rx=0 tx=0).stop 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 shutdown_connections 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195584b0 0x56161955a8e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619545cf0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c9c0 0x5616195456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff2f1ffb640 0 client.16404 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:04.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 --2- 172.21.15.16:0/853339310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c0a0 0x561619548270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 >> 172.21.15.16:0/853339310 conn(0x561619539ed0 msgr2=0x56161953fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:04.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 shutdown_connections 2024-09-10T23:45:04.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 1 -- 172.21.15.16:0/853339310 wait complete. 2024-09-10T23:45:04.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.001+0000 7ff31273c740 20 client.16404 trim_cache size 0 max 16384 2024-09-10T23:45:04.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.018+0000 7ff31273c740 1 Processor -- start 2024-09-10T23:45:04.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.018+0000 7ff31273c740 1 -- start start 2024-09-10T23:45:04.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff31273c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56161953c0a0 0x561619554800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff31273c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619534e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff31273c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561619548950 0x561619549d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff31273c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081b30d0 con 0x56161953c0a0 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff31273c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081b09a0 con 0x56161953c9c0 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff31273c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081ae7f0 con 0x561619548950 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56161953c0a0 0x561619554800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56161953c0a0 0x561619554800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46740/0 (socket says 172.21.15.16:46740) 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 -- 172.21.15.16:0/1590438010 learned_addr learned my addr 172.21.15.16:0/1590438010 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e904640 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561619548950 0x561619549d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30d902640 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619534e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 -- 172.21.15.16:0/1590438010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561619548950 msgr2=0x561619549d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561619548950 0x561619549d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 -- 172.21.15.16:0/1590438010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 msgr2=0x561619534e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619534e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 -- 172.21.15.16:0/1590438010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56161953b290 con 0x56161953c0a0 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30d902640 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619534e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff30e103640 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56161953c0a0 0x561619554800 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff3040c95e0 tx=0x7ff30403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4180f7bbee361b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff2f3fff640 1 -- 172.21.15.16:0/1590438010 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304049040 con 0x56161953c0a0 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.019+0000 7ff2f3fff640 1 -- 172.21.15.16:0/1590438010 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3040ccb20 con 0x56161953c0a0 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff2f3fff640 1 -- 172.21.15.16:0/1590438010 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3040d1af0 con 0x56161953c0a0 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 -- 172.21.15.16:0/1590438010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56161953c0a0 msgr2=0x561619554800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56161953c0a0 0x561619554800 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff3040c95e0 tx=0x7ff30403b6b0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 -- 172.21.15.16:0/1590438010 shutdown_connections 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561619548950 0x561619549d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619534e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 --2- 172.21.15.16:0/1590438010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56161953c0a0 0x561619554800 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 -- 172.21.15.16:0/1590438010 >> 172.21.15.16:0/1590438010 conn(0x561619539ed0 msgr2=0x561619543f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 -- 172.21.15.16:0/1590438010 shutdown_connections 2024-09-10T23:45:04.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.020+0000 7ff31273c740 1 -- 172.21.15.16:0/1590438010 wait complete. 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 -- start start 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 Processor -- start 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c0a0 0x561619550860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619550da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619541930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081aee60 con 0x561619548950 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081b02d0 con 0x56161953c9c0 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081af530 con 0x56161953c0a0 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff31273c740 10 client.0 _ll_register_callbacks cb 0x7ff300009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619541930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619541930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46756/0 (socket says 172.21.15.16:46756) 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 -- 172.21.15.16:0/5515506 learned_addr learned my addr 172.21.15.16:0/5515506 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e103640 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c0a0 0x561619550860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30d902640 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619550da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 -- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c0a0 msgr2=0x561619550860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c0a0 0x561619550860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 -- 172.21.15.16:0/5515506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 msgr2=0x561619550da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619550da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.021+0000 7ff30e904640 1 -- 172.21.15.16:0/5515506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616195485e0 con 0x561619548950 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff30e904640 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619541930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff300019880 tx=0x7ff30001a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b11097d4ac9bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff2f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/5515506 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300019620 con 0x561619548950 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/5515506 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff300019af0 con 0x561619548950 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3040ccb20 con 0x561619548950 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/5515506 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff300019d10 con 0x561619548950 2024-09-10T23:45:04.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 10 client.16410 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5616195c6600 con 0x561619548950 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/5515506 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3040ccb20 con 0x561619548950 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/5515506 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff30003c410 con 0x561619548950 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 10 client.16410 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 20 client.16410 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195c6cf0 0x5616195c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 4 client.16410 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.022+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616194b0850 con 0x5616195c6cf0 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff30e103640 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195c6cf0 0x5616195c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff30e103640 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195c6cf0 0x5616195c9110 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89de264207cd2e0a server_cookie=82295c754a46e9e0 in_seq=0 out_seq=0 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff2f1ffb640 10 client.16410 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:04.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff2f1ffb640 1 -- 172.21.15.16:0/5515506 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x5616194b0850 con 0x5616195c6cf0 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff2f1ffb640 10 client.16410 handle_command_reply: tid=0 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 client.16410 shutdown 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 msgr2=0x561619541930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619541930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff300019880 tx=0x7ff30001a3f0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 shutdown_connections 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5616195c6cf0 0x5616195c9110 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561619548950 0x561619541930 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56161953c9c0 0x561619550da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.023+0000 7ff31273c740 1 --2- 172.21.15.16:0/5515506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56161953c0a0 0x561619550860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 >> 172.21.15.16:0/5515506 conn(0x561619539ed0 msgr2=0x561619538700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff2f1ffb640 0 client.16410 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 shutdown_connections 2024-09-10T23:45:04.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff31273c740 1 -- 172.21.15.16:0/5515506 wait complete. 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff31273c740 20 client.16410 trim_cache size 0 max 16384 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "929418da-1031-4c88-ab22-3439cedacaf4", 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:45:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:04.045 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:45:04.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff2f40b54d0 msgr2=0x7ff2f40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff2f40b54d0 0x7ff2f40b7990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff3080ffce0 tx=0x7ff30000c040 comp rx=0 tx=0).stop 2024-09-10T23:45:04.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 msgr2=0x7ff3080fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3080fdc20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff304005940 tx=0x7ff3040042f0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 shutdown_connections 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff308108060 0x7ff3080fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff2f40b54d0 0x7ff2f40b7990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3081076e0 0x7ff3080fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 --2- 172.21.15.16:0/2044164114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308101cd0 0x7ff3080fdc20 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 >> 172.21.15.16:0/2044164114 conn(0x7ff3080fd720 msgr2=0x7ff30806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 shutdown_connections 2024-09-10T23:45:04.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:04.024+0000 7ff310367640 1 -- 172.21.15.16:0/2044164114 wait complete. 2024-09-10T23:45:04.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:04 smithi071 ceph-mon[35018]: pgmap v465: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:45:04.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:04 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:45:04.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:04 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:04.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:04 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:45:04.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:04 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:04.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:04 smithi066 ceph-mon[34761]: pgmap v465: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:45:04.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:04 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:45:04.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:04 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:04.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:04 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:45:04.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:04 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:04.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:04 smithi016 ceph-mon[30855]: pgmap v465: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:45:04.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:04 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:45:04.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:04 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:04.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:04 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:45:04.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:04 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:04.820 INFO:tasks.cephfs.filesystem:scrub status for tag:929418da-1031-4c88-ab22-3439cedacaf4 - {'path': '/', 'tag': '929418da-1031-4c88-ab22-3439cedacaf4', 'options': 'recursive,force'} 2024-09-10T23:45:06.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:06 smithi066 ceph-mon[34761]: pgmap v466: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:06 smithi016 ceph-mon[30855]: pgmap v466: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:06.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:06 smithi071 ceph-mon[35018]: pgmap v466: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:08.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:08 smithi016 ceph-mon[30855]: pgmap v467: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:08.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:08 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:45:08.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:08 smithi066 ceph-mon[34761]: pgmap v467: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:08.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:08 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:45:08.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:08 smithi071 ceph-mon[35018]: pgmap v467: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:08.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:08 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:45:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:10 smithi066 ceph-mon[34761]: pgmap v468: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:45:10.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:10 smithi016 ceph-mon[30855]: pgmap v468: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:45:10.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:10 smithi071 ceph-mon[35018]: pgmap v468: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:45:12.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:12 smithi066 ceph-mon[34761]: pgmap v469: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:12 smithi016 ceph-mon[30855]: pgmap v469: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:12.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:12 smithi071 ceph-mon[35018]: pgmap v469: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:45:14.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:14 smithi066 ceph-mon[34761]: pgmap v470: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:45:14.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:14 smithi016 ceph-mon[30855]: pgmap v470: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:45:14.772 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:14 smithi071 ceph-mon[35018]: pgmap v470: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:45:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:16 smithi066 ceph-mon[34761]: pgmap v471: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:45:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:16 smithi016 ceph-mon[30855]: pgmap v471: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:45:16.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:16 smithi071 ceph-mon[35018]: pgmap v471: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:45:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:18 smithi016 ceph-mon[30855]: pgmap v472: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:45:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:18 smithi066 ceph-mon[34761]: pgmap v472: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:45:18.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:18 smithi071 ceph-mon[35018]: pgmap v472: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:45:20.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:20 smithi066 ceph-mon[34761]: pgmap v473: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:45:20.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:20 smithi016 ceph-mon[30855]: pgmap v473: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:45:20.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:20 smithi071 ceph-mon[35018]: pgmap v473: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:45:21.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:21 smithi016 ceph-mon[30855]: pgmap v474: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:45:21.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:21 smithi071 ceph-mon[35018]: pgmap v474: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:45:21.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:21 smithi066 ceph-mon[34761]: pgmap v474: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:45:23.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:23 smithi016 ceph-mon[30855]: pgmap v475: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:45:24.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:23 smithi071 ceph-mon[35018]: pgmap v475: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:45:24.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:23 smithi066 ceph-mon[34761]: pgmap v475: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:45:25.854 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:25 smithi066 ceph-mon[34761]: pgmap v476: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:25.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:25 smithi016 ceph-mon[30855]: pgmap v476: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:26.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:25 smithi071 ceph-mon[35018]: pgmap v476: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:27.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:27 smithi016 ceph-mon[30855]: pgmap v477: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:28.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:27 smithi071 ceph-mon[35018]: pgmap v477: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:28.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:27 smithi066 ceph-mon[34761]: pgmap v477: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:28.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:28.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:28.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:28.986 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:45:29.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:29.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:29.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:29.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:45:29.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:29.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:29.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:29.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:45:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:30 smithi016 ceph-mon[30855]: pgmap v478: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:45:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:30 smithi071 ceph-mon[35018]: pgmap v478: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:45:30.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:30 smithi066 ceph-mon[34761]: pgmap v478: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:45:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:32 smithi016 ceph-mon[30855]: pgmap v479: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:45:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:32 smithi071 ceph-mon[35018]: pgmap v479: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:45:32.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:32 smithi066 ceph-mon[34761]: pgmap v479: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:45:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:34 smithi016 ceph-mon[30855]: pgmap v480: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:45:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:34 smithi071 ceph-mon[35018]: pgmap v480: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:45:34.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:34 smithi066 ceph-mon[34761]: pgmap v480: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:45:34.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:45:35.100 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.630+0000 7f6b93d63640 1 -- 172.21.15.16:0/1447077219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c108020 msgr2=0x7f6b8c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.630+0000 7f6b93d63640 1 --2- 172.21.15.16:0/1447077219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c108020 0x7f6b8c10e820 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009900 tx=0x7f6b8402a410 comp rx=0 tx=0).stop 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.630+0000 7f6b93d63640 1 -- 172.21.15.16:0/1447077219 shutdown_connections 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.630+0000 7f6b93d63640 1 --2- 172.21.15.16:0/1447077219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c108020 0x7f6b8c10e820 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.630+0000 7f6b93d63640 1 --2- 172.21.15.16:0/1447077219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b8c1076a0 0x7f6b8c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.630+0000 7f6b93d63640 1 --2- 172.21.15.16:0/1447077219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b8c101c90 0x7f6b8c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.631+0000 7f6b93d63640 1 -- 172.21.15.16:0/1447077219 >> 172.21.15.16:0/1447077219 conn(0x7f6b8c0fd700 msgr2=0x7f6b8c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.631+0000 7f6b93d63640 1 -- 172.21.15.16:0/1447077219 shutdown_connections 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.631+0000 7f6b93d63640 1 -- 172.21.15.16:0/1447077219 wait complete. 2024-09-10T23:45:35.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.631+0000 7f6b93d63640 1 Processor -- start 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.631+0000 7f6b93d63640 1 -- start start 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b93d63640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c101c90 0x7f6b8c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b93d63640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b8c1076a0 0x7f6b8c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b93d63640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b8c108020 0x7f6b8c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b93d63640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c111ce0 con 0x7f6b8c101c90 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b93d63640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c111b60 con 0x7f6b8c1076a0 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b93d63640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c111e60 con 0x7f6b8c108020 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c101c90 0x7f6b8c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c101c90 0x7f6b8c199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42688/0 (socket says 172.21.15.16:42688) 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 -- 172.21.15.16:0/3849100342 learned_addr learned my addr 172.21.15.16:0/3849100342 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b92300640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b8c108020 0x7f6b8c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b912fe640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b8c1076a0 0x7f6b8c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 -- 172.21.15.16:0/3849100342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b8c108020 msgr2=0x7f6b8c19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b8c108020 0x7f6b8c19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 -- 172.21.15.16:0/3849100342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b8c1076a0 msgr2=0x7f6b8c199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b8c1076a0 0x7f6b8c199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.632+0000 7f6b91aff640 1 -- 172.21.15.16:0/3849100342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c19f2b0 con 0x7f6b8c101c90 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.633+0000 7f6b91aff640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c101c90 0x7f6b8c199200 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00eab0 tx=0x7f6b7c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.633+0000 7f6b8affd640 1 -- 172.21.15.16:0/3849100342 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00ce40 con 0x7f6b8c101c90 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.633+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8c19f5a0 con 0x7f6b8c101c90 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.633+0000 7f6b8affd640 1 -- 172.21.15.16:0/3849100342 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b7c011920 con 0x7f6b8c101c90 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.633+0000 7f6b8affd640 1 -- 172.21.15.16:0/3849100342 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c010a30 con 0x7f6b8c101c90 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.633+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8c1a5c60 con 0x7f6b8c101c90 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.635+0000 7f6b96138740 1 Processor -- start 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b96138740 1 -- start start 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b96138740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9163860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b96138740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c916f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b96138740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9172120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b8affd640 1 -- 172.21.15.16:0/3849100342 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f6b7c00f040 con 0x7f6b8c101c90 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b96138740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5640c90d9e50 con 0x5640c9163da0 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b96138740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5640c90c9280 con 0x5640c916fd30 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b96138740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5640c90cd090 con 0x5640c9163480 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b91aff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c916f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b91aff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c916f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42704/0 (socket says 172.21.15.16:42704) 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b91aff640 1 -- 172.21.15.16:0/2755568794 learned_addr learned my addr 172.21.15.16:0/2755568794 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b92300640 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9163860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b912fe640 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9172120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b92300640 1 -- 172.21.15.16:0/2755568794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 msgr2=0x5640c9172120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b92300640 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9172120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b92300640 1 -- 172.21.15.16:0/2755568794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 msgr2=0x5640c916f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b92300640 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c916f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.636+0000 7f6b92300640 1 -- 172.21.15.16:0/2755568794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c8e27650 con 0x5640c9163480 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.637+0000 7f6b92300640 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9163860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b84005940 tx=0x7f6b84032c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d48f4be84547553b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.637+0000 7f6b8affd640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6b740b5450 0x7f6b740b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.637+0000 7f6b91aff640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6b740b5450 0x7f6b740b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.637+0000 7f6b73fff640 1 -- 172.21.15.16:0/2755568794 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84040070 con 0x5640c9163480 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.637+0000 7f6b73fff640 1 -- 172.21.15.16:0/2755568794 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b840316a0 con 0x5640c9163480 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.637+0000 7f6b73fff640 1 -- 172.21.15.16:0/2755568794 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84035040 con 0x5640c9163480 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.637+0000 7f6b8affd640 1 -- 172.21.15.16:0/3849100342 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6b7c0e6220 con 0x7f6b8c101c90 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 -- 172.21.15.16:0/2755568794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 msgr2=0x5640c9163860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b91aff640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6b740b5450 0x7f6b740b7910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0a8cd0 tx=0x7f6b7c0e9d60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9163860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b84005940 tx=0x7f6b84032c50 comp rx=0 tx=0).stop 2024-09-10T23:45:35.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 -- 172.21.15.16:0/2755568794 shutdown_connections 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9172120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c916f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 --2- 172.21.15.16:0/2755568794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9163860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 -- 172.21.15.16:0/2755568794 >> 172.21.15.16:0/2755568794 conn(0x5640c91612b0 msgr2=0x5640c9162450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 -- 172.21.15.16:0/2755568794 shutdown_connections 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 -- 172.21.15.16:0/2755568794 wait complete. 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 -- start start 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.638+0000 7f6b96138740 1 Processor -- start 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b96138740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c916f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b96138740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163da0 0x5640c916ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b96138740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c916fd30 0x5640c916d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b96138740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5640c8f2a700 con 0x5640c916fd30 2024-09-10T23:45:35.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b96138740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5640c9064110 con 0x5640c9163da0 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b96138740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5640c9172950 con 0x5640c9163480 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b96138740 10 client.0 _ll_register_callbacks cb 0x5640c907d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c916fd30 0x5640c916d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c916fd30 0x5640c916d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42706/0 (socket says 172.21.15.16:42706) 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 -- 172.21.15.16:0/2430332786 learned_addr learned my addr 172.21.15.16:0/2430332786 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b912fe640 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163da0 0x5640c916ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c916f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 -- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 msgr2=0x5640c916f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c916f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 -- 172.21.15.16:0/2430332786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163da0 msgr2=0x5640c916ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163da0 0x5640c916ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.639+0000 7f6b92300640 1 -- 172.21.15.16:0/2430332786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640c9091c40 con 0x5640c916fd30 2024-09-10T23:45:35.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b92300640 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c916fd30 0x5640c916d0a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6b840057c0 tx=0x7f6b84005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9cf2a8498d1e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b717fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b717fa640 1 -- 172.21.15.16:0/2430332786 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84040070 con 0x5640c916fd30 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b717fa640 1 -- 172.21.15.16:0/2430332786 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6b84004030 con 0x5640c916fd30 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b840316a0 con 0x5640c916fd30 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b717fa640 1 -- 172.21.15.16:0/2430332786 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b84035040 con 0x5640c916fd30 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 10 client.16422 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5640c917e280 con 0x5640c916fd30 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b717fa640 1 -- 172.21.15.16:0/2430332786 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b840316a0 con 0x5640c916fd30 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b717fa640 1 -- 172.21.15.16:0/2430332786 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b840035f0 con 0x5640c916fd30 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 10 client.16422 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 20 client.16422 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:35.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c917f5d0 0x5640c91819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 4 client.16422 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.640+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640c90dbda0 con 0x5640c917f5d0 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.641+0000 7f6b912fe640 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c917f5d0 0x5640c91819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.641+0000 7f6b912fe640 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c917f5d0 0x5640c91819c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7317a67c5f469c2 server_cookie=4bada463bb51c37c in_seq=0 out_seq=0 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.641+0000 7f6b717fa640 10 client.16422 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b717fa640 1 -- 172.21.15.16:0/2430332786 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640c90dbda0 con 0x5640c917f5d0 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b717fa640 10 client.16422 handle_command_reply: tid=0 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 client.16422 shutdown 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c916fd30 msgr2=0x5640c916d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c916fd30 0x5640c916d0a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6b840057c0 tx=0x7f6b84005d90 comp rx=0 tx=0).stop 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 shutdown_connections 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c917f5d0 0x5640c91819c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c916fd30 0x5640c916d0a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163da0 0x5640c916ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b717fa640 0 client.16422 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 --2- 172.21.15.16:0/2430332786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c916f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 >> 172.21.15.16:0/2430332786 conn(0x5640c91612b0 msgr2=0x5640c9166e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 shutdown_connections 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 1 -- 172.21.15.16:0/2430332786 wait complete. 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.642+0000 7f6b96138740 20 client.16422 trim_cache size 0 max 16384 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 Processor -- start 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 -- start start 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c9171120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9171660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1b0df0 con 0x5640c9163da0 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1ae6c0 con 0x5640c916fd30 2024-09-10T23:45:35.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b96138740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1ac510 con 0x5640c9163480 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b912fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c9171120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b912fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c9171120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42710/0 (socket says 172.21.15.16:42710) 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b912fe640 1 -- 172.21.15.16:0/3162390669 learned_addr learned my addr 172.21.15.16:0/3162390669 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b92300640 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.660+0000 7f6b92300640 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9171660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b912fe640 1 -- 172.21.15.16:0/3162390669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 msgr2=0x5640c9160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b912fe640 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b912fe640 1 -- 172.21.15.16:0/3162390669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 msgr2=0x5640c9171660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b912fe640 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9171660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b912fe640 1 -- 172.21.15.16:0/3162390669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640c9162990 con 0x5640c9163da0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b912fe640 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c9171120 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5640c90cd090 tx=0x7f6b8000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3528623787ef845e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b737fe640 1 -- 172.21.15.16:0/3162390669 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80029070 con 0x5640c9163da0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b737fe640 1 -- 172.21.15.16:0/3162390669 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b80003de0 con 0x5640c9163da0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.661+0000 7f6b737fe640 1 -- 172.21.15.16:0/3162390669 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80011800 con 0x5640c9163da0 2024-09-10T23:45:35.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 -- 172.21.15.16:0/3162390669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 msgr2=0x5640c9171120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c9171120 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5640c90cd090 tx=0x7f6b8000b390 comp rx=0 tx=0).stop 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 -- 172.21.15.16:0/3162390669 shutdown_connections 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c916fd30 0x5640c9171660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c9171120 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 --2- 172.21.15.16:0/3162390669 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c9163480 0x5640c9160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 -- 172.21.15.16:0/3162390669 >> 172.21.15.16:0/3162390669 conn(0x5640c91612b0 msgr2=0x5640c916e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 -- 172.21.15.16:0/3162390669 shutdown_connections 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 -- 172.21.15.16:0/3162390669 wait complete. 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 -- start start 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.662+0000 7f6b96138740 1 Processor -- start 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163480 0x5640c9185070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c91815a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c916fd30 0x5640c9181ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1acb80 con 0x5640c9163da0 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1adff0 con 0x5640c9163480 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1ad250 con 0x5640c916fd30 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 10 client.0 _ll_register_callbacks cb 0x7f6b7c0e9c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:45:35.681 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:45:35.682 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.683 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:35.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c91815a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c91815a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42716/0 (socket says 172.21.15.16:42716) 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 -- 172.21.15.16:0/95891876 learned_addr learned my addr 172.21.15.16:0/95891876 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b92300640 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163480 0x5640c9185070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b92300640 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c916fd30 0x5640c9181ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 -- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c916fd30 msgr2=0x5640c9181ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c916fd30 0x5640c9181ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 -- 172.21.15.16:0/95891876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163480 msgr2=0x5640c9185070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163480 0x5640c9185070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 -- 172.21.15.16:0/95891876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640c9182220 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b912fe640 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c91815a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b80000c00 tx=0x7f6b80004190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3227875f39b3b6da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b717fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b717fa640 1 -- 172.21.15.16:0/95891876 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80032060 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b717fa640 1 -- 172.21.15.16:0/95891876 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6b80005240 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.663+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b80003de0 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b717fa640 1 -- 172.21.15.16:0/95891876 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b80029040 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 10 client.16428 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5640c91ed080 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b717fa640 1 -- 172.21.15.16:0/95891876 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b80003de0 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b717fa640 1 -- 172.21.15.16:0/95891876 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b8002c070 con 0x5640c9163da0 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 10 client.16428 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 20 client.16428 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c91ed720 0x5640c91efb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:35.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 4 client.16428 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640c90d7850 con 0x5640c91ed720 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.664+0000 7f6b92300640 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c91ed720 0x5640c91efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b92300640 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c91ed720 0x5640c91efb40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153007b433d3ef10 server_cookie=9e61dfc3ddce68a9 in_seq=0 out_seq=0 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b717fa640 10 client.16428 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b717fa640 1 -- 172.21.15.16:0/95891876 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x5640c90d7850 con 0x5640c91ed720 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b717fa640 10 client.16428 handle_command_reply: tid=0 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 client.16428 shutdown 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 msgr2=0x5640c91815a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c91815a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b80000c00 tx=0x7f6b80004190 comp rx=0 tx=0).stop 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 shutdown_connections 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5640c91ed720 0x5640c91efb40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5640c916fd30 0x5640c9181ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640c9163da0 0x5640c91815a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b717fa640 0 client.16428 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:35.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 --2- 172.21.15.16:0/95891876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5640c9163480 0x5640c9185070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 >> 172.21.15.16:0/95891876 conn(0x5640c91612b0 msgr2=0x5640c9166510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 shutdown_connections 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.665+0000 7f6b96138740 1 -- 172.21.15.16:0/95891876 wait complete. 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b96138740 20 client.16428 trim_cache size 0 max 16384 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6b740b5450 msgr2=0x7f6b740b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6b740b5450 0x7f6b740b7910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0a8cd0 tx=0x7f6b7c0e9d60 comp rx=0 tx=0).stop 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c101c90 msgr2=0x7f6b8c199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c101c90 0x7f6b8c199200 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00eab0 tx=0x7f6b7c00ef70 comp rx=0 tx=0).stop 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 shutdown_connections 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b8c108020 0x7f6b8c19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6b740b5450 0x7f6b740b7910 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b8c1076a0 0x7f6b8c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 --2- 172.21.15.16:0/3849100342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b8c101c90 0x7f6b8c199200 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:35.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 >> 172.21.15.16:0/3849100342 conn(0x7f6b8c0fd700 msgr2=0x7f6b8c06acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:35.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 shutdown_connections 2024-09-10T23:45:35.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:35.666+0000 7f6b93d63640 1 -- 172.21.15.16:0/3849100342 wait complete. 2024-09-10T23:45:36.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:36 smithi016 ceph-mon[30855]: pgmap v481: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:36.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:36 smithi071 ceph-mon[35018]: pgmap v481: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:36.544 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:45:36.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:45:36.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:36 smithi066 ceph-mon[34761]: pgmap v481: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:36.803 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:37.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 -- 172.21.15.16:0/2676735967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 msgr2=0x7fe13c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:37.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 --2- 172.21.15.16:0/2676735967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c10e820 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe134009ca0 tx=0x7fe13402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 -- 172.21.15.16:0/2676735967 shutdown_connections 2024-09-10T23:45:37.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 --2- 172.21.15.16:0/2676735967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c10e820 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 --2- 172.21.15.16:0/2676735967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe13c1076a0 0x7fe13c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 --2- 172.21.15.16:0/2676735967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c101c90 0x7fe13c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 -- 172.21.15.16:0/2676735967 >> 172.21.15.16:0/2676735967 conn(0x7fe13c0fd700 msgr2=0x7fe13c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 -- 172.21.15.16:0/2676735967 shutdown_connections 2024-09-10T23:45:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.344+0000 7fe142e0d640 1 -- 172.21.15.16:0/2676735967 wait complete. 2024-09-10T23:45:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 Processor -- start 2024-09-10T23:45:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 -- start start 2024-09-10T23:45:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe13c101c90 0x7fe13c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c1076a0 0x7fe13c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c111ce0 con 0x7fe13c108020 2024-09-10T23:45:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c111b60 con 0x7fe13c1076a0 2024-09-10T23:45:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe142e0d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c111e60 con 0x7fe13c101c90 2024-09-10T23:45:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42746/0 (socket says 172.21.15.16:42746) 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 -- 172.21.15.16:0/472479925 learned_addr learned my addr 172.21.15.16:0/472479925 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe140ba9640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe13c101c90 0x7fe13c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe13bfff640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c1076a0 0x7fe13c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 -- 172.21.15.16:0/472479925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe13c101c90 msgr2=0x7fe13c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe13c101c90 0x7fe13c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 -- 172.21.15.16:0/472479925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c1076a0 msgr2=0x7fe13c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c1076a0 0x7fe13c199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.345+0000 7fe1413aa640 1 -- 172.21.15.16:0/472479925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c19f380 con 0x7fe13c108020 2024-09-10T23:45:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.346+0000 7fe1413aa640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c19ebb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe134005cc0 tx=0x7fe13402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.346+0000 7fe139ffb640 1 -- 172.21.15.16:0/472479925 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134003bf0 con 0x7fe13c108020 2024-09-10T23:45:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.346+0000 7fe139ffb640 1 -- 172.21.15.16:0/472479925 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe134003d90 con 0x7fe13c108020 2024-09-10T23:45:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.346+0000 7fe139ffb640 1 -- 172.21.15.16:0/472479925 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13402fb20 con 0x7fe13c108020 2024-09-10T23:45:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.346+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c19f610 con 0x7fe13c108020 2024-09-10T23:45:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.346+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c1a5db0 con 0x7fe13c108020 2024-09-10T23:45:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.347+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c102070 con 0x7fe13c108020 2024-09-10T23:45:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.349+0000 7fe139ffb640 1 -- 172.21.15.16:0/472479925 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe134004580 con 0x7fe13c108020 2024-09-10T23:45:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.350+0000 7fe139ffb640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1240b54d0 0x7fe1240b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.350+0000 7fe139ffb640 1 -- 172.21.15.16:0/472479925 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fe1341073d0 con 0x7fe13c108020 2024-09-10T23:45:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.350+0000 7fe140ba9640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1240b54d0 0x7fe1240b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.351+0000 7fe140ba9640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1240b54d0 0x7fe1240b7990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009990 tx=0x7fe12c009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:37.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.353+0000 7fe139ffb640 1 -- 172.21.15.16:0/472479925 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe1340cdf50 con 0x7fe13c108020 2024-09-10T23:45:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.576+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe13c19a400 con 0x7fe13c108020 2024-09-10T23:45:37.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.577+0000 7fe139ffb640 1 -- 172.21.15.16:0/472479925 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fe13c19a400 con 0x7fe13c108020 2024-09-10T23:45:37.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:45:37.579 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:45:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:45:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1240b54d0 msgr2=0x7fe1240b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1240b54d0 0x7fe1240b7990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009990 tx=0x7fe12c009110 comp rx=0 tx=0).stop 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 msgr2=0x7fe13c19ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c19ebb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe134005cc0 tx=0x7fe13402f380 comp rx=0 tx=0).stop 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 shutdown_connections 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe13c108020 0x7fe13c19ebb0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe1240b54d0 0x7fe1240b7990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c1076a0 0x7fe13c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 --2- 172.21.15.16:0/472479925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe13c101c90 0x7fe13c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 >> 172.21.15.16:0/472479925 conn(0x7fe13c0fd700 msgr2=0x7fe13c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.579+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 shutdown_connections 2024-09-10T23:45:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:37.580+0000 7fe142e0d640 1 -- 172.21.15.16:0/472479925 wait complete. 2024-09-10T23:45:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:38 smithi016 ceph-mon[30855]: pgmap v482: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:38 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/472479925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:45:38.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:45:38.499 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:38.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:38 smithi071 ceph-mon[35018]: pgmap v482: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:38.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:38 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/472479925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:45:38.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:38 smithi066 ceph-mon[34761]: pgmap v482: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:38 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/472479925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:45:39.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/2952753451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d41076a0 msgr2=0x7fc7d4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/2952753451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d41076a0 0x7fc7d4107ae0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009900 tx=0x7fc7c402a410 comp rx=0 tx=0).stop 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/2952753451 shutdown_connections 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/2952753451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7d4108020 0x7fc7d410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/2952753451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d41076a0 0x7fc7d4107ae0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/2952753451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d4101c90 0x7fc7d4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/2952753451 >> 172.21.15.16:0/2952753451 conn(0x7fc7d40fd700 msgr2=0x7fc7d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/2952753451 shutdown_connections 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.063+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/2952753451 wait complete. 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 Processor -- start 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 -- start start 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d4101c90 0x7fc7d4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d41076a0 0x7fc7d4198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7d4108020 0x7fc7d419db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4111ce0 con 0x7fc7d4101c90 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4111b60 con 0x7fc7d4108020 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dc7e4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4111e60 con 0x7fc7d41076a0 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d4101c90 0x7fc7d4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d4101c90 0x7fc7d4198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42762/0 (socket says 172.21.15.16:42762) 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 -- 172.21.15.16:0/3326413855 learned_addr learned my addr 172.21.15.16:0/3326413855 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d41076a0 0x7fc7d4198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dad81640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7d4108020 0x7fc7d419db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 -- 172.21.15.16:0/3326413855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d41076a0 msgr2=0x7fc7d4198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d41076a0 0x7fc7d4198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 -- 172.21.15.16:0/3326413855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7d4108020 msgr2=0x7fc7d419db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7d4108020 0x7fc7d419db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7da580640 1 -- 172.21.15.16:0/3326413855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d419e2e0 con 0x7fc7d4101c90 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.064+0000 7fc7dad81640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7d4108020 0x7fc7d419db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.065+0000 7fc7da580640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d4101c90 0x7fc7d4198230 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d950 tx=0x7fc7d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.065+0000 7fc7cb7fe640 1 -- 172.21.15.16:0/3326413855 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0017070 con 0x7fc7d4101c90 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.065+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d419e5d0 con 0x7fc7d4101c90 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.065+0000 7fc7cb7fe640 1 -- 172.21.15.16:0/3326413855 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d0009c30 con 0x7fc7d4101c90 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.065+0000 7fc7cb7fe640 1 -- 172.21.15.16:0/3326413855 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000f620 con 0x7fc7d4101c90 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.065+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d41a4d10 con 0x7fc7d4101c90 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.067+0000 7fc7debb9740 1 Processor -- start 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7debb9740 1 -- start start 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5d96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7debb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ff7a54dea0 con 0x55ff7a5d9c20 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7debb9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ff7a53d2d0 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7debb9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff7a5410e0 con 0x55ff7a5d9300 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7cb7fe640 1 -- 172.21.15.16:0/3326413855 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc7d0010460 con 0x7fc7d4101c90 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7da580640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7da580640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42764/0 (socket says 172.21.15.16:42764) 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7da580640 1 -- 172.21.15.16:0/418421818 learned_addr learned my addr 172.21.15.16:0/418421818 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:58002/0 (socket says 172.21.15.16:58002) 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7dad81640 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5d96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/418421818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 msgr2=0x55ff7a5d96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5d96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.068+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/418421818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 msgr2=0x55ff7a5e5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/418421818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7a29b650 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7da580640 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e7fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009230 tx=0x7fc7c4032e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d6f2731636b03d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7cb7fe640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc7c00b5450 0x7fc7c00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7c8ff9640 1 -- 172.21.15.16:0/418421818 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4040070 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7c8ff9640 1 -- 172.21.15.16:0/418421818 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c40316a0 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7c8ff9640 1 -- 172.21.15.16:0/418421818 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4035040 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7dad81640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc7c00b5450 0x7fc7c00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.069+0000 7fc7cb7fe640 1 -- 172.21.15.16:0/3326413855 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc7d00e5c30 con 0x7fc7d4101c90 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7dad81640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc7c00b5450 0x7fc7c00b7910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00f4c0 tx=0x7fc7cc007740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 -- 172.21.15.16:0/418421818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 msgr2=0x55ff7a5e7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e7fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009230 tx=0x7fc7c4032e60 comp rx=0 tx=0).stop 2024-09-10T23:45:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 -- 172.21.15.16:0/418421818 shutdown_connections 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e7fa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 --2- 172.21.15.16:0/418421818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5d96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 -- 172.21.15.16:0/418421818 >> 172.21.15.16:0/418421818 conn(0x55ff7a5d7130 msgr2=0x55ff7a5d82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 -- 172.21.15.16:0/418421818 shutdown_connections 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 -- 172.21.15.16:0/418421818 wait complete. 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 -- start start 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.070+0000 7fc7debb9740 1 Processor -- start 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7debb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ff7a39e700 con 0x55ff7a5d9c20 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7debb9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ff7a4d8160 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7debb9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff7a5e87d0 con 0x55ff7a5d9300 2024-09-10T23:45:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7debb9740 10 client.0 _ll_register_callbacks cb 0x55ff7a4f19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42772/0 (socket says 172.21.15.16:42772) 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/149657330 learned_addr learned my addr 172.21.15.16:0/149657330 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7da580640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 msgr2=0x55ff7a5e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7dad81640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/149657330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 msgr2=0x55ff7a5e2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/149657330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7a505c90 con 0x55ff7a5d9c20 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7da580640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e2850 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000c00 tx=0x7fc7c402ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6e95ef1ab1f708 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.071+0000 7fc7bdffb640 1 -- 172.21.15.16:0/149657330 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c404d060 con 0x55ff7a5d9c20 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7bdffb640 1 -- 172.21.15.16:0/149657330 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc7c4031d10 con 0x55ff7a5d9c20 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c40316a0 con 0x55ff7a5d9c20 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7bdffb640 1 -- 172.21.15.16:0/149657330 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7c4040070 con 0x55ff7a5d9c20 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 10 client.16446 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff7a5f4060 con 0x55ff7a5d9c20 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7bdffb640 1 -- 172.21.15.16:0/149657330 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c40316a0 con 0x55ff7a5d9c20 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7bdffb640 1 -- 172.21.15.16:0/149657330 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc7c4052450 con 0x55ff7a5d9c20 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 10 client.16446 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 10 client.16446 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 20 client.16446 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a5f53b0 0x55ff7a5f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 4 client.16446 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.072+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff7a54fdf0 con 0x55ff7a5f53b0 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.073+0000 7fc7da580640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a5f53b0 0x55ff7a5f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.073+0000 7fc7da580640 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a5f53b0 0x55ff7a5f77a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33dc466fb5b864df server_cookie=8995b8df62e6b85 in_seq=0 out_seq=0 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.073+0000 7fc7bdffb640 10 client.16446 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7bdffb640 1 -- 172.21.15.16:0/149657330 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff7a54fdf0 con 0x55ff7a5f53b0 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7bdffb640 10 client.16446 handle_command_reply: tid=0 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 client.16446 shutdown 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 msgr2=0x55ff7a5e2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e2850 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000c00 tx=0x7fc7c402ab90 comp rx=0 tx=0).stop 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 shutdown_connections 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a5f53b0 0x55ff7a5f77a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5e2850 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7bdffb640 0 client.16446 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:45:39.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 --2- 172.21.15.16:0/149657330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 >> 172.21.15.16:0/149657330 conn(0x55ff7a5d7130 msgr2=0x55ff7a5dccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:39.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 shutdown_connections 2024-09-10T23:45:39.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 1 -- 172.21.15.16:0/149657330 wait complete. 2024-09-10T23:45:39.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.074+0000 7fc7debb9740 20 client.16446 trim_cache size 0 max 16384 2024-09-10T23:45:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 Processor -- start 2024-09-10T23:45:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 -- start start 2024-09-10T23:45:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5dfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41aecf0 con 0x55ff7a5d9c20 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41ac5c0 con 0x55ff7a5d9300 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.087+0000 7fc7debb9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41aa410 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5dfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5dfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42780/0 (socket says 172.21.15.16:42780) 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/1068255412 learned_addr learned my addr 172.21.15.16:0/1068255412 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7da580640 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/1068255412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5e5bb0 msgr2=0x55ff7a5dffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/1068255412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5d9300 msgr2=0x55ff7a5e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/1068255412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7a5e8710 con 0x55ff7a5d9c20 2024-09-10T23:45:39.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7da580640 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5dfa60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc7c402a930 tx=0x7fc7c4052450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38910d12939efc2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7bffff640 1 -- 172.21.15.16:0/1068255412 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c404d030 con 0x55ff7a5d9c20 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7bffff640 1 -- 172.21.15.16:0/1068255412 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c4052c40 con 0x55ff7a5d9c20 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.088+0000 7fc7bffff640 1 -- 172.21.15.16:0/1068255412 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4035040 con 0x55ff7a5d9c20 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 -- 172.21.15.16:0/1068255412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 msgr2=0x55ff7a5dfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5dfa60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc7c402a930 tx=0x7fc7c4052450 comp rx=0 tx=0).stop 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 -- 172.21.15.16:0/1068255412 shutdown_connections 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5dffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5dfa60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 --2- 172.21.15.16:0/1068255412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5d9300 0x55ff7a5e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 -- 172.21.15.16:0/1068255412 >> 172.21.15.16:0/1068255412 conn(0x55ff7a5d7130 msgr2=0x55ff7a5e3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 -- 172.21.15.16:0/1068255412 shutdown_connections 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 -- 172.21.15.16:0/1068255412 wait complete. 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 -- start start 2024-09-10T23:45:39.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.089+0000 7fc7debb9740 1 Processor -- start 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7debb9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7debb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41aaa80 con 0x55ff7a5d9c20 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7debb9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41abef0 con 0x55ff7a5e5bb0 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7debb9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41ab150 con 0x55ff7a5d9300 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7debb9740 10 client.0 _ll_register_callbacks cb 0x7fc7d00e95b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5f66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42794/0 (socket says 172.21.15.16:42794) 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/363078096 learned_addr learned my addr 172.21.15.16:0/363078096 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7dad81640 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7da580640 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 msgr2=0x55ff7a5fb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5fb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/363078096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 msgr2=0x55ff7a5f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 -- 172.21.15.16:0/363078096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7a663310 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7d9d7f640 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5f66d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40528f0 tx=0x7fc7c402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df38d5871bb58521 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.090+0000 7fc7bdffb640 1 -- 172.21.15.16:0/363078096 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c405f020 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7bdffb640 1 -- 172.21.15.16:0/363078096 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc7c40037f0 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c4052c40 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7bdffb640 1 -- 172.21.15.16:0/363078096 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7c406a050 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 10 client.16452 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff7a664530 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7bdffb640 1 -- 172.21.15.16:0/363078096 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c4052c40 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7bdffb640 1 -- 172.21.15.16:0/363078096 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc7c403c950 con 0x55ff7a5d9c20 2024-09-10T23:45:39.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 10 client.16452 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 10 client.16452 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 20 client.16452 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a664be0 0x55ff7a666fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 4 client.16452 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff7a54b8a0 con 0x55ff7a664be0 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.091+0000 7fc7da580640 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a664be0 0x55ff7a666fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7da580640 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a664be0 0x55ff7a666fd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7451c9a9f9d808b3 server_cookie=3cdf355150cedfcc in_seq=0 out_seq=0 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7bdffb640 10 client.16452 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7bdffb640 1 -- 172.21.15.16:0/363078096 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff7a54b8a0 con 0x55ff7a664be0 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7bdffb640 10 client.16452 handle_command_reply: tid=0 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 client.16452 shutdown 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 msgr2=0x55ff7a5f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5f66d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40528f0 tx=0x7fc7c402a410 comp rx=0 tx=0).stop 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 shutdown_connections 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55ff7a664be0 0x55ff7a666fd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ff7a5e5bb0 0x55ff7a5f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ff7a5d9c20 0x55ff7a5f66d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 --2- 172.21.15.16:0/363078096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7a5d9300 0x55ff7a5fb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 >> 172.21.15.16:0/363078096 conn(0x55ff7a5d7130 msgr2=0x55ff7a5e46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7bdffb640 0 client.16452 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 shutdown_connections 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 1 -- 172.21.15.16:0/363078096 wait complete. 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.092+0000 7fc7debb9740 20 client.16452 trim_cache size 0 max 16384 2024-09-10T23:45:39.100 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc7c00b5450 msgr2=0x7fc7c00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc7c00b5450 0x7fc7c00b7910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00f4c0 tx=0x7fc7cc007740 comp rx=0 tx=0).stop 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d4101c90 msgr2=0x7fc7d4198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d4101c90 0x7fc7d4198230 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d950 tx=0x7fc7d000de10 comp rx=0 tx=0).stop 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 shutdown_connections 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc7c00b5450 0x7fc7c00b7910 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7d4108020 0x7fc7d419db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7d41076a0 0x7fc7d4198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 --2- 172.21.15.16:0/3326413855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7d4101c90 0x7fc7d4198230 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:39.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 >> 172.21.15.16:0/3326413855 conn(0x7fc7d40fd700 msgr2=0x7fc7d40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:39.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 shutdown_connections 2024-09-10T23:45:39.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:39.093+0000 7fc7dc7e4640 1 -- 172.21.15.16:0/3326413855 wait complete. 2024-09-10T23:45:39.775 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:45:40.032 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:40.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:40 smithi016 ceph-mon[30855]: pgmap v483: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:45:40.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:40 smithi071 ceph-mon[35018]: pgmap v483: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:45:40.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 -- 172.21.15.16:0/3940427047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd4101cd0 msgr2=0x7f8bd41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/3940427047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd4101cd0 0x7f8bd41020b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009ca0 tx=0x7f8bd002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 -- 172.21.15.16:0/3940427047 shutdown_connections 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/3940427047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd4108060 0x7f8bd410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/3940427047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bd41076e0 0x7f8bd4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/3940427047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd4101cd0 0x7f8bd41020b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 -- 172.21.15.16:0/3940427047 >> 172.21.15.16:0/3940427047 conn(0x7f8bd40fd700 msgr2=0x7f8bd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 -- 172.21.15.16:0/3940427047 shutdown_connections 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.506+0000 7f8bdb38c640 1 -- 172.21.15.16:0/3940427047 wait complete. 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 Processor -- start 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 -- start start 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bd4101cd0 0x7f8bd40fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd41076e0 0x7f8bd40fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd4108060 0x7f8bd40fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd4111d20 con 0x7f8bd41076e0 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd4111ba0 con 0x7f8bd4108060 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bdb38c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd4111ea0 con 0x7f8bd4101cd0 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd41076e0 0x7f8bd40fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd41076e0 0x7f8bd40fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42808/0 (socket says 172.21.15.16:42808) 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 -- 172.21.15.16:0/2459343556 learned_addr learned my addr 172.21.15.16:0/2459343556 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bd4101cd0 0x7f8bd40fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd9929640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd4108060 0x7f8bd40fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 -- 172.21.15.16:0/2459343556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bd4101cd0 msgr2=0x7f8bd40fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bd4101cd0 0x7f8bd40fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 -- 172.21.15.16:0/2459343556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd4108060 msgr2=0x7f8bd40fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd4108060 0x7f8bd40fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 -- 172.21.15.16:0/2459343556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd41a7680 con 0x7f8bd41076e0 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd9929640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd4108060 0x7f8bd40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.507+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd41076e0 0x7f8bd40fe140 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400e9f0 tx=0x7f8bc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:40.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.508+0000 7f8bca7fc640 1 -- 172.21.15.16:0/2459343556 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400cd80 con 0x7f8bd41076e0 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.508+0000 7f8bca7fc640 1 -- 172.21.15.16:0/2459343556 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc40054d0 con 0x7f8bd41076e0 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.508+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd41a7970 con 0x7f8bd41076e0 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.508+0000 7f8bca7fc640 1 -- 172.21.15.16:0/2459343556 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4010690 con 0x7f8bd41076e0 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.508+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd41a7e60 con 0x7f8bd41076e0 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.510+0000 7f8bdd761740 1 Processor -- start 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.510+0000 7f8bdd761740 1 -- start start 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.510+0000 7f8bca7fc640 1 -- 172.21.15.16:0/2459343556 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f8bc4004e90 con 0x7f8bd41076e0 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x56302498f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x56302499b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bdd761740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563024905ea0 con 0x56302498f4d0 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bdd761740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5630248f52d0 con 0x56302499bd80 2024-09-10T23:45:40.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bdd761740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5630248f90e0 con 0x56302498fdf0 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x56302498f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x56302498f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42824/0 (socket says 172.21.15.16:42824) 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 -- 172.21.15.16:0/4096921871 learned_addr learned my addr 172.21.15.16:0/4096921871 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd8927640 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9128640 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x56302499b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 -- 172.21.15.16:0/4096921871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 msgr2=0x56302499b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x56302499b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 -- 172.21.15.16:0/4096921871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 msgr2=0x56302499e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 -- 172.21.15.16:0/4096921871 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563024653650 con 0x56302498f4d0 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd8927640 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:40.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9128640 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x56302499b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bca7fc640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8bc00b5450 0x7f8bc00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9929640 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x56302498f8b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009ba0 tx=0x7f8bcc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa5838d382c933d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.511+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8bc00b5450 0x7f8bc00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bca7fc640 1 -- 172.21.15.16:0/2459343556 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f8bc40e6520 con 0x7f8bd41076e0 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bbf7fe640 1 -- 172.21.15.16:0/4096921871 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc004030 con 0x56302498f4d0 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bbf7fe640 1 -- 172.21.15.16:0/4096921871 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bcc0035f0 con 0x56302498f4d0 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bbf7fe640 1 -- 172.21.15.16:0/4096921871 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0126b0 con 0x56302498f4d0 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 -- 172.21.15.16:0/4096921871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 msgr2=0x56302498f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8bc00b5450 0x7f8bc00b7910 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56302498e1e0 tx=0x7f8bd0005f80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x56302498f8b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009ba0 tx=0x7f8bcc010740 comp rx=0 tx=0).stop 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 -- 172.21.15.16:0/4096921871 shutdown_connections 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x56302499b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 --2- 172.21.15.16:0/4096921871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x56302498f8b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 -- 172.21.15.16:0/4096921871 >> 172.21.15.16:0/4096921871 conn(0x56302498d300 msgr2=0x56302498e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 -- 172.21.15.16:0/4096921871 shutdown_connections 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.512+0000 7f8bdd761740 1 -- 172.21.15.16:0/4096921871 wait complete. 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 -- start start 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 Processor -- start 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498f4d0 0x56302499b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x563024998b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302499bd80 0x563024999180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563024756700 con 0x56302499bd80 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563024890160 con 0x56302498f4d0 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56302499ea00 con 0x56302498fdf0 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bdd761740 10 client.0 _ll_register_callbacks cb 0x5630248a99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:40.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bd9929640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302499bd80 0x563024999180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bd9929640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302499bd80 0x563024999180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42834/0 (socket says 172.21.15.16:42834) 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bd9929640 1 -- 172.21.15.16:0/2170576672 learned_addr learned my addr 172.21.15.16:0/2170576672 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.513+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498f4d0 0x56302499b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x563024998b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd9929640 1 -- 172.21.15.16:0/2170576672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 msgr2=0x563024998b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd9929640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x563024998b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd9929640 1 -- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498f4d0 msgr2=0x56302499b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd9929640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498f4d0 0x56302499b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd9929640 1 -- 172.21.15.16:0/2170576672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630248bdc90 con 0x56302499bd80 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x563024998b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bd9929640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302499bd80 0x563024999180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0095a0 tx=0x7f8bcc009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63c717d7b8fc514 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bbcff9640 1 -- 172.21.15.16:0/2170576672 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc02b060 con 0x56302499bd80 2024-09-10T23:45:40.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bbcff9640 1 -- 172.21.15.16:0/2170576672 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f8bcc003a70 con 0x56302499bd80 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bcc0035f0 con 0x56302499bd80 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bbcff9640 1 -- 172.21.15.16:0/2170576672 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8bcc003f90 con 0x56302499bd80 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bdd761740 10 client.16464 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.514+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5630249aa3a0 con 0x56302499bd80 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bbcff9640 1 -- 172.21.15.16:0/2170576672 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bcc0035f0 con 0x56302499bd80 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bbcff9640 1 -- 172.21.15.16:0/2170576672 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8bcc00f040 con 0x56302499bd80 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bdd761740 10 client.16464 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bdd761740 10 client.16464 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bdd761740 20 client.16464 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5630249ab7a0 0x5630249adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bdd761740 4 client.16464 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563024907df0 con 0x5630249ab7a0 2024-09-10T23:45:40.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.515+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5630249ab7a0 0x5630249adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.516+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5630249ab7a0 0x5630249adb90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78de72eac51d3d28 server_cookie=998f6a7ec6f62ec5 in_seq=0 out_seq=0 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.516+0000 7f8bbcff9640 10 client.16464 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.516+0000 7f8bbcff9640 1 -- 172.21.15.16:0/2170576672 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563024907df0 con 0x5630249ab7a0 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.516+0000 7f8bbcff9640 10 client.16464 handle_command_reply: tid=0 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 client.16464 shutdown 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302499bd80 msgr2=0x563024999180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302499bd80 0x563024999180 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0095a0 tx=0x7f8bcc009cb0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 shutdown_connections 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x5630249ab7a0 0x5630249adb90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302499bd80 0x563024999180 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498fdf0 0x563024998b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2170576672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498f4d0 0x56302499b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 >> 172.21.15.16:0/2170576672 conn(0x56302498d300 msgr2=0x563024992e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bbcff9640 0 client.16464 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 shutdown_connections 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 1 -- 172.21.15.16:0/2170576672 wait complete. 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.517+0000 7f8bdd761740 20 client.16464 trim_cache size 0 max 16384 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 Processor -- start 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 -- start start 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498f4d0 0x563024999140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498fdf0 0x56302498cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd41b3060 con 0x56302498fdf0 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd41b0930 con 0x56302499bd80 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.530+0000 7f8bdd761740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd41ae780 con 0x56302498f4d0 2024-09-10T23:45:40.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498fdf0 0x56302498cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498fdf0 0x56302498cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42850/0 (socket says 172.21.15.16:42850) 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 -- 172.21.15.16:0/2207420719 learned_addr learned my addr 172.21.15.16:0/2207420719 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd9929640 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498f4d0 0x563024999140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 -- 172.21.15.16:0/2207420719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498f4d0 msgr2=0x563024999140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498f4d0 0x563024999140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 -- 172.21.15.16:0/2207420719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 msgr2=0x56302499a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 -- 172.21.15.16:0/2207420719 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56302499ba20 con 0x56302498fdf0 2024-09-10T23:45:40.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd9128640 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498f4d0 0x563024999140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:40.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bd8927640 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498fdf0 0x56302498cc10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40ac930 tx=0x7f8bc40ac830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecac55c299b716a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:40.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bbeffd640 1 -- 172.21.15.16:0/2207420719 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40ac4b0 con 0x56302498fdf0 2024-09-10T23:45:40.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bbeffd640 1 -- 172.21.15.16:0/2207420719 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc4005680 con 0x56302498fdf0 2024-09-10T23:45:40.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.531+0000 7f8bbeffd640 1 -- 172.21.15.16:0/2207420719 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40b1480 con 0x56302498fdf0 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 -- 172.21.15.16:0/2207420719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498fdf0 msgr2=0x56302498cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498fdf0 0x56302498cc10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40ac930 tx=0x7f8bc40ac830 comp rx=0 tx=0).stop 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 -- 172.21.15.16:0/2207420719 shutdown_connections 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302499bd80 0x56302499a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498fdf0 0x56302498cc10 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 --2- 172.21.15.16:0/2207420719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302498f4d0 0x563024999140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 -- 172.21.15.16:0/2207420719 >> 172.21.15.16:0/2207420719 conn(0x56302498d300 msgr2=0x56302499a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 -- 172.21.15.16:0/2207420719 shutdown_connections 2024-09-10T23:45:40.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 -- 172.21.15.16:0/2207420719 wait complete. 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 -- start start 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.532+0000 7f8bdd761740 1 Processor -- start 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x5630249a4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498fdf0 0x5630249b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bdd761740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302499bd80 0x5630249b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bdd761740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd41aedf0 con 0x56302498f4d0 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bdd761740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd41b0260 con 0x56302498fdf0 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bdd761740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd41af4c0 con 0x56302499bd80 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bdd761740 10 client.0 _ll_register_callbacks cb 0x7f8bcc009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x5630249a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x5630249a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42854/0 (socket says 172.21.15.16:42854) 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 -- 172.21.15.16:0/142496217 learned_addr learned my addr 172.21.15.16:0/142496217 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9929640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302499bd80 0x5630249b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd8927640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498fdf0 0x5630249b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 -- 172.21.15.16:0/142496217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302499bd80 msgr2=0x5630249b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302499bd80 0x5630249b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 -- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498fdf0 msgr2=0x5630249b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498fdf0 0x5630249b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 -- 172.21.15.16:0/142496217 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630249b37b0 con 0x56302498f4d0 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9929640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302499bd80 0x5630249b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd8927640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498fdf0 0x5630249b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bd9128640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x5630249a4320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0035000 tx=0x7f8bd00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc53f75587d9a14b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.533+0000 7f8bbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bbcff9640 1 -- 172.21.15.16:0/142496217 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0003b70 con 0x56302498f4d0 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bbcff9640 1 -- 172.21.15.16:0/142496217 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f8bd0003d10 con 0x56302498f4d0 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bc4005680 con 0x56302498f4d0 2024-09-10T23:45:40.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bbcff9640 1 -- 172.21.15.16:0/142496217 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8bd0004b40 con 0x56302498f4d0 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 10 client.16470 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563024a18330 con 0x56302498f4d0 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bbcff9640 1 -- 172.21.15.16:0/142496217 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc4005680 con 0x56302498f4d0 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bbcff9640 1 -- 172.21.15.16:0/142496217 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8bd0044040 con 0x56302498f4d0 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 10 client.16470 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 10 client.16470 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 20 client.16470 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563024a18940 0x563024a1ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 4 client.16470 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630249038a0 con 0x563024a18940 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.534+0000 7f8bd8927640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563024a18940 0x563024a1ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bd8927640 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563024a18940 0x563024a1ad60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec83f4d36470c461 server_cookie=4d7260e5eaa70a86 in_seq=0 out_seq=0 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bbcff9640 10 client.16470 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:45:40.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bbcff9640 1 -- 172.21.15.16:0/142496217 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630249038a0 con 0x563024a18940 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bbcff9640 10 client.16470 handle_command_reply: tid=0 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 client.16470 shutdown 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 msgr2=0x5630249a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x5630249a4320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0035000 tx=0x7f8bd00095c0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 shutdown_connections 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563024a18940 0x563024a1ad60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56302499bd80 0x5630249b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56302498fdf0 0x5630249b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 --2- 172.21.15.16:0/142496217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56302498f4d0 0x5630249a4320 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bbcff9640 0 client.16470 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 >> 172.21.15.16:0/142496217 conn(0x56302498d300 msgr2=0x56302499a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 shutdown_connections 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.535+0000 7f8bdd761740 1 -- 172.21.15.16:0/142496217 wait complete. 2024-09-10T23:45:40.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdd761740 20 client.16470 trim_cache size 0 max 16384 2024-09-10T23:45:40.552 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:45:40.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8bc00b5450 msgr2=0x7f8bc00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8bc00b5450 0x7f8bc00b7910 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56302498e1e0 tx=0x7f8bd0005f80 comp rx=0 tx=0).stop 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd41076e0 msgr2=0x7f8bd40fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd41076e0 0x7f8bd40fe140 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400e9f0 tx=0x7f8bc400edf0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 shutdown_connections 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8bc00b5450 0x7f8bc00b7910 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd4108060 0x7f8bd40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bd41076e0 0x7f8bd40fe140 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 --2- 172.21.15.16:0/2459343556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bd4101cd0 0x7f8bd40fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 >> 172.21.15.16:0/2459343556 conn(0x7f8bd40fd700 msgr2=0x7f8bd406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 shutdown_connections 2024-09-10T23:45:40.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:40.536+0000 7f8bdb38c640 1 -- 172.21.15.16:0/2459343556 wait complete. 2024-09-10T23:45:40.554 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:40 smithi066 ceph-mon[34761]: pgmap v483: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:45:41.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:45:41.535 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 -- 172.21.15.16:0/2420706682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844101cd0 msgr2=0x7fc8441020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 --2- 172.21.15.16:0/2420706682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844101cd0 0x7fc8441020b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc834009900 tx=0x7fc83402a410 comp rx=0 tx=0).stop 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 -- 172.21.15.16:0/2420706682 shutdown_connections 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 --2- 172.21.15.16:0/2420706682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc844108060 0x7fc84410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 --2- 172.21.15.16:0/2420706682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8441076e0 0x7fc844107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 --2- 172.21.15.16:0/2420706682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844101cd0 0x7fc8441020b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 -- 172.21.15.16:0/2420706682 >> 172.21.15.16:0/2420706682 conn(0x7fc8440fd700 msgr2=0x7fc8440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 -- 172.21.15.16:0/2420706682 shutdown_connections 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.031+0000 7fc848e80640 1 -- 172.21.15.16:0/2420706682 wait complete. 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 Processor -- start 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 -- start start 2024-09-10T23:45:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc844101cd0 0x7fc844197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8441076e0 0x7fc8441975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844108060 0x7fc84419c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc844110c20 con 0x7fc844108060 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc844110aa0 con 0x7fc844101cd0 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc848e80640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc844110da0 con 0x7fc8441076e0 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844108060 0x7fc84419c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844108060 0x7fc84419c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42868/0 (socket says 172.21.15.16:42868) 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 -- 172.21.15.16:0/3895117291 learned_addr learned my addr 172.21.15.16:0/3895117291 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc84259c640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc844101cd0 0x7fc844197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc83bfff640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8441076e0 0x7fc8441975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 -- 172.21.15.16:0/3895117291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8441076e0 msgr2=0x7fc8441975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8441076e0 0x7fc8441975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 -- 172.21.15.16:0/3895117291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc844101cd0 msgr2=0x7fc844197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc844101cd0 0x7fc844197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.032+0000 7fc842d9d640 1 -- 172.21.15.16:0/3895117291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84419d140 con 0x7fc844108060 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.033+0000 7fc842d9d640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844108060 0x7fc84419c970 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009ed0 tx=0x7fc83c0104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.033+0000 7fc83b7fe640 1 -- 172.21.15.16:0/3895117291 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c004b20 con 0x7fc844108060 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.033+0000 7fc83b7fe640 1 -- 172.21.15.16:0/3895117291 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc83c004cc0 con 0x7fc844108060 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.033+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84419d430 con 0x7fc844108060 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.033+0000 7fc83b7fe640 1 -- 172.21.15.16:0/3895117291 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c016710 con 0x7fc844108060 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.033+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8441a3af0 con 0x7fc844108060 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 Processor -- start 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc83b7fe640 1 -- 172.21.15.16:0/3895117291 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc83c005020 con 0x7fc844108060 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 -- start start 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f2058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f211840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f211d80 0x55762f214170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55762f17bea0 con 0x55762f211d80 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55762f16b2d0 con 0x55762f205df0 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc84b255740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55762f16f0e0 con 0x55762f2054d0 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f2058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f211d80 0x55762f214170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.036+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f211d80 0x55762f214170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42884/0 (socket says 172.21.15.16:42884) 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83bfff640 1 -- 172.21.15.16:0/1247320245 learned_addr learned my addr 172.21.15.16:0/1247320245 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc84259c640 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f211840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83b7fe640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8300b5450 0x7fc8300b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83bfff640 1 -- 172.21.15.16:0/1247320245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 msgr2=0x55762f2058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f2058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83bfff640 1 -- 172.21.15.16:0/1247320245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 msgr2=0x55762f211840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f211840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83bfff640 1 -- 172.21.15.16:0/1247320245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762eec9650 con 0x55762f211d80 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc84259c640 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f211840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc842d9d640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8300b5450 0x7fc8300b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f211d80 0x55762f214170 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc82c014a20 tx=0x7fc82c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da9a48b823da4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc83b7fe640 1 -- 172.21.15.16:0/3895117291 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc83c0e7e30 con 0x7fc844108060 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc838ff9640 1 -- 172.21.15.16:0/1247320245 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c014270 con 0x55762f211d80 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc838ff9640 1 -- 172.21.15.16:0/1247320245 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82c018030 con 0x55762f211d80 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.037+0000 7fc838ff9640 1 -- 172.21.15.16:0/1247320245 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00f8c0 con 0x55762f211d80 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 -- 172.21.15.16:0/1247320245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f211d80 msgr2=0x55762f214170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f211d80 0x55762f214170 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc82c014a20 tx=0x7fc82c004730 comp rx=0 tx=0).stop 2024-09-10T23:45:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc842d9d640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8300b5450 0x7fc8300b7910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0e5690 tx=0x7fc83c071040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 -- 172.21.15.16:0/1247320245 shutdown_connections 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f211d80 0x55762f214170 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f211840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 --2- 172.21.15.16:0/1247320245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f2058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 -- 172.21.15.16:0/1247320245 >> 172.21.15.16:0/1247320245 conn(0x55762f203300 msgr2=0x55762f2044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 -- 172.21.15.16:0/1247320245 shutdown_connections 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.038+0000 7fc84b255740 1 -- 172.21.15.16:0/1247320245 wait complete. 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 -- start start 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 Processor -- start 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f2116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f205df0 0x55762f20eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55762efcc700 con 0x55762f2054d0 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55762f106160 con 0x55762f211d80 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55762f214a00 con 0x55762f205df0 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84b255740 10 client.0 _ll_register_callbacks cb 0x55762f11f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f2116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f2116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42886/0 (socket says 172.21.15.16:42886) 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 -- 172.21.15.16:0/1676634116 learned_addr learned my addr 172.21.15.16:0/1676634116 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc84259c640 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f205df0 0x55762f20eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 -- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f205df0 msgr2=0x55762f20eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f205df0 0x55762f20eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 -- 172.21.15.16:0/1676634116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 msgr2=0x55762f20f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.039+0000 7fc83bfff640 1 -- 172.21.15.16:0/1676634116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55762f133c90 con 0x55762f2054d0 2024-09-10T23:45:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f2116d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e520 tx=0x7fc82c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f2c0bdb0cf66b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc829ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc829ffb640 1 -- 172.21.15.16:0/1676634116 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0142d0 con 0x55762f2054d0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc829ffb640 1 -- 172.21.15.16:0/1676634116 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc82c004220 con 0x55762f2054d0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82c018030 con 0x55762f2054d0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc829ffb640 1 -- 172.21.15.16:0/1676634116 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc82c014690 con 0x55762f2054d0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc84b255740 10 client.16482 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55762f220390 con 0x55762f2054d0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc829ffb640 1 -- 172.21.15.16:0/1676634116 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82c018030 con 0x55762f2054d0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc829ffb640 1 -- 172.21.15.16:0/1676634116 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc82c027070 con 0x55762f2054d0 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc84b255740 10 client.16482 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.040+0000 7fc84b255740 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.041+0000 7fc84b255740 20 client.16482 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.041+0000 7fc84b255740 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f221780 0x55762f223b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.041+0000 7fc84b255740 4 client.16482 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.041+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55762f17ddf0 con 0x55762f221780 2024-09-10T23:45:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.041+0000 7fc84259c640 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f221780 0x55762f223b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.041+0000 7fc84259c640 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f221780 0x55762f223b70 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b700a1f1b9106edc server_cookie=8299e7bb82144035 in_seq=0 out_seq=0 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.041+0000 7fc829ffb640 10 client.16482 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc829ffb640 1 -- 172.21.15.16:0/1676634116 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55762f17ddf0 con 0x55762f221780 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc829ffb640 10 client.16482 handle_command_reply: tid=0 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 client.16482 shutdown 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 msgr2=0x55762f2116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f2116d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e520 tx=0x7fc82c00f3c0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 shutdown_connections 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f221780 0x55762f223b70 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f205df0 0x55762f20eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 --2- 172.21.15.16:0/1676634116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f2116d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 >> 172.21.15.16:0/1676634116 conn(0x55762f203300 msgr2=0x55762f208ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc829ffb640 0 client.16482 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 shutdown_connections 2024-09-10T23:45:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 1 -- 172.21.15.16:0/1676634116 wait complete. 2024-09-10T23:45:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.042+0000 7fc84b255740 20 client.16482 trim_cache size 0 max 16384 2024-09-10T23:45:42.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.055+0000 7fc84b255740 1 Processor -- start 2024-09-10T23:45:42.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.055+0000 7fc84b255740 1 -- start start 2024-09-10T23:45:42.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.055+0000 7fc84b255740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f21dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.055+0000 7fc84b255740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f202c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc84b255740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f211d80 0x55762f213170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc84b255740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441aed10 con 0x55762f2054d0 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc84b255740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441ac5e0 con 0x55762f205df0 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc84b255740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441aa430 con 0x55762f211d80 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f21dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f21dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42898/0 (socket says 172.21.15.16:42898) 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 -- 172.21.15.16:0/1747332217 learned_addr learned my addr 172.21.15.16:0/1747332217 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc84259c640 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f202c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 -- 172.21.15.16:0/1747332217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f211d80 msgr2=0x55762f213170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f211d80 0x55762f213170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 -- 172.21.15.16:0/1747332217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 msgr2=0x55762f202c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f202c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 -- 172.21.15.16:0/1747332217 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762f203d80 con 0x55762f2054d0 2024-09-10T23:45:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc84259c640 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f202c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc83bfff640 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f21dc30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005d00 tx=0x7fc82c00fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0aa5b54bdfeae92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc82bfff640 1 -- 172.21.15.16:0/1747332217 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c035020 con 0x55762f2054d0 2024-09-10T23:45:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc82bfff640 1 -- 172.21.15.16:0/1747332217 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82c018040 con 0x55762f2054d0 2024-09-10T23:45:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.056+0000 7fc82bfff640 1 -- 172.21.15.16:0/1747332217 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0117b0 con 0x55762f2054d0 2024-09-10T23:45:42.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 -- 172.21.15.16:0/1747332217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 msgr2=0x55762f21dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f21dc30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005d00 tx=0x7fc82c00fd70 comp rx=0 tx=0).stop 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 -- 172.21.15.16:0/1747332217 shutdown_connections 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f211d80 0x55762f213170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f205df0 0x55762f202c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 --2- 172.21.15.16:0/1747332217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f2054d0 0x55762f21dc30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 -- 172.21.15.16:0/1747332217 >> 172.21.15.16:0/1747332217 conn(0x55762f203300 msgr2=0x55762f209d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 -- 172.21.15.16:0/1747332217 shutdown_connections 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 -- 172.21.15.16:0/1747332217 wait complete. 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 -- start start 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.057+0000 7fc84b255740 1 Processor -- start 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84b255740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f21a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84b255740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f205df0 0x55762f21a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84b255740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84b255740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441aaaa0 con 0x55762f205df0 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84b255740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441abf10 con 0x55762f211d80 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84b255740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441ab170 con 0x55762f2054d0 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84b255740 10 client.0 _ll_register_callbacks cb 0x7fc82c014470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f205df0 0x55762f21a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f205df0 0x55762f21a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42904/0 (socket says 172.21.15.16:42904) 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 -- 172.21.15.16:0/2784934257 learned_addr learned my addr 172.21.15.16:0/2784934257 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc83bfff640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f21a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 -- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 msgr2=0x55762f21a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f21a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc83bfff640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 -- 172.21.15.16:0/2784934257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 msgr2=0x55762f20be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 -- 172.21.15.16:0/2784934257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55762f1fe990 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc83bfff640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc84259c640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f205df0 0x55762f21a5c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8340096c0 tx=0x7fc8340041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3ff46bf8925916 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.058+0000 7fc829ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc829ffb640 1 -- 172.21.15.16:0/2784934257 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834035040 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc829ffb640 1 -- 172.21.15.16:0/2784934257 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc834005240 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82c018040 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc829ffb640 1 -- 172.21.15.16:0/2784934257 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc834054050 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 10 client.16488 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55762f229490 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc829ffb640 1 -- 172.21.15.16:0/2784934257 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82c018040 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc829ffb640 1 -- 172.21.15.16:0/2784934257 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc834003680 con 0x55762f205df0 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 10 client.16488 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 20 client.16488 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f28e680 0x55762f290aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 4 client.16488 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.059+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55762f1798a0 con 0x55762f28e680 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc83bfff640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f28e680 0x55762f290aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc83bfff640 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f28e680 0x55762f290aa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6952dac457e73cef server_cookie=8619b1bde967458 in_seq=0 out_seq=0 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc829ffb640 10 client.16488 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc829ffb640 1 -- 172.21.15.16:0/2784934257 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55762f1798a0 con 0x55762f28e680 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc829ffb640 10 client.16488 handle_command_reply: tid=0 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 client.16488 shutdown 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f205df0 msgr2=0x55762f21a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f205df0 0x55762f21a5c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8340096c0 tx=0x7fc8340041a0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 shutdown_connections 2024-09-10T23:45:42.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55762f28e680 0x55762f290aa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55762f211d80 0x55762f20be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55762f205df0 0x55762f21a5c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 --2- 172.21.15.16:0/2784934257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55762f2054d0 0x55762f21a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 >> 172.21.15.16:0/2784934257 conn(0x55762f203300 msgr2=0x55762f210150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc829ffb640 0 client.16488 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 shutdown_connections 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.060+0000 7fc84b255740 1 -- 172.21.15.16:0/2784934257 wait complete. 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc84b255740 20 client.16488 trim_cache size 0 max 16384 2024-09-10T23:45:42.067 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:45:42.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8300b5450 msgr2=0x7fc8300b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8300b5450 0x7fc8300b7910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0e5690 tx=0x7fc83c071040 comp rx=0 tx=0).stop 2024-09-10T23:45:42.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844108060 msgr2=0x7fc84419c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:42.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844108060 0x7fc84419c970 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009ed0 tx=0x7fc83c0104b0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 shutdown_connections 2024-09-10T23:45:42.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844108060 0x7fc84419c970 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8441076e0 0x7fc8441975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc8300b5450 0x7fc8300b7910 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 --2- 172.21.15.16:0/3895117291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc844101cd0 0x7fc844197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:42.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 >> 172.21.15.16:0/3895117291 conn(0x7fc8440fd700 msgr2=0x7fc8440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:42.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 shutdown_connections 2024-09-10T23:45:42.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:42.061+0000 7fc848e80640 1 -- 172.21.15.16:0/3895117291 wait complete. 2024-09-10T23:45:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:42 smithi016 ceph-mon[30855]: pgmap v484: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:45:42.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:42 smithi071 ceph-mon[35018]: pgmap v484: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:45:42.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:42 smithi066 ceph-mon[34761]: pgmap v484: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:45:43.702 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:45:43.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:45:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:44.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:44 smithi016 ceph-mon[30855]: pgmap v485: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:45:44.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:44 smithi071 ceph-mon[35018]: pgmap v485: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:45:44.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:44 smithi066 ceph-mon[34761]: pgmap v485: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:45:44.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/3886189559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 msgr2=0x7ff4a01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/3886189559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a01031a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff490009900 tx=0x7ff49002a410 comp rx=0 tx=0).stop 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/3886189559 shutdown_connections 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/3886189559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4a0109150 0x7ff4a010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/3886189559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a01087d0 0x7ff4a0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/3886189559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a01031a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/3886189559 >> 172.21.15.16:0/3886189559 conn(0x7ff4a00fe830 msgr2=0x7ff4a0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/3886189559 shutdown_connections 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.585+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/3886189559 wait complete. 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 Processor -- start 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 -- start start 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a0199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4a01087d0 0x7ff4a01997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0109150 0x7ff4a019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0112e10 con 0x7ff4a0102dc0 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0112c90 con 0x7ff4a01087d0 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff4a5f9e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0112f90 con 0x7ff4a0109150 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.586+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a0199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a0199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51330/0 (socket says 172.21.15.16:51330) 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 -- 172.21.15.16:0/704285407 learned_addr learned my addr 172.21.15.16:0/704285407 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49ffff640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0109150 0x7ff4a019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49effd640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4a01087d0 0x7ff4a01997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 -- 172.21.15.16:0/704285407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0109150 msgr2=0x7ff4a019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0109150 0x7ff4a019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 -- 172.21.15.16:0/704285407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4a01087d0 msgr2=0x7ff4a01997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4a01087d0 0x7ff4a01997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 -- 172.21.15.16:0/704285407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a019f310 con 0x7ff4a0102dc0 2024-09-10T23:45:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a0199260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff490005940 tx=0x7ff4900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49cff9640 1 -- 172.21.15.16:0/704285407 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49003f030 con 0x7ff4a0102dc0 2024-09-10T23:45:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a019f5a0 con 0x7ff4a0102dc0 2024-09-10T23:45:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49cff9640 1 -- 172.21.15.16:0/704285407 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff490003cb0 con 0x7ff4a0102dc0 2024-09-10T23:45:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff49cff9640 1 -- 172.21.15.16:0/704285407 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490035070 con 0x7ff4a0102dc0 2024-09-10T23:45:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.587+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a01a5cc0 con 0x7ff4a0102dc0 2024-09-10T23:45:44.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.590+0000 7ff49cff9640 1 -- 172.21.15.16:0/704285407 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff49003bbf0 con 0x7ff4a0102dc0 2024-09-10T23:45:44.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.590+0000 7ff4a8373740 1 Processor -- start 2024-09-10T23:45:44.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.590+0000 7ff4a8373740 1 -- start start 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98466ee0 0x557a984672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98467800 0x557a98477660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a98479f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff4a8373740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557a983dde60 con 0x557a98467800 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff4a8373740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557a983cd290 con 0x557a98477ba0 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff4a8373740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a983d10a0 con 0x557a98466ee0 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98467800 0x557a98477660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98466ee0 0x557a984672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98467800 0x557a98477660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51342/0 (socket says 172.21.15.16:51342) 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49f7fe640 1 -- 172.21.15.16:0/1052403850 learned_addr learned my addr 172.21.15.16:0/1052403850 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98466ee0 0x557a984672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:38646/0 (socket says 172.21.15.16:38646) 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49effd640 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a98479f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49cff9640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff4880b54d0 0x7ff4880b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 -- 172.21.15.16:0/1052403850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 msgr2=0x557a98479f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a98479f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 -- 172.21.15.16:0/1052403850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98467800 msgr2=0x557a98477660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98467800 0x557a98477660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 -- 172.21.15.16:0/1052403850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9812b930 con 0x557a98466ee0 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98467800 0x557a98477660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49ffff640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff4880b54d0 0x7ff4880b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.591+0000 7ff49cff9640 1 -- 172.21.15.16:0/704285407 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff490106b60 con 0x7ff4a0102dc0 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.592+0000 7ff49ffff640 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98466ee0 0x557a984672c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff498004980 tx=0x7ff49800f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f322b9b70d161f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.592+0000 7ff485ffb640 1 -- 172.21.15.16:0/1052403850 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498019560 con 0x557a98466ee0 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.592+0000 7ff49ffff640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff4880b54d0 0x7ff4880b7990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff498020000 tx=0x7ff49801d000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.592+0000 7ff485ffb640 1 -- 172.21.15.16:0/1052403850 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff498019c70 con 0x557a98466ee0 2024-09-10T23:45:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.592+0000 7ff485ffb640 1 -- 172.21.15.16:0/1052403850 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498010a00 con 0x557a98466ee0 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 -- 172.21.15.16:0/1052403850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98466ee0 msgr2=0x557a984672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98466ee0 0x557a984672c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff498004980 tx=0x7ff49800f850 comp rx=0 tx=0).stop 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 -- 172.21.15.16:0/1052403850 shutdown_connections 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a98479f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98467800 0x557a98477660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1052403850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98466ee0 0x557a984672c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 -- 172.21.15.16:0/1052403850 >> 172.21.15.16:0/1052403850 conn(0x557a98464d10 msgr2=0x557a98465eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 -- 172.21.15.16:0/1052403850 shutdown_connections 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 -- 172.21.15.16:0/1052403850 wait complete. 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 -- start start 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.593+0000 7ff4a8373740 1 Processor -- start 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98474b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a984750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a984755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff4a8373740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557a9822e890 con 0x557a98466ee0 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff4a8373740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557a98367d40 con 0x557a98477ba0 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff4a8373740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a9847a850 con 0x557a98467800 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff4a8373740 10 client.0 _ll_register_callbacks cb 0x557a983cbc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98474b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98474b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51344/0 (socket says 172.21.15.16:51344) 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 -- 172.21.15.16:0/2916487930 learned_addr learned my addr 172.21.15.16:0/2916487930 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49effd640 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a984750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49ffff640 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a984755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 -- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 msgr2=0x557a984750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a984750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 -- 172.21.15.16:0/2916487930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 msgr2=0x557a984755e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a984755e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.594+0000 7ff49f7fe640 1 -- 172.21.15.16:0/2916487930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a98483c30 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98474b60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c95b0 tx=0x7ff4901047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb1977109d85141 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff47effd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff47effd640 1 -- 172.21.15.16:0/2916487930 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490049070 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff47effd640 1 -- 172.21.15.16:0/2916487930 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff4900cd240 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff498019c70 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff47effd640 1 -- 172.21.15.16:0/2916487930 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4900c8e80 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 10 client.16500 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a984865e0 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff47effd640 1 -- 172.21.15.16:0/2916487930 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff498019c70 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff47effd640 1 -- 172.21.15.16:0/2916487930 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff4900d60e0 con 0x557a98466ee0 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 10 client.16500 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:44.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 20 client.16500 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984879a0 0x557a98489dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 4 client.16500 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.595+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a983dfdb0 con 0x557a984879a0 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.596+0000 7ff49effd640 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984879a0 0x557a98489dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.596+0000 7ff49effd640 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984879a0 0x557a98489dd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b4b799da30d6fbc server_cookie=4e5dbfbf20398131 in_seq=0 out_seq=0 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.596+0000 7ff47effd640 10 client.16500 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff47effd640 1 -- 172.21.15.16:0/2916487930 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a983dfdb0 con 0x557a984879a0 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff47effd640 10 client.16500 handle_command_reply: tid=0 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 client.16500 shutdown 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 msgr2=0x557a98474b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98474b60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c95b0 tx=0x7ff4901047b0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 shutdown_connections 2024-09-10T23:45:44.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984879a0 0x557a98489dd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98477ba0 0x557a984755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a984750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 --2- 172.21.15.16:0/2916487930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98474b60 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 >> 172.21.15.16:0/2916487930 conn(0x557a98464d10 msgr2=0x557a98463f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff47effd640 0 client.16500 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 shutdown_connections 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 1 -- 172.21.15.16:0/2916487930 wait complete. 2024-09-10T23:45:44.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.597+0000 7ff4a8373740 20 client.16500 trim_cache size 0 max 16384 2024-09-10T23:45:44.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 Processor -- start 2024-09-10T23:45:44.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 -- start start 2024-09-10T23:45:44.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98472630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98467800 0x557a98466440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98477ba0 0x557a984742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a01aec20 con 0x557a98466ee0 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a01ac4f0 con 0x557a98467800 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff4a8373740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a01aa340 con 0x557a98477ba0 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.615+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98472630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98472630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51348/0 (socket says 172.21.15.16:51348) 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 -- 172.21.15.16:0/1533125023 learned_addr learned my addr 172.21.15.16:0/1533125023 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 -- 172.21.15.16:0/1533125023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98477ba0 msgr2=0x557a984742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98477ba0 0x557a984742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49effd640 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98467800 0x557a98466440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 -- 172.21.15.16:0/1533125023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98467800 msgr2=0x557a98466440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98467800 0x557a98466440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 -- 172.21.15.16:0/1533125023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a98478710 con 0x557a98466ee0 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98472630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff490031440 tx=0x7ff49003b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1463890653e445f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff4857fa640 1 -- 172.21.15.16:0/1533125023 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490049070 con 0x557a98466ee0 2024-09-10T23:45:44.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff4857fa640 1 -- 172.21.15.16:0/1533125023 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4900ccaf0 con 0x557a98466ee0 2024-09-10T23:45:44.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.616+0000 7ff4857fa640 1 -- 172.21.15.16:0/1533125023 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490005d50 con 0x557a98466ee0 2024-09-10T23:45:44.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 -- 172.21.15.16:0/1533125023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 msgr2=0x557a98472630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98472630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff490031440 tx=0x7ff49003b6b0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 -- 172.21.15.16:0/1533125023 shutdown_connections 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98477ba0 0x557a984742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98467800 0x557a98466440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 --2- 172.21.15.16:0/1533125023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98466ee0 0x557a98472630 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 -- 172.21.15.16:0/1533125023 >> 172.21.15.16:0/1533125023 conn(0x557a98464d10 msgr2=0x557a984769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 -- 172.21.15.16:0/1533125023 shutdown_connections 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 -- 172.21.15.16:0/1533125023 wait complete. 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 -- start start 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.617+0000 7ff4a8373740 1 Processor -- start 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98466ee0 0x557a9847fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a98480200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98477ba0 0x557a9848e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a01aa9b0 con 0x557a98477ba0 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a01abe20 con 0x557a98466ee0 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a01ab080 con 0x557a98467800 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 10 client.0 _ll_register_callbacks cb 0x7ff49003bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98477ba0 0x557a9848e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98477ba0 0x557a9848e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51352/0 (socket says 172.21.15.16:51352) 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 -- 172.21.15.16:0/819925868 learned_addr learned my addr 172.21.15.16:0/819925868 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49effd640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a98480200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98466ee0 0x557a9847fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 -- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 msgr2=0x557a98480200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a98480200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 -- 172.21.15.16:0/819925868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98466ee0 msgr2=0x557a9847fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98466ee0 0x557a9847fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 -- 172.21.15.16:0/819925868 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9848ee50 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98466ee0 0x557a9847fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff49ffff640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98477ba0 0x557a9848e6e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff49800ff30 tx=0x7ff498010e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f33e123316f28b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff47effd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff47effd640 1 -- 172.21.15.16:0/819925868 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498034060 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff47effd640 1 -- 172.21.15.16:0/819925868 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7ff498010640 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.618+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4900ccaf0 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff47effd640 1 -- 172.21.15.16:0/819925868 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff498019560 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 10 client.16506 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a98490190 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff47effd640 1 -- 172.21.15.16:0/819925868 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4900ccaf0 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff47effd640 1 -- 172.21.15.16:0/819925868 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff498019c70 con 0x557a98477ba0 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 10 client.16506 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:44.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 20 client.16506 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:44.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984f5900 0x557a984f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:44.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 4 client.16506 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:45:44.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557a983db860 con 0x557a984f5900 2024-09-10T23:45:44.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.619+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984f5900 0x557a984f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:44.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.620+0000 7ff49f7fe640 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984f5900 0x557a984f7cf0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22b362ae535a3730 server_cookie=d87afa3e819dc01c in_seq=0 out_seq=0 2024-09-10T23:45:44.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.620+0000 7ff47effd640 10 client.16506 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:44.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.621+0000 7ff47effd640 1 -- 172.21.15.16:0/819925868 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557a983db860 con 0x557a984f5900 2024-09-10T23:45:44.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.621+0000 7ff47effd640 10 client.16506 handle_command_reply: tid=0 2024-09-10T23:45:44.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.621+0000 7ff4a8373740 1 client.16506 shutdown 2024-09-10T23:45:44.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98477ba0 msgr2=0x557a9848e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98477ba0 0x557a9848e6e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff49800ff30 tx=0x7ff498010e20 comp rx=0 tx=0).stop 2024-09-10T23:45:44.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 shutdown_connections 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557a984f5900 0x557a984f7cf0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a98477ba0 0x557a9848e6e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a98467800 0x557a98480200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 --2- 172.21.15.16:0/819925868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557a98466ee0 0x557a9847fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff47effd640 0 client.16506 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 >> 172.21.15.16:0/819925868 conn(0x557a98464d10 msgr2=0x557a9846a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 shutdown_connections 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 1 -- 172.21.15.16:0/819925868 wait complete. 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.622+0000 7ff4a8373740 20 client.16506 trim_cache size 0 max 16384 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:45:44.627 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:45:44.628 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "343dfa4b-bfad-4056-b8bf-5f4133f990f0", 2024-09-10T23:45:44.628 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:45:44.628 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:45:44.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff4880b54d0 msgr2=0x7ff4880b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff4880b54d0 0x7ff4880b7990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff498020000 tx=0x7ff49801d000 comp rx=0 tx=0).stop 2024-09-10T23:45:44.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 msgr2=0x7ff4a0199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a0199260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff490005940 tx=0x7ff4900042f0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 shutdown_connections 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0109150 0x7ff4a019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff4880b54d0 0x7ff4880b7990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4a01087d0 0x7ff4a01997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 --2- 172.21.15.16:0/704285407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4a0102dc0 0x7ff4a0199260 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 >> 172.21.15.16:0/704285407 conn(0x7ff4a00fe830 msgr2=0x7ff4a0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 shutdown_connections 2024-09-10T23:45:44.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:44.623+0000 7ff4a5f9e640 1 -- 172.21.15.16:0/704285407 wait complete. 2024-09-10T23:45:45.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:45:45.770 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:46.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 -- 172.21.15.16:0/2602376492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c101810 msgr2=0x7f4d5c101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 --2- 172.21.15.16:0/2602376492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c101810 0x7f4d5c101bf0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009900 tx=0x7f4d4c02a410 comp rx=0 tx=0).stop 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 -- 172.21.15.16:0/2602376492 shutdown_connections 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 --2- 172.21.15.16:0/2602376492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c10d250 0x7f4d5c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 --2- 172.21.15.16:0/2602376492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c10a920 0x7f4d5c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 --2- 172.21.15.16:0/2602376492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c101810 0x7f4d5c101bf0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 -- 172.21.15.16:0/2602376492 >> 172.21.15.16:0/2602376492 conn(0x7f4d5c076f50 msgr2=0x7f4d5c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 -- 172.21.15.16:0/2602376492 shutdown_connections 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.311+0000 7f4d61cce640 1 -- 172.21.15.16:0/2602376492 wait complete. 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 Processor -- start 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 -- start start 2024-09-10T23:45:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c101810 0x7f4d5c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c10a920 0x7f4d5c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c10d250 0x7f4d5c1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c112de0 con 0x7f4d5c10a920 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c112c60 con 0x7f4d5c10d250 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d61cce640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c112f60 con 0x7f4d5c101810 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d53fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c10a920 0x7f4d5c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d5b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c101810 0x7f4d5c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d53fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c10a920 0x7f4d5c19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51372/0 (socket says 172.21.15.16:51372) 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d53fff640 1 -- 172.21.15.16:0/427842458 learned_addr learned my addr 172.21.15.16:0/427842458 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.312+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c10d250 0x7f4d5c1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d53fff640 1 -- 172.21.15.16:0/427842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c101810 msgr2=0x7f4d5c19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d53fff640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c101810 0x7f4d5c19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d53fff640 1 -- 172.21.15.16:0/427842458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c10d250 msgr2=0x7f4d5c1a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d53fff640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c10d250 0x7f4d5c1a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d53fff640 1 -- 172.21.15.16:0/427842458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c1a1570 con 0x7f4d5c10a920 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d53fff640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c10a920 0x7f4d5c19ba00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400d950 tx=0x7f4d4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d597fa640 1 -- 172.21.15.16:0/427842458 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44017030 con 0x7f4d5c10a920 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5c1a1860 con 0x7f4d5c10a920 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d597fa640 1 -- 172.21.15.16:0/427842458 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d44004020 con 0x7f4d5c10a920 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d597fa640 1 -- 172.21.15.16:0/427842458 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d440047a0 con 0x7f4d5c10a920 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.313+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5c1a7f20 con 0x7f4d5c10a920 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 Processor -- start 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d597fa640 1 -- 172.21.15.16:0/427842458 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4d44009a30 con 0x7f4d5c10a920 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 -- start start 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486a94480 0x55d486a94860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aa07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486aa0d30 0x55d486aa3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d486a0ae50 con 0x55d486a94480 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d4869fa280 con 0x55d486aa0d30 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.316+0000 7f4d640a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d4869fe090 con 0x55d486a94da0 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486a94480 0x55d486a94860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486a94480 0x55d486a94860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51386/0 (socket says 172.21.15.16:51386) 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aa07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 -- 172.21.15.16:0/1639275835 learned_addr learned my addr 172.21.15.16:0/1639275835 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d53fff640 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486aa0d30 0x55d486aa3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 -- 172.21.15.16:0/1639275835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 msgr2=0x55d486aa07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aa07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 -- 172.21.15.16:0/1639275835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486aa0d30 msgr2=0x55d486aa3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486aa0d30 0x55d486aa3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 -- 172.21.15.16:0/1639275835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d486758650 con 0x55d486a94480 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d53fff640 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486aa0d30 0x55d486aa3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486a94480 0x55d486a94860 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009f70 tx=0x7f4d54010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b841b120e0a3e0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d597fa640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4d480b5450 0x7f4d480b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d51ffb640 1 -- 172.21.15.16:0/1639275835 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54016070 con 0x55d486a94480 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4d480b5450 0x7f4d480b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d51ffb640 1 -- 172.21.15.16:0/1639275835 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d54004d20 con 0x55d486a94480 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d51ffb640 1 -- 172.21.15.16:0/1639275835 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d540127d0 con 0x55d486a94480 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.317+0000 7f4d597fa640 1 -- 172.21.15.16:0/427842458 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4d440e59b0 con 0x7f4d5c10a920 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 -- 172.21.15.16:0/1639275835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486a94480 msgr2=0x55d486a94860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4d480b5450 0x7f4d480b7910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c005ab0 tx=0x7f4d4c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486a94480 0x55d486a94860 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009f70 tx=0x7f4d54010800 comp rx=0 tx=0).stop 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 -- 172.21.15.16:0/1639275835 shutdown_connections 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486aa0d30 0x55d486aa3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aa07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 --2- 172.21.15.16:0/1639275835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486a94480 0x55d486a94860 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 -- 172.21.15.16:0/1639275835 >> 172.21.15.16:0/1639275835 conn(0x55d486a922b0 msgr2=0x55d486a93450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 -- 172.21.15.16:0/1639275835 shutdown_connections 2024-09-10T23:45:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 -- 172.21.15.16:0/1639275835 wait complete. 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.318+0000 7f4d640a3740 1 -- start start 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 1 Processor -- start 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486aa0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486a9dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d48685b700 con 0x55d486aa0d30 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d486995110 con 0x55d486a94480 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d486aa39b0 con 0x55d486a94da0 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d640a3740 10 client.0 _ll_register_callbacks cb 0x55d4869ae990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51396/0 (socket says 172.21.15.16:51396) 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2539334726 learned_addr learned my addr 172.21.15.16:0/2539334726 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486aa0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d53fff640 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486a9dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 msgr2=0x55d486a9dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486a9dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2539334726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 msgr2=0x55d486aa0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486aa0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.319+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2539334726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4869c2c40 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9e130 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4d54005a80 tx=0x7f4d54004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6223a68a9f94c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d3affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d3affd640 1 -- 172.21.15.16:0/2539334726 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54029060 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d54004d20 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d3affd640 1 -- 172.21.15.16:0/2539334726 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4d540053f0 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d3affd640 1 -- 172.21.15.16:0/2539334726 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d54016070 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d640a3740 10 client.16518 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d486aaf350 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d3affd640 1 -- 172.21.15.16:0/2539334726 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d54004d20 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d3affd640 1 -- 172.21.15.16:0/2539334726 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d5400f040 con 0x55d486aa0d30 2024-09-10T23:45:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d640a3740 10 client.16518 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d640a3740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.320+0000 7f4d640a3740 20 client.16518 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.321+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486ab0750 0x55d486ab2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.321+0000 7f4d640a3740 4 client.16518 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.321+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d486a0cda0 con 0x55d486ab0750 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.321+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486ab0750 0x55d486ab2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.321+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486ab0750 0x55d486ab2b40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a6fc554d666e0a server_cookie=fa36dd09e6fbd5af in_seq=0 out_seq=0 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.321+0000 7f4d3affd640 10 client.16518 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d3affd640 1 -- 172.21.15.16:0/2539334726 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d486a0cda0 con 0x55d486ab0750 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d3affd640 10 client.16518 handle_command_reply: tid=0 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 client.16518 shutdown 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 msgr2=0x55d486a9e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9e130 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4d54005a80 tx=0x7f4d54004c70 comp rx=0 tx=0).stop 2024-09-10T23:45:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 shutdown_connections 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486ab0750 0x55d486ab2b40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9e130 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486a9dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d3affd640 0 client.16518 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2539334726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486aa0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 >> 172.21.15.16:0/2539334726 conn(0x55d486a922b0 msgr2=0x55d486a97e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 shutdown_connections 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 1 -- 172.21.15.16:0/2539334726 wait complete. 2024-09-10T23:45:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.322+0000 7f4d640a3740 20 client.16518 trim_cache size 0 max 16384 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 Processor -- start 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 -- start start 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486a9e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aacc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1b30d0 con 0x55d486aa0d30 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1b09a0 con 0x55d486a94480 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d640a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1ae7f0 con 0x55d486a94da0 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51406/0 (socket says 172.21.15.16:51406) 2024-09-10T23:45:46.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 -- 172.21.15.16:0/3148611724 learned_addr learned my addr 172.21.15.16:0/3148611724 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486a9e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d53fff640 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aacc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 -- 172.21.15.16:0/3148611724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 msgr2=0x55d486aacc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aacc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 -- 172.21.15.16:0/3148611724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 msgr2=0x55d486a9e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486a9e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 -- 172.21.15.16:0/3148611724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d486a8db60 con 0x55d486aa0d30 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.341+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9f7f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4d540098b0 tx=0x7f4d540099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f283cb1f0b0d5edb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d517fa640 1 -- 172.21.15.16:0/3148611724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54029070 con 0x55d486aa0d30 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d517fa640 1 -- 172.21.15.16:0/3148611724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d54009b70 con 0x55d486aa0d30 2024-09-10T23:45:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d517fa640 1 -- 172.21.15.16:0/3148611724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54005830 con 0x55d486aa0d30 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 -- 172.21.15.16:0/3148611724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 msgr2=0x55d486a9f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9f7f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4d540098b0 tx=0x7f4d540099e0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 -- 172.21.15.16:0/3148611724 shutdown_connections 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486a9f7f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94da0 0x55d486aacc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 --2- 172.21.15.16:0/3148611724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94480 0x55d486a9e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 -- 172.21.15.16:0/3148611724 >> 172.21.15.16:0/3148611724 conn(0x55d486a922b0 msgr2=0x55d486a9f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 -- 172.21.15.16:0/3148611724 shutdown_connections 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.342+0000 7f4d640a3740 1 -- 172.21.15.16:0/3148611724 wait complete. 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 -- start start 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 Processor -- start 2024-09-10T23:45:46.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94480 0x55d486aa8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94da0 0x55d486aa93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486aa3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1aee60 con 0x55d486aa0d30 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1b02d0 con 0x55d486a94da0 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1af530 con 0x55d486a94480 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d640a3740 10 client.0 _ll_register_callbacks cb 0x7f4d4c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486aa3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d5b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94480 0x55d486aa8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486aa3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51418/0 (socket says 172.21.15.16:51418) 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d5b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94480 0x55d486aa8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:38732/0 (socket says 172.21.15.16:38732) 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2437901739 learned_addr learned my addr 172.21.15.16:0/2437901739 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.343+0000 7f4d53fff640 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94da0 0x55d486aa93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2437901739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94480 msgr2=0x55d486aa8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94480 0x55d486aa8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2437901739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94da0 msgr2=0x55d486aa93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94da0 0x55d486aa93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d5bfff640 1 -- 172.21.15.16:0/2437901739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d486aa4320 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d53fff640 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94da0 0x55d486aa93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d5bfff640 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486aa3c30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400a010 tx=0x7f4d54010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e89a9e105f4bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d3affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d3affd640 1 -- 172.21.15.16:0/2437901739 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54029040 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d54009b70 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d3affd640 1 -- 172.21.15.16:0/2437901739 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4d54004cd0 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d3affd640 1 -- 172.21.15.16:0/2437901739 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d54045050 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d640a3740 10 client.16524 fetch_fsmap learned FSMap version 25 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.344+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d486b1dcc0 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d3affd640 1 -- 172.21.15.16:0/2437901739 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d54009b70 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d3affd640 1 -- 172.21.15.16:0/2437901739 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d54012450 con 0x55d486aa0d30 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d640a3740 10 client.16524 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:45:46.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d640a3740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d640a3740 20 client.16524 populate_metadata read hostname 'smithi016' 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486b1e2c0 0x55d486b206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d640a3740 4 client.16524 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d486a93a10 con 0x55d486b1e2c0 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486b1e2c0 0x55d486b206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d3affd640 10 client.16524 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.345+0000 7f4d5b7fe640 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486b1e2c0 0x55d486b206b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14201109b9fd6130 server_cookie=882c7e3e21788f25 in_seq=0 out_seq=0 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d3affd640 1 -- 172.21.15.16:0/2437901739 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55d486a93a10 con 0x55d486b1e2c0 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d3affd640 10 client.16524 handle_command_reply: tid=0 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 client.16524 shutdown 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 msgr2=0x55d486aa3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486aa3c30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400a010 tx=0x7f4d54010fd0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 shutdown_connections 2024-09-10T23:45:46.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d486b1e2c0 0x55d486b206b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d486aa0d30 0x55d486aa3c30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d486a94da0 0x55d486aa93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 --2- 172.21.15.16:0/2437901739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d486a94480 0x55d486aa8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 >> 172.21.15.16:0/2437901739 conn(0x55d486a922b0 msgr2=0x55d486a9f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d3affd640 0 client.16524 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 shutdown_connections 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 1 -- 172.21.15.16:0/2437901739 wait complete. 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.346+0000 7f4d640a3740 20 client.16524 trim_cache size 0 max 16384 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:45:46.352 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "343dfa4b-bfad-4056-b8bf-5f4133f990f0", 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.353 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.354 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.356 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.357 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:45:46.358 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4d480b5450 msgr2=0x7f4d480b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4d480b5450 0x7f4d480b7910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c005ab0 tx=0x7f4d4c005a20 comp rx=0 tx=0).stop 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c10a920 msgr2=0x7f4d5c19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:45:46.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c10a920 0x7f4d5c19ba00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400d950 tx=0x7f4d4400de10 comp rx=0 tx=0).stop 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 shutdown_connections 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4d480b5450 0x7f4d480b7910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c10d250 0x7f4d5c1a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d5c10a920 0x7f4d5c19ba00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 --2- 172.21.15.16:0/427842458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c101810 0x7f4d5c19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 >> 172.21.15.16:0/427842458 conn(0x7f4d5c076f50 msgr2=0x7f4d5c108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 shutdown_connections 2024-09-10T23:45:46.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:45:46.347+0000 7f4d61cce640 1 -- 172.21.15.16:0/427842458 wait complete. 2024-09-10T23:45:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:46 smithi016 ceph-mon[30855]: pgmap v486: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:46 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:45:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:46 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:46 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:45:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:46 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:46.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:46 smithi071 ceph-mon[35018]: pgmap v486: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:46.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:46 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:45:46.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:46 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:46.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:46 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:45:46.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:46 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:46 smithi066 ceph-mon[34761]: pgmap v486: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:45:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:46 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:45:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:46 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:46 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:45:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:46 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:45:47.146 INFO:tasks.cephfs.filesystem:scrub status for tag:343dfa4b-bfad-4056-b8bf-5f4133f990f0 - {'path': '/', 'tag': '343dfa4b-bfad-4056-b8bf-5f4133f990f0', 'options': 'recursive,force'} 2024-09-10T23:45:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:48 smithi016 ceph-mon[30855]: pgmap v487: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:48 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:45:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:48 smithi071 ceph-mon[35018]: pgmap v487: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:48 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:45:48.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:48 smithi066 ceph-mon[34761]: pgmap v487: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:45:48.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:48 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:45:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:50 smithi016 ceph-mon[30855]: pgmap v488: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:45:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:50 smithi071 ceph-mon[35018]: pgmap v488: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:45:50.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:50 smithi066 ceph-mon[34761]: pgmap v488: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:45:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:52 smithi016 ceph-mon[30855]: pgmap v489: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:52 smithi071 ceph-mon[35018]: pgmap v489: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:52 smithi066 ceph-mon[34761]: pgmap v489: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:54.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:54 smithi016 ceph-mon[30855]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:45:54.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:54 smithi071 ceph-mon[35018]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:45:54.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:54 smithi066 ceph-mon[34761]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:45:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:56 smithi016 ceph-mon[30855]: pgmap v491: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:45:56.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:56 smithi071 ceph-mon[35018]: pgmap v491: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:45:56.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:56 smithi066 ceph-mon[34761]: pgmap v491: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:45:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:45:58 smithi016 ceph-mon[30855]: pgmap v492: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:45:58 smithi071 ceph-mon[35018]: pgmap v492: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:45:58.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:45:58 smithi066 ceph-mon[34761]: pgmap v492: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:00.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:00 smithi016 ceph-mon[30855]: pgmap v493: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:46:00.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:00 smithi071 ceph-mon[35018]: pgmap v493: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:46:00.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:00 smithi066 ceph-mon[34761]: pgmap v493: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:46:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:02 smithi016 ceph-mon[30855]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:46:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:02 smithi071 ceph-mon[35018]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:46:02.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:02 smithi066 ceph-mon[34761]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:46:04.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:04 smithi016 ceph-mon[30855]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:46:04.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:04 smithi071 ceph-mon[35018]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:46:04.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:04 smithi066 ceph-mon[34761]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:46:06.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:06 smithi071 ceph-mon[35018]: pgmap v496: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:06.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:06 smithi066 ceph-mon[34761]: pgmap v496: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:06.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:06 smithi016 ceph-mon[30855]: pgmap v496: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:08.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:08 smithi071 ceph-mon[35018]: pgmap v497: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:08.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:08 smithi066 ceph-mon[34761]: pgmap v497: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:08.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:08 smithi016 ceph-mon[30855]: pgmap v497: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:10 smithi071 ceph-mon[35018]: pgmap v498: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:46:10.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:10 smithi066 ceph-mon[34761]: pgmap v498: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:46:10.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:10 smithi016 ceph-mon[30855]: pgmap v498: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-10T23:46:12.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:12 smithi071 ceph-mon[35018]: pgmap v499: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:12.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:12 smithi066 ceph-mon[34761]: pgmap v499: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:12.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:12 smithi016 ceph-mon[30855]: pgmap v499: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-10T23:46:14.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:14 smithi071 ceph-mon[35018]: pgmap v500: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:46:14.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:14 smithi066 ceph-mon[34761]: pgmap v500: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:46:14.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:14 smithi016 ceph-mon[30855]: pgmap v500: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-10T23:46:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:16 smithi071 ceph-mon[35018]: pgmap v501: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:46:16.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:16 smithi066 ceph-mon[34761]: pgmap v501: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:46:16.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:16 smithi016 ceph-mon[30855]: pgmap v501: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T23:46:17.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:46:17.425 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 -- 172.21.15.16:0/3131184691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d70104c60 msgr2=0x7f2d701050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 --2- 172.21.15.16:0/3131184691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d70104c60 0x7f2d701050a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009900 tx=0x7f2d6002a410 comp rx=0 tx=0).stop 2024-09-10T23:46:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 -- 172.21.15.16:0/3131184691 shutdown_connections 2024-09-10T23:46:17.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 --2- 172.21.15.16:0/3131184691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d701055e0 0x7f2d7010dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 --2- 172.21.15.16:0/3131184691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d70104c60 0x7f2d701050a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 --2- 172.21.15.16:0/3131184691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d70101880 0x7f2d70101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 -- 172.21.15.16:0/3131184691 >> 172.21.15.16:0/3131184691 conn(0x7f2d70076e60 msgr2=0x7f2d70077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 -- 172.21.15.16:0/3131184691 shutdown_connections 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 -- 172.21.15.16:0/3131184691 wait complete. 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 Processor -- start 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 -- start start 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.912+0000 7f2d77420640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d70101880 0x7f2d70199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d77420640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d70104c60 0x7f2d70199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d77420640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d701055e0 0x7f2d7019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d77420640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70111460 con 0x7f2d701055e0 2024-09-10T23:46:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d77420640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701112e0 con 0x7f2d70104c60 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d77420640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701115e0 con 0x7f2d70101880 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d701055e0 0x7f2d7019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d701055e0 0x7f2d7019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47010/0 (socket says 172.21.15.16:47010) 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 -- 172.21.15.16:0/2208460568 learned_addr learned my addr 172.21.15.16:0/2208460568 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d749bb640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d70104c60 0x7f2d70199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d751bc640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d70101880 0x7f2d70199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 -- 172.21.15.16:0/2208460568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d70101880 msgr2=0x7f2d70199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d70101880 0x7f2d70199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 -- 172.21.15.16:0/2208460568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d70104c60 msgr2=0x7f2d70199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d70104c60 0x7f2d70199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 -- 172.21.15.16:0/2208460568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7019f3b0 con 0x7f2d701055e0 2024-09-10T23:46:17.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d749bb640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d70104c60 0x7f2d70199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d759bd640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d701055e0 0x7f2d7019ebe0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b970 tx=0x7f2d6800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d667fc640 1 -- 172.21.15.16:0/2208460568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68019070 con 0x7f2d701055e0 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d667fc640 1 -- 172.21.15.16:0/2208460568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d68014440 con 0x7f2d701055e0 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7019f6a0 con 0x7f2d701055e0 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.913+0000 7f2d667fc640 1 -- 172.21.15.16:0/2208460568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680075d0 con 0x7f2d701055e0 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.914+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d701a5d60 con 0x7f2d701055e0 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.916+0000 7f2d797f5740 1 Processor -- start 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.916+0000 7f2d667fc640 1 -- 172.21.15.16:0/2208460568 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f2d6800cb40 con 0x7f2d701055e0 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.916+0000 7f2d797f5740 1 -- start start 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a99887f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a998b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d797f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5627a98f2e50 con 0x5627a997c480 2024-09-10T23:46:17.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d797f5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5627a98e2280 con 0x5627a997cda0 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d797f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5627a98e6090 con 0x5627a9988d30 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47016/0 (socket says 172.21.15.16:47016) 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 -- 172.21.15.16:0/1716873668 learned_addr learned my addr 172.21.15.16:0/1716873668 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a998b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d751bc640 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a99887f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d667fc640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2d5c0b5450 0x7f2d5c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 -- 172.21.15.16:0/1716873668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 msgr2=0x5627a998b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a998b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 -- 172.21.15.16:0/1716873668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 msgr2=0x5627a99887f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a99887f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 -- 172.21.15.16:0/1716873668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a9640650 con 0x5627a997c480 2024-09-10T23:46:17.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d759bd640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2d5c0b5450 0x7f2d5c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997c860 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2d6002a930 tx=0x7f2d600058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94ab6136ac7fb1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.917+0000 7f2d667fc640 1 -- 172.21.15.16:0/2208460568 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2d680e5810 con 0x7f2d701055e0 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d5b7fe640 1 -- 172.21.15.16:0/1716873668 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60035070 con 0x5627a997c480 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d5b7fe640 1 -- 172.21.15.16:0/1716873668 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d60042030 con 0x5627a997c480 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d5b7fe640 1 -- 172.21.15.16:0/1716873668 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d600047a0 con 0x5627a997c480 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d759bd640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2d5c0b5450 0x7f2d5c0b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b940 tx=0x7f2d68079040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d797f5740 1 -- 172.21.15.16:0/1716873668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 msgr2=0x5627a997c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997c860 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2d6002a930 tx=0x7f2d600058d0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d797f5740 1 -- 172.21.15.16:0/1716873668 shutdown_connections 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a998b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a99887f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.918+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1716873668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997c860 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 -- 172.21.15.16:0/1716873668 >> 172.21.15.16:0/1716873668 conn(0x5627a997a2b0 msgr2=0x5627a997b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 -- 172.21.15.16:0/1716873668 shutdown_connections 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 -- 172.21.15.16:0/1716873668 wait complete. 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 -- start start 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 Processor -- start 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a9988560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a997cda0 0x5627a99859b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a9988d30 0x5627a9985ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5627a9743700 con 0x5627a997c480 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5627a987d110 con 0x5627a9988d30 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5627a998b9a0 con 0x5627a997cda0 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.919+0000 7f2d797f5740 10 client.0 _ll_register_callbacks cb 0x5627a9896990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a9988560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a9988560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47026/0 (socket says 172.21.15.16:47026) 2024-09-10T23:46:17.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 -- 172.21.15.16:0/1071237853 learned_addr learned my addr 172.21.15.16:0/1071237853 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a9988d30 0x5627a9985ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d751bc640 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a997cda0 0x5627a99859b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 -- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a997cda0 msgr2=0x5627a99859b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a997cda0 0x5627a99859b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 -- 172.21.15.16:0/1071237853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a9988d30 msgr2=0x5627a9985ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a9988d30 0x5627a9985ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 -- 172.21.15.16:0/1071237853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a98aac40 con 0x5627a997c480 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d749bb640 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a9988560 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2d60031a60 tx=0x7f2d600042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0153f81e5a6f573 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d58ff9640 1 -- 172.21.15.16:0/1071237853 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60052060 con 0x5627a997c480 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d58ff9640 1 -- 172.21.15.16:0/1071237853 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2d6004b670 con 0x5627a997c480 2024-09-10T23:46:17.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d60042030 con 0x5627a997c480 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d58ff9640 1 -- 172.21.15.16:0/1071237853 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d60035070 con 0x5627a997c480 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d797f5740 10 client.16536 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.920+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627a9997240 con 0x5627a997c480 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d58ff9640 1 -- 172.21.15.16:0/1071237853 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d60042030 con 0x5627a997c480 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d58ff9640 1 -- 172.21.15.16:0/1071237853 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d6003a040 con 0x5627a997c480 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d797f5740 10 client.16536 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d797f5740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d797f5740 20 client.16536 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9998590 0x5627a999a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d797f5740 4 client.16536 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627a98f4da0 con 0x5627a9998590 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.921+0000 7f2d751bc640 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9998590 0x5627a999a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.922+0000 7f2d58ff9640 10 client.16536 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.922+0000 7f2d751bc640 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9998590 0x5627a999a980 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a4b42b47d173ba server_cookie=deef717cf8504e2 in_seq=0 out_seq=0 2024-09-10T23:46:17.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.922+0000 7f2d58ff9640 1 -- 172.21.15.16:0/1071237853 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627a98f4da0 con 0x5627a9998590 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.922+0000 7f2d58ff9640 10 client.16536 handle_command_reply: tid=0 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.922+0000 7f2d797f5740 1 client.16536 shutdown 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 msgr2=0x5627a9988560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a9988560 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2d60031a60 tx=0x7f2d600042d0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 shutdown_connections 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9998590 0x5627a999a980 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a9988d30 0x5627a9985ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a997cda0 0x5627a99859b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 --2- 172.21.15.16:0/1071237853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a9988560 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 >> 172.21.15.16:0/1071237853 conn(0x5627a997a2b0 msgr2=0x5627a997fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d58ff9640 0 client.16536 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 shutdown_connections 2024-09-10T23:46:17.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 1 -- 172.21.15.16:0/1071237853 wait complete. 2024-09-10T23:46:17.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.923+0000 7f2d797f5740 20 client.16536 trim_cache size 0 max 16384 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 Processor -- start 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 -- start start 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a9982bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a9983100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701b0eb0 con 0x5627a997c480 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701ae780 con 0x5627a997cda0 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d797f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701ac5d0 con 0x5627a9988d30 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d749bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d749bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47036/0 (socket says 172.21.15.16:47036) 2024-09-10T23:46:17.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d749bb640 1 -- 172.21.15.16:0/661371972 learned_addr learned my addr 172.21.15.16:0/661371972 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.941+0000 7f2d751bc640 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a9982bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d749bb640 1 -- 172.21.15.16:0/661371972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 msgr2=0x5627a9983100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d749bb640 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a9983100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d749bb640 1 -- 172.21.15.16:0/661371972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 msgr2=0x5627a9982bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d749bb640 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a9982bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d749bb640 1 -- 172.21.15.16:0/661371972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a997ad30 con 0x5627a997c480 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d749bb640 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997ba80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2d600317d0 tx=0x7f2d6002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e819487a07b02b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d5affd640 1 -- 172.21.15.16:0/661371972 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60052040 con 0x5627a997c480 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d5affd640 1 -- 172.21.15.16:0/661371972 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d60042030 con 0x5627a997c480 2024-09-10T23:46:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.942+0000 7f2d5affd640 1 -- 172.21.15.16:0/661371972 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6004bb80 con 0x5627a997c480 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 -- 172.21.15.16:0/661371972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 msgr2=0x5627a997ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997ba80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2d600317d0 tx=0x7f2d6002a410 comp rx=0 tx=0).stop 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 -- 172.21.15.16:0/661371972 shutdown_connections 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a9983100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997cda0 0x5627a9982bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 --2- 172.21.15.16:0/661371972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997c480 0x5627a997ba80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 -- 172.21.15.16:0/661371972 >> 172.21.15.16:0/661371972 conn(0x5627a997a2b0 msgr2=0x5627a997b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 -- 172.21.15.16:0/661371972 shutdown_connections 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 -- 172.21.15.16:0/661371972 wait complete. 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 -- start start 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.943+0000 7f2d797f5740 1 Processor -- start 2024-09-10T23:46:17.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997c480 0x5627a999b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997cda0 0x5627a999ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d797f5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a999bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d797f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701acc40 con 0x5627a997cda0 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d797f5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701ae0b0 con 0x5627a997c480 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d797f5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701ad310 con 0x5627a9988d30 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d797f5740 10 client.0 _ll_register_callbacks cb 0x7f2d6c00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997cda0 0x5627a999ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997cda0 0x5627a999ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47046/0 (socket says 172.21.15.16:47046) 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 -- 172.21.15.16:0/940106662 learned_addr learned my addr 172.21.15.16:0/940106662 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d749bb640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a999bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d749bb640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997c480 0x5627a999b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 -- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 msgr2=0x5627a999bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a999bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 -- 172.21.15.16:0/940106662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997c480 msgr2=0x5627a999b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997c480 0x5627a999b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 -- 172.21.15.16:0/940106662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a9a04130 con 0x5627a997cda0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d749bb640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997c480 0x5627a999b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d751bc640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997cda0 0x5627a999ba70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x5627a998ba30 tx=0x7f2d6c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d9f4f4795daa15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.944+0000 7f2d58ff9640 1 -- 172.21.15.16:0/940106662 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c01c410 con 0x5627a997cda0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d58ff9640 1 -- 172.21.15.16:0/940106662 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2d6c01c5b0 con 0x5627a997cda0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d60042030 con 0x5627a997cda0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d58ff9640 1 -- 172.21.15.16:0/940106662 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d6c01c7b0 con 0x5627a997cda0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 10 client.16542 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627a9a054d0 con 0x5627a997cda0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d58ff9640 1 -- 172.21.15.16:0/940106662 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d60042030 con 0x5627a997cda0 2024-09-10T23:46:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d58ff9640 1 -- 172.21.15.16:0/940106662 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d6c02da70 con 0x5627a997cda0 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 10 client.16542 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 20 client.16542 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9a05c80 0x5627a9a080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 4 client.16542 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5627a98f0850 con 0x5627a9a05c80 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.945+0000 7f2d749bb640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9a05c80 0x5627a9a080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d58ff9640 10 client.16542 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d749bb640 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9a05c80 0x5627a9a080a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7dd0182fdabe6c7 server_cookie=ba9ea1871e85d449 in_seq=0 out_seq=0 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d58ff9640 1 -- 172.21.15.16:0/940106662 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5627a98f0850 con 0x5627a9a05c80 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d58ff9640 10 client.16542 handle_command_reply: tid=0 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 client.16542 shutdown 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997cda0 msgr2=0x5627a999ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997cda0 0x5627a999ba70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x5627a998ba30 tx=0x7f2d6c00cee0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 shutdown_connections 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5627a9a05c80 0x5627a9a080a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5627a9988d30 0x5627a999bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5627a997cda0 0x5627a999ba70 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d58ff9640 0 client.16542 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 --2- 172.21.15.16:0/940106662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5627a997c480 0x5627a999b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 >> 172.21.15.16:0/940106662 conn(0x5627a997a2b0 msgr2=0x5627a9986fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.946+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 shutdown_connections 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d797f5740 1 -- 172.21.15.16:0/940106662 wait complete. 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d797f5740 20 client.16542 trim_cache size 0 max 16384 2024-09-10T23:46:17.952 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:46:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:17.959 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:46:17.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2d5c0b5450 msgr2=0x7f2d5c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2d5c0b5450 0x7f2d5c0b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b940 tx=0x7f2d68079040 comp rx=0 tx=0).stop 2024-09-10T23:46:17.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d701055e0 msgr2=0x7f2d7019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d701055e0 0x7f2d7019ebe0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b970 tx=0x7f2d6800be30 comp rx=0 tx=0).stop 2024-09-10T23:46:17.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 shutdown_connections 2024-09-10T23:46:17.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d701055e0 0x7f2d7019ebe0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2d5c0b5450 0x7f2d5c0b7910 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d70104c60 0x7f2d70199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 --2- 172.21.15.16:0/2208460568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d70101880 0x7f2d70199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 >> 172.21.15.16:0/2208460568 conn(0x7f2d70076e60 msgr2=0x7f2d70107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 shutdown_connections 2024-09-10T23:46:17.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:17.947+0000 7f2d77420640 1 -- 172.21.15.16:0/2208460568 wait complete. 2024-09-10T23:46:18.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:18 smithi071 ceph-mon[35018]: pgmap v502: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:46:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:18 smithi066 ceph-mon[34761]: pgmap v502: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:46:18.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:18 smithi016 ceph-mon[30855]: pgmap v502: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:46:18.804 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:46:18.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:46:19.069 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1566740271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 msgr2=0x7fc9d0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1566740271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d0108c10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009900 tx=0x7fc9c402a410 comp rx=0 tx=0).stop 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1566740271 shutdown_connections 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1566740271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d0109150 0x7fc9d010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1566740271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d0108c10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1566740271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d0102dc0 0x7fc9d01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1566740271 >> 172.21.15.16:0/1566740271 conn(0x7fc9d00fe830 msgr2=0x7fc9d0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1566740271 shutdown_connections 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.555+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1566740271 wait complete. 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 Processor -- start 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 -- start start 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d0102dc0 0x7fc9d01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d01997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d0109150 0x7fc9d019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d0112e60 con 0x7fc9d01087d0 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d0112ce0 con 0x7fc9d0109150 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9d4f98640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d0112fe0 con 0x7fc9d0102dc0 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9cdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d01997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9cdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d01997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47070/0 (socket says 172.21.15.16:47070) 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9cdd9b640 1 -- 172.21.15.16:0/1560060810 learned_addr learned my addr 172.21.15.16:0/1560060810 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9ce59c640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d0102dc0 0x7fc9d01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.556+0000 7fc9ced9d640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d0109150 0x7fc9d019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9cdd9b640 1 -- 172.21.15.16:0/1560060810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d0102dc0 msgr2=0x7fc9d01992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9cdd9b640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d0102dc0 0x7fc9d01992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9cdd9b640 1 -- 172.21.15.16:0/1560060810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d0109150 msgr2=0x7fc9d019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9cdd9b640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d0109150 0x7fc9d019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9cdd9b640 1 -- 172.21.15.16:0/1560060810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d019f360 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9ced9d640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d0109150 0x7fc9d019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9cdd9b640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d01997f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005ab0 tx=0x7fc9c4003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9bf7fe640 1 -- 172.21.15.16:0/1560060810 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c403f070 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d019f5f0 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9bf7fe640 1 -- 172.21.15.16:0/1560060810 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c4031d60 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9bf7fe640 1 -- 172.21.15.16:0/1560060810 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4035030 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.557+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d01a5d10 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.558+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d01031a0 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.560+0000 7fc9bf7fe640 1 -- 172.21.15.16:0/1560060810 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc9c403b4f0 con 0x7fc9d01087d0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.560+0000 7fc9bf7fe640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b80b54d0 0x7fc9b80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.561+0000 7fc9ce59c640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b80b54d0 0x7fc9b80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.561+0000 7fc9bf7fe640 1 -- 172.21.15.16:0/1560060810 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fc9c4107260 con 0x7fc9d01087d0 2024-09-10T23:46:19.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.561+0000 7fc9ce59c640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b80b54d0 0x7fc9b80b7990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009990 tx=0x7fc9c0009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:19.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.563+0000 7fc9bf7fe640 1 -- 172.21.15.16:0/1560060810 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9c40cde40 con 0x7fc9d01087d0 2024-09-10T23:46:19.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.785+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9d019a3e0 con 0x7fc9d01087d0 2024-09-10T23:46:19.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.786+0000 7fc9bf7fe640 1 -- 172.21.15.16:0/1560060810 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fc9c40cd740 con 0x7fc9d01087d0 2024-09-10T23:46:19.788 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:46:19.788 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:46:19.788 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b80b54d0 msgr2=0x7fc9b80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b80b54d0 0x7fc9b80b7990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009990 tx=0x7fc9c0009110 comp rx=0 tx=0).stop 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 msgr2=0x7fc9d01997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d01997f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005ab0 tx=0x7fc9c4003d50 comp rx=0 tx=0).stop 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 shutdown_connections 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc9b80b54d0 0x7fc9b80b7990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d0109150 0x7fc9d019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9d01087d0 0x7fc9d01997f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 --2- 172.21.15.16:0/1560060810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9d0102dc0 0x7fc9d01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 >> 172.21.15.16:0/1560060810 conn(0x7fc9d00fe830 msgr2=0x7fc9d0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:19.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 shutdown_connections 2024-09-10T23:46:19.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:19.789+0000 7fc9d4f98640 1 -- 172.21.15.16:0/1560060810 wait complete. 2024-09-10T23:46:20.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:20 smithi016 ceph-mon[30855]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:46:20.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:20 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1560060810' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:20.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:46:20.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:20 smithi071 ceph-mon[35018]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:46:20.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:20 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1560060810' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:20.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:20 smithi066 ceph-mon[34761]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:46:20.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:20 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1560060810' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 -- 172.21.15.16:0/3999798814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68108020 msgr2=0x7fed6810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3999798814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68108020 0x7fed6810e820 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fed60009ca0 tx=0x7fed6002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 -- 172.21.15.16:0/3999798814 shutdown_connections 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3999798814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68108020 0x7fed6810e820 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3999798814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed681076a0 0x7fed68107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3999798814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed68101c90 0x7fed68102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 -- 172.21.15.16:0/3999798814 >> 172.21.15.16:0/3999798814 conn(0x7fed680fd700 msgr2=0x7fed680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 -- 172.21.15.16:0/3999798814 shutdown_connections 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 -- 172.21.15.16:0/3999798814 wait complete. 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.198+0000 7fed6ca49640 1 Processor -- start 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6ca49640 1 -- start start 2024-09-10T23:46:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6ca49640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68101c90 0x7fed6819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6ca49640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed681076a0 0x7fed6819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6ca49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed68108020 0x7fed6819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6ca49640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fed68111ca0 con 0x7fed68101c90 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6ca49640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed68111b20 con 0x7fed68108020 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6ca49640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed68111e20 con 0x7fed681076a0 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68101c90 0x7fed6819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68101c90 0x7fed6819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47084/0 (socket says 172.21.15.16:47084) 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 -- 172.21.15.16:0/3318636385 learned_addr learned my addr 172.21.15.16:0/3318636385 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed681076a0 0x7fed6819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed68108020 0x7fed6819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 -- 172.21.15.16:0/3318636385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed681076a0 msgr2=0x7fed6819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed681076a0 0x7fed6819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 -- 172.21.15.16:0/3318636385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed68108020 msgr2=0x7fed6819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed68108020 0x7fed6819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 -- 172.21.15.16:0/3318636385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed681a5450 con 0x7fed68101c90 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.199+0000 7fed6659c640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68101c90 0x7fed6819a070 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c920 tx=0x7fed5800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.200+0000 7fed5ffff640 1 -- 172.21.15.16:0/3318636385 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58007c70 con 0x7fed68101c90 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.200+0000 7fed5ffff640 1 -- 172.21.15.16:0/3318636385 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed58007e10 con 0x7fed68101c90 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.200+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed681a5740 con 0x7fed68101c90 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.200+0000 7fed5ffff640 1 -- 172.21.15.16:0/3318636385 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58018820 con 0x7fed68101c90 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.200+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed681a5c80 con 0x7fed68101c90 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.202+0000 7fed6ee1e740 1 Processor -- start 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.202+0000 7fed6ee1e740 1 -- start start 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.202+0000 7fed5ffff640 1 -- 172.21.15.16:0/3318636385 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fed5800f450 con 0x7fed68101c90 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb22a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb23a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb23d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5576bb1a0ea0 con 0x5576bb22a0f0 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576bb1902d0 con 0x5576bb22aa10 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576bb1940e0 con 0x5576bb23adb0 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb22a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb22a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47090/0 (socket says 172.21.15.16:47090) 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 -- 172.21.15.16:0/4129844094 learned_addr learned my addr 172.21.15.16:0/4129844094 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6659c640 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb23a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb23d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 -- 172.21.15.16:0/4129844094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 msgr2=0x5576bb23d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb23d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 -- 172.21.15.16:0/4129844094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 msgr2=0x5576bb23a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb23a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 -- 172.21.15.16:0/4129844094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576baeee650 con 0x5576bb22a0f0 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb23d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed6659c640 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb23a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed66d9d640 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb22a4d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fed60009940 tx=0x7fed60009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19db5db6ba95bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed5cd99640 1 -- 172.21.15.16:0/4129844094 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60031650 con 0x5576bb22a0f0 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed5cd99640 1 -- 172.21.15.16:0/4129844094 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed6003f070 con 0x5576bb22a0f0 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.203+0000 7fed5cd99640 1 -- 172.21.15.16:0/4129844094 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed600046b0 con 0x5576bb22a0f0 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed5ffff640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fed540b5450 0x7fed540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6659c640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fed540b5450 0x7fed540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 -- 172.21.15.16:0/4129844094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 msgr2=0x5576bb22a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed5ffff640 1 -- 172.21.15.16:0/3318636385 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fed580e61b0 con 0x7fed68101c90 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb22a4d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fed60009940 tx=0x7fed60009970 comp rx=0 tx=0).stop 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 -- 172.21.15.16:0/4129844094 shutdown_connections 2024-09-10T23:46:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb23d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb23a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/4129844094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb22a4d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 -- 172.21.15.16:0/4129844094 >> 172.21.15.16:0/4129844094 conn(0x5576bb227f20 msgr2=0x5576bb2290c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 -- 172.21.15.16:0/4129844094 shutdown_connections 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.204+0000 7fed6ee1e740 1 -- 172.21.15.16:0/4129844094 wait complete. 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6659c640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fed540b5450 0x7fed540b7910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fed580e3a10 tx=0x7fed58000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 -- start start 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 Processor -- start 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb23a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22aa10 0x5576bb237b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb238260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5576baff1700 con 0x5576bb22aa10 2024-09-10T23:46:21.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576bb12b160 con 0x5576bb22a0f0 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576bb23da00 con 0x5576bb23adb0 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed6ee1e740 10 client.0 _ll_register_callbacks cb 0x5576bb1449e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22aa10 0x5576bb237b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22aa10 0x5576bb237b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47104/0 (socket says 172.21.15.16:47104) 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 -- 172.21.15.16:0/418461296 learned_addr learned my addr 172.21.15.16:0/418461296 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed66d9d640 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb23a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 -- 172.21.15.16:0/418461296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 msgr2=0x5576bb238260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb238260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 -- 172.21.15.16:0/418461296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 msgr2=0x5576bb23a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb23a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.205+0000 7fed5dd9b640 1 -- 172.21.15.16:0/418461296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bb158c90 con 0x5576bb22aa10 2024-09-10T23:46:21.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22aa10 0x5576bb237b90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fed50010720 tx=0x7fed50010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a84b1c17176e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed4dffb640 1 -- 172.21.15.16:0/418461296 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50004220 con 0x5576bb22aa10 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed4dffb640 1 -- 172.21.15.16:0/418461296 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fed500043c0 con 0x5576bb22aa10 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed6003f070 con 0x5576bb22aa10 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed4dffb640 1 -- 172.21.15.16:0/418461296 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed5000c910 con 0x5576bb22aa10 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed6ee1e740 10 client.16560 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576bb249430 con 0x5576bb22aa10 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed4dffb640 1 -- 172.21.15.16:0/418461296 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed6003f070 con 0x5576bb22aa10 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed4dffb640 1 -- 172.21.15.16:0/418461296 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fed50025470 con 0x5576bb22aa10 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed6ee1e740 10 client.16560 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed6ee1e740 10 client.16560 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed6ee1e740 20 client.16560 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.206+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb24a890 0x5576bb24ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.207+0000 7fed6ee1e740 4 client.16560 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.207+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576bb1a2df0 con 0x5576bb24a890 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.207+0000 7fed66d9d640 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb24a890 0x5576bb24ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.207+0000 7fed4dffb640 10 client.16560 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.207+0000 7fed66d9d640 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb24a890 0x5576bb24ccf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52d789d7bdd8bc03 server_cookie=8cffe239b2bd2d4b in_seq=0 out_seq=0 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed4dffb640 1 -- 172.21.15.16:0/418461296 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576bb1a2df0 con 0x5576bb24a890 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed4dffb640 10 client.16560 handle_command_reply: tid=0 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 client.16560 shutdown 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22aa10 msgr2=0x5576bb237b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22aa10 0x5576bb237b90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fed50010720 tx=0x7fed50010be0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 shutdown_connections 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb24a890 0x5576bb24ccf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb238260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed4dffb640 0 client.16560 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22aa10 0x5576bb237b90 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/418461296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb23a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 >> 172.21.15.16:0/418461296 conn(0x5576bb227f20 msgr2=0x5576bb22da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.208+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 shutdown_connections 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.209+0000 7fed6ee1e740 1 -- 172.21.15.16:0/418461296 wait complete. 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.209+0000 7fed6ee1e740 20 client.16560 trim_cache size 0 max 16384 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 Processor -- start 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 -- start start 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb227760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb246c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb2525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fed681aec30 con 0x5576bb22a0f0 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed681ac500 con 0x5576bb22aa10 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed681aa350 con 0x5576bb23adb0 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb227760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb227760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47112/0 (socket says 172.21.15.16:47112) 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 -- 172.21.15.16:0/3987016512 learned_addr learned my addr 172.21.15.16:0/3987016512 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 -- 172.21.15.16:0/3987016512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 msgr2=0x5576bb2525c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3987016512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb2525c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 -- 172.21.15.16:0/3987016512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 msgr2=0x5576bb246c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3987016512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb246c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 -- 172.21.15.16:0/3987016512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bb22a840 con 0x5576bb22a0f0 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.222+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3987016512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb227760 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fed600042c0 tx=0x7fed600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f27cfe760ea8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed4ffff640 1 -- 172.21.15.16:0/3987016512 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60004810 con 0x5576bb22a0f0 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed4ffff640 1 -- 172.21.15.16:0/3987016512 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed6003f040 con 0x5576bb22a0f0 2024-09-10T23:46:21.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed4ffff640 1 -- 172.21.15.16:0/3987016512 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6002f660 con 0x5576bb22a0f0 2024-09-10T23:46:21.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3987016512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 msgr2=0x5576bb227760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3987016512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb227760 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fed600042c0 tx=0x7fed600042f0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3987016512 shutdown_connections 2024-09-10T23:46:21.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3987016512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb23adb0 0x5576bb2525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3987016512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22aa10 0x5576bb246c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3987016512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb22a0f0 0x5576bb227760 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3987016512 >> 172.21.15.16:0/3987016512 conn(0x5576bb227f20 msgr2=0x5576bb23bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3987016512 shutdown_connections 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.223+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3987016512 wait complete. 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 -- start start 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 Processor -- start 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb242fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb22aa10 0x5576bb243550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb23adb0 0x5576bb23fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fed681aa9c0 con 0x5576bb23adb0 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed681abe30 con 0x5576bb22a0f0 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed681ab090 con 0x5576bb22aa10 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed6ee1e740 10 client.0 _ll_register_callbacks cb 0x7fed5000e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:21.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb23adb0 0x5576bb23fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb23adb0 0x5576bb23fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47114/0 (socket says 172.21.15.16:47114) 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed66d9d640 1 -- 172.21.15.16:0/3367690422 learned_addr learned my addr 172.21.15.16:0/3367690422 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb22aa10 0x5576bb243550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.224+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb242fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed66d9d640 1 -- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb22aa10 msgr2=0x5576bb243550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb22aa10 0x5576bb243550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed66d9d640 1 -- 172.21.15.16:0/3367690422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 msgr2=0x5576bb242fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb242fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed66d9d640 1 -- 172.21.15.16:0/3367690422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bb240560 con 0x5576bb23adb0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed66d9d640 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb23adb0 0x5576bb23fd30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fed60005e30 tx=0x7fed6002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d8b494d50de123 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed4dffb640 1 -- 172.21.15.16:0/3367690422 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6005c060 con 0x5576bb23adb0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed4dffb640 1 -- 172.21.15.16:0/3367690422 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fed60004610 con 0x5576bb23adb0 2024-09-10T23:46:21.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed6003f040 con 0x5576bb23adb0 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed4dffb640 1 -- 172.21.15.16:0/3367690422 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fed60003e40 con 0x5576bb23adb0 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed6ee1e740 10 client.16566 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576bb2b83d0 con 0x5576bb23adb0 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.225+0000 7fed4dffb640 1 -- 172.21.15.16:0/3367690422 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed6003f040 con 0x5576bb23adb0 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed4dffb640 1 -- 172.21.15.16:0/3367690422 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fed6002fa70 con 0x5576bb23adb0 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed6ee1e740 10 client.16566 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed6ee1e740 10 client.16566 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed6ee1e740 20 client.16566 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb2b8600 0x5576bb2ba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed6ee1e740 4 client.16566 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576bb19e8a0 con 0x5576bb2b8600 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb2b8600 0x5576bb2ba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed4dffb640 10 client.16566 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed5dd9b640 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb2b8600 0x5576bb2ba9f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48bd4a02e3983f14 server_cookie=d176323e07e3a744 in_seq=0 out_seq=0 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed4dffb640 1 -- 172.21.15.16:0/3367690422 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576bb19e8a0 con 0x5576bb2b8600 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed4dffb640 10 client.16566 handle_command_reply: tid=0 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.226+0000 7fed6ee1e740 1 client.16566 shutdown 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb23adb0 msgr2=0x5576bb23fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb23adb0 0x5576bb23fd30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fed60005e30 tx=0x7fed6002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 shutdown_connections 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5576bb2b8600 0x5576bb2ba9f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5576bb23adb0 0x5576bb23fd30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576bb22aa10 0x5576bb243550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 --2- 172.21.15.16:0/3367690422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576bb22a0f0 0x5576bb242fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 >> 172.21.15.16:0/3367690422 conn(0x5576bb227f20 msgr2=0x5576bb2391c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed4dffb640 0 client.16566 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:21.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 shutdown_connections 2024-09-10T23:46:21.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 1 -- 172.21.15.16:0/3367690422 wait complete. 2024-09-10T23:46:21.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ee1e740 20 client.16566 trim_cache size 0 max 16384 2024-09-10T23:46:21.243 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fed540b5450 msgr2=0x7fed540b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fed540b5450 0x7fed540b7910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fed580e3a10 tx=0x7fed58000bc0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68101c90 msgr2=0x7fed6819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68101c90 0x7fed6819a070 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c920 tx=0x7fed5800cde0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 shutdown_connections 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fed540b5450 0x7fed540b7910 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed68108020 0x7fed6819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed681076a0 0x7fed6819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.227+0000 7fed6ca49640 1 --2- 172.21.15.16:0/3318636385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed68101c90 0x7fed6819a070 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.228+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 >> 172.21.15.16:0/3318636385 conn(0x7fed680fd700 msgr2=0x7fed680ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.228+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 shutdown_connections 2024-09-10T23:46:21.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:21.228+0000 7fed6ca49640 1 -- 172.21.15.16:0/3318636385 wait complete. 2024-09-10T23:46:21.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:46:22.246 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:22.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:22 smithi071 ceph-mon[35018]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:46:22.526 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:22 smithi016 ceph-mon[30855]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:46:22.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:22 smithi066 ceph-mon[34761]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:46:22.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 -- 172.21.15.16:0/802779892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68104570 msgr2=0x7fec6810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/802779892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68104570 0x7fec6810cb50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009ca0 tx=0x7fec5c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 -- 172.21.15.16:0/802779892 shutdown_connections 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/802779892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6810d120 0x7fec6810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/802779892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68104570 0x7fec6810cb50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/802779892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec68103b70 0x7fec68103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 -- 172.21.15.16:0/802779892 >> 172.21.15.16:0/802779892 conn(0x7fec680fd700 msgr2=0x7fec680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 -- 172.21.15.16:0/802779892 shutdown_connections 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 -- 172.21.15.16:0/802779892 wait complete. 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.733+0000 7fec6d1a1640 1 Processor -- start 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6d1a1640 1 -- start start 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6d1a1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68103b70 0x7fec681019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6d1a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec68104570 0x7fec68101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6d1a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6810d120 0x7fec68102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6d1a1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec68112d60 con 0x7fec68103b70 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6d1a1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec68112be0 con 0x7fec68104570 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6d1a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec68112ee0 con 0x7fec6810d120 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68103b70 0x7fec681019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68103b70 0x7fec681019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47138/0 (socket says 172.21.15.16:47138) 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 -- 172.21.15.16:0/2985648151 learned_addr learned my addr 172.21.15.16:0/2985648151 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6659c640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec68104570 0x7fec68101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec6759e640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6810d120 0x7fec68102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 -- 172.21.15.16:0/2985648151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6810d120 msgr2=0x7fec68102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6810d120 0x7fec68102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 -- 172.21.15.16:0/2985648151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec68104570 msgr2=0x7fec68101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec68104570 0x7fec68101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.734+0000 7fec66d9d640 1 -- 172.21.15.16:0/2985648151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec681a76d0 con 0x7fec68103b70 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.735+0000 7fec66d9d640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68103b70 0x7fec681019f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fec5800d950 tx=0x7fec5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.735+0000 7fec4ffff640 1 -- 172.21.15.16:0/2985648151 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58017030 con 0x7fec68103b70 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.735+0000 7fec4ffff640 1 -- 172.21.15.16:0/2985648151 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec58004020 con 0x7fec68103b70 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.735+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec681a79c0 con 0x7fec68103b70 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.735+0000 7fec4ffff640 1 -- 172.21.15.16:0/2985648151 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec580047a0 con 0x7fec68103b70 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.735+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec681a7f50 con 0x7fec68103b70 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.737+0000 7fec6f576740 1 Processor -- start 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.737+0000 7fec6f576740 1 -- start start 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.737+0000 7fec4ffff640 1 -- 172.21.15.16:0/2985648151 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fec58009a30 con 0x7fec68103b70 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6f576740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6f576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a142df0 0x559e0a14e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6f576740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a151170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6f576740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e0a0b8ea0 con 0x559e0a1424d0 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6f576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e0a0a82d0 con 0x559e0a142df0 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6f576740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e0a0ac0e0 con 0x559e0a14ed80 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47142/0 (socket says 172.21.15.16:47142) 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 -- 172.21.15.16:0/4090879454 learned_addr learned my addr 172.21.15.16:0/4090879454 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6659c640 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec66d9d640 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a142df0 0x559e0a14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 -- 172.21.15.16:0/4090879454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 msgr2=0x559e0a151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 -- 172.21.15.16:0/4090879454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a142df0 msgr2=0x559e0a14e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a142df0 0x559e0a14e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 -- 172.21.15.16:0/4090879454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e09e06650 con 0x559e0a1424d0 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec66d9d640 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a142df0 0x559e0a14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec6759e640 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1428b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ab40 tx=0x7fec6000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca6352855407cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec4ffff640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec500b54d0 0x7fec500b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.738+0000 7fec4d7fa640 1 -- 172.21.15.16:0/4090879454 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6001d070 con 0x559e0a1424d0 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec4d7fa640 1 -- 172.21.15.16:0/4090879454 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec600188f0 con 0x559e0a1424d0 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec4d7fa640 1 -- 172.21.15.16:0/4090879454 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec600109f0 con 0x559e0a1424d0 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec66d9d640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec500b54d0 0x7fec500b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec4ffff640 1 -- 172.21.15.16:0/2985648151 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fec580e58b0 con 0x7fec68103b70 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 -- 172.21.15.16:0/4090879454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 msgr2=0x559e0a1428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1428b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ab40 tx=0x7fec6000f3c0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec66d9d640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec500b54d0 0x7fec500b7990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fec580e3110 tx=0x7fec58093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 -- 172.21.15.16:0/4090879454 shutdown_connections 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a142df0 0x559e0a14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 --2- 172.21.15.16:0/4090879454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1428b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 -- 172.21.15.16:0/4090879454 >> 172.21.15.16:0/4090879454 conn(0x559e0a140300 msgr2=0x559e0a1414a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 -- 172.21.15.16:0/4090879454 shutdown_connections 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.739+0000 7fec6f576740 1 -- 172.21.15.16:0/4090879454 wait complete. 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 -- start start 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 Processor -- start 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a1424d0 0x559e0a14e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a14bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 0x559e0a14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e09f09700 con 0x559e0a142df0 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e0a043160 con 0x559e0a14ed80 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e0a151a00 con 0x559e0a1424d0 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6f576740 10 client.0 _ll_register_callbacks cb 0x559e0a05c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a14bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a14bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47156/0 (socket says 172.21.15.16:47156) 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6659c640 1 -- 172.21.15.16:0/3460614834 learned_addr learned my addr 172.21.15.16:0/3460614834 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.740+0000 7fec6759e640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 0x559e0a14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6759e640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a1424d0 0x559e0a14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6659c640 1 -- 172.21.15.16:0/3460614834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a1424d0 msgr2=0x559e0a14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6659c640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a1424d0 0x559e0a14e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6659c640 1 -- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 msgr2=0x559e0a14c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6659c640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 0x559e0a14c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6659c640 1 -- 172.21.15.16:0/3460614834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0a070c90 con 0x559e0a142df0 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6759e640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a1424d0 0x559e0a14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6659c640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a14bad0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009ca0 tx=0x7fec5c031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0f736cce8883f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:22.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec4aff5640 1 -- 172.21.15.16:0/3460614834 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c031790 con 0x559e0a142df0 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec600188f0 con 0x559e0a142df0 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec4aff5640 1 -- 172.21.15.16:0/3460614834 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fec5c003970 con 0x559e0a142df0 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec4aff5640 1 -- 172.21.15.16:0/3460614834 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fec5c003b70 con 0x559e0a142df0 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6f576740 10 client.16578 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559e0a15d310 con 0x559e0a142df0 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.741+0000 7fec4aff5640 1 -- 172.21.15.16:0/3460614834 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec600188f0 con 0x559e0a142df0 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec4aff5640 1 -- 172.21.15.16:0/3460614834 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fec5c004500 con 0x559e0a142df0 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec6f576740 10 client.16578 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec6f576740 10 client.16578 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec6f576740 20 client.16578 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec6f576740 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a15e820 0x559e0a160c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec6f576740 4 client.16578 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:22.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e0a0badf0 con 0x559e0a15e820 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.742+0000 7fec6759e640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a15e820 0x559e0a160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.743+0000 7fec6759e640 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a15e820 0x559e0a160c10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bfeb9a210a03f41 server_cookie=bf6cef6c14048c69 in_seq=0 out_seq=0 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.743+0000 7fec4aff5640 10 client.16578 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.743+0000 7fec4aff5640 1 -- 172.21.15.16:0/3460614834 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e0a0badf0 con 0x559e0a15e820 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.743+0000 7fec4aff5640 10 client.16578 handle_command_reply: tid=0 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.743+0000 7fec6f576740 1 client.16578 shutdown 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.743+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 msgr2=0x559e0a14bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.743+0000 7fec6f576740 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a14bad0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009ca0 tx=0x7fec5c031450 comp rx=0 tx=0).stop 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 shutdown_connections 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a15e820 0x559e0a160c10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 0x559e0a14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a14bad0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec4aff5640 0 client.16578 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:22.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 --2- 172.21.15.16:0/3460614834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a1424d0 0x559e0a14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 >> 172.21.15.16:0/3460614834 conn(0x559e0a140300 msgr2=0x559e0a145ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:22.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 shutdown_connections 2024-09-10T23:46:22.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 1 -- 172.21.15.16:0/3460614834 wait complete. 2024-09-10T23:46:22.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.744+0000 7fec6f576740 20 client.16578 trim_cache size 0 max 16384 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 Processor -- start 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 -- start start 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a1424d0 0x559e0a141b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a13b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec681b30a0 con 0x559e0a142df0 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec681b0970 con 0x559e0a1424d0 2024-09-10T23:46:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6f576740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec681ae810 con 0x559e0a14ed80 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a15ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47170/0 (socket says 172.21.15.16:47170) 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.757+0000 7fec6659c640 1 -- 172.21.15.16:0/2322349392 learned_addr learned my addr 172.21.15.16:0/2322349392 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6759e640 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a1424d0 0x559e0a141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6759e640 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a13b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6659c640 1 -- 172.21.15.16:0/2322349392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 msgr2=0x559e0a13b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6659c640 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a13b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6659c640 1 -- 172.21.15.16:0/2322349392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a1424d0 msgr2=0x559e0a141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6659c640 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a1424d0 0x559e0a141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6659c640 1 -- 172.21.15.16:0/2322349392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0a14c450 con 0x559e0a142df0 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6759e640 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a1424d0 0x559e0a141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec6659c640 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a15ac30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005e30 tx=0x7fec5c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4307fff67b10f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec4cff9640 1 -- 172.21.15.16:0/2322349392 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c031790 con 0x559e0a142df0 2024-09-10T23:46:22.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec4cff9640 1 -- 172.21.15.16:0/2322349392 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec5c036050 con 0x559e0a142df0 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.758+0000 7fec4cff9640 1 -- 172.21.15.16:0/2322349392 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0309c0 con 0x559e0a142df0 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 -- 172.21.15.16:0/2322349392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 msgr2=0x559e0a15ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a15ac30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005e30 tx=0x7fec5c0021f0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 -- 172.21.15.16:0/2322349392 shutdown_connections 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a14ed80 0x559e0a13b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a142df0 0x559e0a15ac30 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 --2- 172.21.15.16:0/2322349392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a1424d0 0x559e0a141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 -- 172.21.15.16:0/2322349392 >> 172.21.15.16:0/2322349392 conn(0x559e0a140300 msgr2=0x559e0a141430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 -- 172.21.15.16:0/2322349392 shutdown_connections 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 -- 172.21.15.16:0/2322349392 wait complete. 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 -- start start 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.759+0000 7fec6f576740 1 Processor -- start 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6f576740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6f576740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a142df0 0x559e0a1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6f576740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 0x559e0a150a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6f576740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec681aee80 con 0x559e0a1424d0 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6f576740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec681b02a0 con 0x559e0a14ed80 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6f576740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec681af500 con 0x559e0a142df0 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6f576740 10 client.0 _ll_register_callbacks cb 0x7fec5c02f420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47184/0 (socket says 172.21.15.16:47184) 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 -- 172.21.15.16:0/124484456 learned_addr learned my addr 172.21.15.16:0/124484456 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6659c640 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a142df0 0x559e0a1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 -- 172.21.15.16:0/124484456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a142df0 msgr2=0x559e0a1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a142df0 0x559e0a1502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 -- 172.21.15.16:0/124484456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 msgr2=0x559e0a150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 0x559e0a150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 -- 172.21.15.16:0/124484456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0a153120 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec6759e640 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1576b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fec60005940 tx=0x7fec60000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8089e912ba24263d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.760+0000 7fec4aff5640 1 -- 172.21.15.16:0/124484456 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60031020 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec4aff5640 1 -- 172.21.15.16:0/124484456 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fec600055b0 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec5c036050 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec4aff5640 1 -- 172.21.15.16:0/124484456 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fec6001d040 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 10 client.16584 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559e0a1cb9c0 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec4aff5640 1 -- 172.21.15.16:0/124484456 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec5c036050 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec4aff5640 1 -- 172.21.15.16:0/124484456 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fec60023030 con 0x559e0a1424d0 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 10 client.16584 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 10 client.16584 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:46:22.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 20 client.16584 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a1cbdb0 0x559e0a1ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 4 client.16584 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.761+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e0a0b68a0 con 0x559e0a1cbdb0 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6659c640 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a1cbdb0 0x559e0a1ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec4aff5640 10 client.16584 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6659c640 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a1cbdb0 0x559e0a1ce1a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a58bcf2c658bcfc server_cookie=de4670284bc499b2 in_seq=0 out_seq=0 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec4aff5640 1 -- 172.21.15.16:0/124484456 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e0a0b68a0 con 0x559e0a1cbdb0 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec4aff5640 10 client.16584 handle_command_reply: tid=0 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 client.16584 shutdown 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 msgr2=0x559e0a1576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1576b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fec60005940 tx=0x7fec60000bc0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 shutdown_connections 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x559e0a1cbdb0 0x559e0a1ce1a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e0a14ed80 0x559e0a150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e0a142df0 0x559e0a1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec4aff5640 0 client.16584 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 --2- 172.21.15.16:0/124484456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e0a1424d0 0x559e0a1576b0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.762+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 >> 172.21.15.16:0/124484456 conn(0x559e0a140300 msgr2=0x559e0a14d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 shutdown_connections 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6f576740 1 -- 172.21.15.16:0/124484456 wait complete. 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6f576740 20 client.16584 trim_cache size 0 max 16384 2024-09-10T23:46:22.777 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:22.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec500b54d0 msgr2=0x7fec500b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec500b54d0 0x7fec500b7990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fec580e3110 tx=0x7fec58093040 comp rx=0 tx=0).stop 2024-09-10T23:46:22.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68103b70 msgr2=0x7fec681019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:22.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68103b70 0x7fec681019f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fec5800d950 tx=0x7fec5800de10 comp rx=0 tx=0).stop 2024-09-10T23:46:22.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 shutdown_connections 2024-09-10T23:46:22.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6810d120 0x7fec68102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fec500b54d0 0x7fec500b7990 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec68104570 0x7fec68101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 --2- 172.21.15.16:0/2985648151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec68103b70 0x7fec681019f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:22.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 >> 172.21.15.16:0/2985648151 conn(0x7fec680fd700 msgr2=0x7fec680fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:22.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 shutdown_connections 2024-09-10T23:46:22.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:22.763+0000 7fec6d1a1640 1 -- 172.21.15.16:0/2985648151 wait complete. 2024-09-10T23:46:23.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:46:23.730 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 -- 172.21.15.16:0/2833377337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade4109150 msgr2=0x7fade410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/2833377337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade4109150 0x7fade410f950 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faddc009ca0 tx=0x7faddc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 -- 172.21.15.16:0/2833377337 shutdown_connections 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/2833377337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade4109150 0x7fade410f950 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/2833377337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade41087d0 0x7fade4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/2833377337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fade4102dc0 0x7fade41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 -- 172.21.15.16:0/2833377337 >> 172.21.15.16:0/2833377337 conn(0x7fade40fe830 msgr2=0x7fade4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 -- 172.21.15.16:0/2833377337 shutdown_connections 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.206+0000 7fadeb7ad640 1 -- 172.21.15.16:0/2833377337 wait complete. 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 Processor -- start 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 -- start start 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fade4102dc0 0x7fade4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade41087d0 0x7fade41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade4109150 0x7fade419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fade4112dd0 con 0x7fade41087d0 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fade4112c50 con 0x7fade4109150 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fadeb7ad640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fade4112f50 con 0x7fade4102dc0 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fade8d48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade41087d0 0x7fade41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fade8d48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade41087d0 0x7fade41997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37532/0 (socket says 172.21.15.16:37532) 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.207+0000 7fade8d48640 1 -- 172.21.15.16:0/1291859487 learned_addr learned my addr 172.21.15.16:0/1291859487 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade9d4a640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade4109150 0x7fade419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade9549640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fade4102dc0 0x7fade4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade8d48640 1 -- 172.21.15.16:0/1291859487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fade4102dc0 msgr2=0x7fade4199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade8d48640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fade4102dc0 0x7fade4199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade8d48640 1 -- 172.21.15.16:0/1291859487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade4109150 msgr2=0x7fade419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade8d48640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade4109150 0x7fade419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade8d48640 1 -- 172.21.15.16:0/1291859487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade419f310 con 0x7fade41087d0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fade8d48640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade41087d0 0x7fade41997a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fadd400d950 tx=0x7fadd400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fadda7fc640 1 -- 172.21.15.16:0/1291859487 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4017070 con 0x7fade41087d0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fadda7fc640 1 -- 172.21.15.16:0/1291859487 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd4009c30 con 0x7fade41087d0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade419f600 con 0x7fade41087d0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fadda7fc640 1 -- 172.21.15.16:0/1291859487 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd400f620 con 0x7fade41087d0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.208+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41a5e90 con 0x7fade41087d0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadda7fc640 1 -- 172.21.15.16:0/1291859487 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fadd4010460 con 0x7fade41087d0 2024-09-10T23:46:24.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 Processor -- start 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 -- start start 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8e1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56437f847ea0 con 0x56437f8d1a10 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56437f8372d0 con 0x56437f8d10f0 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fadedb82740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56437f83b0e0 con 0x56437f8e1db0 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.211+0000 7fade9549640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8e1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37536/0 (socket says 172.21.15.16:37536) 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 -- 172.21.15.16:0/3412031809 learned_addr learned my addr 172.21.15.16:0/3412031809 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade8d48640 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9d4a640 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 -- 172.21.15.16:0/3412031809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 msgr2=0x56437f8e41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8e41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fadda7fc640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fadd00b54d0 0x7fadd00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 -- 172.21.15.16:0/3412031809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 msgr2=0x56437f8d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 -- 172.21.15.16:0/3412031809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437f595650 con 0x56437f8d1a10 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9d4a640 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9d4a640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fadd00b54d0 0x7fadd00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fadda7fc640 1 -- 172.21.15.16:0/1291859487 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fadd40e5c00 con 0x7fade41087d0 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fade9549640 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8e1870 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fade000bd20 tx=0x7fade000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44e2ebfc088dbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fadcf7fe640 1 -- 172.21.15.16:0/3412031809 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0015070 con 0x56437f8d1a10 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fadcf7fe640 1 -- 172.21.15.16:0/3412031809 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade000be10 con 0x56437f8d1a10 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.212+0000 7fadcf7fe640 1 -- 172.21.15.16:0/3412031809 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade00119a0 con 0x56437f8d1a10 2024-09-10T23:46:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 -- 172.21.15.16:0/3412031809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 msgr2=0x56437f8e1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fade9d4a640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fadd00b54d0 0x7fadd00b7990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faddc006010 tx=0x7faddc03f040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8e1870 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fade000bd20 tx=0x7fade000f730 comp rx=0 tx=0).stop 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 -- 172.21.15.16:0/3412031809 shutdown_connections 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8e1870 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 --2- 172.21.15.16:0/3412031809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 -- 172.21.15.16:0/3412031809 >> 172.21.15.16:0/3412031809 conn(0x56437f8cef20 msgr2=0x56437f8d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 -- 172.21.15.16:0/3412031809 shutdown_connections 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 -- 172.21.15.16:0/3412031809 wait complete. 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.213+0000 7fadedb82740 1 -- start start 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 1 Processor -- start 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d10f0 0x56437f8e1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d1a10 0x56437f8deb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8e1db0 0x56437f8df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56437f698700 con 0x56437f8e1db0 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56437f7d2160 con 0x56437f8d1a10 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56437f8e4a60 con 0x56437f8d10f0 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fadedb82740 10 client.0 _ll_register_callbacks cb 0x56437f7eb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8e1db0 0x56437f8df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8e1db0 0x56437f8df260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37546/0 (socket says 172.21.15.16:37546) 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 -- 172.21.15.16:0/3915064235 learned_addr learned my addr 172.21.15.16:0/3915064235 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9549640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d10f0 0x56437f8e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade8d48640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d1a10 0x56437f8deb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 -- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d10f0 msgr2=0x56437f8e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d10f0 0x56437f8e1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 -- 172.21.15.16:0/3915064235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d1a10 msgr2=0x56437f8deb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d1a10 0x56437f8deb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade9d4a640 1 -- 172.21.15.16:0/3915064235 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56437f7ffc90 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.214+0000 7fade8d48640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d1a10 0x56437f8deb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fade9d4a640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8e1db0 0x56437f8df260 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faddc0316d0 tx=0x7faddc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bdcdbb75261941 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadccff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadccff9640 1 -- 172.21.15.16:0/3915064235 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc003d80 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadccff9640 1 -- 172.21.15.16:0/3915064235 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7faddc004040 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade000be10 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadccff9640 1 -- 172.21.15.16:0/3915064235 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faddc004240 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 10 client.16596 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56437f8f0460 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadccff9640 1 -- 172.21.15.16:0/3915064235 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade000be10 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadccff9640 1 -- 172.21.15.16:0/3915064235 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faddc050020 con 0x56437f8e1db0 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 10 client.16596 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 20 client.16596 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f8f18c0 0x56437f8f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 4 client.16596 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.215+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56437f849df0 con 0x56437f8f18c0 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.216+0000 7fade9549640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f8f18c0 0x56437f8f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.216+0000 7fade9549640 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f8f18c0 0x56437f8f3cd0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63419a13c2d03231 server_cookie=68f4b8b8914582bc in_seq=0 out_seq=0 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.216+0000 7fadccff9640 10 client.16596 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadccff9640 1 -- 172.21.15.16:0/3915064235 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56437f849df0 con 0x56437f8f18c0 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadccff9640 10 client.16596 handle_command_reply: tid=0 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 client.16596 shutdown 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8e1db0 msgr2=0x56437f8df260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8e1db0 0x56437f8df260 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faddc0316d0 tx=0x7faddc0095c0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 shutdown_connections 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f8f18c0 0x56437f8f3cd0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8e1db0 0x56437f8df260 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadccff9640 0 client.16596 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d1a10 0x56437f8deb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 --2- 172.21.15.16:0/3915064235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d10f0 0x56437f8e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 >> 172.21.15.16:0/3915064235 conn(0x56437f8cef20 msgr2=0x56437f8d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 shutdown_connections 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.217+0000 7fadedb82740 1 -- 172.21.15.16:0/3915064235 wait complete. 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.218+0000 7fadedb82740 20 client.16596 trim_cache size 0 max 16384 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 Processor -- start 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 -- start start 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fade41aecb0 con 0x56437f8d1a10 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fade41ac580 con 0x56437f8d10f0 2024-09-10T23:46:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fadedb82740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fade41aa3d0 con 0x56437f8e1db0 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37560/0 (socket says 172.21.15.16:37560) 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 -- 172.21.15.16:0/3080802196 learned_addr learned my addr 172.21.15.16:0/3080802196 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade9549640 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 -- 172.21.15.16:0/3080802196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 msgr2=0x56437f8f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade9d4a640 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8f95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 -- 172.21.15.16:0/3080802196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 msgr2=0x56437f8edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8edcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade8d48640 1 -- 172.21.15.16:0/3080802196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437f8e2730 con 0x56437f8d1a10 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.231+0000 7fade9549640 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fade8d48640 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8c9e70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fadd40abd80 tx=0x7fadd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc028f6da83a11c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadceffd640 1 -- 172.21.15.16:0/3080802196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4020070 con 0x56437f8d1a10 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadceffd640 1 -- 172.21.15.16:0/3080802196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd4091e50 con 0x56437f8d1a10 2024-09-10T23:46:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadceffd640 1 -- 172.21.15.16:0/3080802196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd40b5610 con 0x56437f8d1a10 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 -- 172.21.15.16:0/3080802196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 msgr2=0x56437f8c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8c9e70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fadd40abd80 tx=0x7fadd4005880 comp rx=0 tx=0).stop 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 -- 172.21.15.16:0/3080802196 shutdown_connections 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8e1db0 0x56437f8f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d1a10 0x56437f8c9e70 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 --2- 172.21.15.16:0/3080802196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8d10f0 0x56437f8edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 -- 172.21.15.16:0/3080802196 >> 172.21.15.16:0/3080802196 conn(0x56437f8cef20 msgr2=0x56437f8e2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 -- 172.21.15.16:0/3080802196 shutdown_connections 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.232+0000 7fadedb82740 1 -- 172.21.15.16:0/3080802196 wait complete. 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 -- start start 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 Processor -- start 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d10f0 0x56437f8e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d1a10 0x56437f8ea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8e1db0 0x56437f8e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fade41aaa40 con 0x56437f8d10f0 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fade41abeb0 con 0x56437f8e1db0 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fade41ab110 con 0x56437f8d1a10 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fadedb82740 10 client.0 _ll_register_callbacks cb 0x7faddc005c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fade9549640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d10f0 0x56437f8e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fade9549640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d10f0 0x56437f8e9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37566/0 (socket says 172.21.15.16:37566) 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fade9549640 1 -- 172.21.15.16:0/1419336245 learned_addr learned my addr 172.21.15.16:0/1419336245 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.233+0000 7fade9d4a640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8e1db0 0x56437f8e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade8d48640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d1a10 0x56437f8ea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade9549640 1 -- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d1a10 msgr2=0x56437f8ea260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade9549640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d1a10 0x56437f8ea260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade9549640 1 -- 172.21.15.16:0/1419336245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8e1db0 msgr2=0x56437f8e6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade9549640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8e1db0 0x56437f8e6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade9549640 1 -- 172.21.15.16:0/1419336245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56437f8e7230 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade8d48640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d1a10 0x56437f8ea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fade9549640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d10f0 0x56437f8e9d20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fade000bd20 tx=0x7fade0005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b6c79cd0fc13c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadccff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadccff9640 1 -- 172.21.15.16:0/1419336245 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0015070 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadccff9640 1 -- 172.21.15.16:0/1419336245 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fade0005040 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd4091e50 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadccff9640 1 -- 172.21.15.16:0/1419336245 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fade0005240 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadedb82740 10 client.16602 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56437f95eff0 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadccff9640 1 -- 172.21.15.16:0/1419336245 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd4091e50 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadccff9640 1 -- 172.21.15.16:0/1419336245 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fade002b020 con 0x56437f8d10f0 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.234+0000 7fadedb82740 10 client.16602 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadedb82740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:24.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadedb82740 20 client.16602 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadedb82740 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f95f4c0 0x56437f9618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadedb82740 4 client.16602 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56437f8458a0 con 0x56437f95f4c0 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fade8d48640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f95f4c0 0x56437f9618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fade8d48640 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f95f4c0 0x56437f9618e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10bcce6bf435420a server_cookie=e08960a3b42d5237 in_seq=0 out_seq=0 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadccff9640 10 client.16602 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadccff9640 1 -- 172.21.15.16:0/1419336245 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56437f8458a0 con 0x56437f95f4c0 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadccff9640 10 client.16602 handle_command_reply: tid=0 2024-09-10T23:46:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.235+0000 7fadedb82740 1 client.16602 shutdown 2024-09-10T23:46:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d10f0 msgr2=0x56437f8e9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d10f0 0x56437f8e9d20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fade000bd20 tx=0x7fade0005f40 comp rx=0 tx=0).stop 2024-09-10T23:46:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 shutdown_connections 2024-09-10T23:46:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56437f95f4c0 0x56437f9618e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56437f8e1db0 0x56437f8e6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56437f8d1a10 0x56437f8ea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadccff9640 0 client.16602 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:24.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 --2- 172.21.15.16:0/1419336245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437f8d10f0 0x56437f8e9d20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.258 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:24.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 >> 172.21.15.16:0/1419336245 conn(0x56437f8cef20 msgr2=0x56437f8e01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 shutdown_connections 2024-09-10T23:46:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 1 -- 172.21.15.16:0/1419336245 wait complete. 2024-09-10T23:46:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadedb82740 20 client.16602 trim_cache size 0 max 16384 2024-09-10T23:46:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fadd00b54d0 msgr2=0x7fadd00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fadd00b54d0 0x7fadd00b7990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faddc006010 tx=0x7faddc03f040 comp rx=0 tx=0).stop 2024-09-10T23:46:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade41087d0 msgr2=0x7fade41997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade41087d0 0x7fade41997a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fadd400d950 tx=0x7fadd400de10 comp rx=0 tx=0).stop 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 shutdown_connections 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fadd00b54d0 0x7fadd00b7990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fade4109150 0x7fade419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fade41087d0 0x7fade41997a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 --2- 172.21.15.16:0/1291859487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fade4102dc0 0x7fade4199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 >> 172.21.15.16:0/1291859487 conn(0x7fade40fe830 msgr2=0x7fade40ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 shutdown_connections 2024-09-10T23:46:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:24.236+0000 7fadeb7ad640 1 -- 172.21.15.16:0/1291859487 wait complete. 2024-09-10T23:46:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:24 smithi016 ceph-mon[30855]: pgmap v505: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:46:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:24 smithi071 ceph-mon[35018]: pgmap v505: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:46:24.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:24 smithi066 ceph-mon[34761]: pgmap v505: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T23:46:25.967 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:46:25.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:46:26.240 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:26.514 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:26 smithi016 ceph-mon[30855]: pgmap v506: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:46:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:26 smithi071 ceph-mon[35018]: pgmap v506: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:46:26.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:26 smithi066 ceph-mon[34761]: pgmap v506: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:46:26.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 -- 172.21.15.16:0/1370537920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c103b30 msgr2=0x7f814c103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 --2- 172.21.15.16:0/1370537920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c103b30 0x7f814c103f10 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f813c009900 tx=0x7f813c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 -- 172.21.15.16:0/1370537920 shutdown_connections 2024-09-10T23:46:26.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 --2- 172.21.15.16:0/1370537920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f814c10d0e0 0x7f814c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 --2- 172.21.15.16:0/1370537920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f814c104530 0x7f814c10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 --2- 172.21.15.16:0/1370537920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c103b30 0x7f814c103f10 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 -- 172.21.15.16:0/1370537920 >> 172.21.15.16:0/1370537920 conn(0x7f814c0fd700 msgr2=0x7f814c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 -- 172.21.15.16:0/1370537920 shutdown_connections 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.752+0000 7f81518cc640 1 -- 172.21.15.16:0/1370537920 wait complete. 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 Processor -- start 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 -- start start 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f814c103b30 0x7f814c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c104530 0x7f814c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f814c10d0e0 0x7f814c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f814c112df0 con 0x7f814c104530 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f814c112c70 con 0x7f814c103b30 2024-09-10T23:46:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f81518cc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f814c112f70 con 0x7f814c10d0e0 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c104530 0x7f814c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c104530 0x7f814c199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37570/0 (socket says 172.21.15.16:37570) 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 -- 172.21.15.16:0/2814174530 learned_addr learned my addr 172.21.15.16:0/2814174530 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f814affd640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f814c103b30 0x7f814c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f814b7fe640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f814c10d0e0 0x7f814c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 -- 172.21.15.16:0/2814174530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f814c10d0e0 msgr2=0x7f814c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f814c10d0e0 0x7f814c19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 -- 172.21.15.16:0/2814174530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f814c103b30 msgr2=0x7f814c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f814c103b30 0x7f814c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.753+0000 7f8143fff640 1 -- 172.21.15.16:0/2814174530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814c19f3d0 con 0x7f814c104530 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.754+0000 7f814b7fe640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f814c10d0e0 0x7f814c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.754+0000 7f8143fff640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c104530 0x7f814c199860 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f813400b4a0 tx=0x7f813400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.754+0000 7f81508ca640 1 -- 172.21.15.16:0/2814174530 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134014070 con 0x7f814c104530 2024-09-10T23:46:26.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.754+0000 7f81508ca640 1 -- 172.21.15.16:0/2814174530 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8134010ac0 con 0x7f814c104530 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.754+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f814c19f6c0 con 0x7f814c104530 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.754+0000 7f81508ca640 1 -- 172.21.15.16:0/2814174530 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134017c30 con 0x7f814c104530 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.754+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814c1a5f50 con 0x7f814c104530 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.756+0000 7f8153ca1740 1 Processor -- start 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.756+0000 7f81508ca640 1 -- 172.21.15.16:0/2814174530 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f8134010610 con 0x7f814c104530 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8153ca1740 1 -- start start 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c19ee0 0x55b517c1a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c2a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c2aba0 0x55b517c2cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8153ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b517b90e60 con 0x55b517c19ee0 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8153ca1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b517b80290 con 0x55b517c1a800 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8153ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b517b840a0 con 0x55b517c2aba0 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c19ee0 0x55b517c1a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c19ee0 0x55b517c1a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37580/0 (socket says 172.21.15.16:37580) 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 -- 172.21.15.16:0/2463800684 learned_addr learned my addr 172.21.15.16:0/2463800684 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f8143fff640 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c2aba0 0x55b517c2cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814affd640 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c2a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 -- 172.21.15.16:0/2463800684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c2aba0 msgr2=0x55b517c2cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c2aba0 0x55b517c2cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 -- 172.21.15.16:0/2463800684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 msgr2=0x55b517c2a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c2a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814b7fe640 1 -- 172.21.15.16:0/2463800684 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5178de930 con 0x55b517c19ee0 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.757+0000 7f814affd640 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c2a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f81508ca640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81380b54d0 0x7f81380b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f814b7fe640 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c19ee0 0x55b517c1a2c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8144008e00 tx=0x7f814400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c93b905ba83b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f814affd640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81380b54d0 0x7f81380b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f8141ffb640 1 -- 172.21.15.16:0/2463800684 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814400f830 con 0x55b517c19ee0 2024-09-10T23:46:26.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f81508ca640 1 -- 172.21.15.16:0/2814174530 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f81340e57b0 con 0x7f814c104530 2024-09-10T23:46:26.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f8141ffb640 1 -- 172.21.15.16:0/2463800684 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8144018480 con 0x55b517c19ee0 2024-09-10T23:46:26.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f8141ffb640 1 -- 172.21.15.16:0/2463800684 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814400e5f0 con 0x55b517c19ee0 2024-09-10T23:46:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f8153ca1740 1 -- 172.21.15.16:0/2463800684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c19ee0 msgr2=0x55b517c1a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f814affd640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81380b54d0 0x7f81380b7990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f813c005ab0 tx=0x7f813c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.758+0000 7f8153ca1740 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c19ee0 0x55b517c1a2c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8144008e00 tx=0x7f814400d710 comp rx=0 tx=0).stop 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 -- 172.21.15.16:0/2463800684 shutdown_connections 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c2aba0 0x55b517c2cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c2a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 --2- 172.21.15.16:0/2463800684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c19ee0 0x55b517c1a2c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 -- 172.21.15.16:0/2463800684 >> 172.21.15.16:0/2463800684 conn(0x55b517c17d10 msgr2=0x55b517c18eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 -- 172.21.15.16:0/2463800684 shutdown_connections 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 -- 172.21.15.16:0/2463800684 wait complete. 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 -- start start 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.759+0000 7f8153ca1740 1 Processor -- start 2024-09-10T23:46:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8153ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b5179e1890 con 0x55b517c2aba0 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8153ca1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b517b1ad40 con 0x55b517c1a800 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8153ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b517c2d850 con 0x55b517c19ee0 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8153ca1740 10 client.0 _ll_register_callbacks cb 0x55b517b7ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c27b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:49262/0 (socket says 172.21.15.16:49262) 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814affd640 1 -- 172.21.15.16:0/911858329 learned_addr learned my addr 172.21.15.16:0/911858329 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8143fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814b7fe640 1 -- 172.21.15.16:0/911858329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 msgr2=0x55b517c27b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814b7fe640 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c27b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814b7fe640 1 -- 172.21.15.16:0/911858329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 msgr2=0x55b517c280a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814b7fe640 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c280a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814b7fe640 1 -- 172.21.15.16:0/911858329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b517c36c30 con 0x55b517c2aba0 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f8143fff640 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f814b7fe640 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c285e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8144018e60 tx=0x7f8144008b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7a47a3a20471fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f812affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.760+0000 7f812affd640 1 -- 172.21.15.16:0/911858329 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144028060 con 0x55b517c2aba0 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f812affd640 1 -- 172.21.15.16:0/911858329 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f814400fa40 con 0x55b517c2aba0 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8144018480 con 0x55b517c2aba0 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f812affd640 1 -- 172.21.15.16:0/911858329 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f814400fc40 con 0x55b517c2aba0 2024-09-10T23:46:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 10 client.16614 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b517c39550 con 0x55b517c2aba0 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f812affd640 1 -- 172.21.15.16:0/911858329 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8144018480 con 0x55b517c2aba0 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f812affd640 1 -- 172.21.15.16:0/911858329 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f814400e3b0 con 0x55b517c2aba0 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 10 client.16614 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 20 client.16614 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517c3a950 0x55b517c3cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 4 client.16614 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.761+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b517b92db0 con 0x55b517c3a950 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.762+0000 7f814affd640 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517c3a950 0x55b517c3cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.762+0000 7f814affd640 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517c3a950 0x55b517c3cd40 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a768d5d709c6462 server_cookie=55d516a95a32a823 in_seq=0 out_seq=0 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.762+0000 7f812affd640 10 client.16614 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f812affd640 1 -- 172.21.15.16:0/911858329 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b517b92db0 con 0x55b517c3a950 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f812affd640 10 client.16614 handle_command_reply: tid=0 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 client.16614 shutdown 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 msgr2=0x55b517c285e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c285e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8144018e60 tx=0x7f8144008b10 comp rx=0 tx=0).stop 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 shutdown_connections 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517c3a950 0x55b517c3cd40 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c285e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 --2- 172.21.15.16:0/911858329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 >> 172.21.15.16:0/911858329 conn(0x55b517c17d10 msgr2=0x55b517c16f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f812affd640 0 client.16614 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 shutdown_connections 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 1 -- 172.21.15.16:0/911858329 wait complete. 2024-09-10T23:46:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.763+0000 7f8153ca1740 20 client.16614 trim_cache size 0 max 16384 2024-09-10T23:46:26.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 Processor -- start 2024-09-10T23:46:26.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 -- start start 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c28060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1aee10 con 0x55b517c2aba0 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1ac6e0 con 0x55b517c1a800 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8153ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1aa530 con 0x55b517c19ee0 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f814b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f814b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c263e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37592/0 (socket says 172.21.15.16:37592) 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f814b7fe640 1 -- 172.21.15.16:0/4084073884 learned_addr learned my addr 172.21.15.16:0/4084073884 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f8143fff640 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f814affd640 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c28060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f814b7fe640 1 -- 172.21.15.16:0/4084073884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 msgr2=0x55b517c28060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.781+0000 7f814b7fe640 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c28060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f814b7fe640 1 -- 172.21.15.16:0/4084073884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 msgr2=0x55b517c285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f814b7fe640 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c285a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f814b7fe640 1 -- 172.21.15.16:0/4084073884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b517c13640 con 0x55b517c2aba0 2024-09-10T23:46:26.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f814b7fe640 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c263e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8144018e90 tx=0x7f8144008660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a831fe35338b5409 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f81417fa640 1 -- 172.21.15.16:0/4084073884 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814401c030 con 0x55b517c2aba0 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f81417fa640 1 -- 172.21.15.16:0/4084073884 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f814400ee90 con 0x55b517c2aba0 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f81417fa640 1 -- 172.21.15.16:0/4084073884 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144028040 con 0x55b517c2aba0 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f8153ca1740 1 -- 172.21.15.16:0/4084073884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 msgr2=0x55b517c263e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.782+0000 7f8153ca1740 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c263e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8144018e90 tx=0x7f8144008660 comp rx=0 tx=0).stop 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- 172.21.15.16:0/4084073884 shutdown_connections 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c263e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 --2- 172.21.15.16:0/4084073884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c28060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- 172.21.15.16:0/4084073884 >> 172.21.15.16:0/4084073884 conn(0x55b517c17d10 msgr2=0x55b517c2bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- 172.21.15.16:0/4084073884 shutdown_connections 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- 172.21.15.16:0/4084073884 wait complete. 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- start start 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 Processor -- start 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c32ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c33020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c2fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1aaba0 con 0x55b517c2aba0 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1ac010 con 0x55b517c1a800 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1ab270 con 0x55b517c19ee0 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.783+0000 7f8153ca1740 10 client.0 _ll_register_callbacks cb 0x7f8144008c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c2fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c32ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c32ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:49290/0 (socket says 172.21.15.16:49290) 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814affd640 1 -- 172.21.15.16:0/1500883845 learned_addr learned my addr 172.21.15.16:0/1500883845 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c2fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37604/0 (socket says 172.21.15.16:37604) 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f8143fff640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c33020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 -- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 msgr2=0x55b517c32ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c32ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 -- 172.21.15.16:0/1500883845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 msgr2=0x55b517c33020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c33020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 -- 172.21.15.16:0/1500883845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b517c335e0 con 0x55b517c2aba0 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814affd640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c32ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f8143fff640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c33020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f814b7fe640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c2fab0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8144018e60 tx=0x7f8144008500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb517f8359d2773 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:26.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f812affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f812affd640 1 -- 172.21.15.16:0/1500883845 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814403c070 con 0x55b517c2aba0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f812affd640 1 -- 172.21.15.16:0/1500883845 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f814400ebf0 con 0x55b517c2aba0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.784+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f814400ee90 con 0x55b517c2aba0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f812affd640 1 -- 172.21.15.16:0/1500883845 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8144048050 con 0x55b517c2aba0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 10 client.16620 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b517ca79a0 con 0x55b517c2aba0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f812affd640 1 -- 172.21.15.16:0/1500883845 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f814400ee90 con 0x55b517c2aba0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f812affd640 1 -- 172.21.15.16:0/1500883845 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8144023b00 con 0x55b517c2aba0 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 10 client.16620 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 20 client.16620 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517ca7f50 0x55b517caa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:26.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 4 client.16620 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:46:26.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b517b8e860 con 0x55b517ca7f50 2024-09-10T23:46:26.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.785+0000 7f814affd640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517ca7f50 0x55b517caa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:26.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.786+0000 7f814affd640 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517ca7f50 0x55b517caa370 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad872cefd5148c90 server_cookie=324eeced6e0ebc0e in_seq=0 out_seq=0 2024-09-10T23:46:26.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.786+0000 7f812affd640 10 client.16620 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f812affd640 1 -- 172.21.15.16:0/1500883845 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b517b8e860 con 0x55b517ca7f50 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f812affd640 10 client.16620 handle_command_reply: tid=0 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 client.16620 shutdown 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 msgr2=0x55b517c2fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c2fab0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8144018e60 tx=0x7f8144008500 comp rx=0 tx=0).stop 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 shutdown_connections 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b517ca7f50 0x55b517caa370 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b517c2aba0 0x55b517c2fab0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b517c1a800 0x55b517c33020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 --2- 172.21.15.16:0/1500883845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b517c19ee0 0x55b517c32ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f812affd640 0 client.16620 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.788+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 >> 172.21.15.16:0/1500883845 conn(0x55b517c17d10 msgr2=0x55b517c26320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 shutdown_connections 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f8153ca1740 1 -- 172.21.15.16:0/1500883845 wait complete. 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f8153ca1740 20 client.16620 trim_cache size 0 max 16384 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "639441ff-19fd-4ae8-8724-9893c482cd8c", 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:46:26.793 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:46:26.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81380b54d0 msgr2=0x7f81380b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81380b54d0 0x7f81380b7990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f813c005ab0 tx=0x7f813c005a20 comp rx=0 tx=0).stop 2024-09-10T23:46:26.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c104530 msgr2=0x7f814c199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:26.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c104530 0x7f814c199860 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f813400b4a0 tx=0x7f813400b960 comp rx=0 tx=0).stop 2024-09-10T23:46:26.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 shutdown_connections 2024-09-10T23:46:26.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f814c10d0e0 0x7f814c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f814c104530 0x7f814c199860 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f81380b54d0 0x7f81380b7990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 --2- 172.21.15.16:0/2814174530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f814c103b30 0x7f814c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:26.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 >> 172.21.15.16:0/2814174530 conn(0x7f814c0fd700 msgr2=0x7f814c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:26.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 shutdown_connections 2024-09-10T23:46:26.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:26.789+0000 7f81518cc640 1 -- 172.21.15.16:0/2814174530 wait complete. 2024-09-10T23:46:27.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:46:27.760 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 -- 172.21.15.16:0/3111967662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac108060 msgr2=0x7f4fac10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/3111967662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac108060 0x7f4fac10e860 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009ca0 tx=0x7f4fa402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 -- 172.21.15.16:0/3111967662 shutdown_connections 2024-09-10T23:46:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/3111967662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac108060 0x7f4fac10e860 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/3111967662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac1076e0 0x7f4fac107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/3111967662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac101cd0 0x7f4fac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 -- 172.21.15.16:0/3111967662 >> 172.21.15.16:0/3111967662 conn(0x7f4fac0fd700 msgr2=0x7f4fac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 -- 172.21.15.16:0/3111967662 shutdown_connections 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 -- 172.21.15.16:0/3111967662 wait complete. 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 Processor -- start 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.278+0000 7f4fb17c4640 1 -- start start 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fb17c4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac101cd0 0x7f4fac0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fb17c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac1076e0 0x7f4fac0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fb17c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac108060 0x7f4fac0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fb17c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac111d70 con 0x7f4fac1076e0 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fb17c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac111bf0 con 0x7f4fac108060 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fb17c4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac111ef0 con 0x7f4fac101cd0 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac1076e0 0x7f4fac0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac1076e0 0x7f4fac0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37610/0 (socket says 172.21.15.16:37610) 2024-09-10T23:46:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2899062209 learned_addr learned my addr 172.21.15.16:0/2899062209 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faaffd640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac101cd0 0x7f4fac0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac108060 0x7f4fac0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2899062209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac101cd0 msgr2=0x7f4fac0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac101cd0 0x7f4fac0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2899062209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac108060 msgr2=0x7f4fac0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac108060 0x7f4fac0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2899062209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac1a77a0 con 0x7f4fac1076e0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac108060 0x7f4fac0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.279+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac1076e0 0x7f4fac0fe140 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000b4a0 tx=0x7f4fa000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.280+0000 7f4f93fff640 1 -- 172.21.15.16:0/2899062209 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0014070 con 0x7f4fac1076e0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.280+0000 7f4f93fff640 1 -- 172.21.15.16:0/2899062209 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa0010ac0 con 0x7f4fac1076e0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.280+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac1a7a90 con 0x7f4fac1076e0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.280+0000 7f4f93fff640 1 -- 172.21.15.16:0/2899062209 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0017c30 con 0x7f4fac1076e0 2024-09-10T23:46:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.280+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac1a7fd0 con 0x7f4fac1076e0 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 Processor -- start 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 -- start start 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4f93fff640 1 -- 172.21.15.16:0/2899062209 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4fa0010610 con 0x7f4fac1076e0 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df0a0 0x562ca37df480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37df9c0 0x562ca37eb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37eb950 0x562ca37edd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562ca3755e50 con 0x562ca37df0a0 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562ca3745280 con 0x562ca37eb950 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.282+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ca3749090 con 0x562ca37df9c0 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df0a0 0x562ca37df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df0a0 0x562ca37df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37614/0 (socket says 172.21.15.16:37614) 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 -- 172.21.15.16:0/1172776847 learned_addr learned my addr 172.21.15.16:0/1172776847 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37eb950 0x562ca37edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4faaffd640 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37df9c0 0x562ca37eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 -- 172.21.15.16:0/1172776847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37df9c0 msgr2=0x562ca37eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37df9c0 0x562ca37eb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 -- 172.21.15.16:0/1172776847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37eb950 msgr2=0x562ca37edd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37eb950 0x562ca37edd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 -- 172.21.15.16:0/1172776847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca34a3650 con 0x562ca37df0a0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37eb950 0x562ca37edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df0a0 0x562ca37df480 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4004af0 tx=0x7f4fa4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7191bfc6697a934 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4f93fff640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f940b5450 0x7f4f940b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4f917fa640 1 -- 172.21.15.16:0/1172776847 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4031cf0 con 0x562ca37df0a0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4faaffd640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f940b5450 0x7f4f940b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4f917fa640 1 -- 172.21.15.16:0/1172776847 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa4036070 con 0x562ca37df0a0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.283+0000 7f4f917fa640 1 -- 172.21.15.16:0/1172776847 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40042a0 con 0x562ca37df0a0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4f93fff640 1 -- 172.21.15.16:0/2899062209 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4fa00e5870 con 0x7f4fac1076e0 2024-09-10T23:46:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 -- 172.21.15.16:0/1172776847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df0a0 msgr2=0x562ca37df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4faaffd640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f940b5450 0x7f4f940b7910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x562ca37dddb0 tx=0x7f4f9c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df0a0 0x562ca37df480 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4004af0 tx=0x7f4fa4005fd0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 -- 172.21.15.16:0/1172776847 shutdown_connections 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37eb950 0x562ca37edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37df9c0 0x562ca37eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/1172776847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df0a0 0x562ca37df480 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 -- 172.21.15.16:0/1172776847 >> 172.21.15.16:0/1172776847 conn(0x562ca37dced0 msgr2=0x562ca37de070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 -- 172.21.15.16:0/1172776847 shutdown_connections 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.284+0000 7f4fb3b99740 1 -- 172.21.15.16:0/1172776847 wait complete. 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 -- start start 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 Processor -- start 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562ca35a6700 con 0x562ca37df9c0 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562ca36e0110 con 0x562ca37df0a0 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ca37ee570 con 0x562ca37eb950 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fb3b99740 10 client.0 _ll_register_callbacks cb 0x562ca36f9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37620/0 (socket says 172.21.15.16:37620) 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2257161936 learned_addr learned my addr 172.21.15.16:0/2257161936 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faaffd640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 msgr2=0x562ca37e8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2257161936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 msgr2=0x562ca37eb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37eb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4faa7fc640 1 -- 172.21.15.16:0/2257161936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca370dc40 con 0x562ca37df9c0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.285+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e8610 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a8fc0 tx=0x7f4fa00a7cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46b9d3498910b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4f8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4f8eff5640 1 -- 172.21.15.16:0/2257161936 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa001e030 con 0x562ca37df9c0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4f8eff5640 1 -- 172.21.15.16:0/2257161936 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4fa00a7fc0 con 0x562ca37df9c0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa4036070 con 0x562ca37df9c0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4f8eff5640 1 -- 172.21.15.16:0/2257161936 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4fa00e7e60 con 0x562ca37df9c0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4fb3b99740 10 client.16632 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.286+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ca37f9e80 con 0x562ca37df9c0 2024-09-10T23:46:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4f8eff5640 1 -- 172.21.15.16:0/2257161936 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa00d2070 con 0x562ca37df9c0 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4f8eff5640 1 -- 172.21.15.16:0/2257161936 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4fa00b4e50 con 0x562ca37df9c0 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4fb3b99740 10 client.16632 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4fb3b99740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4fb3b99740 20 client.16632 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca37fb340 0x562ca37fd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4fb3b99740 4 client.16632 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ca3757da0 con 0x562ca37fb340 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.287+0000 7f4faaffd640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca37fb340 0x562ca37fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4faaffd640 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca37fb340 0x562ca37fd730 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a68f60a783f2d56 server_cookie=45e6c6d04c73366c in_seq=0 out_seq=0 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4f8eff5640 10 client.16632 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4f8eff5640 1 -- 172.21.15.16:0/2257161936 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ca3757da0 con 0x562ca37fb340 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4f8eff5640 10 client.16632 handle_command_reply: tid=0 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4fb3b99740 1 client.16632 shutdown 2024-09-10T23:46:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 msgr2=0x562ca37e8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e8610 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a8fc0 tx=0x7f4fa00a7cb0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 shutdown_connections 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.288+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca37fb340 0x562ca37fd730 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e8610 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/2257161936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37eb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4f8eff5640 0 client.16632 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 >> 172.21.15.16:0/2257161936 conn(0x562ca37dced0 msgr2=0x562ca37e2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 shutdown_connections 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4fb3b99740 1 -- 172.21.15.16:0/2257161936 wait complete. 2024-09-10T23:46:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.289+0000 7f4fb3b99740 20 client.16632 trim_cache size 0 max 16384 2024-09-10T23:46:28.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.306+0000 7f4fb3b99740 1 Processor -- start 2024-09-10T23:46:28.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fb3b99740 1 -- start start 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1b30c0 con 0x562ca37df9c0 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1b0990 con 0x562ca37df0a0 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1ae7e0 con 0x562ca37eb950 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37636/0 (socket says 172.21.15.16:37636) 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 -- 172.21.15.16:0/3502178616 learned_addr learned my addr 172.21.15.16:0/3502178616 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faaffd640 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 -- 172.21.15.16:0/3502178616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 msgr2=0x562ca37e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 -- 172.21.15.16:0/3502178616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 msgr2=0x562ca37ea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37ea2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.307+0000 7f4faa7fc640 1 -- 172.21.15.16:0/3502178616 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca37ee0b0 con 0x562ca37df9c0 2024-09-10T23:46:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.308+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e5820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a8320 tx=0x7f4fa0017650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9155ff28046f9a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.308+0000 7f4f90ff9640 1 -- 172.21.15.16:0/3502178616 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa001e070 con 0x562ca37df9c0 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.308+0000 7f4f90ff9640 1 -- 172.21.15.16:0/3502178616 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa00d2070 con 0x562ca37df9c0 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.308+0000 7f4f90ff9640 1 -- 172.21.15.16:0/3502178616 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00b52e0 con 0x562ca37df9c0 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.308+0000 7f4fb3b99740 1 -- 172.21.15.16:0/3502178616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 msgr2=0x562ca37e5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.308+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e5820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a8320 tx=0x7f4fa0017650 comp rx=0 tx=0).stop 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 -- 172.21.15.16:0/3502178616 shutdown_connections 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca37e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37e5820 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/3502178616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37ea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 -- 172.21.15.16:0/3502178616 >> 172.21.15.16:0/3502178616 conn(0x562ca37dced0 msgr2=0x562ca37dbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 -- 172.21.15.16:0/3502178616 shutdown_connections 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 -- 172.21.15.16:0/3502178616 wait complete. 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 -- start start 2024-09-10T23:46:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.309+0000 7f4fb3b99740 1 Processor -- start 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fb3b99740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca3868170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1aee50 con 0x562ca37df9c0 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1b02c0 con 0x562ca37df0a0 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fb3b99740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1af520 con 0x562ca37eb950 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fb3b99740 10 client.0 _ll_register_callbacks cb 0x7f4fa000b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37640/0 (socket says 172.21.15.16:37640) 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 -- 172.21.15.16:0/559246809 learned_addr learned my addr 172.21.15.16:0/559246809 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4fab7fe640 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca3868170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faaffd640 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 -- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 msgr2=0x562ca3868170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca3868170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 -- 172.21.15.16:0/559246809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 msgr2=0x562ca37f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 -- 172.21.15.16:0/559246809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca38686b0 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4faa7fc640 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37f1240 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00aba50 tx=0x7f4fa00abd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badf0b4827422955 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.310+0000 7f4f8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4f8eff5640 1 -- 172.21.15.16:0/559246809 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa001e070 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4f8eff5640 1 -- 172.21.15.16:0/559246809 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f4fa00aafb0 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa00d2070 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4f8eff5640 1 -- 172.21.15.16:0/559246809 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4fa00970d0 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 10 client.16638 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ca38699c0 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4f8eff5640 1 -- 172.21.15.16:0/559246809 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa4036070 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4f8eff5640 1 -- 172.21.15.16:0/559246809 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4fa00a76a0 con 0x562ca37df9c0 2024-09-10T23:46:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 10 client.16638 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 20 client.16638 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca3869e70 0x562ca386c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 4 client.16638 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.311+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4fa00d2070 con 0x562ca3869e70 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.312+0000 7f4faaffd640 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca3869e70 0x562ca386c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.312+0000 7f4f8eff5640 10 client.16638 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.312+0000 7f4faaffd640 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca3869e70 0x562ca386c290 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=655e19baf45fd147 server_cookie=72c0d4cf58a5706f in_seq=0 out_seq=0 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.312+0000 7f4f8eff5640 1 -- 172.21.15.16:0/559246809 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x7f4fa00d2070 con 0x562ca3869e70 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.312+0000 7f4f8eff5640 10 client.16638 handle_command_reply: tid=0 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.312+0000 7f4fb3b99740 1 client.16638 shutdown 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 msgr2=0x562ca37f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37f1240 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00aba50 tx=0x7f4fa00abd50 comp rx=0 tx=0).stop 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 shutdown_connections 2024-09-10T23:46:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x562ca3869e70 0x562ca386c290 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ca37eb950 0x562ca3868170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ca37df9c0 0x562ca37f1240 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 --2- 172.21.15.16:0/559246809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ca37df0a0 0x562ca37f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4f8eff5640 0 client.16638 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 >> 172.21.15.16:0/559246809 conn(0x562ca37dced0 msgr2=0x562ca37e6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 shutdown_connections 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 1 -- 172.21.15.16:0/559246809 wait complete. 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.313+0000 7f4fb3b99740 20 client.16638 trim_cache size 0 max 16384 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:46:28.324 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.325 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.326 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:46:28.327 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.328 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.329 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.330 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:28.331 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f940b5450 msgr2=0x7f4f940b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f940b5450 0x7f4f940b7910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x562ca37dddb0 tx=0x7f4f9c00b390 comp rx=0 tx=0).stop 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac1076e0 msgr2=0x7f4fac0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac1076e0 0x7f4fac0fe140 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000b4a0 tx=0x7f4fa000b960 comp rx=0 tx=0).stop 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 shutdown_connections 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f940b5450 0x7f4f940b7910 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac108060 0x7f4fac0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac1076e0 0x7f4fac0fe140 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 --2- 172.21.15.16:0/2899062209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac101cd0 0x7f4fac0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 >> 172.21.15.16:0/2899062209 conn(0x7f4fac0fd700 msgr2=0x7f4fac104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 shutdown_connections 2024-09-10T23:46:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:28.314+0000 7f4fb17c4640 1 -- 172.21.15.16:0/2899062209 wait complete. 2024-09-10T23:46:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:28 smithi016 ceph-mon[30855]: pgmap v507: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:46:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:28 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:46:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:28 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:28 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:46:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:28 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:28 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:46:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:28 smithi071 ceph-mon[35018]: pgmap v507: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:46:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:28 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:46:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:28 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:28 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:46:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:28 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:28 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:46:28.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:28 smithi066 ceph-mon[34761]: pgmap v507: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:46:28.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:28 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:46:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:28 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:28 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:46:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:28 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:28.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:28 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:46:29.103 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:46:29.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:46:29.352 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:29.352 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:29.353 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:29.353 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:46:29.364 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:29.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:29.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:29.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:29.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:46:29.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:29.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:29.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:29.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 -- 172.21.15.16:0/3351758298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c10f450 msgr2=0x7fb16c111840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 --2- 172.21.15.16:0/3351758298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c10f450 0x7fb16c111840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb164009900 tx=0x7fb16402a480 comp rx=0 tx=0).stop 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 -- 172.21.15.16:0/3351758298 shutdown_connections 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 --2- 172.21.15.16:0/3351758298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c10f450 0x7fb16c111840 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 --2- 172.21.15.16:0/3351758298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb16c1021c0 0x7fb16c10ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 --2- 172.21.15.16:0/3351758298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb16c1018a0 0x7fb16c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 -- 172.21.15.16:0/3351758298 >> 172.21.15.16:0/3351758298 conn(0x7fb16c0fd730 msgr2=0x7fb16c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 -- 172.21.15.16:0/3351758298 shutdown_connections 2024-09-10T23:46:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.861+0000 7fb173a1c640 1 -- 172.21.15.16:0/3351758298 wait complete. 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 Processor -- start 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 -- start start 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c1018a0 0x7fb16c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb16c1021c0 0x7fb16c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb16c10f450 0x7fb16c1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c114f50 con 0x7fb16c1018a0 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c114dd0 con 0x7fb16c10f450 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb173a1c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1150d0 con 0x7fb16c1021c0 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c1018a0 0x7fb16c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c1018a0 0x7fb16c19b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37652/0 (socket says 172.21.15.16:37652) 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 -- 172.21.15.16:0/2890698449 learned_addr learned my addr 172.21.15.16:0/2890698449 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb171fb9640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb16c10f450 0x7fb16c1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb170fb7640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb16c1021c0 0x7fb16c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 -- 172.21.15.16:0/2890698449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb16c1021c0 msgr2=0x7fb16c19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb16c1021c0 0x7fb16c19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 -- 172.21.15.16:0/2890698449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb16c10f450 msgr2=0x7fb16c1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb16c10f450 0x7fb16c1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.862+0000 7fb1717b8640 1 -- 172.21.15.16:0/2890698449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c1a1480 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.863+0000 7fb1717b8640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c1018a0 0x7fb16c19b3d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cce0 tx=0x7fb15c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.863+0000 7fb16a7fc640 1 -- 172.21.15.16:0/2890698449 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00f650 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.863+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c1a1770 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.863+0000 7fb16a7fc640 1 -- 172.21.15.16:0/2890698449 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb15c00fca0 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.863+0000 7fb16a7fc640 1 -- 172.21.15.16:0/2890698449 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c018b40 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.863+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a7e30 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.864+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c101c80 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.865+0000 7fb16a7fc640 1 -- 172.21.15.16:0/2890698449 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb15c00f7f0 con 0x7fb16c1018a0 2024-09-10T23:46:29.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.866+0000 7fb16a7fc640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1540b5450 0x7fb1540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:29.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.866+0000 7fb170fb7640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1540b5450 0x7fb1540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:29.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.866+0000 7fb16a7fc640 1 -- 172.21.15.16:0/2890698449 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fb15c0e64d0 con 0x7fb16c1018a0 2024-09-10T23:46:29.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.867+0000 7fb170fb7640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1540b5450 0x7fb1540b7910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ffdf0 tx=0x7fb16000c4a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:29.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:29.871+0000 7fb16a7fc640 1 -- 172.21.15.16:0/2890698449 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb15c014030 con 0x7fb16c1018a0 2024-09-10T23:46:30.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.095+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb16c19c500 con 0x7fb16c1018a0 2024-09-10T23:46:30.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.096+0000 7fb16a7fc640 1 -- 172.21.15.16:0/2890698449 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fb15c0ad050 con 0x7fb16c1018a0 2024-09-10T23:46:30.097 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:46:30.098 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:46:30.098 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.098+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1540b5450 msgr2=0x7fb1540b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.098+0000 7fb173a1c640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1540b5450 0x7fb1540b7910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ffdf0 tx=0x7fb16000c4a0 comp rx=0 tx=0).stop 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.098+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c1018a0 msgr2=0x7fb16c19b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.098+0000 7fb173a1c640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c1018a0 0x7fb16c19b3d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cce0 tx=0x7fb15c00a620 comp rx=0 tx=0).stop 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 shutdown_connections 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb1540b5450 0x7fb1540b7910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb16c10f450 0x7fb16c1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb16c1021c0 0x7fb16c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 --2- 172.21.15.16:0/2890698449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16c1018a0 0x7fb16c19b3d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 >> 172.21.15.16:0/2890698449 conn(0x7fb16c0fd730 msgr2=0x7fb16c10ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 shutdown_connections 2024-09-10T23:46:30.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:30.099+0000 7fb173a1c640 1 -- 172.21.15.16:0/2890698449 wait complete. 2024-09-10T23:46:30.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:30 smithi066 ceph-mon[34761]: pgmap v508: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:46:30.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:30 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2890698449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:30.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:30 smithi016 ceph-mon[30855]: pgmap v508: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:46:30.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:30 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2890698449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:30.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:30 smithi071 ceph-mon[35018]: pgmap v508: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:46:30.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:30 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2890698449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:30.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:46:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:31.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 -- 172.21.15.16:0/3167205456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c102dc0 msgr2=0x7fd20c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 --2- 172.21.15.16:0/3167205456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c102dc0 0x7fd20c1031a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd208009900 tx=0x7fd20802a410 comp rx=0 tx=0).stop 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 -- 172.21.15.16:0/3167205456 shutdown_connections 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 --2- 172.21.15.16:0/3167205456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c109150 0x7fd20c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 --2- 172.21.15.16:0/3167205456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c1087d0 0x7fd20c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 --2- 172.21.15.16:0/3167205456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c102dc0 0x7fd20c1031a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 -- 172.21.15.16:0/3167205456 >> 172.21.15.16:0/3167205456 conn(0x7fd20c0fe830 msgr2=0x7fd20c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 -- 172.21.15.16:0/3167205456 shutdown_connections 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 -- 172.21.15.16:0/3167205456 wait complete. 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 Processor -- start 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.545+0000 7fd21443f640 1 -- start start 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd21443f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c102dc0 0x7fd20c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd21443f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c1087d0 0x7fd20c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd21443f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c109150 0x7fd20c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd21443f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112e10 con 0x7fd20c109150 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd21443f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112c90 con 0x7fd20c102dc0 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd21443f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c112f90 con 0x7fd20c1087d0 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c109150 0x7fd20c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c109150 0x7fd20c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37676/0 (socket says 172.21.15.16:37676) 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2119da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c1087d0 0x7fd20c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 -- 172.21.15.16:0/1561410864 learned_addr learned my addr 172.21.15.16:0/1561410864 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2121db640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c102dc0 0x7fd20c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 -- 172.21.15.16:0/1561410864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c1087d0 msgr2=0x7fd20c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c1087d0 0x7fd20c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 -- 172.21.15.16:0/1561410864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c102dc0 msgr2=0x7fd20c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c102dc0 0x7fd20c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 -- 172.21.15.16:0/1561410864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c1a7780 con 0x7fd20c109150 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2129dc640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c109150 0x7fd20c075f20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd20400eaa0 tx=0x7fd20400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2037fe640 1 -- 172.21.15.16:0/1561410864 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20400cdb0 con 0x7fd20c109150 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c1a7a70 con 0x7fd20c109150 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2037fe640 1 -- 172.21.15.16:0/1561410864 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd204005020 con 0x7fd20c109150 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.546+0000 7fd2037fe640 1 -- 172.21.15.16:0/1561410864 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2040116d0 con 0x7fd20c109150 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.547+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1a7f60 con 0x7fd20c109150 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.549+0000 7fd216814740 1 Processor -- start 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.549+0000 7fd2037fe640 1 -- 172.21.15.16:0/1561410864 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd20400f040 con 0x7fd20c109150 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.549+0000 7fd216814740 1 -- start start 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd216814740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c12854d0 0x55e5c12858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd216814740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1285df0 0x55e5c1291840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd216814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c1291d80 0x55e5c1294170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd216814740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e5c11fbea0 con 0x55e5c1285df0 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd216814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5c11eb2d0 con 0x55e5c1291d80 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd216814740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e5c11ef0e0 con 0x55e5c12854d0 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1285df0 0x55e5c1291840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1285df0 0x55e5c1291840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37688/0 (socket says 172.21.15.16:37688) 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 -- 172.21.15.16:0/1036400074 learned_addr learned my addr 172.21.15.16:0/1036400074 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2119da640 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c12854d0 0x55e5c12858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2119da640 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c1291d80 0x55e5c1294170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 -- 172.21.15.16:0/1036400074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c12854d0 msgr2=0x55e5c12858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c12854d0 0x55e5c12858b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 -- 172.21.15.16:0/1036400074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c1291d80 msgr2=0x55e5c1294170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c1291d80 0x55e5c1294170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 -- 172.21.15.16:0/1036400074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c0f49650 con 0x55e5c1285df0 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2037fe640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2119da640 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c1291d80 0x55e5c1294170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2119da640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.550+0000 7fd2121db640 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1285df0 0x55e5c1291840 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd208009900 tx=0x7fd208032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2c9e5077ebb5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.551+0000 7fd2037fe640 1 -- 172.21.15.16:0/1561410864 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd2040e5cf0 con 0x7fd20c109150 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.551+0000 7fd200de6640 1 -- 172.21.15.16:0/1036400074 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208040070 con 0x55e5c1285df0 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.551+0000 7fd200de6640 1 -- 172.21.15.16:0/1036400074 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd208004030 con 0x55e5c1285df0 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.551+0000 7fd200de6640 1 -- 172.21.15.16:0/1036400074 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208035040 con 0x55e5c1285df0 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd2119da640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc005d00 tx=0x7fd1fc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:31.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- 172.21.15.16:0/1036400074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1285df0 msgr2=0x55e5c1291840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1285df0 0x55e5c1291840 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd208009900 tx=0x7fd208032bd0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- 172.21.15.16:0/1036400074 shutdown_connections 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c1291d80 0x55e5c1294170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1285df0 0x55e5c1291840 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 --2- 172.21.15.16:0/1036400074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c12854d0 0x55e5c12858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- 172.21.15.16:0/1036400074 >> 172.21.15.16:0/1036400074 conn(0x55e5c1283300 msgr2=0x55e5c12844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- 172.21.15.16:0/1036400074 shutdown_connections 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- 172.21.15.16:0/1036400074 wait complete. 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- start start 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 Processor -- start 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c1291580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c128ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e5c104c700 con 0x55e5c1291d80 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.552+0000 7fd216814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5c1186160 con 0x55e5c12854d0 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd216814740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e5c12949a0 con 0x55e5c1285df0 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd216814740 10 client.0 _ll_register_callbacks cb 0x55e5c119f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c128ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c128ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37700/0 (socket says 172.21.15.16:37700) 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 -- 172.21.15.16:0/128204071 learned_addr learned my addr 172.21.15.16:0/128204071 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2119da640 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2121db640 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c1291580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 -- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 msgr2=0x55e5c128e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 -- 172.21.15.16:0/128204071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 msgr2=0x55e5c1291580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c1291580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 -- 172.21.15.16:0/128204071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c11b3c90 con 0x55e5c1291d80 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd2129dc640 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c128ef10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd2040e3aa0 tx=0x7fd204005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683fbed0c1138cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd1f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/128204071 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20401f030 con 0x55e5c1291d80 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/128204071 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd2040cf070 con 0x55e5c1291d80 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.553+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd208004030 con 0x55e5c1291d80 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/128204071 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2040b0cb0 con 0x55e5c1291d80 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 10 client.16656 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5c12a02a0 con 0x55e5c1291d80 2024-09-10T23:46:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/128204071 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd208004030 con 0x55e5c1291d80 2024-09-10T23:46:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/128204071 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2040cdbb0 con 0x55e5c1291d80 2024-09-10T23:46:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 10 client.16656 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 10 client.16656 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:46:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 20 client.16656 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c12a1820 0x55e5c12a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 4 client.16656 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5c11fddf0 con 0x55e5c12a1820 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.554+0000 7fd2121db640 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c12a1820 0x55e5c12a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.555+0000 7fd1f5ffb640 10 client.16656 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.555+0000 7fd2121db640 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c12a1820 0x55e5c12a3c80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adf33d5cc0b8d1db server_cookie=231fd65371e11451 in_seq=0 out_seq=0 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.555+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/128204071 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e5c11fddf0 con 0x55e5c12a1820 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.555+0000 7fd1f5ffb640 10 client.16656 handle_command_reply: tid=0 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.555+0000 7fd216814740 1 client.16656 shutdown 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 msgr2=0x55e5c128ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c128ef10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd2040e3aa0 tx=0x7fd204005450 comp rx=0 tx=0).stop 2024-09-10T23:46:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 shutdown_connections 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c12a1820 0x55e5c12a3c80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c128ef10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 --2- 172.21.15.16:0/128204071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c1291580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 >> 172.21.15.16:0/128204071 conn(0x55e5c1283300 msgr2=0x55e5c1288ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd1f5ffb640 0 client.16656 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 shutdown_connections 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 1 -- 172.21.15.16:0/128204071 wait complete. 2024-09-10T23:46:31.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.556+0000 7fd216814740 20 client.16656 trim_cache size 0 max 16384 2024-09-10T23:46:31.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 Processor -- start 2024-09-10T23:46:31.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 -- start start 2024-09-10T23:46:31.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c128bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c12a9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1b3090 con 0x55e5c1291d80 2024-09-10T23:46:31.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1b0960 con 0x55e5c12854d0 2024-09-10T23:46:31.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd216814740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1ae7b0 con 0x55e5c1285df0 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c12a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c12a9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37714/0 (socket says 172.21.15.16:37714) 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd2129dc640 1 -- 172.21.15.16:0/1757965969 learned_addr learned my addr 172.21.15.16:0/1757965969 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd2119da640 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.569+0000 7fd2121db640 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c128bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd2129dc640 1 -- 172.21.15.16:0/1757965969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 msgr2=0x55e5c128c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd2129dc640 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd2129dc640 1 -- 172.21.15.16:0/1757965969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 msgr2=0x55e5c128bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd2129dc640 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c128bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd2129dc640 1 -- 172.21.15.16:0/1757965969 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c1289740 con 0x55e5c1291d80 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd2129dc640 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c12a9550 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd20400efd0 tx=0x7fd204005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1249c18d07f894 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd1f7fff640 1 -- 172.21.15.16:0/1757965969 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20401f020 con 0x55e5c1291d80 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd1f7fff640 1 -- 172.21.15.16:0/1757965969 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2040b5760 con 0x55e5c1291d80 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.570+0000 7fd1f7fff640 1 -- 172.21.15.16:0/1757965969 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20405a020 con 0x55e5c1291d80 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 -- 172.21.15.16:0/1757965969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 msgr2=0x55e5c12a9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c12a9550 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd20400efd0 tx=0x7fd204005ec0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 -- 172.21.15.16:0/1757965969 shutdown_connections 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c12a9550 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c128c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 --2- 172.21.15.16:0/1757965969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c128bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 -- 172.21.15.16:0/1757965969 >> 172.21.15.16:0/1757965969 conn(0x55e5c1283300 msgr2=0x55e5c1290820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 -- 172.21.15.16:0/1757965969 shutdown_connections 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 -- 172.21.15.16:0/1757965969 wait complete. 2024-09-10T23:46:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 -- start start 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.571+0000 7fd216814740 1 Processor -- start 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c12966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c1296c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c1307870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1aee20 con 0x55e5c1291d80 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1b0290 con 0x55e5c12854d0 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c1af4f0 con 0x55e5c1285df0 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c1307870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 10 client.0 _ll_register_callbacks cb 0x7fd204009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c1307870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37718/0 (socket says 172.21.15.16:37718) 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 -- 172.21.15.16:0/4038379223 learned_addr learned my addr 172.21.15.16:0/4038379223 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2119da640 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c1296c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2121db640 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c12966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 -- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 msgr2=0x55e5c1296c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c1296c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 -- 172.21.15.16:0/4038379223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 msgr2=0x55e5c12966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c12966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 -- 172.21.15.16:0/4038379223 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c1283d80 con 0x55e5c1291d80 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd2129dc640 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c1307870 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd2040a7bf0 tx=0x7fd2040ac160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83ddd512a261c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd1f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/4038379223 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20401f030 con 0x55e5c1291d80 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/4038379223 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd2040054f0 con 0x55e5c1291d80 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.572+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2040b5760 con 0x55e5c1291d80 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/4038379223 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd20405a070 con 0x55e5c1291d80 2024-09-10T23:46:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 10 client.16662 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5c130f1a0 con 0x55e5c1291d80 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/4038379223 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2040b5760 con 0x55e5c1291d80 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/4038379223 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2040b1e40 con 0x55e5c1291d80 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 10 client.16662 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 10 client.16662 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 20 client.16662 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c130f720 0x55e5c1311b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 4 client.16662 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:31.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5c11f98a0 con 0x55e5c130f720 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.573+0000 7fd2121db640 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c130f720 0x55e5c1311b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd2121db640 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c130f720 0x55e5c1311b40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ece87a3571c0791c server_cookie=812b710b9169dfdd in_seq=0 out_seq=0 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd1f5ffb640 10 client.16662 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd1f5ffb640 1 -- 172.21.15.16:0/4038379223 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5c11f98a0 con 0x55e5c130f720 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd1f5ffb640 10 client.16662 handle_command_reply: tid=0 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 client.16662 shutdown 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 msgr2=0x55e5c1307870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c1307870 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd2040a7bf0 tx=0x7fd2040ac160 comp rx=0 tx=0).stop 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 shutdown_connections 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55e5c130f720 0x55e5c1311b40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5c1291d80 0x55e5c1307870 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e5c1285df0 0x55e5c1296c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd1f5ffb640 0 client.16662 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 --2- 172.21.15.16:0/4038379223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5c12854d0 0x55e5c12966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 >> 172.21.15.16:0/4038379223 conn(0x55e5c1283300 msgr2=0x55e5c1281c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 shutdown_connections 2024-09-10T23:46:31.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.574+0000 7fd216814740 1 -- 172.21.15.16:0/4038379223 wait complete. 2024-09-10T23:46:31.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd216814740 20 client.16662 trim_cache size 0 max 16384 2024-09-10T23:46:31.589 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:31.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 msgr2=0x7fd1f80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc005d00 tx=0x7fd1fc00b390 comp rx=0 tx=0).stop 2024-09-10T23:46:31.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c109150 msgr2=0x7fd20c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:31.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c109150 0x7fd20c075f20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd20400eaa0 tx=0x7fd20400ef60 comp rx=0 tx=0).stop 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 shutdown_connections 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd20c109150 0x7fd20c075f20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20c1087d0 0x7fd20c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd1f80b5450 0x7fd1f80b7910 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 --2- 172.21.15.16:0/1561410864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd20c102dc0 0x7fd20c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 >> 172.21.15.16:0/1561410864 conn(0x7fd20c0fe830 msgr2=0x7fd20c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 shutdown_connections 2024-09-10T23:46:31.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:31.575+0000 7fd21443f640 1 -- 172.21.15.16:0/1561410864 wait complete. 2024-09-10T23:46:32.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:46:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:32.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:32 smithi066 ceph-mon[34761]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:32.670 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:32 smithi016 ceph-mon[30855]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:32.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:32 smithi071 ceph-mon[35018]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 -- 172.21.15.16:0/139447916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 msgr2=0x7f1bac108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/139447916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac108c10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009900 tx=0x7f1ba002a410 comp rx=0 tx=0).stop 2024-09-10T23:46:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 -- 172.21.15.16:0/139447916 shutdown_connections 2024-09-10T23:46:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/139447916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bac109150 0x7f1bac10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/139447916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac108c10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/139447916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bac102dc0 0x7f1bac1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 -- 172.21.15.16:0/139447916 >> 172.21.15.16:0/139447916 conn(0x7f1bac0fe830 msgr2=0x7f1bac100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 -- 172.21.15.16:0/139447916 shutdown_connections 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.054+0000 7f1bb15ec640 1 -- 172.21.15.16:0/139447916 wait complete. 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 Processor -- start 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 -- start start 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bac102dc0 0x7f1bac0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bac109150 0x7f1bac075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac112e10 con 0x7f1bac1087d0 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac112c90 con 0x7f1bac102dc0 2024-09-10T23:46:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1bb15ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac112f90 con 0x7f1bac109150 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37732/0 (socket says 172.21.15.16:37732) 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4123450832 learned_addr learned my addr 172.21.15.16:0/4123450832 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baaffd640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bac102dc0 0x7f1bac0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4123450832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bac109150 msgr2=0x7f1bac075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bac109150 0x7f1bac075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4123450832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bac102dc0 msgr2=0x7f1bac0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bac102dc0 0x7f1bac0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4123450832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac1a7660 con 0x7f1bac1087d0 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.055+0000 7f1baaffd640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bac102dc0 0x7f1bac0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.056+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac0759e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0006010 tx=0x7f1ba00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.056+0000 7f1b93fff640 1 -- 172.21.15.16:0/4123450832 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba003f030 con 0x7f1bac1087d0 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.056+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac1a78f0 con 0x7f1bac1087d0 2024-09-10T23:46:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.056+0000 7f1b93fff640 1 -- 172.21.15.16:0/4123450832 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0003800 con 0x7f1bac1087d0 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.056+0000 7f1b93fff640 1 -- 172.21.15.16:0/4123450832 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0035070 con 0x7f1bac1087d0 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.056+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac1a7e20 con 0x7f1bac1087d0 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 Processor -- start 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 -- start start 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1b93fff640 1 -- 172.21.15.16:0/4123450832 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f1ba0031b10 con 0x7f1bac1087d0 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dce68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bf7dc5cea0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bf7dc4c2d0 con 0x55bf7dce6df0 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.058+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bf7dc500e0 con 0x55bf7dce64d0 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37736/0 (socket says 172.21.15.16:37736) 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4249478434 learned_addr learned my addr 172.21.15.16:0/4249478434 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dce68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4249478434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 msgr2=0x55bf7dce68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dce68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4249478434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 msgr2=0x55bf7dcf2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 -- 172.21.15.16:0/4249478434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7d9aa650 con 0x55bf7dcf2d80 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dce68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf5170 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1ba01040a0 tx=0x7f1ba010cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6740325fb2812ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.059+0000 7f1b93fff640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1b940b5450 0x7f1b940b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1b917fa640 1 -- 172.21.15.16:0/4249478434 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00c94b0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1b940b5450 0x7f1b940b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1b917fa640 1 -- 172.21.15.16:0/4249478434 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0113070 con 0x55bf7dcf2d80 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1b917fa640 1 -- 172.21.15.16:0/4249478434 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00cc7b0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1b93fff640 1 -- 172.21.15.16:0/4123450832 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f1ba0106980 con 0x7f1bac1087d0 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1bb39c1740 1 -- 172.21.15.16:0/4249478434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 msgr2=0x55bf7dcf5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1b940b5450 0x7f1b940b7910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1bac077560 tx=0x7f1ba4005e30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.060+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf5170 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1ba01040a0 tx=0x7f1ba010cd90 comp rx=0 tx=0).stop 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- 172.21.15.16:0/4249478434 shutdown_connections 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf5170 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/4249478434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dce68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- 172.21.15.16:0/4249478434 >> 172.21.15.16:0/4249478434 conn(0x55bf7dce4300 msgr2=0x55bf7dce54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- 172.21.15.16:0/4249478434 shutdown_connections 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- 172.21.15.16:0/4249478434 wait complete. 2024-09-10T23:46:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- start start 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 Processor -- start 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce64d0 0x55bf7dcf25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcefa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bf7daad700 con 0x55bf7dce64d0 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bf7dbe7160 con 0x55bf7dce6df0 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bf7dcf57c0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1bb39c1740 10 client.0 _ll_register_callbacks cb 0x55bf7dc009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1baaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce64d0 0x55bf7dcf25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1baaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce64d0 0x55bf7dcf25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37744/0 (socket says 172.21.15.16:37744) 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.061+0000 7f1baaffd640 1 -- 172.21.15.16:0/2134980968 learned_addr learned my addr 172.21.15.16:0/2134980968 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcefa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baaffd640 1 -- 172.21.15.16:0/2134980968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 msgr2=0x55bf7dceffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baaffd640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baaffd640 1 -- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 msgr2=0x55bf7dcefa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baaffd640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcefa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baaffd640 1 -- 172.21.15.16:0/2134980968 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf7dc14c90 con 0x55bf7dce64d0 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcefa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1baaffd640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce64d0 0x55bf7dcf25f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c010a70 tx=0x7f1b9c010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26be06d470ab2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1b8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2134980968 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c01d060 con 0x55bf7dce64d0 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2134980968 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f1b9c00ed20 con 0x55bf7dce64d0 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ba0113070 con 0x55bf7dce64d0 2024-09-10T23:46:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2134980968 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b9c022450 con 0x55bf7dce64d0 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1bb39c1740 10 client.16674 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bf7dd01050 con 0x55bf7dce64d0 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.062+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2134980968 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0113070 con 0x55bf7dce64d0 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2134980968 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1b9c00d430 con 0x55bf7dce64d0 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1bb39c1740 10 client.16674 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1bb39c1740 10 client.16674 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1bb39c1740 20 client.16674 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd02560 0x55bf7dd049b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1bb39c1740 4 client.16674 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf7dc5edf0 con 0x55bf7dd02560 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd02560 0x55bf7dd049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1b8eff5640 10 client.16674 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.063+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd02560 0x55bf7dd049b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b42c39a6b65edf5 server_cookie=e58df1897da4ebd9 in_seq=0 out_seq=0 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2134980968 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf7dc5edf0 con 0x55bf7dd02560 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1b8eff5640 10 client.16674 handle_command_reply: tid=0 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 client.16674 shutdown 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce64d0 msgr2=0x55bf7dcf25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce64d0 0x55bf7dcf25f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c010a70 tx=0x7f1b9c010f30 comp rx=0 tx=0).stop 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 shutdown_connections 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd02560 0x55bf7dd049b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1b8eff5640 0 client.16674 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcefa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2134980968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce64d0 0x55bf7dcf25f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 >> 172.21.15.16:0/2134980968 conn(0x55bf7dce4300 msgr2=0x55bf7dce9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 shutdown_connections 2024-09-10T23:46:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.064+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2134980968 wait complete. 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.065+0000 7f1bb39c1740 20 client.16674 trim_cache size 0 max 16384 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 Processor -- start 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 -- start start 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce64d0 0x55bf7dce5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce6df0 0x55bf7dcfe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1b30d0 con 0x55bf7dce6df0 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1b09a0 con 0x55bf7dce64d0 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1ae7f0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce6df0 0x55bf7dcfe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce6df0 0x55bf7dcfe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37758/0 (socket says 172.21.15.16:37758) 2024-09-10T23:46:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 -- 172.21.15.16:0/3639326117 learned_addr learned my addr 172.21.15.16:0/3639326117 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baaffd640 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce64d0 0x55bf7dce5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 -- 172.21.15.16:0/3639326117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 msgr2=0x55bf7dceef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 -- 172.21.15.16:0/3639326117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce64d0 msgr2=0x55bf7dce5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce64d0 0x55bf7dce5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 -- 172.21.15.16:0/3639326117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7dcf2960 con 0x55bf7dce6df0 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.078+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce6df0 0x55bf7dcfe9b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00ccdf0 tx=0x7f1ba0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae1b9cd67569a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1b90ff9640 1 -- 172.21.15.16:0/3639326117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0049040 con 0x55bf7dce6df0 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1b90ff9640 1 -- 172.21.15.16:0/3639326117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0113070 con 0x55bf7dce6df0 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1b90ff9640 1 -- 172.21.15.16:0/3639326117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00cc9a0 con 0x55bf7dce6df0 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 -- 172.21.15.16:0/3639326117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce6df0 msgr2=0x55bf7dcfe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce6df0 0x55bf7dcfe9b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00ccdf0 tx=0x7f1ba0003c20 comp rx=0 tx=0).stop 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 -- 172.21.15.16:0/3639326117 shutdown_connections 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dcf2d80 0x55bf7dceef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dce6df0 0x55bf7dcfe9b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/3639326117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce64d0 0x55bf7dce5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 -- 172.21.15.16:0/3639326117 >> 172.21.15.16:0/3639326117 conn(0x55bf7dce4300 msgr2=0x55bf7dce4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 -- 172.21.15.16:0/3639326117 shutdown_connections 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 -- 172.21.15.16:0/3639326117 wait complete. 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.079+0000 7f1bb39c1740 1 -- start start 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 1 Processor -- start 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dcfb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1aee60 con 0x55bf7dcf2d80 2024-09-10T23:46:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1b02d0 con 0x55bf7dce6df0 2024-09-10T23:46:33.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1af530 con 0x55bf7dce64d0 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bb39c1740 10 client.0 _ll_register_callbacks cb 0x7f1b9c008950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37772/0 (socket says 172.21.15.16:37772) 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 -- 172.21.15.16:0/2450966744 learned_addr learned my addr 172.21.15.16:0/2450966744 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1baaffd640 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dcfb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1baa7fc640 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 -- 172.21.15.16:0/2450966744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 msgr2=0x55bf7dcfb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dcfb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 -- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 msgr2=0x55bf7dcf8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.080+0000 7f1bab7fe640 1 -- 172.21.15.16:0/2450966744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf7dcf9970 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bab7fe640 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf9140 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40109c0 tx=0x7f1ba4010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71c23b5d46c4438 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1b8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2450966744 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400fcd0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2450966744 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f1ba401d420 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ba0113070 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2450966744 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ba401d620 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 10 client.16680 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bf7dd704f0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2450966744 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0113070 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2450966744 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1ba402f7d0 con 0x55bf7dcf2d80 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 10 client.16680 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 10 client.16680 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:46:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 20 client.16680 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd70c50 0x55bf7dd73070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 4 client.16680 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.081+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf7dc5a8a0 con 0x55bf7dd70c50 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1baaffd640 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd70c50 0x55bf7dd73070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1b8eff5640 10 client.16680 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1baaffd640 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd70c50 0x55bf7dd73070 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f5dffd3ab15d11c server_cookie=fc6d755bfab5d5a8 in_seq=0 out_seq=0 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1b8eff5640 1 -- 172.21.15.16:0/2450966744 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf7dc5a8a0 con 0x55bf7dd70c50 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1b8eff5640 10 client.16680 handle_command_reply: tid=0 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 client.16680 shutdown 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 msgr2=0x55bf7dcf9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf9140 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40109c0 tx=0x7f1ba4010dc0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 shutdown_connections 2024-09-10T23:46:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bf7dd70c50 0x55bf7dd73070 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1b8eff5640 0 client.16680 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf7dcf2d80 0x55bf7dcf9140 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf7dce6df0 0x55bf7dcf8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 --2- 172.21.15.16:0/2450966744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf7dce64d0 0x55bf7dcfb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.082+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 >> 172.21.15.16:0/2450966744 conn(0x55bf7dce4300 msgr2=0x55bf7dce2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 shutdown_connections 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb39c1740 1 -- 172.21.15.16:0/2450966744 wait complete. 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb39c1740 20 client.16680 trim_cache size 0 max 16384 2024-09-10T23:46:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1b940b5450 msgr2=0x7f1b940b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1b940b5450 0x7f1b940b7910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1bac077560 tx=0x7f1ba4005e30 comp rx=0 tx=0).stop 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 msgr2=0x7f1bac0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac0759e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0006010 tx=0x7f1ba00042f0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 shutdown_connections 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bac109150 0x7f1bac075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bac1087d0 0x7f1bac0759e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1b940b5450 0x7f1b940b7910 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 --2- 172.21.15.16:0/4123450832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bac102dc0 0x7f1bac0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 >> 172.21.15.16:0/4123450832 conn(0x7f1bac0fe830 msgr2=0x7f1bac100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 shutdown_connections 2024-09-10T23:46:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:33.083+0000 7f1bb15ec640 1 -- 172.21.15.16:0/4123450832 wait complete. 2024-09-10T23:46:33.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:46:34.059 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:34.446 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:34 smithi016 ceph-mon[30855]: pgmap v510: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:34.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:34 smithi066 ceph-mon[34761]: pgmap v510: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:34.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 -- 172.21.15.16:0/1931749977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 msgr2=0x7f6d001020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 --2- 172.21.15.16:0/1931749977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001020b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009900 tx=0x7f6cf002a410 comp rx=0 tx=0).stop 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 -- 172.21.15.16:0/1931749977 shutdown_connections 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 --2- 172.21.15.16:0/1931749977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d00108060 0x7f6d0010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 --2- 172.21.15.16:0/1931749977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d001076e0 0x7f6d00107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 --2- 172.21.15.16:0/1931749977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001020b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 -- 172.21.15.16:0/1931749977 >> 172.21.15.16:0/1931749977 conn(0x7f6d000fd700 msgr2=0x7f6d000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 -- 172.21.15.16:0/1931749977 shutdown_connections 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.530+0000 7f6d087cd640 1 -- 172.21.15.16:0/1931749977 wait complete. 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 Processor -- start 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 -- start start 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d001076e0 0x7f6d00199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d00108060 0x7f6d0019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00111d20 con 0x7f6d00101cd0 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00111ba0 con 0x7f6d00108060 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d087cd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00111ea0 con 0x7f6d001076e0 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d06569640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d06569640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36486/0 (socket says 172.21.15.16:36486) 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.531+0000 7f6d06569640 1 -- 172.21.15.16:0/2657942860 learned_addr learned my addr 172.21.15.16:0/2657942860 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d00108060 0x7f6d0019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d05d68640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d001076e0 0x7f6d00199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d06569640 1 -- 172.21.15.16:0/2657942860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d001076e0 msgr2=0x7f6d00199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d06569640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d001076e0 0x7f6d00199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d06569640 1 -- 172.21.15.16:0/2657942860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d00108060 msgr2=0x7f6d0019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d06569640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d00108060 0x7f6d0019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d06569640 1 -- 172.21.15.16:0/2657942860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0019f490 con 0x7f6d00101cd0 2024-09-10T23:46:34.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d05d68640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d001076e0 0x7f6d00199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d06569640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001993e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0005940 tx=0x7f6cf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6cff7fe640 1 -- 172.21.15.16:0/2657942860 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf003f030 con 0x7f6d00101cd0 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0019f720 con 0x7f6d00101cd0 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6cff7fe640 1 -- 172.21.15.16:0/2657942860 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf0003cb0 con 0x7f6d00101cd0 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6cff7fe640 1 -- 172.21.15.16:0/2657942860 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0035070 con 0x7f6d00101cd0 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.532+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d001a5e40 con 0x7f6d00101cd0 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 Processor -- start 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 -- start start 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6cff7fe640 1 -- 172.21.15.16:0/2657942860 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f6cf0003800 con 0x7f6d00101cd0 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ed1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564399e39ea0 con 0x564399ec3a10 2024-09-10T23:46:34.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564399e292d0 con 0x564399ecf9a0 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564399e2d0e0 con 0x564399ec30f0 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d06569640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d06569640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36488/0 (socket says 172.21.15.16:36488) 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d06569640 1 -- 172.21.15.16:0/2173078411 learned_addr learned my addr 172.21.15.16:0/2173078411 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.535+0000 7f6d05d68640 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ed1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d06569640 1 -- 172.21.15.16:0/2173078411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 msgr2=0x564399ec34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d06569640 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d06569640 1 -- 172.21.15.16:0/2173078411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 msgr2=0x564399ed1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d06569640 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ed1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d06569640 1 -- 172.21.15.16:0/2173078411 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564399b87650 con 0x564399ec3a10 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d05d68640 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ed1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:34.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d06569640 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecf460 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0104230 tx=0x7f6cf010ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceef38843b1546e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6cfcff9640 1 -- 172.21.15.16:0/2173078411 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0116020 con 0x564399ec3a10 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6cfcff9640 1 -- 172.21.15.16:0/2173078411 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf010fb50 con 0x564399ec3a10 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6cfcff9640 1 -- 172.21.15.16:0/2173078411 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf010b040 con 0x564399ec3a10 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6cff7fe640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6ce80b5450 0x7f6ce80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6ce80b5450 0x7f6ce80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.536+0000 7f6cff7fe640 1 -- 172.21.15.16:0/2657942860 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6cf0106b10 con 0x7f6d00101cd0 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2173078411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 msgr2=0x564399ecf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6ce80b5450 0x7f6ce80b7910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8005fd0 tx=0x7f6cf8009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecf460 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0104230 tx=0x7f6cf010ade0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2173078411 shutdown_connections 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ed1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecf460 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2173078411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2173078411 >> 172.21.15.16:0/2173078411 conn(0x564399ec0f20 msgr2=0x564399ec20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2173078411 shutdown_connections 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2173078411 wait complete. 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 -- start start 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.537+0000 7f6d0aba2740 1 Processor -- start 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec30f0 0x564399ecf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ecf9a0 0x564399eccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564399c8a700 con 0x564399ec3a10 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564399dc4160 con 0x564399ec30f0 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564399ed23e0 con 0x564399ecf9a0 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 10 client.0 _ll_register_callbacks cb 0x564399ddd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:34.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36502/0 (socket says 172.21.15.16:36502) 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 -- 172.21.15.16:0/2979666198 learned_addr learned my addr 172.21.15.16:0/2979666198 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ecf9a0 0x564399eccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d06569640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec30f0 0x564399ecf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 -- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ecf9a0 msgr2=0x564399eccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ecf9a0 0x564399eccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 -- 172.21.15.16:0/2979666198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec30f0 msgr2=0x564399ecf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec30f0 0x564399ecf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 -- 172.21.15.16:0/2979666198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564399df1c90 con 0x564399ec3a10 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d06569640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec30f0 0x564399ecf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d05d68640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecc6e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400df70 tx=0x7f6cf400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a787705dbba90c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6ce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/2979666198 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4018070 con 0x564399ec3a10 2024-09-10T23:46:34.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/2979666198 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6cf4014680 con 0x564399ec3a10 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.538+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf010fb50 con 0x564399ec3a10 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/2979666198 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cf4024050 con 0x564399ec3a10 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 10 client.16692 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564399eddcb0 con 0x564399ec3a10 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/2979666198 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf010fb50 con 0x564399ec3a10 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/2979666198 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6cf40139c0 con 0x564399ec3a10 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 10 client.16692 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 20 client.16692 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399edf0c0 0x564399ee1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 4 client.16692 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564399e3bdf0 con 0x564399edf0c0 2024-09-10T23:46:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.539+0000 7f6d06569640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399edf0c0 0x564399ee1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.540+0000 7f6d06569640 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399edf0c0 0x564399ee1540 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c90e53f5731e4430 server_cookie=4d44c843885dc3de in_seq=0 out_seq=0 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.540+0000 7f6ce5ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/2979666198 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564399e3bdf0 con 0x564399edf0c0 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6ce5ffb640 10 client.16692 handle_command_reply: tid=0 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 client.16692 shutdown 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 msgr2=0x564399ecc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecc6e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400df70 tx=0x7f6cf400f5b0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 shutdown_connections 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399edf0c0 0x564399ee1540 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ecf9a0 0x564399eccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ecc6e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6ce5ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/2979666198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec30f0 0x564399ecf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 >> 172.21.15.16:0/2979666198 conn(0x564399ec0f20 msgr2=0x564399ec6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 shutdown_connections 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 1 -- 172.21.15.16:0/2979666198 wait complete. 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.541+0000 7f6d0aba2740 20 client.16692 trim_cache size 0 max 16384 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.554+0000 7f6d0aba2740 1 Processor -- start 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.554+0000 7f6d0aba2740 1 -- start start 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ec7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ec7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001b0f10 con 0x564399ec3a10 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001ae7e0 con 0x564399ecf9a0 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001ac630 con 0x564399ec30f0 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ec7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ec7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36510/0 (socket says 172.21.15.16:36510) 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 -- 172.21.15.16:0/562170693 learned_addr learned my addr 172.21.15.16:0/562170693 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ec7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d06569640 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 -- 172.21.15.16:0/562170693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 msgr2=0x564399ec0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 -- 172.21.15.16:0/562170693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 msgr2=0x564399ec7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ec7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 -- 172.21.15.16:0/562170693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564399ecabe0 con 0x564399ec3a10 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6d05d68640 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ec7950 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4014040 tx=0x7f6cf400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87a6c6e58e25bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.555+0000 7f6ce7fff640 1 -- 172.21.15.16:0/562170693 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4018040 con 0x564399ec3a10 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6ce7fff640 1 -- 172.21.15.16:0/562170693 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf402d070 con 0x564399ec3a10 2024-09-10T23:46:34.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6ce7fff640 1 -- 172.21.15.16:0/562170693 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf40136d0 con 0x564399ec3a10 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 -- 172.21.15.16:0/562170693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 msgr2=0x564399ec7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ec7950 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4014040 tx=0x7f6cf400d9d0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 -- 172.21.15.16:0/562170693 shutdown_connections 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ecf9a0 0x564399ec7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ec3a10 0x564399ec7950 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/562170693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ec0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 -- 172.21.15.16:0/562170693 >> 172.21.15.16:0/562170693 conn(0x564399ec0f20 msgr2=0x564399ec1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 -- 172.21.15.16:0/562170693 shutdown_connections 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.556+0000 7f6d0aba2740 1 -- 172.21.15.16:0/562170693 wait complete. 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 -- start start 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 Processor -- start 2024-09-10T23:46:34.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ed7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec3a10 0x564399ed7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ecf9a0 0x564399ec8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001acca0 con 0x564399ecf9a0 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001ae110 con 0x564399ec3a10 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001ad370 con 0x564399ec30f0 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d0aba2740 10 client.0 _ll_register_callbacks cb 0x7f6cf400d1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ecf9a0 0x564399ec8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ecf9a0 0x564399ec8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36518/0 (socket says 172.21.15.16:36518) 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 -- 172.21.15.16:0/858689614 learned_addr learned my addr 172.21.15.16:0/858689614 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d05d68640 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec3a10 0x564399ed7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06569640 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ed7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 -- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 msgr2=0x564399ed7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ed7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 -- 172.21.15.16:0/858689614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec3a10 msgr2=0x564399ed7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec3a10 0x564399ed7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.557+0000 7f6d06d6a640 1 -- 172.21.15.16:0/858689614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564399ed8160 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6d06d6a640 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ecf9a0 0x564399ec8900 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8011e70 tx=0x7f6cf8015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2764af8becbe03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6ce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/858689614 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8030060 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/858689614 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f6cf8020920 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf402d070 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/858689614 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cf8003e40 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6d0aba2740 10 client.16698 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564399ec9d50 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/858689614 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf402d070 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/858689614 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6cf800f040 con 0x564399ecf9a0 2024-09-10T23:46:34.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6d0aba2740 10 client.16698 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6d0aba2740 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.558+0000 7f6d0aba2740 20 client.16698 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.559+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399f4d060 0x564399f4f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.559+0000 7f6d0aba2740 4 client.16698 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.559+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564399e378a0 con 0x564399f4d060 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.559+0000 7f6d06569640 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399f4d060 0x564399f4f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.559+0000 7f6ce5ffb640 10 client.16698 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.559+0000 7f6d06569640 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399f4d060 0x564399f4f450 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbd04c81e1814b1 server_cookie=a9ed6bc69cca765f in_seq=0 out_seq=0 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.559+0000 7f6ce5ffb640 1 -- 172.21.15.16:0/858689614 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564399e378a0 con 0x564399f4d060 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6ce5ffb640 10 client.16698 handle_command_reply: tid=0 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 client.16698 shutdown 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ecf9a0 msgr2=0x564399ec8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ecf9a0 0x564399ec8900 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8011e70 tx=0x7f6cf8015040 comp rx=0 tx=0).stop 2024-09-10T23:46:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 shutdown_connections 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564399f4d060 0x564399f4f450 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564399ecf9a0 0x564399ec8900 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564399ec3a10 0x564399ed7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 --2- 172.21.15.16:0/858689614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564399ec30f0 0x564399ed7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 >> 172.21.15.16:0/858689614 conn(0x564399ec0f20 msgr2=0x564399ec7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6ce5ffb640 0 client.16698 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 shutdown_connections 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 1 -- 172.21.15.16:0/858689614 wait complete. 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d0aba2740 20 client.16698 trim_cache size 0 max 16384 2024-09-10T23:46:34.575 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:34.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6ce80b5450 msgr2=0x7f6ce80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d087cd640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6ce80b5450 0x7f6ce80b7910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8005fd0 tx=0x7f6cf8009600 comp rx=0 tx=0).stop 2024-09-10T23:46:34.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 msgr2=0x7f6d001993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:34.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d087cd640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001993e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0005940 tx=0x7f6cf00042f0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.560+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 shutdown_connections 2024-09-10T23:46:34.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.561+0000 7f6d087cd640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6ce80b5450 0x7f6ce80b7910 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.561+0000 7f6d087cd640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d00108060 0x7f6d0019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.561+0000 7f6d087cd640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d001076e0 0x7f6d00199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.561+0000 7f6d087cd640 1 --2- 172.21.15.16:0/2657942860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00101cd0 0x7f6d001993e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:34.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.561+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 >> 172.21.15.16:0/2657942860 conn(0x7f6d000fd700 msgr2=0x7f6d0006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:34.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.561+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 shutdown_connections 2024-09-10T23:46:34.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:34.561+0000 7f6d087cd640 1 -- 172.21.15.16:0/2657942860 wait complete. 2024-09-10T23:46:34.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:34 smithi071 ceph-mon[35018]: pgmap v510: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:36.298 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:46:36.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:46:36.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:36 smithi066 ceph-mon[34761]: pgmap v511: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:36.565 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:36.606 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:36 smithi016 ceph-mon[30855]: pgmap v511: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:36.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:36 smithi071 ceph-mon[35018]: pgmap v511: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 -- 172.21.15.16:0/407307001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630108020 msgr2=0x7f363010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 --2- 172.21.15.16:0/407307001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630108020 0x7f363010e820 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3628009ca0 tx=0x7f362802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 -- 172.21.15.16:0/407307001 shutdown_connections 2024-09-10T23:46:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 --2- 172.21.15.16:0/407307001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630108020 0x7f363010e820 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 --2- 172.21.15.16:0/407307001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36301076a0 0x7f3630107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 --2- 172.21.15.16:0/407307001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3630101c90 0x7f3630102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 -- 172.21.15.16:0/407307001 >> 172.21.15.16:0/407307001 conn(0x7f36300fd700 msgr2=0x7f36300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 -- 172.21.15.16:0/407307001 shutdown_connections 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.077+0000 7f3637fdc640 1 -- 172.21.15.16:0/407307001 wait complete. 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 Processor -- start 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 -- start start 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630101c90 0x7f363019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36301076a0 0x7f363019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3630108020 0x7f363019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3630111ca0 con 0x7f3630101c90 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3630111b20 con 0x7f3630108020 2024-09-10T23:46:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3637fdc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3630111e20 con 0x7f36301076a0 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3635d78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630101c90 0x7f363019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3635d78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630101c90 0x7f363019a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36534/0 (socket says 172.21.15.16:36534) 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3635d78640 1 -- 172.21.15.16:0/2602078196 learned_addr learned my addr 172.21.15.16:0/2602078196 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3636579640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3630108020 0x7f363019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.078+0000 7f3635577640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36301076a0 0x7f363019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3635d78640 1 -- 172.21.15.16:0/2602078196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36301076a0 msgr2=0x7f363019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3635d78640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36301076a0 0x7f363019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3635d78640 1 -- 172.21.15.16:0/2602078196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3630108020 msgr2=0x7f363019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3635d78640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3630108020 0x7f363019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3635d78640 1 -- 172.21.15.16:0/2602078196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36301a5450 con 0x7f3630101c90 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3635577640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36301076a0 0x7f363019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3635d78640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630101c90 0x7f363019a070 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f362c007c70 tx=0x7f362c010420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:37.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3626ffd640 1 -- 172.21.15.16:0/2602078196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c01c070 con 0x7f3630101c90 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3626ffd640 1 -- 172.21.15.16:0/2602078196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f362c007e20 con 0x7f3630101c90 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3630197ec0 con 0x7f3630101c90 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3626ffd640 1 -- 172.21.15.16:0/2602078196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c00c8a0 con 0x7f3630101c90 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.079+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3630198400 con 0x7f3630101c90 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.081+0000 7f3626ffd640 1 -- 172.21.15.16:0/2602078196 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f362c016030 con 0x7f3630101c90 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.081+0000 7f363a3b1740 1 Processor -- start 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f363a3b1740 1 -- start start 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f363a3b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55783c934e60 con 0x55783c9be800 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f363a3b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55783c924290 con 0x55783c9ca790 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f363a3b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55783c9280a0 con 0x55783c9bdee0 2024-09-10T23:46:37.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36538/0 (socket says 172.21.15.16:36538) 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 -- 172.21.15.16:0/4251970994 learned_addr learned my addr 172.21.15.16:0/4251970994 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3636579640 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635577640 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 -- 172.21.15.16:0/4251970994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 msgr2=0x55783c9be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 -- 172.21.15.16:0/4251970994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 msgr2=0x55783c9ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635d78640 1 -- 172.21.15.16:0/4251970994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783c682930 con 0x55783c9be800 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3635577640 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3636579640 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.082+0000 7f3626ffd640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f361c0b5450 0x7f361c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.083+0000 7f3636579640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f361c0b5450 0x7f361c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.083+0000 7f3635d78640 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9ca250 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ecf40 tx=0x7f362c0f1570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546347dcb27a3a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.083+0000 7f3626ffd640 1 -- 172.21.15.16:0/2602078196 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f362c0e8e60 con 0x7f3630101c90 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.083+0000 7f361bfff640 1 -- 172.21.15.16:0/4251970994 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0ab930 con 0x55783c9be800 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.083+0000 7f361bfff640 1 -- 172.21.15.16:0/4251970994 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f362c0aedf0 con 0x55783c9be800 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.083+0000 7f361bfff640 1 -- 172.21.15.16:0/4251970994 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0aea50 con 0x55783c9be800 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 -- 172.21.15.16:0/4251970994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 msgr2=0x55783c9ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f3636579640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f361c0b5450 0x7f361c0b7910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f362802f500 tx=0x7f362802f330 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9ca250 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ecf40 tx=0x7f362c0f1570 comp rx=0 tx=0).stop 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 -- 172.21.15.16:0/4251970994 shutdown_connections 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9ca250 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 --2- 172.21.15.16:0/4251970994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 -- 172.21.15.16:0/4251970994 >> 172.21.15.16:0/4251970994 conn(0x55783c9bbd10 msgr2=0x55783c9bceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 -- 172.21.15.16:0/4251970994 shutdown_connections 2024-09-10T23:46:37.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 -- 172.21.15.16:0/4251970994 wait complete. 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 -- start start 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.084+0000 7f363a3b1740 1 Processor -- start 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9bdee0 0x55783c9c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9be800 0x55783c9c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f363a3b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55783c785890 con 0x55783c9bdee0 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f363a3b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55783c8bed40 con 0x55783c9ca790 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f363a3b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55783c9cd440 con 0x55783c9be800 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f363a3b1740 10 client.0 _ll_register_callbacks cb 0x55783c922c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9bdee0 0x55783c9c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9bdee0 0x55783c9c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36550/0 (socket says 172.21.15.16:36550) 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 -- 172.21.15.16:0/1756731447 learned_addr learned my addr 172.21.15.16:0/1756731447 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635577640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9be800 0x55783c9c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3636579640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 -- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9be800 msgr2=0x55783c9c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9be800 0x55783c9c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 -- 172.21.15.16:0/1756731447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 msgr2=0x55783c9c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 -- 172.21.15.16:0/1756731447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783c9d6820 con 0x55783c9bdee0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635577640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9be800 0x55783c9c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f3635d78640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9bdee0 0x55783c9c77e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ab860 tx=0x7f362c0ec750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b888e74d69d380 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f36197fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.085+0000 7f36197fa640 1 -- 172.21.15.16:0/1756731447 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0aec30 con 0x55783c9bdee0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f36197fa640 1 -- 172.21.15.16:0/1756731447 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f362c0af540 con 0x55783c9bdee0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f362c0aedf0 con 0x55783c9bdee0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f36197fa640 1 -- 172.21.15.16:0/1756731447 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f362c0af0b0 con 0x55783c9bdee0 2024-09-10T23:46:37.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 10 client.16710 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55783c9d91b0 con 0x55783c9bdee0 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f36197fa640 1 -- 172.21.15.16:0/1756731447 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f362c0aedf0 con 0x55783c9bdee0 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f36197fa640 1 -- 172.21.15.16:0/1756731447 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f362c0b83e0 con 0x55783c9bdee0 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 10 client.16710 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 20 client.16710 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783c9da500 0x55783c9dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 4 client.16710 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55783c936db0 con 0x55783c9da500 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.086+0000 7f3635577640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783c9da500 0x55783c9dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.087+0000 7f36197fa640 10 client.16710 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.087+0000 7f3635577640 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783c9da500 0x55783c9dc8f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee8d43c33e8c0c2 server_cookie=8cd3d4621aebe653 in_seq=0 out_seq=0 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f36197fa640 1 -- 172.21.15.16:0/1756731447 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55783c936db0 con 0x55783c9da500 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f36197fa640 10 client.16710 handle_command_reply: tid=0 2024-09-10T23:46:37.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 client.16710 shutdown 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9bdee0 msgr2=0x55783c9c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9bdee0 0x55783c9c77e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ab860 tx=0x7f362c0ec750 comp rx=0 tx=0).stop 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 shutdown_connections 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783c9da500 0x55783c9dc8f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9be800 0x55783c9c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f36197fa640 0 client.16710 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1756731447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9bdee0 0x55783c9c77e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 >> 172.21.15.16:0/1756731447 conn(0x55783c9bbd10 msgr2=0x55783c9baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 shutdown_connections 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 1 -- 172.21.15.16:0/1756731447 wait complete. 2024-09-10T23:46:37.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.088+0000 7f363a3b1740 20 client.16710 trim_cache size 0 max 16384 2024-09-10T23:46:37.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 Processor -- start 2024-09-10T23:46:37.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 -- start start 2024-09-10T23:46:37.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36301aebe0 con 0x55783c9be800 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36301ac4b0 con 0x55783c9ca790 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f363a3b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36301aa300 con 0x55783c9bdee0 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f3635577640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f3635577640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36554/0 (socket says 172.21.15.16:36554) 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f3635577640 1 -- 172.21.15.16:0/1093866528 learned_addr learned my addr 172.21.15.16:0/1093866528 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f3635d78640 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.106+0000 7f3636579640 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f3635577640 1 -- 172.21.15.16:0/1093866528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 msgr2=0x55783c9c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f3635577640 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f3635577640 1 -- 172.21.15.16:0/1093866528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 msgr2=0x55783c9c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f3635577640 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f3635577640 1 -- 172.21.15.16:0/1093866528 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783c9b7640 con 0x55783c9be800 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f3635577640 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9c49f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55783c9bde90 tx=0x7f3620005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da55332635d0ed13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f361b7fe640 1 -- 172.21.15.16:0/1093866528 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620005220 con 0x55783c9be800 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f361b7fe640 1 -- 172.21.15.16:0/1093866528 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f362001e070 con 0x55783c9be800 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.107+0000 7f361b7fe640 1 -- 172.21.15.16:0/1093866528 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362001b770 con 0x55783c9be800 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 -- 172.21.15.16:0/1093866528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 msgr2=0x55783c9c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9c49f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55783c9bde90 tx=0x7f3620005f50 comp rx=0 tx=0).stop 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 -- 172.21.15.16:0/1093866528 shutdown_connections 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9ca790 0x55783c9c4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9be800 0x55783c9c49f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1093866528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 -- 172.21.15.16:0/1093866528 >> 172.21.15.16:0/1093866528 conn(0x55783c9bbd10 msgr2=0x55783c9c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:37.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 -- 172.21.15.16:0/1093866528 shutdown_connections 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 -- 172.21.15.16:0/1093866528 wait complete. 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 -- start start 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.108+0000 7f363a3b1740 1 Processor -- start 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9be800 0x55783c9de980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f363a3b1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9ca790 0x55783ca3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f363a3b1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36301aa970 con 0x55783c9ca790 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f363a3b1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f36301abde0 con 0x55783c9be800 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f363a3b1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f36301ab040 con 0x55783c9bdee0 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f363a3b1740 10 client.0 _ll_register_callbacks cb 0x7f362c0ecdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9ca790 0x55783ca3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3635d78640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3635577640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9be800 0x55783c9de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9ca790 0x55783ca3f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36564/0 (socket says 172.21.15.16:36564) 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3635d78640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9de3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:33742/0 (socket says 172.21.15.16:33742) 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 -- 172.21.15.16:0/1705467962 learned_addr learned my addr 172.21.15.16:0/1705467962 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 -- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 msgr2=0x55783c9de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9de3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 -- 172.21.15.16:0/1705467962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9be800 msgr2=0x55783c9de980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9be800 0x55783c9de980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3636579640 1 -- 172.21.15.16:0/1705467962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783ca3f7e0 con 0x55783c9ca790 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3635d78640 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.109+0000 7f3635577640 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9be800 0x55783c9de980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f3636579640 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9ca790 0x55783ca3f0a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3628035000 tx=0x7f36280095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76a74ed9e9eb231 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f36197fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f36197fa640 1 -- 172.21.15.16:0/1705467962 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628057060 con 0x55783c9ca790 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f36197fa640 1 -- 172.21.15.16:0/1705467962 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f3628003d40 con 0x55783c9ca790 2024-09-10T23:46:37.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f362001e070 con 0x55783c9ca790 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f36197fa640 1 -- 172.21.15.16:0/1705467962 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3628004040 con 0x55783c9ca790 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f363a3b1740 10 client.16716 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55783ca47da0 con 0x55783c9ca790 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f36197fa640 1 -- 172.21.15.16:0/1705467962 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f362001e070 con 0x55783c9ca790 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f36197fa640 1 -- 172.21.15.16:0/1705467962 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f362802fc00 con 0x55783c9ca790 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f363a3b1740 10 client.16716 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.110+0000 7f363a3b1740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.111+0000 7f363a3b1740 20 client.16716 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.111+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783ca48580 0x55783ca4a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.111+0000 7f363a3b1740 4 client.16716 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.111+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55783c932860 con 0x55783ca48580 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.111+0000 7f3635d78640 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783ca48580 0x55783ca4a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.111+0000 7f36197fa640 10 client.16716 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:37.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.111+0000 7f3635d78640 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783ca48580 0x55783ca4a9a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f999298b86a13e3 server_cookie=13ab05b6335ce37 in_seq=0 out_seq=0 2024-09-10T23:46:37.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f36197fa640 1 -- 172.21.15.16:0/1705467962 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55783c932860 con 0x55783ca48580 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f36197fa640 10 client.16716 handle_command_reply: tid=0 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 client.16716 shutdown 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9ca790 msgr2=0x55783ca3f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9ca790 0x55783ca3f0a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3628035000 tx=0x7f36280095c0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 shutdown_connections 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55783ca48580 0x55783ca4a9a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55783c9ca790 0x55783ca3f0a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55783c9be800 0x55783c9de980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f36197fa640 0 client.16716 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 --2- 172.21.15.16:0/1705467962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55783c9bdee0 0x55783c9de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 >> 172.21.15.16:0/1705467962 conn(0x55783c9bbd10 msgr2=0x55783c9c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 shutdown_connections 2024-09-10T23:46:37.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 1 -- 172.21.15.16:0/1705467962 wait complete. 2024-09-10T23:46:37.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.113+0000 7f363a3b1740 20 client.16716 trim_cache size 0 max 16384 2024-09-10T23:46:37.120 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:46:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:46:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "c875b0be-baec-4865-af9f-deac35c2ab7b", 2024-09-10T23:46:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:46:37.120 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f361c0b5450 msgr2=0x7f361c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f361c0b5450 0x7f361c0b7910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f362802f500 tx=0x7f362802f330 comp rx=0 tx=0).stop 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630101c90 msgr2=0x7f363019a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630101c90 0x7f363019a070 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f362c007c70 tx=0x7f362c010420 comp rx=0 tx=0).stop 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 shutdown_connections 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f361c0b5450 0x7f361c0b7910 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3630108020 0x7f363019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36301076a0 0x7f363019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 --2- 172.21.15.16:0/2602078196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3630101c90 0x7f363019a070 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 >> 172.21.15.16:0/2602078196 conn(0x7f36300fd700 msgr2=0x7f36300fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:37.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 shutdown_connections 2024-09-10T23:46:37.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:37.114+0000 7f3637fdc640 1 -- 172.21.15.16:0/2602078196 wait complete. 2024-09-10T23:46:37.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:46:38.047 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:38.474 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:38 smithi016 ceph-mon[30855]: pgmap v512: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:38.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:38 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:46:38.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:38 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:38.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:38 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:46:38.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:38 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:38.475 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:38 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:46:38.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:38 smithi066 ceph-mon[34761]: pgmap v512: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:38 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:46:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:38 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:38 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:46:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:38 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:38 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:46:38.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 -- 172.21.15.16:0/233791545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 msgr2=0x7fd4c81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/233791545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81031a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009900 tx=0x7fd4bc02a410 comp rx=0 tx=0).stop 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 -- 172.21.15.16:0/233791545 shutdown_connections 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/233791545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8109150 0x7fd4c810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/233791545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c81087d0 0x7fd4c8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/233791545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81031a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 -- 172.21.15.16:0/233791545 >> 172.21.15.16:0/233791545 conn(0x7fd4c80fe830 msgr2=0x7fd4c8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 -- 172.21.15.16:0/233791545 shutdown_connections 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 -- 172.21.15.16:0/233791545 wait complete. 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.558+0000 7fd4cef6e640 1 Processor -- start 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cef6e640 1 -- start start 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cef6e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cef6e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c81087d0 0x7fd4c81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cef6e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8109150 0x7fd4c819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cef6e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8112e10 con 0x7fd4c8102dc0 2024-09-10T23:46:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cef6e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8112c90 con 0x7fd4c81087d0 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cef6e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8112f90 con 0x7fd4c8109150 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36574/0 (socket says 172.21.15.16:36574) 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/1998436025 learned_addr learned my addr 172.21.15.16:0/1998436025 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c81087d0 0x7fd4c81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8109150 0x7fd4c819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/1998436025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8109150 msgr2=0x7fd4c819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8109150 0x7fd4c819eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/1998436025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c81087d0 msgr2=0x7fd4c81997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c81087d0 0x7fd4c81997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.559+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/1998436025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c819f350 con 0x7fd4c8102dc0 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.560+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81992a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc005940 tx=0x7fd4bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.560+0000 7fd4c5ffb640 1 -- 172.21.15.16:0/1998436025 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc03f030 con 0x7fd4c8102dc0 2024-09-10T23:46:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.560+0000 7fd4c5ffb640 1 -- 172.21.15.16:0/1998436025 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4bc003cb0 con 0x7fd4c8102dc0 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.560+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c819f5e0 con 0x7fd4c8102dc0 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.560+0000 7fd4c5ffb640 1 -- 172.21.15.16:0/1998436025 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc035070 con 0x7fd4c8102dc0 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.560+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c81a5d00 con 0x7fd4c8102dc0 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.562+0000 7fd4c5ffb640 1 -- 172.21.15.16:0/1998436025 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd4bc03bbf0 con 0x7fd4c8102dc0 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 Processor -- start 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 -- start start 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e306480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e316820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e319150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55768e27ce50 con 0x55768e3069c0 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55768e26c280 con 0x55768e316d60 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4d1343740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55768e270090 con 0x55768e3060a0 2024-09-10T23:46:38.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4ccd0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e316820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4ccd0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e316820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36582/0 (socket says 172.21.15.16:36582) 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/3501124421 learned_addr learned my addr 172.21.15.16:0/3501124421 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e319150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.563+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e306480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/3501124421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 msgr2=0x55768e306480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e306480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/3501124421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 msgr2=0x55768e319150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e319150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4ccd0a640 1 -- 172.21.15.16:0/3501124421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768dfca650 con 0x55768e3069c0 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e319150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4c5ffb640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4b80b54d0 0x7fd4b80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4b80b54d0 0x7fd4b80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e316820 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc1040c0 tx=0x7fd4bc10ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ba406ed6d12e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4c5ffb640 1 -- 172.21.15.16:0/1998436025 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd4bc106a30 con 0x7fd4c8102dc0 2024-09-10T23:46:38.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4b2ffd640 1 -- 172.21.15.16:0/3501124421 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc049020 con 0x55768e3069c0 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4b2ffd640 1 -- 172.21.15.16:0/3501124421 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4bc0cca70 con 0x55768e3069c0 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.564+0000 7fd4b2ffd640 1 -- 172.21.15.16:0/3501124421 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0c8e00 con 0x55768e3069c0 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4b80b54d0 0x7fd4b80b7990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005fd0 tx=0x7fd4c0009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 -- 172.21.15.16:0/3501124421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 msgr2=0x55768e316820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e316820 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc1040c0 tx=0x7fd4bc10ac60 comp rx=0 tx=0).stop 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 -- 172.21.15.16:0/3501124421 shutdown_connections 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e319150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e316820 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 --2- 172.21.15.16:0/3501124421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e306480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 -- 172.21.15.16:0/3501124421 >> 172.21.15.16:0/3501124421 conn(0x55768e303ed0 msgr2=0x55768e305070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 -- 172.21.15.16:0/3501124421 shutdown_connections 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 -- 172.21.15.16:0/3501124421 wait complete. 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 -- start start 2024-09-10T23:46:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.565+0000 7fd4d1343740 1 Processor -- start 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e316630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e313a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e314060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4d1343740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55768e0cd700 con 0x55768e316d60 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4d1343740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55768e207110 con 0x55768e3069c0 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4d1343740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55768e3197d0 con 0x55768e3060a0 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4d1343740 10 client.0 _ll_register_callbacks cb 0x55768e220990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e314060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4ccd0a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e316630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e314060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36590/0 (socket says 172.21.15.16:36590) 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4ccd0a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e316630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:33776/0 (socket says 172.21.15.16:33776) 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1376477370 learned_addr learned my addr 172.21.15.16:0/1376477370 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e313a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1376477370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 msgr2=0x55768e316630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e316630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1376477370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 msgr2=0x55768e313a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e313a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.566+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1376477370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55768e234c40 con 0x55768e316d60 2024-09-10T23:46:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e314060 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005c40 tx=0x7fd4c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc514698a6b3857 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:38.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1376477370 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0020620 con 0x55768e316d60 2024-09-10T23:46:38.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1376477370 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd4c00207c0 con 0x55768e316d60 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4bc0cca70 con 0x55768e316d60 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1376477370 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4c0020a00 con 0x55768e316d60 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 10 client.16728 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55768e3250c0 con 0x55768e316d60 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1376477370 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4bc0cca70 con 0x55768e316d60 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1376477370 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4c000f040 con 0x55768e316d60 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 10 client.16728 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 20 client.16728 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e326670 0x55768e328ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 4 client.16728 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.567+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55768e27eda0 con 0x55768e326670 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.568+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e326670 0x55768e328ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.568+0000 7fd4a7fff640 10 client.16728 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:38.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.568+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e326670 0x55768e328ab0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad30bb240012a0c server_cookie=5b933f6252011e81 in_seq=0 out_seq=0 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1376477370 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55768e27eda0 con 0x55768e326670 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4a7fff640 10 client.16728 handle_command_reply: tid=0 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 client.16728 shutdown 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 msgr2=0x55768e314060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e314060 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005c40 tx=0x7fd4c0004a40 comp rx=0 tx=0).stop 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 shutdown_connections 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e326670 0x55768e328ab0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e314060 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e313a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1376477370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e316630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 >> 172.21.15.16:0/1376477370 conn(0x55768e303ed0 msgr2=0x55768e309a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4a7fff640 0 client.16728 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 shutdown_connections 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 1 -- 172.21.15.16:0/1376477370 wait complete. 2024-09-10T23:46:38.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.569+0000 7fd4d1343740 20 client.16728 trim_cache size 0 max 16384 2024-09-10T23:46:38.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 Processor -- start 2024-09-10T23:46:38.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 -- start start 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e3229c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e304eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e3053f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c81aece0 con 0x55768e3069c0 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c81ac5b0 con 0x55768e316d60 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.587+0000 7fd4d1343740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c81aa400 con 0x55768e3060a0 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e304eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e304eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36592/0 (socket says 172.21.15.16:36592) 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 -- 172.21.15.16:0/2452021151 learned_addr learned my addr 172.21.15.16:0/2452021151 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e3229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e3053f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 -- 172.21.15.16:0/2452021151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 msgr2=0x55768e3229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e3229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 -- 172.21.15.16:0/2452021151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 msgr2=0x55768e3053f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e3053f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 -- 172.21.15.16:0/2452021151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768e305930 con 0x55768e3069c0 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e3229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e3053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e304eb0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40045e0 tx=0x7fd4b4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f4cdc668137bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4b27fc640 1 -- 172.21.15.16:0/2452021151 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4003b50 con 0x55768e3069c0 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4b27fc640 1 -- 172.21.15.16:0/2452021151 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b40054d0 con 0x55768e3069c0 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.588+0000 7fd4b27fc640 1 -- 172.21.15.16:0/2452021151 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4004c70 con 0x55768e3069c0 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 -- 172.21.15.16:0/2452021151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 msgr2=0x55768e304eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e304eb0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40045e0 tx=0x7fd4b4004610 comp rx=0 tx=0).stop 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 -- 172.21.15.16:0/2452021151 shutdown_connections 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e316d60 0x55768e3053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e3069c0 0x55768e304eb0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 --2- 172.21.15.16:0/2452021151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e3229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 -- 172.21.15.16:0/2452021151 >> 172.21.15.16:0/2452021151 conn(0x55768e303ed0 msgr2=0x55768e318b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:38.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 -- 172.21.15.16:0/2452021151 shutdown_connections 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 -- 172.21.15.16:0/2452021151 wait complete. 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.589+0000 7fd4d1343740 1 -- start start 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 1 Processor -- start 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e31f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e32e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e32e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c81aaa70 con 0x55768e316d60 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c81abee0 con 0x55768e3069c0 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c81ab140 con 0x55768e3060a0 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4d1343740 10 client.0 _ll_register_callbacks cb 0x7fd4c0009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4cd50b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e32e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4cd50b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e32e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36598/0 (socket says 172.21.15.16:36598) 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1065820589 learned_addr learned my addr 172.21.15.16:0/1065820589 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e32e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e31f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 msgr2=0x55768e31f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.590+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e31f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1065820589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 msgr2=0x55768e32e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e32e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4cd50b640 1 -- 172.21.15.16:0/1065820589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55768e392580 con 0x55768e316d60 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4c7fff640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e32e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4cd50b640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e32e7e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00098b0 tx=0x7fd4c0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e89527538e467da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1065820589 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c001fc10 con 0x55768e316d60 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1065820589 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fd4c0020420 con 0x55768e316d60 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4b40054d0 con 0x55768e316d60 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1065820589 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4c001fe80 con 0x55768e316d60 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4d1343740 10 client.16734 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55768e393700 con 0x55768e316d60 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1065820589 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b40054d0 con 0x55768e316d60 2024-09-10T23:46:38.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.591+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1065820589 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4c0038030 con 0x55768e316d60 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4d1343740 10 client.16734 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4d1343740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4d1343740 20 client.16734 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e393f00 0x55768e396320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4d1343740 4 client.16734 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55768e27a850 con 0x55768e393f00 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e393f00 0x55768e396320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4ccd0a640 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e393f00 0x55768e396320 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4902889d6a4b1a server_cookie=947199e58a9950a6 in_seq=0 out_seq=0 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.592+0000 7fd4a7fff640 10 client.16734 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4a7fff640 1 -- 172.21.15.16:0/1065820589 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x55768e27a850 con 0x55768e393f00 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4a7fff640 10 client.16734 handle_command_reply: tid=0 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 client.16734 shutdown 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 msgr2=0x55768e32e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e32e7e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00098b0 tx=0x7fd4c0011a30 comp rx=0 tx=0).stop 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 shutdown_connections 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55768e393f00 0x55768e396320 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55768e316d60 0x55768e32e7e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4a7fff640 0 client.16734 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55768e3069c0 0x55768e32e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 --2- 172.21.15.16:0/1065820589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55768e3060a0 0x55768e31f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 >> 172.21.15.16:0/1065820589 conn(0x55768e303ed0 msgr2=0x55768e318b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 shutdown_connections 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 1 -- 172.21.15.16:0/1065820589 wait complete. 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.593+0000 7fd4d1343740 20 client.16734 trim_cache size 0 max 16384 2024-09-10T23:46:38.604 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:46:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:46:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:38.613 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:46:38.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4b80b54d0 msgr2=0x7fd4b80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4b80b54d0 0x7fd4b80b7990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0005fd0 tx=0x7fd4c0009600 comp rx=0 tx=0).stop 2024-09-10T23:46:38.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 msgr2=0x7fd4c81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:38.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81992a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc005940 tx=0x7fd4bc0042f0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 shutdown_connections 2024-09-10T23:46:38.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4c8109150 0x7fd4c819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd4b80b54d0 0x7fd4b80b7990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c81087d0 0x7fd4c81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 --2- 172.21.15.16:0/1998436025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c8102dc0 0x7fd4c81992a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:38.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 >> 172.21.15.16:0/1998436025 conn(0x7fd4c80fe830 msgr2=0x7fd4c8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:38.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 shutdown_connections 2024-09-10T23:46:38.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:38.594+0000 7fd4cef6e640 1 -- 172.21.15.16:0/1998436025 wait complete. 2024-09-10T23:46:38.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:38 smithi071 ceph-mon[35018]: pgmap v512: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:38 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:46:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:38 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:38 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:46:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:38 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:38.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:38 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:46:39.286 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:46:39.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:46:39.546 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:40.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/3518013059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4104550 msgr2=0x7f3cc410cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:40.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/3518013059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4104550 0x7f3cc410cb30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009900 tx=0x7f3cb802a410 comp rx=0 tx=0).stop 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/3518013059 shutdown_connections 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/3518013059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cc410d100 0x7f3cc410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/3518013059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4104550 0x7f3cc410cb30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/3518013059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cc4103b50 0x7f3cc4103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/3518013059 >> 172.21.15.16:0/3518013059 conn(0x7f3cc40fd700 msgr2=0x7f3cc40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/3518013059 shutdown_connections 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/3518013059 wait complete. 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.072+0000 7f3cc9e1f640 1 Processor -- start 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc9e1f640 1 -- start start 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc9e1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4103b50 0x7f3cc4199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc9e1f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cc4104550 0x7f3cc4199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc9e1f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cc410d100 0x7f3cc419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc9e1f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4112d60 con 0x7f3cc4103b50 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc9e1f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4112be0 con 0x7f3cc4104550 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc9e1f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4112ee0 con 0x7f3cc410d100 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4103b50 0x7f3cc4199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4103b50 0x7f3cc4199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36610/0 (socket says 172.21.15.16:36610) 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 -- 172.21.15.16:0/1332236364 learned_addr learned my addr 172.21.15.16:0/1332236364 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc2ffd640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cc4104550 0x7f3cc4199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc3fff640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cc410d100 0x7f3cc419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 -- 172.21.15.16:0/1332236364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cc410d100 msgr2=0x7f3cc419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cc410d100 0x7f3cc419eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 -- 172.21.15.16:0/1332236364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cc4104550 msgr2=0x7f3cc4199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cc4104550 0x7f3cc4199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 -- 172.21.15.16:0/1332236364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc419f2c0 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.073+0000 7f3cc37fe640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4103b50 0x7f3cc4199210 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c920 tx=0x7f3cb400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.074+0000 7f3cc0ff9640 1 -- 172.21.15.16:0/1332236364 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4007c70 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.074+0000 7f3cc0ff9640 1 -- 172.21.15.16:0/1332236364 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cb4007e10 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.074+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc419f5b0 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.074+0000 7f3cc0ff9640 1 -- 172.21.15.16:0/1332236364 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4018820 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.074+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc41a5c70 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.075+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc4103f30 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.076+0000 7f3cc0ff9640 1 -- 172.21.15.16:0/1332236364 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3cb400f450 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.077+0000 7f3cc0ff9640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3cac0b5450 0x7f3cac0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.077+0000 7f3cc2ffd640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3cac0b5450 0x7f3cac0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.077+0000 7f3cc0ff9640 1 -- 172.21.15.16:0/1332236364 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f3cb40e6090 con 0x7f3cc4103b50 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.078+0000 7f3cc2ffd640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3cac0b5450 0x7f3cac0b7910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8031440 tx=0x7f3cb8005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.081+0000 7f3cc0ff9640 1 -- 172.21.15.16:0/1332236364 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3cb4014030 con 0x7f3cc4103b50 2024-09-10T23:46:40.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.306+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cc41a6010 con 0x7f3cc4103b50 2024-09-10T23:46:40.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.307+0000 7f3cc0ff9640 1 -- 172.21.15.16:0/1332236364 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f3cb40acc70 con 0x7f3cc4103b50 2024-09-10T23:46:40.308 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:46:40.308 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:46:40.309 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:46:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3cac0b5450 msgr2=0x7f3cac0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3cac0b5450 0x7f3cac0b7910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8031440 tx=0x7f3cb8005b50 comp rx=0 tx=0).stop 2024-09-10T23:46:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4103b50 msgr2=0x7f3cc4199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4103b50 0x7f3cc4199210 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c920 tx=0x7f3cb400cde0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 shutdown_connections 2024-09-10T23:46:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cc410d100 0x7f3cc419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f3cac0b5450 0x7f3cac0b7910 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cc4104550 0x7f3cc4199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 --2- 172.21.15.16:0/1332236364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cc4103b50 0x7f3cc4199210 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 >> 172.21.15.16:0/1332236364 conn(0x7f3cc40fd700 msgr2=0x7f3cc40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 shutdown_connections 2024-09-10T23:46:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:40.309+0000 7f3cc9e1f640 1 -- 172.21.15.16:0/1332236364 wait complete. 2024-09-10T23:46:40.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:40 smithi066 ceph-mon[34761]: pgmap v513: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-10T23:46:40.587 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:40 smithi016 ceph-mon[30855]: pgmap v513: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-10T23:46:40.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:40 smithi071 ceph-mon[35018]: pgmap v513: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-10T23:46:40.927 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:46:41.185 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:41.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:41 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1332236364' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:41.584 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:41 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1332236364' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.666+0000 7fecce3b7640 1 -- 172.21.15.16:0/884290744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 msgr2=0x7fecc810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.666+0000 7fecce3b7640 1 --2- 172.21.15.16:0/884290744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc810f560 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009900 tx=0x7fecb802a410 comp rx=0 tx=0).stop 2024-09-10T23:46:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.666+0000 7fecce3b7640 1 -- 172.21.15.16:0/884290744 shutdown_connections 2024-09-10T23:46:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.666+0000 7fecce3b7640 1 --2- 172.21.15.16:0/884290744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc810f560 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.666+0000 7fecce3b7640 1 --2- 172.21.15.16:0/884290744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc81045c0 0x7fecc810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.666+0000 7fecce3b7640 1 --2- 172.21.15.16:0/884290744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecc8103ca0 0x7fecc8104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.666+0000 7fecce3b7640 1 -- 172.21.15.16:0/884290744 >> 172.21.15.16:0/884290744 conn(0x7fecc80fd700 msgr2=0x7fecc80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.667+0000 7fecce3b7640 1 -- 172.21.15.16:0/884290744 shutdown_connections 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.667+0000 7fecce3b7640 1 -- 172.21.15.16:0/884290744 wait complete. 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.667+0000 7fecce3b7640 1 Processor -- start 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.667+0000 7fecce3b7640 1 -- start start 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecce3b7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecc8103ca0 0x7fecc81992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecce3b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc81045c0 0x7fecc8199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecce3b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecce3b7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8112e20 con 0x7fecc810d100 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecce3b7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8112ca0 con 0x7fecc81045c0 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecce3b7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8112fa0 con 0x7fecc8103ca0 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc819ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36618/0 (socket says 172.21.15.16:36618) 2024-09-10T23:46:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 -- 172.21.15.16:0/3687877319 learned_addr learned my addr 172.21.15.16:0/3687877319 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecc8103ca0 0x7fecc81992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 -- 172.21.15.16:0/3687877319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecc8103ca0 msgr2=0x7fecc81992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecc8103ca0 0x7fecc81992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 -- 172.21.15.16:0/3687877319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc81045c0 msgr2=0x7fecc8199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc81045c0 0x7fecc8199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc81045c0 0x7fecc8199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7feccc954640 1 -- 172.21.15.16:0/3687877319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc819f380 con 0x7fecc810d100 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.668+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecc8103ca0 0x7fecc81992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.669+0000 7feccc954640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc819ebb0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fecb802a930 tx=0x7fecb8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.669+0000 7fecc57fa640 1 -- 172.21.15.16:0/3687877319 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb803f070 con 0x7fecc810d100 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.669+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc819f610 con 0x7fecc810d100 2024-09-10T23:46:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.669+0000 7fecc57fa640 1 -- 172.21.15.16:0/3687877319 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecb8031d60 con 0x7fecc810d100 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.669+0000 7fecc57fa640 1 -- 172.21.15.16:0/3687877319 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8035030 con 0x7fecc810d100 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.669+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc81a5d30 con 0x7fecc810d100 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.671+0000 7fecd078c740 1 Processor -- start 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.671+0000 7fecc57fa640 1 -- 172.21.15.16:0/3687877319 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fecb803b4f0 con 0x7fecc810d100 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecd078c740 1 -- start start 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecd078c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecd078c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecd078c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b20d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecd078c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bfb4a88ea0 con 0x55bfb4b12a10 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecd078c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bfb4a782d0 con 0x55bfb4b1e9a0 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecd078c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bfb4a7c0e0 con 0x55bfb4b120f0 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36620/0 (socket says 172.21.15.16:36620) 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 -- 172.21.15.16:0/3774064221 learned_addr learned my addr 172.21.15.16:0/3774064221 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b20d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc57fa640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fecb00b5450 0x7fecb00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 -- 172.21.15.16:0/3774064221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 msgr2=0x55bfb4b124d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b124d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 -- 172.21.15.16:0/3774064221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 msgr2=0x55bfb4b20d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b20d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.672+0000 7fecc7fff640 1 -- 172.21.15.16:0/3774064221 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfb47d6650 con 0x55bfb4b12a10 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.673+0000 7feccc954640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fecb00b5450 0x7fecb00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.673+0000 7fecc57fa640 1 -- 172.21.15.16:0/3687877319 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fecb8106bf0 con 0x7fecc810d100 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.673+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1e460 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fecc000f460 tx=0x7fecc000f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46c52a2959cd753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.673+0000 7fecae7fc640 1 -- 172.21.15.16:0/3774064221 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0004d20 con 0x55bfb4b12a10 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.673+0000 7fecae7fc640 1 -- 172.21.15.16:0/3774064221 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc00119b0 con 0x55bfb4b12a10 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.673+0000 7fecae7fc640 1 -- 172.21.15.16:0/3774064221 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00054e0 con 0x55bfb4b12a10 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 -- 172.21.15.16:0/3774064221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 msgr2=0x55bfb4b1e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1e460 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fecc000f460 tx=0x7fecc000f920 comp rx=0 tx=0).stop 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7feccc954640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fecb00b5450 0x7fecb00b7910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecb8104450 tx=0x7fecb8104040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 -- 172.21.15.16:0/3774064221 shutdown_connections 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b20d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1e460 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 --2- 172.21.15.16:0/3774064221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b124d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 -- 172.21.15.16:0/3774064221 >> 172.21.15.16:0/3774064221 conn(0x55bfb4b0ff20 msgr2=0x55bfb4b110c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 -- 172.21.15.16:0/3774064221 shutdown_connections 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 -- 172.21.15.16:0/3774064221 wait complete. 2024-09-10T23:46:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 -- start start 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.674+0000 7fecd078c740 1 Processor -- start 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b1e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b1bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bfb48d9700 con 0x55bfb4b12a10 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bfb4a13160 con 0x55bfb4b1e9a0 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bfb4b21620 con 0x55bfb4b120f0 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 10 client.0 _ll_register_callbacks cb 0x55bfb4a2c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36630/0 (socket says 172.21.15.16:36630) 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 -- 172.21.15.16:0/3063677754 learned_addr learned my addr 172.21.15.16:0/3063677754 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b1e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b1bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 -- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 msgr2=0x55bfb4b1e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b1e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 -- 172.21.15.16:0/3063677754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 msgr2=0x55bfb4b1bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b1bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 -- 172.21.15.16:0/3063677754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfb4a40c90 con 0x55bfb4b12a10 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1b6d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005100 tx=0x7fecc0011730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38786c2df22b8c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7feca77fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7feca77fe640 1 -- 172.21.15.16:0/3063677754 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0029060 con 0x55bfb4b12a10 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc00119b0 con 0x55bfb4b12a10 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.675+0000 7feca77fe640 1 -- 172.21.15.16:0/3063677754 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fecc0011d70 con 0x55bfb4b12a10 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7feca77fe640 1 -- 172.21.15.16:0/3063677754 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fecc0004a00 con 0x55bfb4b12a10 2024-09-10T23:46:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 10 client.16752 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfb4b2cfa0 con 0x55bfb4b12a10 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7feca77fe640 1 -- 172.21.15.16:0/3063677754 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc00119b0 con 0x55bfb4b12a10 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7feca77fe640 1 -- 172.21.15.16:0/3063677754 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fecc00052d0 con 0x55bfb4b12a10 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 10 client.16752 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 10 client.16752 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 20 client.16752 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b2e3a0 0x55bfb4b30790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 4 client.16752 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.676+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfb4a8adf0 con 0x55bfb4b2e3a0 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.677+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b2e3a0 0x55bfb4b30790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.677+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b2e3a0 0x55bfb4b30790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=99be78fde8fb5cab server_cookie=a91627e736d808f in_seq=0 out_seq=0 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.677+0000 7feca77fe640 10 client.16752 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7feca77fe640 1 -- 172.21.15.16:0/3063677754 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfb4a8adf0 con 0x55bfb4b2e3a0 2024-09-10T23:46:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7feca77fe640 10 client.16752 handle_command_reply: tid=0 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 client.16752 shutdown 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 msgr2=0x55bfb4b1b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1b6d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005100 tx=0x7fecc0011730 comp rx=0 tx=0).stop 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 shutdown_connections 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b2e3a0 0x55bfb4b30790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b1bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1b6d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7feca77fe640 0 client.16752 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 --2- 172.21.15.16:0/3063677754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b1e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 >> 172.21.15.16:0/3063677754 conn(0x55bfb4b0ff20 msgr2=0x55bfb4b15ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 shutdown_connections 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 1 -- 172.21.15.16:0/3063677754 wait complete. 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.678+0000 7fecd078c740 20 client.16752 trim_cache size 0 max 16384 2024-09-10T23:46:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.691+0000 7fecd078c740 1 Processor -- start 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecd078c740 1 -- start start 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecd078c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b0f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecd078c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecd078c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecd078c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecc81b0e40 con 0x55bfb4b12a10 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecd078c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fecc81ae710 con 0x55bfb4b1e9a0 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecd078c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecc81ac560 con 0x55bfb4b120f0 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36632/0 (socket says 172.21.15.16:36632) 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 -- 172.21.15.16:0/2841637540 learned_addr learned my addr 172.21.15.16:0/2841637540 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc77fe640 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b0f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 -- 172.21.15.16:0/2841637540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 msgr2=0x55bfb4b0f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b0f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 -- 172.21.15.16:0/2841637540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 msgr2=0x55bfb4b202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 -- 172.21.15.16:0/2841637540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfb4b19c10 con 0x55bfb4b12a10 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc77fe640 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b0f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecc7fff640 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1fd90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005840 tx=0x7fecc00098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63abe889c7b142ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.692+0000 7fecadffb640 1 -- 172.21.15.16:0/2841637540 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0029070 con 0x55bfb4b12a10 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecadffb640 1 -- 172.21.15.16:0/2841637540 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc00117a0 con 0x55bfb4b12a10 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecadffb640 1 -- 172.21.15.16:0/2841637540 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0003bd0 con 0x55bfb4b12a10 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 -- 172.21.15.16:0/2841637540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 msgr2=0x55bfb4b1fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1fd90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fecc0005840 tx=0x7fecc00098c0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 -- 172.21.15.16:0/2841637540 shutdown_connections 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b12a10 0x55bfb4b1fd90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 --2- 172.21.15.16:0/2841637540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b120f0 0x55bfb4b0f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 -- 172.21.15.16:0/2841637540 >> 172.21.15.16:0/2841637540 conn(0x55bfb4b0ff20 msgr2=0x55bfb4b19f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 -- 172.21.15.16:0/2841637540 shutdown_connections 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 -- 172.21.15.16:0/2841637540 wait complete. 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.693+0000 7fecd078c740 1 -- start start 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 1 Processor -- start 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b120f0 0x55bfb4b26af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b12a10 0x55bfb4b27050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b17930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecc81acbd0 con 0x55bfb4b120f0 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fecc81ae040 con 0x55bfb4b12a10 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fecc81ad2a0 con 0x55bfb4b1e9a0 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecd078c740 10 client.0 _ll_register_callbacks cb 0x7fecc0015050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b120f0 0x55bfb4b26af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b120f0 0x55bfb4b26af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36638/0 (socket says 172.21.15.16:36638) 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 -- 172.21.15.16:0/3616285939 learned_addr learned my addr 172.21.15.16:0/3616285939 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b17930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b12a10 0x55bfb4b27050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 -- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b1e9a0 msgr2=0x55bfb4b17930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b17930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 -- 172.21.15.16:0/3616285939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b12a10 msgr2=0x55bfb4b27050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b12a10 0x55bfb4b27050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.694+0000 7fecc77fe640 1 -- 172.21.15.16:0/3616285939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfb4b180c0 con 0x55bfb4b120f0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecc77fe640 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b120f0 0x55bfb4b26af0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00cfd0 tx=0x7fecbc006bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f3b10ce20c42e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7feca77fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7feca77fe640 1 -- 172.21.15.16:0/3616285939 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00f040 con 0x55bfb4b120f0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7feca77fe640 1 -- 172.21.15.16:0/3616285939 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fecbc0176b0 con 0x55bfb4b120f0 2024-09-10T23:46:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc00117a0 con 0x55bfb4b120f0 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7feca77fe640 1 -- 172.21.15.16:0/3616285939 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fecbc031050 con 0x55bfb4b120f0 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 10 client.16758 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfb4b19390 con 0x55bfb4b120f0 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7feca77fe640 1 -- 172.21.15.16:0/3616285939 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecc00117a0 con 0x55bfb4b120f0 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7feca77fe640 1 -- 172.21.15.16:0/3616285939 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fecbc015040 con 0x55bfb4b120f0 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 10 client.16758 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 10 client.16758 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 20 client.16758 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b9c150 0x55bfb4b9e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 4 client.16758 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.695+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bfb4a868a0 con 0x55bfb4b9c150 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.696+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b9c150 0x55bfb4b9e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.696+0000 7feca77fe640 10 client.16758 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.696+0000 7fecc7fff640 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b9c150 0x55bfb4b9e570 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b7640f3d36dfd21 server_cookie=f42f059f257bc991 in_seq=0 out_seq=0 2024-09-10T23:46:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.696+0000 7feca77fe640 1 -- 172.21.15.16:0/3616285939 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bfb4a868a0 con 0x55bfb4b9c150 2024-09-10T23:46:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.696+0000 7feca77fe640 10 client.16758 handle_command_reply: tid=0 2024-09-10T23:46:41.725 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.696+0000 7fecd078c740 1 client.16758 shutdown 2024-09-10T23:46:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b120f0 msgr2=0x55bfb4b26af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b120f0 0x55bfb4b26af0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00cfd0 tx=0x7fecbc006bc0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 shutdown_connections 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bfb4b9c150 0x55bfb4b9e570 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bfb4b1e9a0 0x55bfb4b17930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bfb4b12a10 0x55bfb4b27050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 --2- 172.21.15.16:0/3616285939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb4b120f0 0x55bfb4b26af0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7feca77fe640 0 client.16758 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 >> 172.21.15.16:0/3616285939 conn(0x55bfb4b0ff20 msgr2=0x55bfb4b1cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 shutdown_connections 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 1 -- 172.21.15.16:0/3616285939 wait complete. 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecd078c740 20 client.16758 trim_cache size 0 max 16384 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fecb00b5450 msgr2=0x7fecb00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fecb00b5450 0x7fecb00b7910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecb8104450 tx=0x7fecb8104040 comp rx=0 tx=0).stop 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 msgr2=0x7fecc819ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc819ebb0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fecb802a930 tx=0x7fecb8003cd0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 shutdown_connections 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc810d100 0x7fecc819ebb0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fecb00b5450 0x7fecb00b7910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc81045c0 0x7fecc8199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 --2- 172.21.15.16:0/3687877319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecc8103ca0 0x7fecc81992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 >> 172.21.15.16:0/3687877319 conn(0x7fecc80fd700 msgr2=0x7fecc810f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 shutdown_connections 2024-09-10T23:46:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:41.697+0000 7fecce3b7640 1 -- 172.21.15.16:0/3687877319 wait complete. 2024-09-10T23:46:41.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:41 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1332236364' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:46:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:42 smithi016 ceph-mon[30855]: pgmap v514: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:42.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:42 smithi066 ceph-mon[34761]: pgmap v514: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:42.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:46:42.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:42 smithi071 ceph-mon[35018]: pgmap v514: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:42.827 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:43.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.303+0000 7f87cf37c640 1 -- 172.21.15.16:0/1190550543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 msgr2=0x7f87c8111770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.303+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1190550543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c8111770 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009ca0 tx=0x7f87c002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 -- 172.21.15.16:0/1190550543 shutdown_connections 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1190550543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c8111770 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1190550543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c8102130 0x7f87c810ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1190550543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8101810 0x7f87c8101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 -- 172.21.15.16:0/1190550543 >> 172.21.15.16:0/1190550543 conn(0x7f87c8076f50 msgr2=0x7f87c8077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 -- 172.21.15.16:0/1190550543 shutdown_connections 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 -- 172.21.15.16:0/1190550543 wait complete. 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 Processor -- start 2024-09-10T23:46:43.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 -- start start 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8101810 0x7f87c819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c8102130 0x7f87c819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.304+0000 7f87cf37c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c81a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cf37c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8114f40 con 0x7f87c810f2f0 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cf37c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8114dc0 con 0x7f87c8101810 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cf37c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81150c0 con 0x7f87c8102130 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c81a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c81a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36646/0 (socket says 172.21.15.16:36646) 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 -- 172.21.15.16:0/1563654801 learned_addr learned my addr 172.21.15.16:0/1563654801 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd118640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8101810 0x7f87c819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cc917640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c8102130 0x7f87c819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 -- 172.21.15.16:0/1563654801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c8102130 msgr2=0x7f87c819b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c8102130 0x7f87c819b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 -- 172.21.15.16:0/1563654801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8101810 msgr2=0x7f87c819b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8101810 0x7f87c819b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 -- 172.21.15.16:0/1563654801 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c81a14c0 con 0x7f87c810f2f0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cd919640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c81a0cf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f87c00098d0 tx=0x7f87c00317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87be7fc640 1 -- 172.21.15.16:0/1563654801 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c0003b70 con 0x7f87c810f2f0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87be7fc640 1 -- 172.21.15.16:0/1563654801 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87c0003d10 con 0x7f87c810f2f0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c81a1750 con 0x7f87c810f2f0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.305+0000 7f87be7fc640 1 -- 172.21.15.16:0/1563654801 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c002fa20 con 0x7f87c810f2f0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.306+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c81a7e70 con 0x7f87c810f2f0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 Processor -- start 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87be7fc640 1 -- 172.21.15.16:0/1563654801 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f87c002fc40 con 0x7f87c810f2f0 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 -- start start 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c2c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bb00b96ea0 con 0x55bb00c20a10 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bb00b862d0 con 0x55bb00c200f0 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87d1751740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bb00b8a0e0 con 0x55bb00c2c9a0 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87cd118640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c2c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87cd118640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c2c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36658/0 (socket says 172.21.15.16:36658) 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87cd118640 1 -- 172.21.15.16:0/959239682 learned_addr learned my addr 172.21.15.16:0/959239682 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.309+0000 7f87cc917640 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cc917640 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cd118640 1 -- 172.21.15.16:0/959239682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 msgr2=0x55bb00c2ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cd118640 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cd118640 1 -- 172.21.15.16:0/959239682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 msgr2=0x55bb00c204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cd118640 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cd118640 1 -- 172.21.15.16:0/959239682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb008e4650 con 0x55bb00c20a10 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87be7fc640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87b40b5450 0x7f87b40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cd118640 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c2c460 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f87c400bd10 tx=0x7f87c40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1e0a4f8a0f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87cc917640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87b40b5450 0x7f87b40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87be7fc640 1 -- 172.21.15.16:0/1563654801 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f87c0107250 con 0x7f87c810f2f0 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87b37fe640 1 -- 172.21.15.16:0/959239682 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c4004030 con 0x55bb00c20a10 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87b37fe640 1 -- 172.21.15.16:0/959239682 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87c40035f0 con 0x55bb00c20a10 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.310+0000 7f87b37fe640 1 -- 172.21.15.16:0/959239682 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c4011770 con 0x55bb00c20a10 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 -- 172.21.15.16:0/959239682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 msgr2=0x55bb00c2c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87cc917640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87b40b5450 0x7f87b40b7910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009730 tx=0x7f87b8013040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c2c460 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f87c400bd10 tx=0x7f87c40107a0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 -- 172.21.15.16:0/959239682 shutdown_connections 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c2c460 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 --2- 172.21.15.16:0/959239682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 -- 172.21.15.16:0/959239682 >> 172.21.15.16:0/959239682 conn(0x55bb00c1df20 msgr2=0x55bb00c1f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:43.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 -- 172.21.15.16:0/959239682 shutdown_connections 2024-09-10T23:46:43.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 -- 172.21.15.16:0/959239682 wait complete. 2024-09-10T23:46:43.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.311+0000 7f87d1751740 1 -- start start 2024-09-10T23:46:43.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 1 Processor -- start 2024-09-10T23:46:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c2c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c29690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c2c9a0 0x55bb00c29c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bb009e7700 con 0x55bb00c20a10 2024-09-10T23:46:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bb00b21160 con 0x55bb00c2c9a0 2024-09-10T23:46:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bb00c2f620 con 0x55bb00c200f0 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87d1751740 10 client.0 _ll_register_callbacks cb 0x55bb00b3a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87cc917640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c29690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87cc917640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c29690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36674/0 (socket says 172.21.15.16:36674) 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87cc917640 1 -- 172.21.15.16:0/2629090991 learned_addr learned my addr 172.21.15.16:0/2629090991 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87cd118640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c2c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.312+0000 7f87cd919640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c2c9a0 0x55bb00c29c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cc917640 1 -- 172.21.15.16:0/2629090991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 msgr2=0x55bb00c2c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cc917640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c2c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cc917640 1 -- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c2c9a0 msgr2=0x55bb00c29c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cc917640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c2c9a0 0x55bb00c29c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cc917640 1 -- 172.21.15.16:0/2629090991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb00b4ec90 con 0x55bb00c20a10 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cd919640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c2c9a0 0x55bb00c29c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cd118640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c2c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87cc917640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c29690 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f87b8003870 tx=0x7f87b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f2451a11670f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87b0ff9640 1 -- 172.21.15.16:0/2629090991 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b801d910 con 0x55bb00c20a10 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87b0ff9640 1 -- 172.21.15.16:0/2629090991 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f87b801dab0 con 0x55bb00c20a10 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87c40035f0 con 0x55bb00c20a10 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87b0ff9640 1 -- 172.21.15.16:0/2629090991 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87b8035050 con 0x55bb00c20a10 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87d1751740 10 client.16770 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bb00c3afa0 con 0x55bb00c20a10 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.313+0000 7f87b0ff9640 1 -- 172.21.15.16:0/2629090991 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87c40035f0 con 0x55bb00c20a10 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87b0ff9640 1 -- 172.21.15.16:0/2629090991 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87b80303b0 con 0x55bb00c20a10 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87d1751740 10 client.16770 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87d1751740 10 client.16770 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87d1751740 20 client.16770 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87d1751740 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00c3c500 0x55bb00c3e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87d1751740 4 client.16770 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb00b98df0 con 0x55bb00c3c500 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.314+0000 7f87cd118640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00c3c500 0x55bb00c3e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87cd118640 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00c3c500 0x55bb00c3e950 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10fe46a487a6ec22 server_cookie=3b14d30b3c04a3ba in_seq=0 out_seq=0 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87b0ff9640 10 client.16770 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87b0ff9640 1 -- 172.21.15.16:0/2629090991 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb00b98df0 con 0x55bb00c3c500 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87b0ff9640 10 client.16770 handle_command_reply: tid=0 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87d1751740 1 client.16770 shutdown 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 msgr2=0x55bb00c29690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87d1751740 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c29690 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f87b8003870 tx=0x7f87b80046c0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 shutdown_connections 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.315+0000 7f87d1751740 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00c3c500 0x55bb00c3e950 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87d1751740 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c2c9a0 0x55bb00c29c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87d1751740 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c29690 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87d1751740 1 --2- 172.21.15.16:0/2629090991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c2c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 >> 172.21.15.16:0/2629090991 conn(0x55bb00c1df20 msgr2=0x55bb00c23ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:43.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87b0ff9640 0 client.16770 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:43.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 shutdown_connections 2024-09-10T23:46:43.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87d1751740 1 -- 172.21.15.16:0/2629090991 wait complete. 2024-09-10T23:46:43.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.316+0000 7f87d1751740 20 client.16770 trim_cache size 0 max 16384 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 Processor -- start 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 -- start start 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c38880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c20a10 0x55bb00c18e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81b3040 con 0x55bb00c2c9a0 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81b0910 con 0x55bb00c20a10 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87d1751740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81ae760 con 0x55bb00c200f0 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cd919640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cd919640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36684/0 (socket says 172.21.15.16:36684) 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cd919640 1 -- 172.21.15.16:0/97446253 learned_addr learned my addr 172.21.15.16:0/97446253 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cd118640 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c38880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cd919640 1 -- 172.21.15.16:0/97446253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 msgr2=0x55bb00c38880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cc917640 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c20a10 0x55bb00c18e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cd919640 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c38880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.329+0000 7f87cd919640 1 -- 172.21.15.16:0/97446253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c20a10 msgr2=0x55bb00c18e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87cd919640 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c20a10 0x55bb00c18e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87cd919640 1 -- 172.21.15.16:0/97446253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb00c1f650 con 0x55bb00c2c9a0 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87cd118640 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c38880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87cc917640 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c20a10 0x55bb00c18e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87cd919640 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2dd90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f87c0003fd0 tx=0x7f87c002ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6e49481d651c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87b2ffd640 1 -- 172.21.15.16:0/97446253 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00ccea0 con 0x55bb00c2c9a0 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87b2ffd640 1 -- 172.21.15.16:0/97446253 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87c0036070 con 0x55bb00c2c9a0 2024-09-10T23:46:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87b2ffd640 1 -- 172.21.15.16:0/97446253 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00cdbd0 con 0x55bb00c2c9a0 2024-09-10T23:46:43.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87d1751740 1 -- 172.21.15.16:0/97446253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c2c9a0 msgr2=0x55bb00c2dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87d1751740 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2dd90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f87c0003fd0 tx=0x7f87c002ff60 comp rx=0 tx=0).stop 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87d1751740 1 -- 172.21.15.16:0/97446253 shutdown_connections 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87d1751740 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c2c9a0 0x55bb00c2dd90 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87d1751740 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c20a10 0x55bb00c18e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87d1751740 1 --2- 172.21.15.16:0/97446253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c200f0 0x55bb00c38880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.330+0000 7f87d1751740 1 -- 172.21.15.16:0/97446253 >> 172.21.15.16:0/97446253 conn(0x55bb00c1df20 msgr2=0x55bb00c24970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 -- 172.21.15.16:0/97446253 shutdown_connections 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 -- 172.21.15.16:0/97446253 wait complete. 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 -- start start 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 Processor -- start 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c35130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c43f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81aedd0 con 0x55bb00c20a10 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81b0240 con 0x55bb00c200f0 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81af4a0 con 0x55bb00c2c9a0 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87d1751740 10 client.0 _ll_register_callbacks cb 0x7f87b8004510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.331+0000 7f87cc917640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c43f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:33926/0 (socket says 172.21.15.16:33926) 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 -- 172.21.15.16:0/3520065872 learned_addr learned my addr 172.21.15.16:0/3520065872 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd118640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c35130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 -- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 msgr2=0x55bb00c35130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c35130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 -- 172.21.15.16:0/3520065872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 msgr2=0x55bb00c43f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c43f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 -- 172.21.15.16:0/3520065872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb00c44d10 con 0x55bb00c2c9a0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cc917640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c43f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd118640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c35130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87cd919640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c444e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cd430 tx=0x7f87c00c9bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89767990dc76af76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87b0ff9640 1 -- 172.21.15.16:0/3520065872 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00ccea0 con 0x55bb00c2c9a0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87c0036070 con 0x55bb00c2c9a0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87b0ff9640 1 -- 172.21.15.16:0/3520065872 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f87c00d6830 con 0x55bb00c2c9a0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87b0ff9640 1 -- 172.21.15.16:0/3520065872 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87c00cd240 con 0x55bb00c2c9a0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87d1751740 10 client.26272 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.332+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bb00ca9520 con 0x55bb00c2c9a0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87b0ff9640 1 -- 172.21.15.16:0/3520065872 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87c0036070 con 0x55bb00c2c9a0 2024-09-10T23:46:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87b0ff9640 1 -- 172.21.15.16:0/3520065872 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87c00cc990 con 0x55bb00c2c9a0 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87d1751740 10 client.26272 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87d1751740 10 client.26272 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87d1751740 20 client.26272 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87d1751740 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00ca9b90 0x55bb00cabf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87d1751740 4 client.26272 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb00b948a0 con 0x55bb00ca9b90 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.333+0000 7f87cd118640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00ca9b90 0x55bb00cabf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87cd118640 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00ca9b90 0x55bb00cabf80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=48428202ebc26e96 server_cookie=4d07316d7260a7c3 in_seq=0 out_seq=0 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87b0ff9640 10 client.26272 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87b0ff9640 1 -- 172.21.15.16:0/3520065872 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb00b948a0 con 0x55bb00ca9b90 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87b0ff9640 10 client.26272 handle_command_reply: tid=0 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 client.26272 shutdown 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 msgr2=0x55bb00c444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c444e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cd430 tx=0x7f87c00c9bb0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 shutdown_connections 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55bb00ca9b90 0x55bb00cabf80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bb00c2c9a0 0x55bb00c444e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87b0ff9640 0 client.26272 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bb00c20a10 0x55bb00c43f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 --2- 172.21.15.16:0/3520065872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb00c200f0 0x55bb00c35130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 >> 172.21.15.16:0/3520065872 conn(0x55bb00c1df20 msgr2=0x55bb00c2acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 shutdown_connections 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 1 -- 172.21.15.16:0/3520065872 wait complete. 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.334+0000 7f87d1751740 20 client.26272 trim_cache size 0 max 16384 2024-09-10T23:46:43.340 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87b40b5450 msgr2=0x7f87b40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87b40b5450 0x7f87b40b7910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009730 tx=0x7f87b8013040 comp rx=0 tx=0).stop 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 msgr2=0x7f87c81a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c81a0cf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f87c00098d0 tx=0x7f87c00317b0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 shutdown_connections 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c810f2f0 0x7f87c81a0cf0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c8102130 0x7f87c819b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87b40b5450 0x7f87b40b7910 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 --2- 172.21.15.16:0/1563654801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8101810 0x7f87c819b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:43.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 >> 172.21.15.16:0/1563654801 conn(0x7f87c8076f50 msgr2=0x7f87c810f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:43.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 shutdown_connections 2024-09-10T23:46:43.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:43.335+0000 7f87cf37c640 1 -- 172.21.15.16:0/1563654801 wait complete. 2024-09-10T23:46:44.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:46:44.392 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:44.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:44 smithi016 ceph-mon[30855]: pgmap v515: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:44.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:44 smithi066 ceph-mon[34761]: pgmap v515: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:44.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:44 smithi071 ceph-mon[35018]: pgmap v515: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.895+0000 7fa92922c640 1 -- 172.21.15.16:0/573093309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa924101cd0 msgr2=0x7fa9241020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.895+0000 7fa92922c640 1 --2- 172.21.15.16:0/573093309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa924101cd0 0x7fa9241020b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa914009900 tx=0x7fa91402a410 comp rx=0 tx=0).stop 2024-09-10T23:46:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.895+0000 7fa92922c640 1 -- 172.21.15.16:0/573093309 shutdown_connections 2024-09-10T23:46:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.895+0000 7fa92922c640 1 --2- 172.21.15.16:0/573093309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa924108060 0x7fa92410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.895+0000 7fa92922c640 1 --2- 172.21.15.16:0/573093309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9241076e0 0x7fa924107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.895+0000 7fa92922c640 1 --2- 172.21.15.16:0/573093309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa924101cd0 0x7fa9241020b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.895+0000 7fa92922c640 1 -- 172.21.15.16:0/573093309 >> 172.21.15.16:0/573093309 conn(0x7fa9240fd700 msgr2=0x7fa9240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.896+0000 7fa92922c640 1 -- 172.21.15.16:0/573093309 shutdown_connections 2024-09-10T23:46:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.896+0000 7fa92922c640 1 -- 172.21.15.16:0/573093309 wait complete. 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.896+0000 7fa92922c640 1 Processor -- start 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.896+0000 7fa92922c640 1 -- start start 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa92922c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa924101cd0 0x7fa9241992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa92922c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9241076e0 0x7fa924199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa92922c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa924108060 0x7fa92419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa92922c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa924111d70 con 0x7fa9241076e0 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa92922c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa924111bf0 con 0x7fa924101cd0 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa92922c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa924111ef0 con 0x7fa924108060 2024-09-10T23:46:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9241076e0 0x7fa924199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9241076e0 0x7fa924199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53382/0 (socket says 172.21.15.16:53382) 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 -- 172.21.15.16:0/2277799196 learned_addr learned my addr 172.21.15.16:0/2277799196 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa92359e640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa924108060 0x7fa92419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa922d9d640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa924101cd0 0x7fa9241992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 -- 172.21.15.16:0/2277799196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa924108060 msgr2=0x7fa92419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa924108060 0x7fa92419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 -- 172.21.15.16:0/2277799196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa924101cd0 msgr2=0x7fa9241992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa924101cd0 0x7fa9241992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 -- 172.21.15.16:0/2277799196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92419f390 con 0x7fa9241076e0 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa922d9d640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa924101cd0 0x7fa9241992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.897+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9241076e0 0x7fa924199820 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b4a0 tx=0x7fa90c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:44.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.898+0000 7fa920d99640 1 -- 172.21.15.16:0/2277799196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c014070 con 0x7fa9241076e0 2024-09-10T23:46:44.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.898+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92419f680 con 0x7fa9241076e0 2024-09-10T23:46:44.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.898+0000 7fa920d99640 1 -- 172.21.15.16:0/2277799196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa90c010ac0 con 0x7fa9241076e0 2024-09-10T23:46:44.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.898+0000 7fa920d99640 1 -- 172.21.15.16:0/2277799196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c017c30 con 0x7fa9241076e0 2024-09-10T23:46:44.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.898+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9241a5dc0 con 0x7fa9241076e0 2024-09-10T23:46:44.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.900+0000 7fa92b601740 1 Processor -- start 2024-09-10T23:46:44.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.900+0000 7fa920d99640 1 -- 172.21.15.16:0/2277799196 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa90c010610 con 0x7fa9241076e0 2024-09-10T23:46:44.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.900+0000 7fa92b601740 1 -- start start 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92b601740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dcb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92b601740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92b601740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dda170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92b601740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559855d41ea0 con 0x559855dd7d80 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92b601740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559855d312d0 con 0x559855dcbdf0 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92b601740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559855d350e0 con 0x559855dcb4d0 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dda170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dda170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53390/0 (socket says 172.21.15.16:53390) 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 -- 172.21.15.16:0/2784679396 learned_addr learned my addr 172.21.15.16:0/2784679396 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92359e640 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dcb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa922d9d640 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 -- 172.21.15.16:0/2784679396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 msgr2=0x559855dcb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dcb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 -- 172.21.15.16:0/2784679396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 msgr2=0x559855dd7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 -- 172.21.15.16:0/2784679396 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559855a8f650 con 0x559855dd7d80 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa92359e640 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dcb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa920d99640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa9100b5450 0x7fa9100b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.901+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dda170 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0e2f30 tx=0x7fa90c0ebcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d113d883178b05d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.902+0000 7fa92359e640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa9100b5450 0x7fa9100b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.902+0000 7fa920d99640 1 -- 172.21.15.16:0/2277799196 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa90c0e58a0 con 0x7fa9241076e0 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.902+0000 7fa9197fa640 1 -- 172.21.15.16:0/2784679396 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0a8370 con 0x559855dd7d80 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.902+0000 7fa9197fa640 1 -- 172.21.15.16:0/2784679396 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa90c017360 con 0x559855dd7d80 2024-09-10T23:46:44.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.902+0000 7fa9197fa640 1 -- 172.21.15.16:0/2784679396 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0ab490 con 0x559855dd7d80 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 -- 172.21.15.16:0/2784679396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 msgr2=0x559855dda170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92359e640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa9100b5450 0x7fa9100b7910 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa91c005fd0 tx=0x7fa91c009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dda170 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0e2f30 tx=0x7fa90c0ebcb0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 -- 172.21.15.16:0/2784679396 shutdown_connections 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dda170 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 --2- 172.21.15.16:0/2784679396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dcb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 -- 172.21.15.16:0/2784679396 >> 172.21.15.16:0/2784679396 conn(0x559855dc9300 msgr2=0x559855dca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 -- 172.21.15.16:0/2784679396 shutdown_connections 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 -- 172.21.15.16:0/2784679396 wait complete. 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 -- start start 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.903+0000 7fa92b601740 1 Processor -- start 2024-09-10T23:46:44.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92b601740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855dd7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92b601740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855dd4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92b601740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855dd5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92b601740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559855b92700 con 0x559855dcb4d0 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92b601740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559855ccc160 con 0x559855dd7d80 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92b601740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559855ddaa00 con 0x559855dcbdf0 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92b601740 10 client.0 _ll_register_callbacks cb 0x559855ce59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855dd7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855dd7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53400/0 (socket says 172.21.15.16:53400) 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 -- 172.21.15.16:0/2533188772 learned_addr learned my addr 172.21.15.16:0/2533188772 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855dd4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92359e640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855dd5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 -- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 msgr2=0x559855dd4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855dd4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 -- 172.21.15.16:0/2533188772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 msgr2=0x559855dd5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855dd5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 -- 172.21.15.16:0/2533188772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559855cf9c90 con 0x559855dcb4d0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa92359e640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855dd5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa922d9d640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855dd7710 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa914009230 tx=0x7fa9140052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d08fef41f114006 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.904+0000 7fa90a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa90a7fc640 1 -- 172.21.15.16:0/2533188772 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914035040 con 0x559855dcb4d0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa90a7fc640 1 -- 172.21.15.16:0/2533188772 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa9140048c0 con 0x559855dcb4d0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559855d43df0 con 0x559855dcb4d0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa90a7fc640 1 -- 172.21.15.16:0/2533188772 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa914004ac0 con 0x559855dcb4d0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 10 client.16788 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559855de63d0 con 0x559855dcb4d0 2024-09-10T23:46:44.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa90a7fc640 1 -- 172.21.15.16:0/2533188772 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559855d43df0 con 0x559855dcb4d0 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa90a7fc640 1 -- 172.21.15.16:0/2533188772 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa9140314a0 con 0x559855dcb4d0 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 10 client.16788 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 20 client.16788 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855de7830 0x559855de9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 4 client.16788 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.905+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559855d3f8a0 con 0x559855de7830 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.906+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855de7830 0x559855de9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.906+0000 7fa91bfff640 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855de7830 0x559855de9c80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9edc83e3c33e3a67 server_cookie=3d6d38cd25a45636 in_seq=0 out_seq=0 2024-09-10T23:46:44.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.906+0000 7fa90a7fc640 10 client.16788 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:44.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa90a7fc640 1 -- 172.21.15.16:0/2533188772 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559855d3f8a0 con 0x559855de7830 2024-09-10T23:46:44.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa90a7fc640 10 client.16788 handle_command_reply: tid=0 2024-09-10T23:46:44.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 client.16788 shutdown 2024-09-10T23:46:44.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 msgr2=0x559855dd7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855dd7710 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa914009230 tx=0x7fa9140052e0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 shutdown_connections 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855de7830 0x559855de9c80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855dd5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855dd4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa90a7fc640 0 client.16788 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 --2- 172.21.15.16:0/2533188772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855dd7710 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 >> 172.21.15.16:0/2533188772 conn(0x559855dc9300 msgr2=0x559855dceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 shutdown_connections 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 1 -- 172.21.15.16:0/2533188772 wait complete. 2024-09-10T23:46:44.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.907+0000 7fa92b601740 20 client.16788 trim_cache size 0 max 16384 2024-09-10T23:46:44.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.920+0000 7fa92b601740 1 Processor -- start 2024-09-10T23:46:44.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.920+0000 7fa92b601740 1 -- start start 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92b601740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dc8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92b601740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92b601740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dd9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92b601740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241b0f50 con 0x559855dd7d80 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92b601740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241ae820 con 0x559855dcbdf0 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92b601740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241ac670 con 0x559855dcb4d0 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dd9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dd9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53414/0 (socket says 172.21.15.16:53414) 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 -- 172.21.15.16:0/4254346790 learned_addr learned my addr 172.21.15.16:0/4254346790 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa922d9d640 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dc8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa91bfff640 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 -- 172.21.15.16:0/4254346790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 msgr2=0x559855dc8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dc8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 -- 172.21.15.16:0/4254346790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 msgr2=0x559855dd68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 -- 172.21.15.16:0/4254346790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559855dd55a0 con 0x559855dd7d80 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.921+0000 7fa92359e640 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dd9170 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009b40 tx=0x7fa91c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c919885232f881 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa918ff9640 1 -- 172.21.15.16:0/4254346790 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c01f610 con 0x559855dd7d80 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa918ff9640 1 -- 172.21.15.16:0/4254346790 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa91c01fc60 con 0x559855dd7d80 2024-09-10T23:46:44.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa918ff9640 1 -- 172.21.15.16:0/4254346790 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c01dc20 con 0x559855dd7d80 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 -- 172.21.15.16:0/4254346790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 msgr2=0x559855dd9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dd9170 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009b40 tx=0x7fa91c016000 comp rx=0 tx=0).stop 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 -- 172.21.15.16:0/4254346790 shutdown_connections 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dd7d80 0x559855dd9170 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dcbdf0 0x559855dd68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 --2- 172.21.15.16:0/4254346790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcb4d0 0x559855dc8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 -- 172.21.15.16:0/4254346790 >> 172.21.15.16:0/4254346790 conn(0x559855dc9300 msgr2=0x559855dd6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:44.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 -- 172.21.15.16:0/4254346790 shutdown_connections 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.922+0000 7fa92b601740 1 -- 172.21.15.16:0/4254346790 wait complete. 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 -- start start 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 Processor -- start 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855ddfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855de01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855ddac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241acce0 con 0x559855dcb4d0 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241ae150 con 0x559855dd7d80 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241ad3b0 con 0x559855dcbdf0 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92b601740 10 client.0 _ll_register_callbacks cb 0x7fa914004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa922d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855ddfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa922d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855ddfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53418/0 (socket says 172.21.15.16:53418) 2024-09-10T23:46:44.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa922d9d640 1 -- 172.21.15.16:0/3094932860 learned_addr learned my addr 172.21.15.16:0/3094932860 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa92359e640 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855ddac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.923+0000 7fa91bfff640 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855de01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa922d9d640 1 -- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 msgr2=0x559855de01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa922d9d640 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855de01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa922d9d640 1 -- 172.21.15.16:0/3094932860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 msgr2=0x559855ddac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa922d9d640 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855ddac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa922d9d640 1 -- 172.21.15.16:0/3094932860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559855ddb190 con 0x559855dcb4d0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa922d9d640 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855ddfca0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa91402a930 tx=0x7fa9140316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740c3e4a4f6be051 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa90a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa90a7fc640 1 -- 172.21.15.16:0/3094932860 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914035070 con 0x559855dcb4d0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa90a7fc640 1 -- 172.21.15.16:0/3094932860 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7fa914031c40 con 0x559855dcb4d0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa91c01fc60 con 0x559855dcb4d0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa90a7fc640 1 -- 172.21.15.16:0/3094932860 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa91405e050 con 0x559855dcb4d0 2024-09-10T23:46:44.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa92b601740 10 client.16794 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559855e54f10 con 0x559855dcb4d0 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.924+0000 7fa90a7fc640 1 -- 172.21.15.16:0/3094932860 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa91c01fc60 con 0x559855dcb4d0 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa90a7fc640 1 -- 172.21.15.16:0/3094932860 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa914045470 con 0x559855dcb4d0 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa92b601740 10 client.16794 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa92b601740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa92b601740 20 client.16794 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa92b601740 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855e55680 0x559855e57a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa92b601740 4 client.16794 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559855d3ccd0 con 0x559855e55680 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa91bfff640 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855e55680 0x559855e57a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa91bfff640 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855e55680 0x559855e57a70 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0cfee8f83312689 server_cookie=1f52d86a72b17011 in_seq=0 out_seq=0 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.925+0000 7fa90a7fc640 10 client.16794 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa90a7fc640 1 -- 172.21.15.16:0/3094932860 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559855d3ccd0 con 0x559855e55680 2024-09-10T23:46:44.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa90a7fc640 10 client.16794 handle_command_reply: tid=0 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 client.16794 shutdown 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 msgr2=0x559855ddfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855ddfca0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa91402a930 tx=0x7fa9140316b0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 shutdown_connections 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559855e55680 0x559855e57a70 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559855dd7d80 0x559855ddac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559855dcbdf0 0x559855de01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 --2- 172.21.15.16:0/3094932860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559855dcb4d0 0x559855ddfca0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 >> 172.21.15.16:0/3094932860 conn(0x559855dc9300 msgr2=0x559855dd69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa90a7fc640 0 client.16794 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 shutdown_connections 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 1 -- 172.21.15.16:0/3094932860 wait complete. 2024-09-10T23:46:44.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.926+0000 7fa92b601740 20 client.16794 trim_cache size 0 max 16384 2024-09-10T23:46:44.933 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa9100b5450 msgr2=0x7fa9100b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa9100b5450 0x7fa9100b7910 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa91c005fd0 tx=0x7fa91c009600 comp rx=0 tx=0).stop 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9241076e0 msgr2=0x7fa924199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9241076e0 0x7fa924199820 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b4a0 tx=0x7fa90c00b960 comp rx=0 tx=0).stop 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 shutdown_connections 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa924108060 0x7fa92419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9241076e0 0x7fa924199820 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa9100b5450 0x7fa9100b7910 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 --2- 172.21.15.16:0/2277799196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa924101cd0 0x7fa9241992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 >> 172.21.15.16:0/2277799196 conn(0x7fa9240fd700 msgr2=0x7fa92406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:44.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 shutdown_connections 2024-09-10T23:46:44.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:44.927+0000 7fa92922c640 1 -- 172.21.15.16:0/2277799196 wait complete. 2024-09-10T23:46:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:46 smithi016 ceph-mon[30855]: pgmap v516: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:46 smithi066 ceph-mon[34761]: pgmap v516: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:46.700 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:46:46.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:46:46.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:46 smithi071 ceph-mon[35018]: pgmap v516: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:46.961 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.593+0000 7f2f55d8e640 1 -- 172.21.15.16:0/813998647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 msgr2=0x7f2f50107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.593+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/813998647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f50107ae0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009900 tx=0x7f2f4402a410 comp rx=0 tx=0).stop 2024-09-10T23:46:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 -- 172.21.15.16:0/813998647 shutdown_connections 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/813998647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f50108020 0x7f2f5010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/813998647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f50107ae0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/813998647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f50101c90 0x7f2f50102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 -- 172.21.15.16:0/813998647 >> 172.21.15.16:0/813998647 conn(0x7f2f500fd700 msgr2=0x7f2f500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 -- 172.21.15.16:0/813998647 shutdown_connections 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 -- 172.21.15.16:0/813998647 wait complete. 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 Processor -- start 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.594+0000 7f2f55d8e640 1 -- start start 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f55d8e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f50101c90 0x7f2f5019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f55d8e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f5019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f55d8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f50108020 0x7f2f5019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f55d8e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2f50111ce0 con 0x7f2f501076a0 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f55d8e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2f50111b60 con 0x7f2f50101c90 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f55d8e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f50111e60 con 0x7f2f50108020 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f5019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f5019a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53426/0 (socket says 172.21.15.16:53426) 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 -- 172.21.15.16:0/2956446957 learned_addr learned my addr 172.21.15.16:0/2956446957 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f50108020 0x7f2f5019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f50101c90 0x7f2f5019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 -- 172.21.15.16:0/2956446957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f50108020 msgr2=0x7f2f5019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f50108020 0x7f2f5019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 -- 172.21.15.16:0/2956446957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f50101c90 msgr2=0x7f2f5019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f50101c90 0x7f2f5019a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.595+0000 7f2f4effd640 1 -- 172.21.15.16:0/2956446957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f501a5410 con 0x7f2f501076a0 2024-09-10T23:46:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.596+0000 7f2f4effd640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f5019a570 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2f44006010 tx=0x7f2f440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.596+0000 7f2f4cff9640 1 -- 172.21.15.16:0/2956446957 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4403f030 con 0x7f2f501076a0 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.596+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f501a56a0 con 0x7f2f501076a0 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.596+0000 7f2f4cff9640 1 -- 172.21.15.16:0/2956446957 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f44003800 con 0x7f2f501076a0 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.596+0000 7f2f4cff9640 1 -- 172.21.15.16:0/2956446957 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44035070 con 0x7f2f501076a0 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.596+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f501a5bd0 con 0x7f2f501076a0 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 Processor -- start 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 -- start start 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560d2ee0 0x564e560d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560df250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560df790 0x564e560e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564e56049e60 con 0x564e560d3800 2024-09-10T23:46:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e56039290 con 0x564e560d2ee0 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f4cff9640 1 -- 172.21.15.16:0/2956446957 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f2f44031b10 con 0x7f2f501076a0 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.599+0000 7f2f58163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564e5603d0a0 con 0x564e560df790 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560df250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560df250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53428/0 (socket says 172.21.15.16:53428) 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 -- 172.21.15.16:0/3376924465 learned_addr learned my addr 172.21.15.16:0/3376924465 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560d2ee0 0x564e560d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4effd640 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560df790 0x564e560e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 -- 172.21.15.16:0/3376924465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560df790 msgr2=0x564e560e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560df790 0x564e560e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 -- 172.21.15.16:0/3376924465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560d2ee0 msgr2=0x564e560d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560d2ee0 0x564e560d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 -- 172.21.15.16:0/3376924465 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e55d97930 con 0x564e560d3800 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4effd640 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560df790 0x564e560e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560d2ee0 0x564e560d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560df250 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000ac50 tx=0x7f2f4000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbc5a6b10b8393d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f4cff9640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2f380b5450 0x7f2f380b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f35ffb640 1 -- 172.21.15.16:0/3376924465 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4001d070 con 0x564e560d3800 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.600+0000 7f2f35ffb640 1 -- 172.21.15.16:0/3376924465 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f40018af0 con 0x564e560d3800 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f35ffb640 1 -- 172.21.15.16:0/3376924465 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40010b30 con 0x564e560d3800 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2f380b5450 0x7f2f380b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f4cff9640 1 -- 172.21.15.16:0/2956446957 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2f44106860 con 0x7f2f501076a0 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 -- 172.21.15.16:0/3376924465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 msgr2=0x564e560df250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2f380b5450 0x7f2f380b7910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f5019b010 tx=0x7f2f48007520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560df250 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000ac50 tx=0x7f2f4000f790 comp rx=0 tx=0).stop 2024-09-10T23:46:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 -- 172.21.15.16:0/3376924465 shutdown_connections 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560df790 0x564e560e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560df250 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 --2- 172.21.15.16:0/3376924465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560d2ee0 0x564e560d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 -- 172.21.15.16:0/3376924465 >> 172.21.15.16:0/3376924465 conn(0x564e560d0d10 msgr2=0x564e560d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.601+0000 7f2f58163740 1 -- 172.21.15.16:0/3376924465 shutdown_connections 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.602+0000 7f2f58163740 1 -- 172.21.15.16:0/3376924465 wait complete. 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.602+0000 7f2f58163740 1 -- start start 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.602+0000 7f2f58163740 1 Processor -- start 2024-09-10T23:46:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.602+0000 7f2f58163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.602+0000 7f2f58163740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.602+0000 7f2f58163740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560dd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f58163740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564e55e9a890 con 0x564e560d3800 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f58163740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e55fd3d40 con 0x564e560df790 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f58163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564e560e2440 con 0x564e560d2ee0 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560dcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53432/0 (socket says 172.21.15.16:53432) 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f58163740 10 client.0 _ll_register_callbacks cb 0x564e56037c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 -- 172.21.15.16:0/2347106575 learned_addr learned my addr 172.21.15.16:0/2347106575 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 -- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 msgr2=0x564e560dc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560dc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 -- 172.21.15.16:0/2347106575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 msgr2=0x564e560dd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560dd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 -- 172.21.15.16:0/2347106575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e560eb870 con 0x564e560d3800 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560dc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f4effd640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560dcce0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2f44005ec0 tx=0x7f2f440c8d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f56c9ee3870cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f2effd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f2effd640 1 -- 172.21.15.16:0/2347106575 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44049040 con 0x564e560d3800 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f2effd640 1 -- 172.21.15.16:0/2347106575 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2f440c9060 con 0x564e560d3800 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f40018af0 con 0x564e560d3800 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f2effd640 1 -- 172.21.15.16:0/2347106575 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f440cc900 con 0x564e560d3800 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f58163740 10 client.16806 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.603+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564e560ee190 con 0x564e560d3800 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f2effd640 1 -- 172.21.15.16:0/2347106575 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f40018af0 con 0x564e560d3800 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f2effd640 1 -- 172.21.15.16:0/2347106575 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2f440b40d0 con 0x564e560d3800 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f58163740 10 client.16806 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f58163740 10 client.16806 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f58163740 20 client.16806 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f58163740 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e560ef640 0x564e560f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f58163740 4 client.16806 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e5604bdb0 con 0x564e560ef640 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.604+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e560ef640 0x564e560f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.605+0000 7f2f2effd640 10 client.16806 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.605+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e560ef640 0x564e560f1ac0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9650431b058c9c88 server_cookie=a2c96bbc205d0c83 in_seq=0 out_seq=0 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.605+0000 7f2f2effd640 1 -- 172.21.15.16:0/2347106575 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e5604bdb0 con 0x564e560ef640 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.605+0000 7f2f2effd640 10 client.16806 handle_command_reply: tid=0 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.605+0000 7f2f58163740 1 client.16806 shutdown 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 msgr2=0x564e560dcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560dcce0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2f44005ec0 tx=0x7f2f440c8d50 comp rx=0 tx=0).stop 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 shutdown_connections 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e560ef640 0x564e560f1ac0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560dcce0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f2effd640 0 client.16806 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 --2- 172.21.15.16:0/2347106575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560dc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 >> 172.21.15.16:0/2347106575 conn(0x564e560d0d10 msgr2=0x564e560cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 shutdown_connections 2024-09-10T23:46:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 1 -- 172.21.15.16:0/2347106575 wait complete. 2024-09-10T23:46:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.606+0000 7f2f58163740 20 client.16806 trim_cache size 0 max 16384 2024-09-10T23:46:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 Processor -- start 2024-09-10T23:46:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 -- start start 2024-09-10T23:46:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560f7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501b0e40 con 0x564e560d3800 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501ae710 con 0x564e560df790 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f58163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501ac560 con 0x564e560d2ee0 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.624+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560f7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53438/0 (socket says 172.21.15.16:53438) 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 -- 172.21.15.16:0/1587571883 learned_addr learned my addr 172.21.15.16:0/1587571883 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 -- 172.21.15.16:0/1587571883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 msgr2=0x564e560cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 -- 172.21.15.16:0/1587571883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 msgr2=0x564e560f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560f78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 -- 172.21.15.16:0/1587571883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e560d1790 con 0x564e560d3800 2024-09-10T23:46:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f4effd640 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560f7390 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2f44104610 tx=0x7f2f44031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b7cc7314c3c06c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f357fa640 1 -- 172.21.15.16:0/1587571883 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44049070 con 0x564e560d3800 2024-09-10T23:46:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f357fa640 1 -- 172.21.15.16:0/1587571883 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f440f3050 con 0x564e560d3800 2024-09-10T23:46:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.625+0000 7f2f357fa640 1 -- 172.21.15.16:0/1587571883 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4407c040 con 0x564e560d3800 2024-09-10T23:46:47.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 -- 172.21.15.16:0/1587571883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 msgr2=0x564e560f7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560f7390 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2f44104610 tx=0x7f2f44031400 comp rx=0 tx=0).stop 2024-09-10T23:46:47.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 -- 172.21.15.16:0/1587571883 shutdown_connections 2024-09-10T23:46:47.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560f7390 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 --2- 172.21.15.16:0/1587571883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 -- 172.21.15.16:0/1587571883 >> 172.21.15.16:0/1587571883 conn(0x564e560d0d10 msgr2=0x564e560cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 -- 172.21.15.16:0/1587571883 shutdown_connections 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.626+0000 7f2f58163740 1 -- 172.21.15.16:0/1587571883 wait complete. 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 -- start start 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 Processor -- start 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560e6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560e6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501acbd0 con 0x564e560d3800 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501ae040 con 0x564e560df790 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501ad2a0 con 0x564e560d2ee0 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f58163740 10 client.0 _ll_register_callbacks cb 0x7f2f440c9440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.627+0000 7f2f4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560e6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53442/0 (socket says 172.21.15.16:53442) 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4effd640 1 -- 172.21.15.16:0/824556388 learned_addr learned my addr 172.21.15.16:0/824556388 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4ffff640 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4effd640 1 -- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 msgr2=0x564e560e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4effd640 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4effd640 1 -- 172.21.15.16:0/824556388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 msgr2=0x564e560e6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4effd640 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560e6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4effd640 1 -- 172.21.15.16:0/824556388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e560e6ed0 con 0x564e560d3800 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f4effd640 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560e6250 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f2f44031ae0 tx=0x7f2f440c8d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a56b8761d77696e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f2effd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f2effd640 1 -- 172.21.15.16:0/824556388 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44049070 con 0x564e560d3800 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f2effd640 1 -- 172.21.15.16:0/824556388 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f2f440cd0a0 con 0x564e560d3800 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f440f3050 con 0x564e560d3800 2024-09-10T23:46:47.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f2effd640 1 -- 172.21.15.16:0/824556388 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f440ee050 con 0x564e560d3800 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f58163740 10 client.16812 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.628+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564e560e6ed0 con 0x564e560d3800 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f2effd640 1 -- 172.21.15.16:0/824556388 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f440f3050 con 0x564e560d3800 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f2effd640 1 -- 172.21.15.16:0/824556388 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2f440d5e40 con 0x564e560d3800 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f58163740 10 client.16812 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f58163740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f58163740 20 client.16812 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f58163740 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e5615d800 0x564e5615fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f58163740 4 client.16812 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564e56047860 con 0x564e5615d800 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.629+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e5615d800 0x564e5615fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.630+0000 7f2f4f7fe640 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e5615d800 0x564e5615fc20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5520f29477e1a36 server_cookie=1261fe5af57c6bd0 in_seq=0 out_seq=0 2024-09-10T23:46:47.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.630+0000 7f2f2effd640 10 client.16812 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:47.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.631+0000 7f2f2effd640 1 -- 172.21.15.16:0/824556388 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564e56047860 con 0x564e5615d800 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.631+0000 7f2f2effd640 10 client.16812 handle_command_reply: tid=0 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.631+0000 7f2f58163740 1 client.16812 shutdown 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.631+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 msgr2=0x564e560e6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.631+0000 7f2f58163740 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560e6250 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f2f44031ae0 tx=0x7f2f440c8d50 comp rx=0 tx=0).stop 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.631+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 shutdown_connections 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.631+0000 7f2f58163740 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564e5615d800 0x564e5615fc20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f58163740 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e560df790 0x564e560e6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f58163740 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564e560d3800 0x564e560e6250 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f2effd640 0 client.16812 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f58163740 1 --2- 172.21.15.16:0/824556388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564e560d2ee0 0x564e560e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 >> 172.21.15.16:0/824556388 conn(0x564e560d0d10 msgr2=0x564e560eae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 shutdown_connections 2024-09-10T23:46:47.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f58163740 1 -- 172.21.15.16:0/824556388 wait complete. 2024-09-10T23:46:47.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f58163740 20 client.16812 trim_cache size 0 max 16384 2024-09-10T23:46:47.637 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:46:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:46:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "035cb11d-5a0e-460f-836d-8711666c4efa", 2024-09-10T23:46:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:46:47.637 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2f380b5450 msgr2=0x7f2f380b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2f380b5450 0x7f2f380b7910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f5019b010 tx=0x7f2f48007520 comp rx=0 tx=0).stop 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 msgr2=0x7f2f5019a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.632+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f5019a570 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2f44006010 tx=0x7f2f440042f0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 shutdown_connections 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f50108020 0x7f2f5019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f501076a0 0x7f2f5019a570 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f2f380b5450 0x7f2f380b7910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 --2- 172.21.15.16:0/2956446957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f50101c90 0x7f2f5019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:47.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 >> 172.21.15.16:0/2956446957 conn(0x7f2f500fd700 msgr2=0x7f2f500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:47.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 shutdown_connections 2024-09-10T23:46:47.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:47.633+0000 7f2f55d8e640 1 -- 172.21.15.16:0/2956446957 wait complete. 2024-09-10T23:46:48.438 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:48 smithi016 ceph-mon[30855]: pgmap v517: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:48.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:46:48.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:48 smithi066 ceph-mon[34761]: pgmap v517: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:48.736 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:48.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:48 smithi071 ceph-mon[35018]: pgmap v517: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.217+0000 7f27b840b640 1 -- 172.21.15.16:0/2682357065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b010d140 msgr2=0x7f27b010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.217+0000 7f27b840b640 1 --2- 172.21.15.16:0/2682357065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b010d140 0x7f27b010f5a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009ca0 tx=0x7f27a802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.217+0000 7f27b840b640 1 -- 172.21.15.16:0/2682357065 shutdown_connections 2024-09-10T23:46:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.217+0000 7f27b840b640 1 --2- 172.21.15.16:0/2682357065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b010d140 0x7f27b010f5a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.217+0000 7f27b840b640 1 --2- 172.21.15.16:0/2682357065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b0104600 0x7f27b010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.217+0000 7f27b840b640 1 --2- 172.21.15.16:0/2682357065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b0103ce0 0x7f27b01040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.218+0000 7f27b840b640 1 -- 172.21.15.16:0/2682357065 >> 172.21.15.16:0/2682357065 conn(0x7f27b00fd720 msgr2=0x7f27b00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.218+0000 7f27b840b640 1 -- 172.21.15.16:0/2682357065 shutdown_connections 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.218+0000 7f27b840b640 1 -- 172.21.15.16:0/2682357065 wait complete. 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.218+0000 7f27b840b640 1 Processor -- start 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.218+0000 7f27b840b640 1 -- start start 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.218+0000 7f27b840b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b0103ce0 0x7f27b01992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.218+0000 7f27b840b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b0104600 0x7f27b0199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b840b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b010d140 0x7f27b019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b840b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0112db0 con 0x7f27b0103ce0 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b840b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0112c30 con 0x7f27b010d140 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b840b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0112f30 con 0x7f27b0104600 2024-09-10T23:46:49.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b0103ce0 0x7f27b01992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b0103ce0 0x7f27b01992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53464/0 (socket says 172.21.15.16:53464) 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 -- 172.21.15.16:0/636956772 learned_addr learned my addr 172.21.15.16:0/636956772 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b59a6640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b0104600 0x7f27b0199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 -- 172.21.15.16:0/636956772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b0104600 msgr2=0x7f27b0199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b0104600 0x7f27b0199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 -- 172.21.15.16:0/636956772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b010d140 msgr2=0x7f27b019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b010d140 0x7f27b019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 -- 172.21.15.16:0/636956772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b019f390 con 0x7f27b0103ce0 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b59a6640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b0104600 0x7f27b0199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b61a7640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b0103ce0 0x7f27b01992e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00d950 tx=0x7f27ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:49.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27a77fe640 1 -- 172.21.15.16:0/636956772 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac017070 con 0x7f27b0103ce0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27a77fe640 1 -- 172.21.15.16:0/636956772 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27ac009c30 con 0x7f27b0103ce0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b019f680 con 0x7f27b0103ce0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27a77fe640 1 -- 172.21.15.16:0/636956772 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00f620 con 0x7f27b0103ce0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.219+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b01a5f10 con 0x7f27b0103ce0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 Processor -- start 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 -- start start 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27a77fe640 1 -- 172.21.15.16:0/636956772 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f27ac010460 con 0x7f27b0103ce0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dce6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dcf2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dcf4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b52dc5ce50 con 0x55b52dce60a0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b52dc4c280 con 0x55b52dcf2950 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.222+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b52dc50090 con 0x55b52dce69c0 2024-09-10T23:46:49.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dce6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dce6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53476/0 (socket says 172.21.15.16:53476) 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 -- 172.21.15.16:0/704062634 learned_addr learned my addr 172.21.15.16:0/704062634 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b59a6640 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dcf4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b61a7640 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dcf2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 -- 172.21.15.16:0/704062634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 msgr2=0x55b52dcf2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dcf2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 -- 172.21.15.16:0/704062634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 msgr2=0x55b52dcf4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dcf4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 -- 172.21.15.16:0/704062634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52d9aa650 con 0x55b52dce60a0 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b61a7640 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dcf2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b59a6640 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dcf4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b69a8640 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dce6480 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f27a80097b0 tx=0x7f27a8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7330523f064a7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27a4de6640 1 -- 172.21.15.16:0/704062634 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8031cf0 con 0x55b52dce60a0 2024-09-10T23:46:49.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27a4de6640 1 -- 172.21.15.16:0/704062634 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a803f070 con 0x55b52dce60a0 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27a77fe640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f279c0b54d0 0x7f279c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27a4de6640 1 -- 172.21.15.16:0/704062634 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8004260 con 0x55b52dce60a0 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.223+0000 7f27b61a7640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f279c0b54d0 0x7f279c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27a77fe640 1 -- 172.21.15.16:0/636956772 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f27ac0e5c30 con 0x7f27b0103ce0 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 -- 172.21.15.16:0/704062634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 msgr2=0x55b52dce6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27b61a7640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f279c0b54d0 0x7f279c0b7990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0e3490 tx=0x7f27ac010cb0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dce6480 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f27a80097b0 tx=0x7f27a8005fa0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 -- 172.21.15.16:0/704062634 shutdown_connections 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dcf4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dcf2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/704062634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dce6480 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 -- 172.21.15.16:0/704062634 >> 172.21.15.16:0/704062634 conn(0x55b52dce3ed0 msgr2=0x55b52dce5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 -- 172.21.15.16:0/704062634 shutdown_connections 2024-09-10T23:46:49.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.224+0000 7f27ba7e0740 1 -- 172.21.15.16:0/704062634 wait complete. 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 -- start start 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 Processor -- start 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dcf2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 0x55b52dcef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dcf2950 0x55b52dcefcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b52daad700 con 0x55b52dce60a0 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b52dbe7110 con 0x55b52dce69c0 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b52dcf5570 con 0x55b52dcf2950 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27ba7e0740 10 client.0 _ll_register_callbacks cb 0x55b52dc00990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dcf2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dcf2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53482/0 (socket says 172.21.15.16:53482) 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 -- 172.21.15.16:0/48477055 learned_addr learned my addr 172.21.15.16:0/48477055 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b59a6640 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 0x55b52dcef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 -- 172.21.15.16:0/48477055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dcf2950 msgr2=0x55b52dcefcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dcf2950 0x55b52dcefcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 -- 172.21.15.16:0/48477055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 msgr2=0x55b52dcef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 0x55b52dcef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.225+0000 7f27b69a8640 1 -- 172.21.15.16:0/48477055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52dc14c40 con 0x55b52dce60a0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27b69a8640 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dcf2270 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f27a8003d80 tx=0x7f27a80099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479ce36a7bba8c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f2799ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f2799ffb640 1 -- 172.21.15.16:0/48477055 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8054060 con 0x55b52dce60a0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f2799ffb640 1 -- 172.21.15.16:0/48477055 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f27a8031860 con 0x55b52dce60a0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a803f070 con 0x55b52dce60a0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f2799ffb640 1 -- 172.21.15.16:0/48477055 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27a8004040 con 0x55b52dce60a0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 10 client.16824 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b52dd00e40 con 0x55b52dce60a0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f2799ffb640 1 -- 172.21.15.16:0/48477055 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a803f070 con 0x55b52dce60a0 2024-09-10T23:46:49.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f2799ffb640 1 -- 172.21.15.16:0/48477055 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27a802fa30 con 0x55b52dce60a0 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 10 client.16824 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 20 client.16824 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd02190 0x55b52dd04580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 4 client.16824 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.226+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b52dc5eda0 con 0x55b52dd02190 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.227+0000 7f27b59a6640 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd02190 0x55b52dd04580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.227+0000 7f27b59a6640 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd02190 0x55b52dd04580 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eda80ff9b2d5fd6 server_cookie=9d42753bf7360432 in_seq=0 out_seq=0 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.227+0000 7f2799ffb640 10 client.16824 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f2799ffb640 1 -- 172.21.15.16:0/48477055 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b52dc5eda0 con 0x55b52dd02190 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f2799ffb640 10 client.16824 handle_command_reply: tid=0 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 client.16824 shutdown 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 msgr2=0x55b52dcf2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dcf2270 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f27a8003d80 tx=0x7f27a80099d0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 shutdown_connections 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd02190 0x55b52dd04580 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dcf2950 0x55b52dcefcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 0x55b52dcef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/48477055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dcf2270 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 >> 172.21.15.16:0/48477055 conn(0x55b52dce3ed0 msgr2=0x55b52dce9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f2799ffb640 0 client.16824 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 shutdown_connections 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 1 -- 172.21.15.16:0/48477055 wait complete. 2024-09-10T23:46:49.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.228+0000 7f27ba7e0740 20 client.16824 trim_cache size 0 max 16384 2024-09-10T23:46:49.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 Processor -- start 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 -- start start 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce60a0 0x55b52dcfe810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 0x55b52dce4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dcf2950 0x55b52dcf1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01b0fb0 con 0x55b52dcf2950 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01ae880 con 0x55b52dce69c0 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01ac6d0 con 0x55b52dce60a0 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dcf2950 0x55b52dcf1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dcf2950 0x55b52dcf1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53484/0 (socket says 172.21.15.16:53484) 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 -- 172.21.15.16:0/394851033 learned_addr learned my addr 172.21.15.16:0/394851033 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce60a0 0x55b52dcfe810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 -- 172.21.15.16:0/394851033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce60a0 msgr2=0x55b52dcfe810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce60a0 0x55b52dcfe810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 -- 172.21.15.16:0/394851033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 msgr2=0x55b52dce4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 0x55b52dce4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.246+0000 7f27b69a8640 1 -- 172.21.15.16:0/394851033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52dcf02d0 con 0x55b52dcf2950 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27b69a8640 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dcf2950 0x55b52dcf1400 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009980 tx=0x7f27a80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7367f70591d116 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f279bfff640 1 -- 172.21.15.16:0/394851033 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8054040 con 0x55b52dcf2950 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f279bfff640 1 -- 172.21.15.16:0/394851033 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a803f040 con 0x55b52dcf2950 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f279bfff640 1 -- 172.21.15.16:0/394851033 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8004440 con 0x55b52dcf2950 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 -- 172.21.15.16:0/394851033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dcf2950 msgr2=0x55b52dcf1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dcf2950 0x55b52dcf1400 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009980 tx=0x7f27a80095c0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 -- 172.21.15.16:0/394851033 shutdown_connections 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dcf2950 0x55b52dcf1400 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dce69c0 0x55b52dce4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/394851033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce60a0 0x55b52dcfe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 -- 172.21.15.16:0/394851033 >> 172.21.15.16:0/394851033 conn(0x55b52dce3ed0 msgr2=0x55b52dcf0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:49.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 -- 172.21.15.16:0/394851033 shutdown_connections 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.247+0000 7f27ba7e0740 1 -- 172.21.15.16:0/394851033 wait complete. 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 -- start start 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 Processor -- start 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dd073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dd078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dd041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01acd40 con 0x55b52dce60a0 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01ae1b0 con 0x55b52dcf2950 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01ad410 con 0x55b52dce69c0 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27ba7e0740 10 client.0 _ll_register_callbacks cb 0x7f27a8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:46:49.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dd073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27b69a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dd073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53496/0 (socket says 172.21.15.16:53496) 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27b69a8640 1 -- 172.21.15.16:0/1531325257 learned_addr learned my addr 172.21.15.16:0/1531325257 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27b59a6640 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dd078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.248+0000 7f27b69a8640 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dd041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f27b69a8640 1 -- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 msgr2=0x55b52dd078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f27b69a8640 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dd078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f27b69a8640 1 -- 172.21.15.16:0/1531325257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 msgr2=0x55b52dd041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f27b69a8640 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dd041a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f27b69a8640 1 -- 172.21.15.16:0/1531325257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52dd04810 con 0x55b52dce60a0 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f27b69a8640 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dd073b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f27a8003da0 tx=0x7f27a8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfc7a0a3d6fbb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f2799ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f2799ffb640 1 -- 172.21.15.16:0/1531325257 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8054040 con 0x55b52dce60a0 2024-09-10T23:46:49.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f2799ffb640 1 -- 172.21.15.16:0/1531325257 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8426+0+0 (secure 0 0 0) 0x7f27a80041e0 con 0x55b52dce60a0 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.249+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a803f040 con 0x55b52dce60a0 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f2799ffb640 1 -- 172.21.15.16:0/1531325257 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27a80043e0 con 0x55b52dce60a0 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 10 client.16830 fetch_fsmap learned FSMap version 25 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b52dd6f670 con 0x55b52dce60a0 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f2799ffb640 1 -- 172.21.15.16:0/1531325257 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a803f040 con 0x55b52dce60a0 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f2799ffb640 1 -- 172.21.15.16:0/1531325257 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27a8004610 con 0x55b52dce60a0 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 10 client.16830 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 20 client.16830 populate_metadata read hostname 'smithi016' 2024-09-10T23:46:49.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd6faf0 0x55b52dd71ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 4 client.16830 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b52dc5a850 con 0x55b52dd6faf0 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.250+0000 7f27b59a6640 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd6faf0 0x55b52dd71ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27b59a6640 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd6faf0 0x55b52dd71ee0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=483474bab6e67e12 server_cookie=cb540e1d49884c6f in_seq=0 out_seq=0 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f2799ffb640 10 client.16830 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f2799ffb640 1 -- 172.21.15.16:0/1531325257 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x55b52dc5a850 con 0x55b52dd6faf0 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f2799ffb640 10 client.16830 handle_command_reply: tid=0 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 client.16830 shutdown 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 msgr2=0x55b52dd073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dd073b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f27a8003da0 tx=0x7f27a8005fa0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 shutdown_connections 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b52dd6faf0 0x55b52dd71ee0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b52dcf2950 0x55b52dd041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b52dce69c0 0x55b52dd078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 --2- 172.21.15.16:0/1531325257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b52dce60a0 0x55b52dd073b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 >> 172.21.15.16:0/1531325257 conn(0x55b52dce3ed0 msgr2=0x55b52dcf1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f2799ffb640 0 client.16830 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 shutdown_connections 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 1 -- 172.21.15.16:0/1531325257 wait complete. 2024-09-10T23:46:49.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.251+0000 7f27ba7e0740 20 client.16830 trim_cache size 0 max 16384 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "035cb11d-5a0e-460f-836d-8711666c4efa", 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:49.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:46:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.268 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.269 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:46:49.270 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:46:49.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:46:49.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:46:49.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:46:49.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:46:49.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:49.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:46:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:46:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f279c0b54d0 msgr2=0x7f279c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f279c0b54d0 0x7f279c0b7990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0e3490 tx=0x7f27ac010cb0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b0103ce0 msgr2=0x7f27b01992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b0103ce0 0x7f27b01992e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00d950 tx=0x7f27ac00de10 comp rx=0 tx=0).stop 2024-09-10T23:46:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 shutdown_connections 2024-09-10T23:46:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f279c0b54d0 0x7f279c0b7990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b010d140 0x7f27b019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27b0104600 0x7f27b0199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 --2- 172.21.15.16:0/636956772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27b0103ce0 0x7f27b01992e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 >> 172.21.15.16:0/636956772 conn(0x7f27b00fd720 msgr2=0x7f27b00fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 shutdown_connections 2024-09-10T23:46:49.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:46:49.252+0000 7f27b840b640 1 -- 172.21.15.16:0/636956772 wait complete. 2024-09-10T23:46:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:49 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:46:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:49 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:49 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:46:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:49 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:49.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:49 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:46:49.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:49 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:49.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:49 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:46:49.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:49 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:49.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:49 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:46:49.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:49 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:49.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:49 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:46:49.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:49 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:46:50.094 INFO:tasks.cephfs.filesystem:scrub status for tag:035cb11d-5a0e-460f-836d-8711666c4efa - {'path': '/', 'tag': '035cb11d-5a0e-460f-836d-8711666c4efa', 'options': 'recursive,force'} 2024-09-10T23:46:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:50 smithi016 ceph-mon[30855]: pgmap v518: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-10T23:46:50.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:50 smithi071 ceph-mon[35018]: pgmap v518: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-10T23:46:50.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:50 smithi066 ceph-mon[34761]: pgmap v518: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-10T23:46:51.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:51 smithi016 ceph-mon[30855]: pgmap v519: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:46:51.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:51 smithi071 ceph-mon[35018]: pgmap v519: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:46:51.802 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:51 smithi066 ceph-mon[34761]: pgmap v519: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:46:52.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:52 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:46:52.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:52 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:46:53.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:52 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:46:53.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:53 smithi016 ceph-mon[30855]: pgmap v520: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:54.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:53 smithi071 ceph-mon[35018]: pgmap v520: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:54.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:53 smithi066 ceph-mon[34761]: pgmap v520: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:46:55.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:55 smithi016 ceph-mon[30855]: pgmap v521: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:56.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:55 smithi071 ceph-mon[35018]: pgmap v521: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:56.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:55 smithi066 ceph-mon[34761]: pgmap v521: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:46:57.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:57 smithi016 ceph-mon[30855]: pgmap v522: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:58.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:57 smithi071 ceph-mon[35018]: pgmap v522: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:58.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:57 smithi066 ceph-mon[34761]: pgmap v522: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:46:59.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:46:59 smithi016 ceph-mon[30855]: pgmap v523: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:47:00.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:46:59 smithi071 ceph-mon[35018]: pgmap v523: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:47:00.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:46:59 smithi066 ceph-mon[34761]: pgmap v523: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:47:01.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:01 smithi016 ceph-mon[30855]: pgmap v524: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:47:02.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:01 smithi071 ceph-mon[35018]: pgmap v524: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:47:02.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:01 smithi066 ceph-mon[34761]: pgmap v524: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:47:03.988 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:03 smithi016 ceph-mon[30855]: pgmap v525: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:47:04.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:03 smithi071 ceph-mon[35018]: pgmap v525: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:47:04.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:03 smithi066 ceph-mon[34761]: pgmap v525: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:47:05.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:05 smithi016 ceph-mon[30855]: pgmap v526: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:47:06.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:05 smithi071 ceph-mon[35018]: pgmap v526: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:47:06.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:05 smithi066 ceph-mon[34761]: pgmap v526: 97 pgs: 97 active+clean; 14 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:47:07.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:07 smithi016 ceph-mon[30855]: pgmap v527: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:47:08.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:07 smithi071 ceph-mon[35018]: pgmap v527: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:47:08.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:07 smithi066 ceph-mon[34761]: pgmap v527: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:47:08.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:08 smithi016 ceph-mon[30855]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:47:09.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:08 smithi071 ceph-mon[35018]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:47:09.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:08 smithi066 ceph-mon[34761]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:47:09.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:09 smithi016 ceph-mon[30855]: pgmap v529: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:47:10.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:09 smithi071 ceph-mon[35018]: pgmap v529: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:47:10.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:09 smithi066 ceph-mon[34761]: pgmap v529: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:47:11.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:11 smithi016 ceph-mon[30855]: pgmap v530: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:47:12.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:11 smithi071 ceph-mon[35018]: pgmap v530: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:47:12.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:11 smithi066 ceph-mon[34761]: pgmap v530: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:47:13.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:13 smithi016 ceph-mon[30855]: pgmap v531: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:47:14.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:13 smithi071 ceph-mon[35018]: pgmap v531: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:47:14.051 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:13 smithi066 ceph-mon[34761]: pgmap v531: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:47:15.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:15 smithi016 ceph-mon[30855]: pgmap v532: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:16.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:15 smithi071 ceph-mon[35018]: pgmap v532: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:16.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:15 smithi066 ceph-mon[34761]: pgmap v532: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:17.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:17 smithi016 ceph-mon[30855]: pgmap v533: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:18.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:17 smithi071 ceph-mon[35018]: pgmap v533: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:18.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:17 smithi066 ceph-mon[34761]: pgmap v533: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:19.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:18 smithi016 ceph-mon[30855]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:47:19.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:18 smithi071 ceph-mon[35018]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:47:19.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:18 smithi066 ceph-mon[34761]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:47:20.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:47:20.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:19 smithi016 ceph-mon[30855]: pgmap v535: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:20.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:19 smithi071 ceph-mon[35018]: pgmap v535: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:20.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:19 smithi066 ceph-mon[34761]: pgmap v535: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:20.373 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:47:20.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 -- 172.21.15.16:0/3075389146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb548104570 msgr2=0x7fb54810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 --2- 172.21.15.16:0/3075389146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb548104570 0x7fb54810cb50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009900 tx=0x7fb53c02a410 comp rx=0 tx=0).stop 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 -- 172.21.15.16:0/3075389146 shutdown_connections 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 --2- 172.21.15.16:0/3075389146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb54810d120 0x7fb54810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 --2- 172.21.15.16:0/3075389146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb548104570 0x7fb54810cb50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 --2- 172.21.15.16:0/3075389146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 0x7fb548103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 -- 172.21.15.16:0/3075389146 >> 172.21.15.16:0/3075389146 conn(0x7fb5480fd700 msgr2=0x7fb5480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 -- 172.21.15.16:0/3075389146 shutdown_connections 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 -- 172.21.15.16:0/3075389146 wait complete. 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.898+0000 7fb54ded6640 1 Processor -- start 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb54ded6640 1 -- start start 2024-09-10T23:47:20.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb54ded6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 0x7fb548199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb54ded6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb548104570 0x7fb5481997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb54ded6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb54810d120 0x7fb54819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb54ded6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb548112d60 con 0x7fb54810d120 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb54ded6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb548112be0 con 0x7fb548104570 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb54ded6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb548112ee0 con 0x7fb548103b70 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb547fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb54810d120 0x7fb54819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 0x7fb548199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 0x7fb548199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:34348/0 (socket says 172.21.15.16:34348) 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 -- 172.21.15.16:0/2471155394 learned_addr learned my addr 172.21.15.16:0/2471155394 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb546ffd640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb548104570 0x7fb5481997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 -- 172.21.15.16:0/2471155394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb548104570 msgr2=0x7fb5481997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb548104570 0x7fb5481997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 -- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb54810d120 msgr2=0x7fb54819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb54810d120 0x7fb54819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb5477fe640 1 -- 172.21.15.16:0/2471155394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54819f320 con 0x7fb548103b70 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.899+0000 7fb546ffd640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb548104570 0x7fb5481997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.900+0000 7fb5477fe640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 0x7fb548199270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d770 tx=0x7fb53800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.900+0000 7fb544ff9640 1 -- 172.21.15.16:0/2471155394 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538017070 con 0x7fb548103b70 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.900+0000 7fb544ff9640 1 -- 172.21.15.16:0/2471155394 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5380054d0 con 0x7fb548103b70 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.900+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54819f610 con 0x7fb548103b70 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.900+0000 7fb544ff9640 1 -- 172.21.15.16:0/2471155394 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538004c30 con 0x7fb548103b70 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.900+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5481a5cd0 con 0x7fb548103b70 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.902+0000 7fb5502ab740 1 Processor -- start 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.902+0000 7fb5502ab740 1 -- start start 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.902+0000 7fb544ff9640 1 -- 172.21.15.16:0/2471155394 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb538004e10 con 0x7fb548103b70 2024-09-10T23:47:20.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fbf6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc02410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb5502ab740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e51fb6ce50 con 0x55e51fbf60a0 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb5502ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e51fb5c280 con 0x55e51fc02950 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb5502ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e51fb60090 con 0x55e51fbf69c0 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fbf6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fbf6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57816/0 (socket says 172.21.15.16:57816) 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 -- 172.21.15.16:0/3442290181 learned_addr learned my addr 172.21.15.16:0/3442290181 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb5477fe640 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc02410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 -- 172.21.15.16:0/3442290181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 msgr2=0x55e51fc02410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc02410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 -- 172.21.15.16:0/3442290181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 msgr2=0x55e51fc04d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 -- 172.21.15.16:0/3442290181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51f8ba650 con 0x55e51fbf60a0 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb547fff640 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fbf6480 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb5400039f0 tx=0x7fb540003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2065c72b754f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.903+0000 7fb544ff9640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb5300b5450 0x7fb5300b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb52dffb640 1 -- 172.21.15.16:0/3442290181 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54001a470 con 0x55e51fbf60a0 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb52dffb640 1 -- 172.21.15.16:0/3442290181 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb540015070 con 0x55e51fbf60a0 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb52dffb640 1 -- 172.21.15.16:0/3442290181 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5400107e0 con 0x55e51fbf60a0 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5477fe640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb5300b5450 0x7fb5300b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb544ff9640 1 -- 172.21.15.16:0/2471155394 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fb5380e5ab0 con 0x7fb548103b70 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5502ab740 1 -- 172.21.15.16:0/3442290181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 msgr2=0x55e51fbf6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5477fe640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb5300b5450 0x7fb5300b7910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5380e32e0 tx=0x7fb538009f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fbf6480 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb5400039f0 tx=0x7fb540003eb0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5502ab740 1 -- 172.21.15.16:0/3442290181 shutdown_connections 2024-09-10T23:47:20.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc02410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3442290181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fbf6480 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.904+0000 7fb5502ab740 1 -- 172.21.15.16:0/3442290181 >> 172.21.15.16:0/3442290181 conn(0x55e51fbf3ed0 msgr2=0x55e51fbf5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 -- 172.21.15.16:0/3442290181 shutdown_connections 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 -- 172.21.15.16:0/3442290181 wait complete. 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 -- start start 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 Processor -- start 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fc021e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fbff630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fbffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e51f9bd700 con 0x55e51fbf60a0 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e51faf7110 con 0x55e51fc02950 2024-09-10T23:47:20.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e51fc055d0 con 0x55e51fbf69c0 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.905+0000 7fb5502ab740 10 client.0 _ll_register_callbacks cb 0x55e51fb10990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fc021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fc021e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57828/0 (socket says 172.21.15.16:57828) 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 -- 172.21.15.16:0/2225841630 learned_addr learned my addr 172.21.15.16:0/2225841630 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 -- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 msgr2=0x55e51fbff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb546ffd640 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fbff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fbff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 -- 172.21.15.16:0/2225841630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 msgr2=0x55e51fbffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fbffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 -- 172.21.15.16:0/2225841630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51fb24c40 con 0x55e51fbf60a0 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb546ffd640 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fbff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:47:20.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb547fff640 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fc021e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb540005c00 tx=0x7fb540004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bced9876341cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb526ffd640 1 -- 172.21.15.16:0/2225841630 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5400118d0 con 0x55e51fbf60a0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb526ffd640 1 -- 172.21.15.16:0/2225841630 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fb540011a70 con 0x55e51fbf60a0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb540015070 con 0x55e51fbf60a0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb526ffd640 1 -- 172.21.15.16:0/2225841630 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb540032050 con 0x55e51fbf60a0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb5502ab740 10 client.16842 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.906+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e51fc10ea0 con 0x55e51fbf60a0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb526ffd640 1 -- 172.21.15.16:0/2225841630 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb540015070 con 0x55e51fbf60a0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb526ffd640 1 -- 172.21.15.16:0/2225841630 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb54001a590 con 0x55e51fbf60a0 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb5502ab740 10 client.16842 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb5502ab740 10 client.16842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb5502ab740 20 client.16842 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb5502ab740 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc121f0 0x55e51fc145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb5502ab740 4 client.16842 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e51fb6eda0 con 0x55e51fc121f0 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.907+0000 7fb546ffd640 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc121f0 0x55e51fc145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.908+0000 7fb546ffd640 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc121f0 0x55e51fc145e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc82f2cdc01d0c3a server_cookie=7afa22a18c0a7ad in_seq=0 out_seq=0 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.908+0000 7fb526ffd640 10 client.16842 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.908+0000 7fb526ffd640 1 -- 172.21.15.16:0/2225841630 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e51fb6eda0 con 0x55e51fc121f0 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.908+0000 7fb526ffd640 10 client.16842 handle_command_reply: tid=0 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 client.16842 shutdown 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 msgr2=0x55e51fc021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fc021e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb540005c00 tx=0x7fb540004970 comp rx=0 tx=0).stop 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 shutdown_connections 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc121f0 0x55e51fc145e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fbffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fbff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 --2- 172.21.15.16:0/2225841630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf60a0 0x55e51fc021e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 >> 172.21.15.16:0/2225841630 conn(0x55e51fbf3ed0 msgr2=0x55e51fbf9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:20.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb526ffd640 0 client.16842 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:20.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 shutdown_connections 2024-09-10T23:47:20.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 1 -- 172.21.15.16:0/2225841630 wait complete. 2024-09-10T23:47:20.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.909+0000 7fb5502ab740 20 client.16842 trim_cache size 0 max 16384 2024-09-10T23:47:20.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 Processor -- start 2024-09-10T23:47:20.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 -- start start 2024-09-10T23:47:20.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf60a0 0x55e51fbf56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf69c0 0x55e51fc03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481b0f30 con 0x55e51fbf69c0 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481ae800 con 0x55e51fc02950 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb5502ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481ac670 con 0x55e51fbf60a0 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf69c0 0x55e51fc03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf69c0 0x55e51fc03d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57832/0 (socket says 172.21.15.16:57832) 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 -- 172.21.15.16:0/3178398845 learned_addr learned my addr 172.21.15.16:0/3178398845 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb547fff640 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb547fff640 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf60a0 0x55e51fbf56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 -- 172.21.15.16:0/3178398845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf60a0 msgr2=0x55e51fbf56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf60a0 0x55e51fbf56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 -- 172.21.15.16:0/3178398845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 msgr2=0x55e51fc04280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.927+0000 7fb546ffd640 1 -- 172.21.15.16:0/3178398845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51fbff3e0 con 0x55e51fbf69c0 2024-09-10T23:47:20.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.928+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf69c0 0x55e51fc03d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb53c031440 tx=0x7fb53c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4fd6fdde19e93b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.928+0000 7fb52d7fa640 1 -- 172.21.15.16:0/3178398845 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c035040 con 0x55e51fbf69c0 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.928+0000 7fb52d7fa640 1 -- 172.21.15.16:0/3178398845 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb53c047070 con 0x55e51fbf69c0 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.928+0000 7fb52d7fa640 1 -- 172.21.15.16:0/3178398845 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c004ae0 con 0x55e51fbf69c0 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 -- 172.21.15.16:0/3178398845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf69c0 msgr2=0x55e51fc03d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf69c0 0x55e51fc03d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb53c031440 tx=0x7fb53c005d50 comp rx=0 tx=0).stop 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 -- 172.21.15.16:0/3178398845 shutdown_connections 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fc02950 0x55e51fc04280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fbf69c0 0x55e51fc03d40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3178398845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf60a0 0x55e51fbf56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 -- 172.21.15.16:0/3178398845 >> 172.21.15.16:0/3178398845 conn(0x55e51fbf3ed0 msgr2=0x55e51fbf4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 -- 172.21.15.16:0/3178398845 shutdown_connections 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 -- 172.21.15.16:0/3178398845 wait complete. 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 -- start start 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.929+0000 7fb5502ab740 1 Processor -- start 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fbf60a0 0x55e51fc0b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc19bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb5502ab740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fc02950 0x55e51fc1a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb5502ab740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481accc0 con 0x55e51fc02950 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb5502ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481ae130 con 0x55e51fbf60a0 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb5502ab740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481ad390 con 0x55e51fbf69c0 2024-09-10T23:47:20.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb5502ab740 10 client.0 _ll_register_callbacks cb 0x7fb540009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fc02950 0x55e51fc1a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fc02950 0x55e51fc1a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57842/0 (socket says 172.21.15.16:57842) 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 -- 172.21.15.16:0/3784020736 learned_addr learned my addr 172.21.15.16:0/3784020736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc19bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fbf60a0 0x55e51fc0b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 -- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 msgr2=0x55e51fc19bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc19bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 -- 172.21.15.16:0/3784020736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fbf60a0 msgr2=0x55e51fc0b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fbf60a0 0x55e51fc0b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 -- 172.21.15.16:0/3784020736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51fc09e60 con 0x55e51fc02950 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc19bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb547fff640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fc02950 0x55e51fc1a350 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb540002230 tx=0x7fb540004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10977b6ccff2c72e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:20.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.930+0000 7fb526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb526ffd640 1 -- 172.21.15.16:0/3784020736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5400116d0 con 0x55e51fc02950 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb526ffd640 1 -- 172.21.15.16:0/3784020736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fb540011870 con 0x55e51fc02950 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb53c047070 con 0x55e51fc02950 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb526ffd640 1 -- 172.21.15.16:0/3784020736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb540011a70 con 0x55e51fc02950 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 10 client.16848 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e51fc7f1e0 con 0x55e51fc02950 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb526ffd640 1 -- 172.21.15.16:0/3784020736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb53c047070 con 0x55e51fc02950 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb526ffd640 1 -- 172.21.15.16:0/3784020736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb540043440 con 0x55e51fc02950 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 10 client.16848 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 20 client.16848 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc7f900 0x55e51fc81d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:20.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 4 client.16848 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:47:20.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.931+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e51fb6a850 con 0x55e51fc7f900 2024-09-10T23:47:20.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.932+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc7f900 0x55e51fc81d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:20.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.932+0000 7fb546ffd640 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc7f900 0x55e51fc81d20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f21a00eb4a052ec server_cookie=c57857bda9b5828 in_seq=0 out_seq=0 2024-09-10T23:47:20.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.932+0000 7fb526ffd640 10 client.16848 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.932+0000 7fb526ffd640 1 -- 172.21.15.16:0/3784020736 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55e51fb6a850 con 0x55e51fc7f900 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.932+0000 7fb526ffd640 10 client.16848 handle_command_reply: tid=0 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.932+0000 7fb5502ab740 1 client.16848 shutdown 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fc02950 msgr2=0x55e51fc1a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fc02950 0x55e51fc1a350 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb540002230 tx=0x7fb540004970 comp rx=0 tx=0).stop 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 shutdown_connections 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e51fc7f900 0x55e51fc81d20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e51fc02950 0x55e51fc1a350 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e51fbf69c0 0x55e51fc19bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 --2- 172.21.15.16:0/3784020736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e51fbf60a0 0x55e51fc0b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 >> 172.21.15.16:0/3784020736 conn(0x55e51fbf3ed0 msgr2=0x55e51fc00c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb526ffd640 0 client.16848 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 shutdown_connections 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 1 -- 172.21.15.16:0/3784020736 wait complete. 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb5502ab740 20 client.16848 trim_cache size 0 max 16384 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:47:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:47:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:47:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:47:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:47:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:47:20.948 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb5300b5450 msgr2=0x7fb5300b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb54ded6640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb5300b5450 0x7fb5300b7910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5380e32e0 tx=0x7fb538009f90 comp rx=0 tx=0).stop 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.933+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 msgr2=0x7fb548199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 0x7fb548199270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d770 tx=0x7fb53800dc30 comp rx=0 tx=0).stop 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 shutdown_connections 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb54810d120 0x7fb54819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb5300b5450 0x7fb5300b7910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb548104570 0x7fb5481997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 --2- 172.21.15.16:0/2471155394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb548103b70 0x7fb548199270 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 >> 172.21.15.16:0/2471155394 conn(0x7fb5480fd700 msgr2=0x7fb5480fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:20.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 shutdown_connections 2024-09-10T23:47:20.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:20.934+0000 7fb54ded6640 1 -- 172.21.15.16:0/2471155394 wait complete. 2024-09-10T23:47:21.755 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:47:21.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:47:22.059 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:47:22.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:21 smithi016 ceph-mon[30855]: pgmap v536: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:22.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:21 smithi071 ceph-mon[35018]: pgmap v536: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:22.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:21 smithi066 ceph-mon[34761]: pgmap v536: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 -- 172.21.15.16:0/4122696501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c101c90 msgr2=0x7fb50c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 --2- 172.21.15.16:0/4122696501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c101c90 0x7fb50c102070 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009ca0 tx=0x7fb4fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 -- 172.21.15.16:0/4122696501 shutdown_connections 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 --2- 172.21.15.16:0/4122696501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb50c108020 0x7fb50c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 --2- 172.21.15.16:0/4122696501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb50c1076a0 0x7fb50c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 --2- 172.21.15.16:0/4122696501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c101c90 0x7fb50c102070 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 -- 172.21.15.16:0/4122696501 >> 172.21.15.16:0/4122696501 conn(0x7fb50c0fd700 msgr2=0x7fb50c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 -- 172.21.15.16:0/4122696501 shutdown_connections 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.612+0000 7fb510a47640 1 -- 172.21.15.16:0/4122696501 wait complete. 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 Processor -- start 2024-09-10T23:47:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 -- start start 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb50c101c90 0x7fb50c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb50c1076a0 0x7fb50c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c108020 0x7fb50c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c111ce0 con 0x7fb50c108020 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c111b60 con 0x7fb50c101c90 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb510a47640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c111e60 con 0x7fb50c1076a0 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb50ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c108020 0x7fb50c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb50ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c108020 0x7fb50c19ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57874/0 (socket says 172.21.15.16:57874) 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb50ad9d640 1 -- 172.21.15.16:0/567898712 learned_addr learned my addr 172.21.15.16:0/567898712 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb50a59c640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb50c101c90 0x7fb50c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.613+0000 7fb509d9b640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb50c1076a0 0x7fb50c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb50ad9d640 1 -- 172.21.15.16:0/567898712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb50c1076a0 msgr2=0x7fb50c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb50ad9d640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb50c1076a0 0x7fb50c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb50ad9d640 1 -- 172.21.15.16:0/567898712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb50c101c90 msgr2=0x7fb50c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb50ad9d640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb50c101c90 0x7fb50c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb50ad9d640 1 -- 172.21.15.16:0/567898712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c1a5550 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb509d9b640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb50c1076a0 0x7fb50c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb50a59c640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb50c101c90 0x7fb50c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb50ad9d640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c108020 0x7fb50c19ac10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb50400c970 tx=0x7fb50400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb5037fe640 1 -- 172.21.15.16:0/567898712 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504007bb0 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb5037fe640 1 -- 172.21.15.16:0/567898712 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb504007d50 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50c1a5840 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb5037fe640 1 -- 172.21.15.16:0/567898712 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504004e60 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.614+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50c1a5d80 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.615+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50c102070 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.616+0000 7fb5037fe640 1 -- 172.21.15.16:0/567898712 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb504005020 con 0x7fb50c108020 2024-09-10T23:47:22.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.617+0000 7fb5037fe640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb4f80b54d0 0x7fb4f80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:22.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.617+0000 7fb50a59c640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb4f80b54d0 0x7fb4f80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:22.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.617+0000 7fb5037fe640 1 -- 172.21.15.16:0/567898712 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fb5040e5c70 con 0x7fb50c108020 2024-09-10T23:47:22.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.618+0000 7fb50a59c640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb4f80b54d0 0x7fb4f80b7990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000f80 tx=0x7fb4fc02f480 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:22.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.622+0000 7fb5037fe640 1 -- 172.21.15.16:0/567898712 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb504014030 con 0x7fb50c108020 2024-09-10T23:47:22.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.846+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb50c02e5c0 con 0x7fb50c108020 2024-09-10T23:47:22.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.847+0000 7fb5037fe640 1 -- 172.21.15.16:0/567898712 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fb5040ac7c0 con 0x7fb50c108020 2024-09-10T23:47:22.848 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:47:22.848 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:47:22.848 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb4f80b54d0 msgr2=0x7fb4f80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb4f80b54d0 0x7fb4f80b7990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc000f80 tx=0x7fb4fc02f480 comp rx=0 tx=0).stop 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c108020 msgr2=0x7fb50c19ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c108020 0x7fb50c19ac10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb50400c970 tx=0x7fb50400ce30 comp rx=0 tx=0).stop 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 shutdown_connections 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb50c108020 0x7fb50c19ac10 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb50c1076a0 0x7fb50c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb4f80b54d0 0x7fb4f80b7990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 --2- 172.21.15.16:0/567898712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb50c101c90 0x7fb50c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:22.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 >> 172.21.15.16:0/567898712 conn(0x7fb50c0fd700 msgr2=0x7fb50c105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:22.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 shutdown_connections 2024-09-10T23:47:22.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:22.849+0000 7fb510a47640 1 -- 172.21.15.16:0/567898712 wait complete. 2024-09-10T23:47:22.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:22 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/567898712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:47:23.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:22 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/567898712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:47:23.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:22 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/567898712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:47:23.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:47:23.940 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:47:23.985 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:23 smithi016 ceph-mon[30855]: pgmap v537: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:24.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:23 smithi071 ceph-mon[35018]: pgmap v537: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:23 smithi066 ceph-mon[34761]: pgmap v537: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:24.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.498+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/1481123857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 msgr2=0x7f7b4410ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.498+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/1481123857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4410ef20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009900 tx=0x7f7b3802a480 comp rx=0 tx=0).stop 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/1481123857 shutdown_connections 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/1481123857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b4410f460 0x7f7b44111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/1481123857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4410ef20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/1481123857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b441018b0 0x7f7b44101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/1481123857 >> 172.21.15.16:0/1481123857 conn(0x7f7b440fd700 msgr2=0x7f7b440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/1481123857 shutdown_connections 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/1481123857 wait complete. 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 Processor -- start 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- start start 2024-09-10T23:47:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b441018b0 0x7f7b4419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b4410f460 0x7f7b441a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44114f30 con 0x7f7b441021d0 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44114db0 con 0x7f7b441018b0 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.499+0000 7f7b4bd0c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441150b0 con 0x7f7b4410f460 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4419ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42524/0 (socket says 172.21.15.16:42524) 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 -- 172.21.15.16:0/4106889302 learned_addr learned my addr 172.21.15.16:0/4106889302 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b4410f460 0x7f7b441a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b441018b0 0x7f7b4419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 -- 172.21.15.16:0/4106889302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b4410f460 msgr2=0x7f7b441a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b4410f460 0x7f7b441a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 -- 172.21.15.16:0/4106889302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b441018b0 msgr2=0x7f7b4419b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b441018b0 0x7f7b4419b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 -- 172.21.15.16:0/4106889302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b441a1570 con 0x7f7b441021d0 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b441018b0 0x7f7b4419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b492a7640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4419ba00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7b38005940 tx=0x7f7b380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b42ffd640 1 -- 172.21.15.16:0/4106889302 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3803f030 con 0x7f7b441021d0 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b42ffd640 1 -- 172.21.15.16:0/4106889302 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b38003cb0 con 0x7f7b441021d0 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b441a1800 con 0x7f7b441021d0 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b42ffd640 1 -- 172.21.15.16:0/4106889302 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38035070 con 0x7f7b441021d0 2024-09-10T23:47:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.500+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b441a7f20 con 0x7f7b441021d0 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 Processor -- start 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b42ffd640 1 -- 172.21.15.16:0/4106889302 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f7b3803bbf0 con 0x7f7b441021d0 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 -- start start 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e981a10 0x56267e98d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e98d9a0 0x56267e98fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56267e8f7ea0 con 0x56267e98d9a0 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56267e8e72d0 con 0x56267e981a10 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56267e8eb0e0 con 0x56267e9810f0 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e98d9a0 0x56267e98fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b49aa8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e981a10 0x56267e98d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b49aa8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e981a10 0x56267e98d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:49460/0 (socket says 172.21.15.16:49460) 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e98d9a0 0x56267e98fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42534/0 (socket says 172.21.15.16:42534) 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.503+0000 7f7b49aa8640 1 -- 172.21.15.16:0/3770746422 learned_addr learned my addr 172.21.15.16:0/3770746422 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b492a7640 1 -- 172.21.15.16:0/3770746422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 msgr2=0x56267e9814d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b492a7640 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9814d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b492a7640 1 -- 172.21.15.16:0/3770746422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e981a10 msgr2=0x56267e98d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b492a7640 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e981a10 0x56267e98d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b492a7640 1 -- 172.21.15.16:0/3770746422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267e645650 con 0x56267e98d9a0 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e981a10 0x56267e98d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b42ffd640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b2c0b5450 0x7f7b2c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b492a7640 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e98d9a0 0x56267e98fd90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7b381042b0 tx=0x7f7b3810ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906246f506ba4177 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b2c0b5450 0x7f7b2c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b42ffd640 1 -- 172.21.15.16:0/4106889302 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f7b38106b30 con 0x7f7b441021d0 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b2bfff640 1 -- 172.21.15.16:0/3770746422 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380c9630 con 0x56267e98d9a0 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b2bfff640 1 -- 172.21.15.16:0/3770746422 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b380ccaf0 con 0x56267e98d9a0 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.504+0000 7f7b2bfff640 1 -- 172.21.15.16:0/3770746422 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38005d50 con 0x56267e98d9a0 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/3770746422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e98d9a0 msgr2=0x56267e98fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b2c0b5450 0x7f7b2c0b7910 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c005fd0 tx=0x7f7b3c005cc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e98d9a0 0x56267e98fd90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7b381042b0 tx=0x7f7b3810ae00 comp rx=0 tx=0).stop 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/3770746422 shutdown_connections 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e98d9a0 0x56267e98fd90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e981a10 0x56267e98d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/3770746422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9814d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/3770746422 >> 172.21.15.16:0/3770746422 conn(0x56267e97ef20 msgr2=0x56267e9800c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/3770746422 shutdown_connections 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.505+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/3770746422 wait complete. 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 -- start start 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 Processor -- start 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e9810f0 0x56267e98d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e981a10 0x56267e98a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e98ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56267e748700 con 0x56267e9810f0 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56267e882160 con 0x56267e98d9a0 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56267e9903e0 con 0x56267e981a10 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b4e0e1740 10 client.0 _ll_register_callbacks cb 0x56267e89b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b49aa8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e9810f0 0x56267e98d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b49aa8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e9810f0 0x56267e98d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42538/0 (socket says 172.21.15.16:42538) 2024-09-10T23:47:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b49aa8640 1 -- 172.21.15.16:0/2289724703 learned_addr learned my addr 172.21.15.16:0/2289724703 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.506+0000 7f7b492a7640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e981a10 0x56267e98a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e98ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b49aa8640 1 -- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e981a10 msgr2=0x56267e98a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e981a10 0x56267e98a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b49aa8640 1 -- 172.21.15.16:0/2289724703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 msgr2=0x56267e98ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e98ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b49aa8640 1 -- 172.21.15.16:0/2289724703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267e8afc90 con 0x56267e9810f0 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e98ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e9810f0 0x56267e98d310 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7b34012700 tx=0x7f7b3400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d109fbfa8a8994 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b297fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:24.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b297fa640 1 -- 172.21.15.16:0/2289724703 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34010dc0 con 0x56267e9810f0 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b297fa640 1 -- 172.21.15.16:0/2289724703 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f7b34004b20 con 0x56267e9810f0 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b380ccaf0 con 0x56267e9810f0 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b297fa640 1 -- 172.21.15.16:0/2289724703 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7b34004d20 con 0x56267e9810f0 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b4e0e1740 10 client.16866 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.507+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56267e99bd30 con 0x56267e9810f0 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b297fa640 1 -- 172.21.15.16:0/2289724703 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b380ccaf0 con 0x56267e9810f0 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b297fa640 1 -- 172.21.15.16:0/2289724703 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7b34019070 con 0x56267e9810f0 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b4e0e1740 10 client.16866 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b4e0e1740 10 client.16866 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b4e0e1740 20 client.16866 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267e99d290 0x56267e99f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b4e0e1740 4 client.16866 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56267e8f9df0 con 0x56267e99d290 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b492a7640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267e99d290 0x56267e99f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b297fa640 10 client.16866 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.508+0000 7f7b492a7640 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267e99d290 0x56267e99f680 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f5009d4622bece1 server_cookie=c4bf779e5991c7f9 in_seq=0 out_seq=0 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b297fa640 1 -- 172.21.15.16:0/2289724703 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56267e8f9df0 con 0x56267e99d290 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b297fa640 10 client.16866 handle_command_reply: tid=0 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 client.16866 shutdown 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e9810f0 msgr2=0x56267e98d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e9810f0 0x56267e98d310 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7b34012700 tx=0x7f7b3400af90 comp rx=0 tx=0).stop 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 shutdown_connections 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267e99d290 0x56267e99f680 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e98ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e981a10 0x56267e98a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b297fa640 0 client.16866 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/2289724703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e9810f0 0x56267e98d310 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 >> 172.21.15.16:0/2289724703 conn(0x56267e97ef20 msgr2=0x56267e984ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.509+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 shutdown_connections 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.510+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/2289724703 wait complete. 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.510+0000 7f7b4e0e1740 20 client.16866 trim_cache size 0 max 16384 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.523+0000 7f7b4e0e1740 1 Processor -- start 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.523+0000 7f7b4e0e1740 1 -- start start 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e9810f0 0x56267e9995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e98ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e98d9a0 0x56267e98f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441b3140 con 0x56267e981a10 2024-09-10T23:47:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441b0a10 con 0x56267e9810f0 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441ae880 con 0x56267e98d9a0 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e98ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e98ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42546/0 (socket says 172.21.15.16:42546) 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 -- 172.21.15.16:0/1551211186 learned_addr learned my addr 172.21.15.16:0/1551211186 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e98d9a0 0x56267e98f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e9810f0 0x56267e9995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 -- 172.21.15.16:0/1551211186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e98d9a0 msgr2=0x56267e98f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e98d9a0 0x56267e98f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 -- 172.21.15.16:0/1551211186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e9810f0 msgr2=0x56267e9995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e9810f0 0x56267e9995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 -- 172.21.15.16:0/1551211186 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267e99f9f0 con 0x56267e981a10 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e98d9a0 0x56267e98f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.524+0000 7f7b492a7640 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e98ed90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7b380ca250 tx=0x7f7b38005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684659de24544760 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/1551211186 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38049040 con 0x56267e981a10 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/1551211186 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b380ccaf0 con 0x56267e981a10 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b2b7fe640 1 -- 172.21.15.16:0/1551211186 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380cc750 con 0x56267e981a10 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/1551211186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 msgr2=0x56267e98ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e98ed90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7b380ca250 tx=0x7f7b38005c90 comp rx=0 tx=0).stop 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/1551211186 shutdown_connections 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e98d9a0 0x56267e98f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e98ed90 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/1551211186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e9810f0 0x56267e9995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/1551211186 >> 172.21.15.16:0/1551211186 conn(0x56267e97ef20 msgr2=0x56267e97df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/1551211186 shutdown_connections 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.525+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/1551211186 wait complete. 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 -- start start 2024-09-10T23:47:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 Processor -- start 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9958d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e995e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e990650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441aeed0 con 0x56267e981a10 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441b0340 con 0x56267e98d9a0 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b441af5a0 con 0x56267e9810f0 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b4e0e1740 10 client.0 _ll_register_callbacks cb 0x7f7b34005c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e995e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b492a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e995e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42548/0 (socket says 172.21.15.16:42548) 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.526+0000 7f7b492a7640 1 -- 172.21.15.16:0/24634141 learned_addr learned my addr 172.21.15.16:0/24634141 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b4a2a9640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e990650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b492a7640 1 -- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 msgr2=0x56267e9958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b492a7640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9958d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b492a7640 1 -- 172.21.15.16:0/24634141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 msgr2=0x56267e990650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b492a7640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e990650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b492a7640 1 -- 172.21.15.16:0/24634141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267e990e80 con 0x56267e981a10 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b492a7640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e995e70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7b38104360 tx=0x7f7b3803b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f975d9316a3e932 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b297fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b297fa640 1 -- 172.21.15.16:0/24634141 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38049070 con 0x56267e981a10 2024-09-10T23:47:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b297fa640 1 -- 172.21.15.16:0/24634141 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f7b38104530 con 0x56267e981a10 2024-09-10T23:47:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b380ccaf0 con 0x56267e981a10 2024-09-10T23:47:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b297fa640 1 -- 172.21.15.16:0/24634141 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7b380cc930 con 0x56267e981a10 2024-09-10T23:47:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b4e0e1740 10 client.16872 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.527+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56267ea0acd0 con 0x56267e981a10 2024-09-10T23:47:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b297fa640 1 -- 172.21.15.16:0/24634141 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b38078e50 con 0x56267e981a10 2024-09-10T23:47:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b297fa640 1 -- 172.21.15.16:0/24634141 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7b380cd240 con 0x56267e981a10 2024-09-10T23:47:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b4e0e1740 10 client.16872 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b4e0e1740 10 client.16872 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:47:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b4e0e1740 20 client.16872 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267ea0afb0 0x56267ea0d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b4e0e1740 4 client.16872 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56267e8f58a0 con 0x56267ea0afb0 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267ea0afb0 0x56267ea0d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b49aa8640 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267ea0afb0 0x56267ea0d3d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d647b740a384666e server_cookie=a4dcda4d2b8f378e in_seq=0 out_seq=0 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.528+0000 7f7b297fa640 10 client.16872 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b297fa640 1 -- 172.21.15.16:0/24634141 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56267e8f58a0 con 0x56267ea0afb0 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b297fa640 10 client.16872 handle_command_reply: tid=0 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 client.16872 shutdown 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 msgr2=0x56267e995e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e995e70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7b38104360 tx=0x7f7b3803b6b0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 shutdown_connections 2024-09-10T23:47:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x56267ea0afb0 0x56267ea0d3d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267e98d9a0 0x56267e990650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56267e981a10 0x56267e995e70 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b297fa640 0 client.16872 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 --2- 172.21.15.16:0/24634141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56267e9810f0 0x56267e9958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 >> 172.21.15.16:0/24634141 conn(0x56267e97ef20 msgr2=0x56267e97d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 shutdown_connections 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 1 -- 172.21.15.16:0/24634141 wait complete. 2024-09-10T23:47:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.529+0000 7f7b4e0e1740 20 client.16872 trim_cache size 0 max 16384 2024-09-10T23:47:24.555 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:47:24.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b2c0b5450 msgr2=0x7f7b2c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b2c0b5450 0x7f7b2c0b7910 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c005fd0 tx=0x7f7b3c005cc0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 msgr2=0x7f7b4419ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4419ba00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7b38005940 tx=0x7f7b380042f0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 shutdown_connections 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b4410f460 0x7f7b441a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b441021d0 0x7f7b4419ba00 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7b2c0b5450 0x7f7b2c0b7910 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 --2- 172.21.15.16:0/4106889302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b441018b0 0x7f7b4419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 >> 172.21.15.16:0/4106889302 conn(0x7f7b440fd700 msgr2=0x7f7b440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 shutdown_connections 2024-09-10T23:47:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:24.530+0000 7f7b4bd0c640 1 -- 172.21.15.16:0/4106889302 wait complete. 2024-09-10T23:47:25.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:47:25.458 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:47:25.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 -- 172.21.15.16:0/925249615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20103ce0 msgr2=0x7f1f201040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 --2- 172.21.15.16:0/925249615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20103ce0 0x7f1f201040c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009900 tx=0x7f1f1002a410 comp rx=0 tx=0).stop 2024-09-10T23:47:25.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 -- 172.21.15.16:0/925249615 shutdown_connections 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 --2- 172.21.15.16:0/925249615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f2010d140 0x7f1f2010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 --2- 172.21.15.16:0/925249615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f20104600 0x7f1f2010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 --2- 172.21.15.16:0/925249615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20103ce0 0x7f1f201040c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 -- 172.21.15.16:0/925249615 >> 172.21.15.16:0/925249615 conn(0x7f1f200fd720 msgr2=0x7f1f200ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 -- 172.21.15.16:0/925249615 shutdown_connections 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.948+0000 7f1f26270640 1 -- 172.21.15.16:0/925249615 wait complete. 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 Processor -- start 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 -- start start 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f20103ce0 0x7f1f201994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20104600 0x7f1f201999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f2010d140 0x7f1f2019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f20112e90 con 0x7f1f20104600 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f20112d10 con 0x7f1f20103ce0 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.949+0000 7f1f26270640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f20113010 con 0x7f1f2010d140 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20104600 0x7f1f201999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20104600 0x7f1f201999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42558/0 (socket says 172.21.15.16:42558) 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/1449291281 learned_addr learned my addr 172.21.15.16:0/1449291281 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f20103ce0 0x7f1f201994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f2480d640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f2010d140 0x7f1f2019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/1449291281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f2010d140 msgr2=0x7f1f2019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f2010d140 0x7f1f2019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/1449291281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f20103ce0 msgr2=0x7f1f201994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f20103ce0 0x7f1f201994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/1449291281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2019f550 con 0x7f1f20104600 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20104600 0x7f1f201999e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b3c0 tx=0x7f1f1400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1d7fa640 1 -- 172.21.15.16:0/1449291281 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14011830 con 0x7f1f20104600 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1d7fa640 1 -- 172.21.15.16:0/1449291281 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f14016070 con 0x7f1f20104600 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2019f840 con 0x7f1f20104600 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f1d7fa640 1 -- 172.21.15.16:0/1449291281 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14010de0 con 0x7f1f20104600 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.950+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f201a5f00 con 0x7f1f20104600 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 Processor -- start 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 -- start start 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae98884d0 0x55cae98888b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f1d7fa640 1 -- 172.21.15.16:0/1449291281 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f1f140119d0 con 0x7f1f20104600 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae9898c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae989b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cae97feea0 con 0x55cae98884d0 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cae97ee2d0 con 0x55cae9888df0 2024-09-10T23:47:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f28645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cae97f20e0 con 0x55cae9899190 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f2480d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae98884d0 0x55cae98888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f2480d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae98884d0 0x55cae98888b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42574/0 (socket says 172.21.15.16:42574) 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.953+0000 7f1f2480d640 1 -- 172.21.15.16:0/1409150822 learned_addr learned my addr 172.21.15.16:0/1409150822 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae9898c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae989b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f2480d640 1 -- 172.21.15.16:0/1409150822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 msgr2=0x55cae989b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f2480d640 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae989b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f2480d640 1 -- 172.21.15.16:0/1409150822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 msgr2=0x55cae9898c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f2480d640 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae9898c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f2480d640 1 -- 172.21.15.16:0/1409150822 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae954c650 con 0x55cae98884d0 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f2480d640 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae98884d0 0x55cae98888b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009f50 tx=0x7f1f1800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2131870df06e5cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f067fc640 1 -- 172.21.15.16:0/1409150822 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1801a070 con 0x55cae98884d0 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f067fc640 1 -- 172.21.15.16:0/1409150822 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f180158c0 con 0x55cae98884d0 2024-09-10T23:47:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f067fc640 1 -- 172.21.15.16:0/1409150822 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800a860 con 0x55cae98884d0 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f1d7fa640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b5450 0x7f1f080b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.954+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b5450 0x7f1f080b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f1d7fa640 1 -- 172.21.15.16:0/1449291281 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f1f140e5590 con 0x7f1f20104600 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 -- 172.21.15.16:0/1409150822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae98884d0 msgr2=0x55cae98888b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b5450 0x7f1f080b7910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f10031440 tx=0x7f1f10005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae98884d0 0x55cae98888b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009f50 tx=0x7f1f1800c8b0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 -- 172.21.15.16:0/1409150822 shutdown_connections 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae989b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae9898c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 --2- 172.21.15.16:0/1409150822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae98884d0 0x55cae98888b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 -- 172.21.15.16:0/1409150822 >> 172.21.15.16:0/1409150822 conn(0x55cae9886300 msgr2=0x55cae98874a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 -- 172.21.15.16:0/1409150822 shutdown_connections 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 -- 172.21.15.16:0/1409150822 wait complete. 2024-09-10T23:47:25.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.955+0000 7f1f28645740 1 -- start start 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 1 Processor -- start 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae9898a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae9895ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98964f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cae964f700 con 0x55cae9888df0 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cae9789160 con 0x55cae98884d0 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cae989be40 con 0x55cae9899190 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae9895ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae9895ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42590/0 (socket says 172.21.15.16:42590) 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/741040746 learned_addr learned my addr 172.21.15.16:0/741040746 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f28645740 10 client.0 _ll_register_callbacks cb 0x55cae97a29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f2480d640 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae9898a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/741040746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 msgr2=0x55cae98964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 msgr2=0x55cae9898a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae9898a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.956+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/741040746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cae97b6c90 con 0x55cae9888df0 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae9895ee0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b390 tx=0x7f1f14010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94410a57a31a2768 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1eff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1eff7fe640 1 -- 172.21.15.16:0/741040746 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140a7110 con 0x55cae9888df0 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1eff7fe640 1 -- 172.21.15.16:0/741040746 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f1f140a7c10 con 0x55cae9888df0 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f180158c0 con 0x55cae9888df0 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1eff7fe640 1 -- 172.21.15.16:0/741040746 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f140ab4b0 con 0x55cae9888df0 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 10 client.16884 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cae98a77f0 con 0x55cae9888df0 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1eff7fe640 1 -- 172.21.15.16:0/741040746 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f180158c0 con 0x55cae9888df0 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1eff7fe640 1 -- 172.21.15.16:0/741040746 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f140b0020 con 0x55cae9888df0 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 10 client.16884 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 10 client.16884 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 20 client.16884 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae98a8c00 0x55cae98aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 4 client.16884 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.957+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cae9800df0 con 0x55cae98a8c00 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.958+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae98a8c00 0x55cae98aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.958+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae98a8c00 0x55cae98aaff0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a673dcae676dcddf server_cookie=7f5f0c8e74e85796 in_seq=0 out_seq=0 2024-09-10T23:47:25.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.958+0000 7f1eff7fe640 10 client.16884 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1eff7fe640 1 -- 172.21.15.16:0/741040746 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cae9800df0 con 0x55cae98a8c00 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1eff7fe640 10 client.16884 handle_command_reply: tid=0 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 client.16884 shutdown 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 msgr2=0x55cae9895ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae9895ee0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b390 tx=0x7f1f14010800 comp rx=0 tx=0).stop 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 shutdown_connections 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae98a8c00 0x55cae98aaff0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae9895ee0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1eff7fe640 0 client.16884 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 --2- 172.21.15.16:0/741040746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae9898a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 >> 172.21.15.16:0/741040746 conn(0x55cae9886300 msgr2=0x55cae988be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:25.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 shutdown_connections 2024-09-10T23:47:25.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 1 -- 172.21.15.16:0/741040746 wait complete. 2024-09-10T23:47:25.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.959+0000 7f1f28645740 20 client.16884 trim_cache size 0 max 16384 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 Processor -- start 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 -- start start 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae98a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae98b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201aedd0 con 0x55cae9888df0 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201ac6a0 con 0x55cae98884d0 2024-09-10T23:47:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f28645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201aa510 con 0x55cae9899190 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae98b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae98b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42604/0 (socket says 172.21.15.16:42604) 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/2329857757 learned_addr learned my addr 172.21.15.16:0/2329857757 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f2480d640 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/2329857757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 msgr2=0x55cae98b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/2329857757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 msgr2=0x55cae98a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae98a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae98a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1f7fe640 1 -- 172.21.15.16:0/2329857757 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cae9886130 con 0x55cae9888df0 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f2480d640 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.973+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae98a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae98b08c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400bd80 tx=0x7f1f140aac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf1742e223fbf42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f05ffb640 1 -- 172.21.15.16:0/2329857757 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140a7110 con 0x55cae9888df0 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f05ffb640 1 -- 172.21.15.16:0/2329857757 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140ac0a0 con 0x55cae9888df0 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f05ffb640 1 -- 172.21.15.16:0/2329857757 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140ab2f0 con 0x55cae9888df0 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f28645740 1 -- 172.21.15.16:0/2329857757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 msgr2=0x55cae98b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f28645740 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae98b08c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400bd80 tx=0x7f1f140aac50 comp rx=0 tx=0).stop 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f28645740 1 -- 172.21.15.16:0/2329857757 shutdown_connections 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f28645740 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae9899190 0x55cae98b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f28645740 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9888df0 0x55cae98b08c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f28645740 1 --2- 172.21.15.16:0/2329857757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae98884d0 0x55cae98a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.974+0000 7f1f28645740 1 -- 172.21.15.16:0/2329857757 >> 172.21.15.16:0/2329857757 conn(0x55cae9886300 msgr2=0x55cae9897d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 -- 172.21.15.16:0/2329857757 shutdown_connections 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 -- 172.21.15.16:0/2329857757 wait complete. 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 -- start start 2024-09-10T23:47:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 Processor -- start 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae98884d0 0x55cae98a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae989e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9899190 0x55cae989e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201aab60 con 0x55cae9899190 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201abfd0 con 0x55cae9888df0 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f201ab230 con 0x55cae98884d0 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.975+0000 7f1f28645740 10 client.0 _ll_register_callbacks cb 0x7f1f14010fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9899190 0x55cae989e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9899190 0x55cae989e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42608/0 (socket says 172.21.15.16:42608) 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 -- 172.21.15.16:0/3415635469 learned_addr learned my addr 172.21.15.16:0/3415635469 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f1f7fe640 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae989e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae98884d0 0x55cae98a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 -- 172.21.15.16:0/3415635469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae98884d0 msgr2=0x55cae98a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae98884d0 0x55cae98a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 -- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 msgr2=0x55cae989e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae989e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 -- 172.21.15.16:0/3415635469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cae9915ad0 con 0x55cae9899190 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f2480d640 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9899190 0x55cae989e830 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c3f0 tx=0x7f1f1800a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7727e9ffde496678 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1eff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1eff7fe640 1 -- 172.21.15.16:0/3415635469 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1801a040 con 0x55cae9899190 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f140ac0a0 con 0x55cae9899190 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.976+0000 7f1eff7fe640 1 -- 172.21.15.16:0/3415635469 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f1f1800aaa0 con 0x55cae9899190 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1eff7fe640 1 -- 172.21.15.16:0/3415635469 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f18030050 con 0x55cae9899190 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 10 client.16890 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cae9916cc0 con 0x55cae9899190 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1eff7fe640 1 -- 172.21.15.16:0/3415635469 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140ac0a0 con 0x55cae9899190 2024-09-10T23:47:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1eff7fe640 1 -- 172.21.15.16:0/3415635469 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f18021b80 con 0x55cae9899190 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 10 client.16890 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 10 client.16890 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 20 client.16890 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae9917100 0x55cae99194f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 4 client.16890 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cae97fc8a0 con 0x55cae9917100 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.977+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae9917100 0x55cae99194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f1ffff640 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae9917100 0x55cae99194f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b15aea6cca609d6 server_cookie=4fe82237629da31b in_seq=0 out_seq=0 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1eff7fe640 10 client.16890 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1eff7fe640 1 -- 172.21.15.16:0/3415635469 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cae97fc8a0 con 0x55cae9917100 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1eff7fe640 10 client.16890 handle_command_reply: tid=0 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 client.16890 shutdown 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9899190 msgr2=0x55cae989e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9899190 0x55cae989e830 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c3f0 tx=0x7f1f1800a930 comp rx=0 tx=0).stop 2024-09-10T23:47:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 shutdown_connections 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55cae9917100 0x55cae99194f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cae9899190 0x55cae989e830 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cae9888df0 0x55cae989e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 --2- 172.21.15.16:0/3415635469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cae98884d0 0x55cae98a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 >> 172.21.15.16:0/3415635469 conn(0x55cae9886300 msgr2=0x55cae9894760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1eff7fe640 0 client.16890 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 shutdown_connections 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 1 -- 172.21.15.16:0/3415635469 wait complete. 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.978+0000 7f1f28645740 20 client.16890 trim_cache size 0 max 16384 2024-09-10T23:47:25.987 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:47:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b5450 msgr2=0x7f1f080b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b5450 0x7f1f080b7910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f10031440 tx=0x7f1f10005e80 comp rx=0 tx=0).stop 2024-09-10T23:47:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20104600 msgr2=0x7f1f201999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20104600 0x7f1f201999e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b3c0 tx=0x7f1f1400b880 comp rx=0 tx=0).stop 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 shutdown_connections 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f2010d140 0x7f1f2019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f20104600 0x7f1f201999e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1f080b5450 0x7f1f080b7910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 --2- 172.21.15.16:0/1449291281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f20103ce0 0x7f1f201994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 >> 172.21.15.16:0/1449291281 conn(0x7f1f200fd720 msgr2=0x7f1f200fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 shutdown_connections 2024-09-10T23:47:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:25.979+0000 7f1f26270640 1 -- 172.21.15.16:0/1449291281 wait complete. 2024-09-10T23:47:26.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:25 smithi016 ceph-mon[30855]: pgmap v538: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:26.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:25 smithi071 ceph-mon[35018]: pgmap v538: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:26.304 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:25 smithi066 ceph-mon[34761]: pgmap v538: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:26.795 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:47:27.055 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:47:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 -- 172.21.15.16:0/3382448039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 msgr2=0x7f8490102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 --2- 172.21.15.16:0/3382448039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f8490102070 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8480009900 tx=0x7f848002a410 comp rx=0 tx=0).stop 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 -- 172.21.15.16:0/3382448039 shutdown_connections 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 --2- 172.21.15.16:0/3382448039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8490108020 0x7f849010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 --2- 172.21.15.16:0/3382448039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84901076a0 0x7f8490107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 --2- 172.21.15.16:0/3382448039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f8490102070 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 -- 172.21.15.16:0/3382448039 >> 172.21.15.16:0/3382448039 conn(0x7f84900fd700 msgr2=0x7f84900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 -- 172.21.15.16:0/3382448039 shutdown_connections 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.566+0000 7f84971fe640 1 -- 172.21.15.16:0/3382448039 wait complete. 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 Processor -- start 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 -- start start 2024-09-10T23:47:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f84901992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84901076a0 0x7f8490199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8490108020 0x7f849019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111ce0 con 0x7f8490101c90 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111b60 con 0x7f8490108020 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f84971fe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111e60 con 0x7f84901076a0 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f8494f9a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f84901992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f8494f9a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f84901992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42624/0 (socket says 172.21.15.16:42624) 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f8494f9a640 1 -- 172.21.15.16:0/487195672 learned_addr learned my addr 172.21.15.16:0/487195672 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f848ffff640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84901076a0 0x7f8490199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f849579b640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8490108020 0x7f849019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f8494f9a640 1 -- 172.21.15.16:0/487195672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84901076a0 msgr2=0x7f8490199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.567+0000 7f8494f9a640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84901076a0 0x7f8490199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f8494f9a640 1 -- 172.21.15.16:0/487195672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8490108020 msgr2=0x7f849019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f8494f9a640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8490108020 0x7f849019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f8494f9a640 1 -- 172.21.15.16:0/487195672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849019f3a0 con 0x7f8490101c90 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f848ffff640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84901076a0 0x7f8490199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f849579b640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8490108020 0x7f849019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f8494f9a640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f84901992f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8480005940 tx=0x7f84800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f848dffb640 1 -- 172.21.15.16:0/487195672 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848003f030 con 0x7f8490101c90 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f848dffb640 1 -- 172.21.15.16:0/487195672 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8480003cb0 con 0x7f8490101c90 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849019f630 con 0x7f8490101c90 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f848dffb640 1 -- 172.21.15.16:0/487195672 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480035070 con 0x7f8490101c90 2024-09-10T23:47:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.568+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84901a5d50 con 0x7f8490101c90 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.571+0000 7f84995d3740 1 Processor -- start 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.571+0000 7f84995d3740 1 -- start start 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.571+0000 7f848dffb640 1 -- 172.21.15.16:0/487195672 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f848003bb70 con 0x7f8490101c90 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f84995d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286de0f0 0x564a286de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f84995d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286dea10 0x564a286ea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f84995d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286ea9a0 0x564a286ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f84995d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564a28654ea0 con 0x564a286de0f0 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f84995d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564a286442d0 con 0x564a286dea10 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f84995d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a286480e0 con 0x564a286ea9a0 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286de0f0 0x564a286de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286de0f0 0x564a286de4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42628/0 (socket says 172.21.15.16:42628) 2024-09-10T23:47:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 -- 172.21.15.16:0/1259388559 learned_addr learned my addr 172.21.15.16:0/1259388559 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f848ffff640 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286ea9a0 0x564a286ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f8494f9a640 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286dea10 0x564a286ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 -- 172.21.15.16:0/1259388559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286ea9a0 msgr2=0x564a286ecd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286ea9a0 0x564a286ecd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 -- 172.21.15.16:0/1259388559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286dea10 msgr2=0x564a286ea460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286dea10 0x564a286ea460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 -- 172.21.15.16:0/1259388559 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a283a2650 con 0x564a286de0f0 2024-09-10T23:47:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f849579b640 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286de0f0 0x564a286de4d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f848800f410 tx=0x7f848800f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e09a57ebe8f4bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f848dffb640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f84780b54d0 0x7f84780b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.572+0000 7f8476ffd640 1 -- 172.21.15.16:0/1259388559 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488015070 con 0x564a286de0f0 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f8494f9a640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f84780b54d0 0x7f84780b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f8476ffd640 1 -- 172.21.15.16:0/1259388559 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8488011bb0 con 0x564a286de0f0 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f8476ffd640 1 -- 172.21.15.16:0/1259388559 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488010c00 con 0x564a286de0f0 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f848dffb640 1 -- 172.21.15.16:0/487195672 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f8480106b60 con 0x7f8490101c90 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 -- 172.21.15.16:0/1259388559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286de0f0 msgr2=0x564a286de4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f8494f9a640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f84780b54d0 0x7f84780b7990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8480104390 tx=0x7f848002a410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286de0f0 0x564a286de4d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f848800f410 tx=0x7f848800f8d0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 -- 172.21.15.16:0/1259388559 shutdown_connections 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286ea9a0 0x564a286ecd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286dea10 0x564a286ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 --2- 172.21.15.16:0/1259388559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286de0f0 0x564a286de4d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 -- 172.21.15.16:0/1259388559 >> 172.21.15.16:0/1259388559 conn(0x564a286dbf20 msgr2=0x564a286dd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 -- 172.21.15.16:0/1259388559 shutdown_connections 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.573+0000 7f84995d3740 1 -- 172.21.15.16:0/1259388559 wait complete. 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 -- start start 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 Processor -- start 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286de0f0 0x564a286ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286dea10 0x564a286e7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286ea9a0 0x564a286e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564a284a5700 con 0x564a286ea9a0 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564a285df160 con 0x564a286de0f0 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564a286ed620 con 0x564a286dea10 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.574+0000 7f84995d3740 10 client.0 _ll_register_callbacks cb 0x564a285f89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286ea9a0 0x564a286e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286ea9a0 0x564a286e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42642/0 (socket says 172.21.15.16:42642) 2024-09-10T23:47:27.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 -- 172.21.15.16:0/721297661 learned_addr learned my addr 172.21.15.16:0/721297661 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f848ffff640 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286dea10 0x564a286e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286de0f0 0x564a286ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 -- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286dea10 msgr2=0x564a286e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286dea10 0x564a286e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 -- 172.21.15.16:0/721297661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286de0f0 msgr2=0x564a286ea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286de0f0 0x564a286ea2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 -- 172.21.15.16:0/721297661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a2860cc90 con 0x564a286ea9a0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f849579b640 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286ea9a0 0x564a286e7d30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8488009a70 tx=0x7f84880107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eb939d6aa39673 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f846ffff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f846ffff640 1 -- 172.21.15.16:0/721297661 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488015040 con 0x564a286ea9a0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f846ffff640 1 -- 172.21.15.16:0/721297661 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f8488010d70 con 0x564a286ea9a0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8488011bb0 con 0x564a286ea9a0 2024-09-10T23:47:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f846ffff640 1 -- 172.21.15.16:0/721297661 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8488031050 con 0x564a286ea9a0 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.575+0000 7f84995d3740 10 client.16902 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a286f8f80 con 0x564a286ea9a0 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f846ffff640 1 -- 172.21.15.16:0/721297661 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8488011bb0 con 0x564a286ea9a0 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f846ffff640 1 -- 172.21.15.16:0/721297661 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f848801a830 con 0x564a286ea9a0 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f84995d3740 10 client.16902 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f84995d3740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f84995d3740 20 client.16902 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f84995d3740 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a286fa330 0x564a286fc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f84995d3740 4 client.16902 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a28656df0 con 0x564a286fa330 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.576+0000 7f848ffff640 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a286fa330 0x564a286fc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.577+0000 7f848ffff640 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a286fa330 0x564a286fc720 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ece61696b8155023 server_cookie=6932a66e53d019f2 in_seq=0 out_seq=0 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.577+0000 7f846ffff640 10 client.16902 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.577+0000 7f846ffff640 1 -- 172.21.15.16:0/721297661 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a28656df0 con 0x564a286fa330 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.577+0000 7f846ffff640 10 client.16902 handle_command_reply: tid=0 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.577+0000 7f84995d3740 1 client.16902 shutdown 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286ea9a0 msgr2=0x564a286e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286ea9a0 0x564a286e7d30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8488009a70 tx=0x7f84880107e0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 shutdown_connections 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a286fa330 0x564a286fc720 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286ea9a0 0x564a286e7d30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286dea10 0x564a286e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f846ffff640 0 client.16902 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 --2- 172.21.15.16:0/721297661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286de0f0 0x564a286ea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 >> 172.21.15.16:0/721297661 conn(0x564a286dbf20 msgr2=0x564a286e1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 shutdown_connections 2024-09-10T23:47:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 1 -- 172.21.15.16:0/721297661 wait complete. 2024-09-10T23:47:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.578+0000 7f84995d3740 20 client.16902 trim_cache size 0 max 16384 2024-09-10T23:47:27.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.591+0000 7f84995d3740 1 Processor -- start 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.591+0000 7f84995d3740 1 -- start start 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f84995d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f84995d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f84995d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f84995d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f84901b0f70 con 0x564a286dea10 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f84995d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ae840 con 0x564a286ea9a0 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f84995d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ac6b0 con 0x564a286de0f0 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42648/0 (socket says 172.21.15.16:42648) 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 -- 172.21.15.16:0/4208969906 learned_addr learned my addr 172.21.15.16:0/4208969906 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f849579b640 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f849579b640 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 -- 172.21.15.16:0/4208969906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 msgr2=0x564a286dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 -- 172.21.15.16:0/4208969906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 msgr2=0x564a286ebd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ebd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 -- 172.21.15.16:0/4208969906 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a286e3170 con 0x564a286dea10 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f849579b640 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.592+0000 7f848ffff640 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f6850 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f848400bd20 tx=0x7f8484004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89868513974202 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84767fc640 1 -- 172.21.15.16:0/4208969906 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484003b80 con 0x564a286dea10 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84767fc640 1 -- 172.21.15.16:0/4208969906 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8484003d20 con 0x564a286dea10 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84767fc640 1 -- 172.21.15.16:0/4208969906 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484012750 con 0x564a286dea10 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 -- 172.21.15.16:0/4208969906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 msgr2=0x564a286f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f6850 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f848400bd20 tx=0x7f8484004410 comp rx=0 tx=0).stop 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 -- 172.21.15.16:0/4208969906 shutdown_connections 2024-09-10T23:47:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f6850 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 --2- 172.21.15.16:0/4208969906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 -- 172.21.15.16:0/4208969906 >> 172.21.15.16:0/4208969906 conn(0x564a286dbf20 msgr2=0x564a286dd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 -- 172.21.15.16:0/4208969906 shutdown_connections 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.593+0000 7f84995d3740 1 -- 172.21.15.16:0/4208969906 wait complete. 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 -- start start 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 Processor -- start 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ed870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f84901acd00 con 0x564a286dea10 2024-09-10T23:47:27.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ae170 con 0x564a286ea9a0 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ad3d0 con 0x564a286de0f0 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f84995d3740 10 client.0 _ll_register_callbacks cb 0x7f8488009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f848ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f848ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42658/0 (socket says 172.21.15.16:42658) 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f848ffff640 1 -- 172.21.15.16:0/4053345623 learned_addr learned my addr 172.21.15.16:0/4053345623 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f849579b640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.594+0000 7f849579b640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f848ffff640 1 -- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 msgr2=0x564a286f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f848ffff640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f848ffff640 1 -- 172.21.15.16:0/4053345623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 msgr2=0x564a286ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f848ffff640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f848ffff640 1 -- 172.21.15.16:0/4053345623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a286f3630 con 0x564a286dea10 2024-09-10T23:47:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f849579b640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f848ffff640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f2e00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8484003fd0 tx=0x7f848400bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4ea3fcaca9b313 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f846ffff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f846ffff640 1 -- 172.21.15.16:0/4053345623 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484033060 con 0x564a286dea10 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f846ffff640 1 -- 172.21.15.16:0/4053345623 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f8484005110 con 0x564a286dea10 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8484003d20 con 0x564a286dea10 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f846ffff640 1 -- 172.21.15.16:0/4053345623 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8484029040 con 0x564a286dea10 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f84995d3740 10 client.16908 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.595+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a28767720 con 0x564a286dea10 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f846ffff640 1 -- 172.21.15.16:0/4053345623 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8484003d20 con 0x564a286dea10 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f846ffff640 1 -- 172.21.15.16:0/4053345623 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f848402c030 con 0x564a286dea10 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f84995d3740 10 client.16908 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f84995d3740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:27.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f84995d3740 20 client.16908 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f84995d3740 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a28767d30 0x564a2876a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f84995d3740 4 client.16908 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a286528a0 con 0x564a28767d30 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f849579b640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a28767d30 0x564a2876a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f849579b640 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a28767d30 0x564a2876a120 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=971495cf349ee2ff server_cookie=833447152d7e9d32 in_seq=0 out_seq=0 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.596+0000 7f846ffff640 10 client.16908 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f846ffff640 1 -- 172.21.15.16:0/4053345623 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a286528a0 con 0x564a28767d30 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f846ffff640 10 client.16908 handle_command_reply: tid=0 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 client.16908 shutdown 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 msgr2=0x564a286f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f2e00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8484003fd0 tx=0x7f848400bb60 comp rx=0 tx=0).stop 2024-09-10T23:47:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 shutdown_connections 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x564a28767d30 0x564a2876a120 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a286ea9a0 0x564a286ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564a286dea10 0x564a286f2e00 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 --2- 172.21.15.16:0/4053345623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564a286de0f0 0x564a286f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f846ffff640 0 client.16908 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 >> 172.21.15.16:0/4053345623 conn(0x564a286dbf20 msgr2=0x564a286e8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 shutdown_connections 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 1 -- 172.21.15.16:0/4053345623 wait complete. 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.597+0000 7f84995d3740 20 client.16908 trim_cache size 0 max 16384 2024-09-10T23:47:27.614 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f84780b54d0 msgr2=0x7f84780b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f84780b54d0 0x7f84780b7990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8480104390 tx=0x7f848002a410 comp rx=0 tx=0).stop 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 msgr2=0x7f84901992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f84901992f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8480005940 tx=0x7f84800042f0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 shutdown_connections 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f84780b54d0 0x7f84780b7990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8490108020 0x7f849019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84901076a0 0x7f8490199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 --2- 172.21.15.16:0/487195672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8490101c90 0x7f84901992f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:27.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 >> 172.21.15.16:0/487195672 conn(0x7f84900fd700 msgr2=0x7f849006abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:27.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 shutdown_connections 2024-09-10T23:47:27.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:27.598+0000 7f84971fe640 1 -- 172.21.15.16:0/487195672 wait complete. 2024-09-10T23:47:28.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:27 smithi016 ceph-mon[30855]: pgmap v539: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:28.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:27 smithi071 ceph-mon[35018]: pgmap v539: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:28.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:27 smithi066 ceph-mon[34761]: pgmap v539: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:47:29.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:28 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:29.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:28 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:29.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:28 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:29.496 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:47:29.496 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:47:29.753 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:47:30.193 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: pgmap v540: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:47:30.193 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-10T23:47:30.194 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-10T23:47:30.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-10T23:47:30.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: Unable to set osd_memory_target on smithi016 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-10T23:47:30.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: Unable to set osd_memory_target on smithi066 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-10T23:47:30.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: Unable to set osd_memory_target on smithi071 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T23:47:30.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:30.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:30.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:47:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: pgmap v540: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:47:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: Unable to set osd_memory_target on smithi016 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: Unable to set osd_memory_target on smithi066 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: Unable to set osd_memory_target on smithi071 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T23:47:30.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:30.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:30.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.280+0000 7f0267851640 1 -- 172.21.15.16:0/3689757435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0260101cd0 msgr2=0x7f02601020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.280+0000 7f0267851640 1 --2- 172.21.15.16:0/3689757435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0260101cd0 0x7f02601020b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f025c009900 tx=0x7f025c02a410 comp rx=0 tx=0).stop 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.280+0000 7f0267851640 1 -- 172.21.15.16:0/3689757435 shutdown_connections 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.280+0000 7f0267851640 1 --2- 172.21.15.16:0/3689757435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0260108060 0x7f026010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.280+0000 7f0267851640 1 --2- 172.21.15.16:0/3689757435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02601076e0 0x7f0260107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.280+0000 7f0267851640 1 --2- 172.21.15.16:0/3689757435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0260101cd0 0x7f02601020b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.280+0000 7f0267851640 1 -- 172.21.15.16:0/3689757435 >> 172.21.15.16:0/3689757435 conn(0x7f02600fd700 msgr2=0x7f02600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 -- 172.21.15.16:0/3689757435 shutdown_connections 2024-09-10T23:47:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 -- 172.21.15.16:0/3689757435 wait complete. 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 Processor -- start 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 -- start start 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0260101cd0 0x7f02600fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02601076e0 0x7f02600fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0260108060 0x7f02600fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0260111d70 con 0x7f02601076e0 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0260111bf0 con 0x7f0260101cd0 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.281+0000 7f0267851640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0260111ef0 con 0x7f0260108060 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02601076e0 0x7f02600fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02601076e0 0x7f02600fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42678/0 (socket says 172.21.15.16:42678) 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 -- 172.21.15.16:0/2540550105 learned_addr learned my addr 172.21.15.16:0/2540550105 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f02655ed640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0260101cd0 0x7f02600fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0265dee640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0260108060 0x7f02600fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 -- 172.21.15.16:0/2540550105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0260108060 msgr2=0x7f02600fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0260108060 0x7f02600fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 -- 172.21.15.16:0/2540550105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0260101cd0 msgr2=0x7f02600fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0260101cd0 0x7f02600fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 -- 172.21.15.16:0/2540550105 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02601a7710 con 0x7f02601076e0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0264dec640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02601076e0 0x7f02600fe140 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f025000e9f0 tx=0x7f025000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f02567fc640 1 -- 172.21.15.16:0/2540550105 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025000cd80 con 0x7f02601076e0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02601a7a00 con 0x7f02601076e0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f02567fc640 1 -- 172.21.15.16:0/2540550105 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02500054d0 con 0x7f02601076e0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f02567fc640 1 -- 172.21.15.16:0/2540550105 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250010690 con 0x7f02601076e0 2024-09-10T23:47:30.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.282+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02601a7f40 con 0x7f02601076e0 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f02567fc640 1 -- 172.21.15.16:0/2540550105 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f0250004e90 con 0x7f02601076e0 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 Processor -- start 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 -- start start 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed4772250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4772790 0x55bed4774b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bed46dce60 con 0x55bed4765ee0 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bed46cc290 con 0x55bed4766800 2024-09-10T23:47:30.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.285+0000 7f0269c26740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bed46d00a0 con 0x55bed4772790 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47662c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42688/0 (socket says 172.21.15.16:42688) 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 -- 172.21.15.16:0/3137017601 learned_addr learned my addr 172.21.15.16:0/3137017601 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f02655ed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed4772250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0264dec640 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4772790 0x55bed4774b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 -- 172.21.15.16:0/3137017601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4772790 msgr2=0x55bed4774b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4772790 0x55bed4774b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 -- 172.21.15.16:0/3137017601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 msgr2=0x55bed4772250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed4772250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 -- 172.21.15.16:0/3137017601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed442a930 con 0x55bed4765ee0 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f0265dee640 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47662c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f025800ae90 tx=0x7f025800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebe02b55e5131a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f02567fc640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f024c0b5450 0x7f024c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f02655ed640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f024c0b5450 0x7f024c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.286+0000 7f024b7fe640 1 -- 172.21.15.16:0/3137017601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258004d20 con 0x55bed4765ee0 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f024b7fe640 1 -- 172.21.15.16:0/3137017601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0258003e20 con 0x55bed4765ee0 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f024b7fe640 1 -- 172.21.15.16:0/3137017601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02580108a0 con 0x55bed4765ee0 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f02567fc640 1 -- 172.21.15.16:0/2540550105 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f02500e63c0 con 0x7f02601076e0 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f0269c26740 1 -- 172.21.15.16:0/3137017601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 msgr2=0x55bed47662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f0269c26740 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47662c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f025800ae90 tx=0x7f025800f790 comp rx=0 tx=0).stop 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f02655ed640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f024c0b5450 0x7f024c0b7910 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f025c005ab0 tx=0x7f025c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f0269c26740 1 -- 172.21.15.16:0/3137017601 shutdown_connections 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f0269c26740 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4772790 0x55bed4774b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f0269c26740 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed4772250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f0269c26740 1 --2- 172.21.15.16:0/3137017601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47662c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.287+0000 7f0269c26740 1 -- 172.21.15.16:0/3137017601 >> 172.21.15.16:0/3137017601 conn(0x55bed4763d10 msgr2=0x55bed4764eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 -- 172.21.15.16:0/3137017601 shutdown_connections 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 -- 172.21.15.16:0/3137017601 wait complete. 2024-09-10T23:47:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 -- start start 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 Processor -- start 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4765ee0 0x55bed476f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed476fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4772790 0x55bed47701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bed452d890 con 0x55bed4772790 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bed4666d40 con 0x55bed4766800 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bed4775440 con 0x55bed4765ee0 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.288+0000 7f0269c26740 10 client.0 _ll_register_callbacks cb 0x55bed46cac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4772790 0x55bed47701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4772790 0x55bed47701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42690/0 (socket says 172.21.15.16:42690) 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f02655ed640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4765ee0 0x55bed476f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0264dec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed476fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 -- 172.21.15.16:0/295667549 learned_addr learned my addr 172.21.15.16:0/295667549 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 -- 172.21.15.16:0/295667549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4765ee0 msgr2=0x55bed476f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4765ee0 0x55bed476f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 -- 172.21.15.16:0/295667549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 msgr2=0x55bed476fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed476fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 -- 172.21.15.16:0/295667549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed477e820 con 0x55bed4772790 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0265dee640 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4772790 0x55bed47701e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f025800abb0 tx=0x7f025800abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157cf19325bc652f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0248ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0248ff9640 1 -- 172.21.15.16:0/295667549 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258004a40 con 0x55bed4772790 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0258003e20 con 0x55bed4772790 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0248ff9640 1 -- 172.21.15.16:0/295667549 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f0258004be0 con 0x55bed4772790 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.289+0000 7f0248ff9640 1 -- 172.21.15.16:0/295667549 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0258004de0 con 0x55bed4772790 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 10 client.16920 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bed4781220 con 0x55bed4772790 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0248ff9640 1 -- 172.21.15.16:0/295667549 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0258003e20 con 0x55bed4772790 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0248ff9640 1 -- 172.21.15.16:0/295667549 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0258005410 con 0x55bed4772790 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 10 client.16920 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 20 client.16920 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed47825d0 0x55bed47849c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 4 client.16920 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bed46dedb0 con 0x55bed47825d0 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.290+0000 7f02655ed640 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed47825d0 0x55bed47849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f02655ed640 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed47825d0 0x55bed47849c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6221c5ec260ca71f server_cookie=bcbbb4fc1be25546 in_seq=0 out_seq=0 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0248ff9640 10 client.16920 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0248ff9640 1 -- 172.21.15.16:0/295667549 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bed46dedb0 con 0x55bed47825d0 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0248ff9640 10 client.16920 handle_command_reply: tid=0 2024-09-10T23:47:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0269c26740 1 client.16920 shutdown 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4772790 msgr2=0x55bed47701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0269c26740 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4772790 0x55bed47701e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f025800abb0 tx=0x7f025800abe0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 shutdown_connections 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.291+0000 7f0269c26740 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed47825d0 0x55bed47849c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0269c26740 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4772790 0x55bed47701e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0269c26740 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed476fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0269c26740 1 --2- 172.21.15.16:0/295667549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4765ee0 0x55bed476f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 >> 172.21.15.16:0/295667549 conn(0x55bed4763d10 msgr2=0x55bed4762f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0248ff9640 0 client.16920 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 shutdown_connections 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0269c26740 1 -- 172.21.15.16:0/295667549 wait complete. 2024-09-10T23:47:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.292+0000 7f0269c26740 20 client.16920 trim_cache size 0 max 16384 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: pgmap v540: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: Unable to set osd_memory_target on smithi016 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: Unable to set osd_memory_target on smithi066 to 184566681: error parsing value: Value '184566681' is below minimum 939524096 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: Unable to set osd_memory_target on smithi071 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:30.303 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:47:30.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.309+0000 7f0269c26740 1 Processor -- start 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.309+0000 7f0269c26740 1 -- start start 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f0269c26740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4763d10 0x55bed476c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f0269c26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4765ee0 0x55bed476ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f0269c26740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4766800 0x55bed4789ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f0269c26740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f02601b3190 con 0x55bed4763d10 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f0269c26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02601b0a60 con 0x55bed4765ee0 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f0269c26740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02601ae8d0 con 0x55bed4766800 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4763d10 0x55bed476c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4763d10 0x55bed476c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42696/0 (socket says 172.21.15.16:42696) 2024-09-10T23:47:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 -- 172.21.15.16:0/99398999 learned_addr learned my addr 172.21.15.16:0/99398999 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 -- 172.21.15.16:0/99398999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4766800 msgr2=0x55bed4789ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 --2- 172.21.15.16:0/99398999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4766800 0x55bed4789ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 -- 172.21.15.16:0/99398999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4765ee0 msgr2=0x55bed476ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 --2- 172.21.15.16:0/99398999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4765ee0 0x55bed476ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 -- 172.21.15.16:0/99398999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed476dc60 con 0x55bed4763d10 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f02655ed640 1 --2- 172.21.15.16:0/99398999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4763d10 0x55bed476c970 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f025c009230 tx=0x7f025c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc035fe89311c8fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f024affd640 1 -- 172.21.15.16:0/99398999 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c035040 con 0x55bed4763d10 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f024affd640 1 -- 172.21.15.16:0/99398999 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f025c057070 con 0x55bed4763d10 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.310+0000 7f024affd640 1 -- 172.21.15.16:0/99398999 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c003c90 con 0x55bed4763d10 2024-09-10T23:47:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 -- 172.21.15.16:0/99398999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4763d10 msgr2=0x55bed476c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 --2- 172.21.15.16:0/99398999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4763d10 0x55bed476c970 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f025c009230 tx=0x7f025c03f000 comp rx=0 tx=0).stop 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 -- 172.21.15.16:0/99398999 shutdown_connections 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 --2- 172.21.15.16:0/99398999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4766800 0x55bed4789ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 --2- 172.21.15.16:0/99398999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4765ee0 0x55bed476ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 --2- 172.21.15.16:0/99398999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4763d10 0x55bed476c970 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 -- 172.21.15.16:0/99398999 >> 172.21.15.16:0/99398999 conn(0x55bed476b100 msgr2=0x55bed477de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 -- 172.21.15.16:0/99398999 shutdown_connections 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 -- 172.21.15.16:0/99398999 wait complete. 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.311+0000 7f0269c26740 1 -- start start 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 1 Processor -- start 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4763d10 0x55bed4778f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47794d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed47ee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f02601aef20 con 0x55bed4765ee0 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02601b0390 con 0x55bed4766800 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02601af5f0 con 0x55bed4763d10 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0269c26740 10 client.0 _ll_register_callbacks cb 0x7f025c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0264dec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0264dec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47794d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42708/0 (socket says 172.21.15.16:42708) 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0264dec640 1 -- 172.21.15.16:0/4052800248 learned_addr learned my addr 172.21.15.16:0/4052800248 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0265dee640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed47ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f02655ed640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4763d10 0x55bed4778f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0264dec640 1 -- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4763d10 msgr2=0x55bed4778f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.312+0000 7f0264dec640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4763d10 0x55bed4778f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0264dec640 1 -- 172.21.15.16:0/4052800248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 msgr2=0x55bed47ee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0264dec640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed47ee200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0264dec640 1 -- 172.21.15.16:0/4052800248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed47ee940 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0265dee640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed47ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0264dec640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47794d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f025000c6a0 tx=0x7f02500e4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1e95aa1b6f4c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0248ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0248ff9640 1 -- 172.21.15.16:0/4052800248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02500ac1c0 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0248ff9640 1 -- 172.21.15.16:0/4052800248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f02500accd0 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f025c057070 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0248ff9640 1 -- 172.21.15.16:0/4052800248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f02500abfe0 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0269c26740 10 client.16926 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bed47efce0 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0248ff9640 1 -- 172.21.15.16:0/4052800248 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f025c057070 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.313+0000 7f0248ff9640 1 -- 172.21.15.16:0/4052800248 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f02500b5970 con 0x55bed4765ee0 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f0269c26740 10 client.16926 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f0269c26740 10 client.16926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f0269c26740 20 client.16926 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f0269c26740 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed4772790 0x55bed47f2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f0269c26740 4 client.16926 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:47:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bed46da860 con 0x55bed4772790 2024-09-10T23:47:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f02655ed640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed4772790 0x55bed47f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f0248ff9640 10 client.16926 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.314+0000 7f02655ed640 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed4772790 0x55bed47f2410 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=603462291d6105c7 server_cookie=baafde6175a4f95e in_seq=0 out_seq=0 2024-09-10T23:47:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.315+0000 7f0248ff9640 1 -- 172.21.15.16:0/4052800248 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bed46da860 con 0x55bed4772790 2024-09-10T23:47:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.315+0000 7f0248ff9640 10 client.16926 handle_command_reply: tid=0 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 client.16926 shutdown 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 msgr2=0x55bed47794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47794d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f025000c6a0 tx=0x7f02500e4040 comp rx=0 tx=0).stop 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 shutdown_connections 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55bed4772790 0x55bed47f2410 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bed4766800 0x55bed47ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bed4765ee0 0x55bed47794d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 --2- 172.21.15.16:0/4052800248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bed4763d10 0x55bed4778f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 >> 172.21.15.16:0/4052800248 conn(0x55bed476b100 msgr2=0x55bed4768f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0248ff9640 0 client.16926 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 shutdown_connections 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 1 -- 172.21.15.16:0/4052800248 wait complete. 2024-09-10T23:47:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.316+0000 7f0269c26740 20 client.16926 trim_cache size 0 max 16384 2024-09-10T23:47:30.322 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:47:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:47:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "a58a062b-771a-4263-be8c-56213e24ce49", 2024-09-10T23:47:30.322 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:47:30.322 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f024c0b5450 msgr2=0x7f024c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f024c0b5450 0x7f024c0b7910 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f025c005ab0 tx=0x7f025c005a20 comp rx=0 tx=0).stop 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02601076e0 msgr2=0x7f02600fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02601076e0 0x7f02600fe140 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f025000e9f0 tx=0x7f025000edf0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 shutdown_connections 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0260108060 0x7f02600fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02601076e0 0x7f02600fe140 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f024c0b5450 0x7f024c0b7910 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 --2- 172.21.15.16:0/2540550105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0260101cd0 0x7f02600fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 >> 172.21.15.16:0/2540550105 conn(0x7f02600fd700 msgr2=0x7f026006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 shutdown_connections 2024-09-10T23:47:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:30.317+0000 7f0267851640 1 -- 172.21.15.16:0/2540550105 wait complete. 2024-09-10T23:47:31.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:30 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:47:31.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:30 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:47:31.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:30 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:47:31.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:30 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:47:31.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:47:31.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:30 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:47:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:30 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:47:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:30 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:47:31.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:30 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:47:31.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:30 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:47:31.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:30 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:47:31.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:30 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:47:31.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:30 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:47:31.464 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:47:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 -- 172.21.15.16:0/2747570138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 msgr2=0x7f0ef0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 --2- 172.21.15.16:0/2747570138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0102070 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009900 tx=0x7f0ee002a410 comp rx=0 tx=0).stop 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 -- 172.21.15.16:0/2747570138 shutdown_connections 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 --2- 172.21.15.16:0/2747570138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef0108020 0x7f0ef010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 --2- 172.21.15.16:0/2747570138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ef01076a0 0x7f0ef0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 --2- 172.21.15.16:0/2747570138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0102070 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 -- 172.21.15.16:0/2747570138 >> 172.21.15.16:0/2747570138 conn(0x7f0ef00fd700 msgr2=0x7f0ef00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 -- 172.21.15.16:0/2747570138 shutdown_connections 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 -- 172.21.15.16:0/2747570138 wait complete. 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.979+0000 7f0ef6027640 1 Processor -- start 2024-09-10T23:47:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0ef6027640 1 -- start start 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0ef6027640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0ef6027640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef01076a0 0x7f0ef0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0ef6027640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ef0108020 0x7f0ef01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0ef6027640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0111d30 con 0x7f0ef0101c90 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0ef6027640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0111bb0 con 0x7f0ef01076a0 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0ef6027640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0111eb0 con 0x7f0ef0108020 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42716/0 (socket says 172.21.15.16:42716) 2024-09-10T23:47:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 -- 172.21.15.16:0/1762845030 learned_addr learned my addr 172.21.15.16:0/1762845030 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef01076a0 0x7f0ef0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ef0108020 0x7f0ef01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 -- 172.21.15.16:0/1762845030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ef0108020 msgr2=0x7f0ef01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ef0108020 0x7f0ef01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 -- 172.21.15.16:0/1762845030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef01076a0 msgr2=0x7f0ef0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef01076a0 0x7f0ef0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 -- 172.21.15.16:0/1762845030 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef01a7710 con 0x7f0ef0101c90 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef01076a0 0x7f0ef0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.980+0000 7f0eef7fe640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0197f30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005ab0 tx=0x7f0ee0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.981+0000 7f0eecff9640 1 -- 172.21.15.16:0/1762845030 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee003f070 con 0x7f0ef0101c90 2024-09-10T23:47:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.981+0000 7f0eecff9640 1 -- 172.21.15.16:0/1762845030 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee0031d60 con 0x7f0ef0101c90 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.981+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef01a79a0 con 0x7f0ef0101c90 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.981+0000 7f0eecff9640 1 -- 172.21.15.16:0/1762845030 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0035030 con 0x7f0ef0101c90 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.981+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef01a7f00 con 0x7f0ef0101c90 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.983+0000 7f0ef83fc740 1 Processor -- start 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.983+0000 7f0ef83fc740 1 -- start start 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.983+0000 7f0eecff9640 1 -- 172.21.15.16:0/1762845030 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f0ee003b580 con 0x7f0ef0101c90 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055480 0x561cc1055860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1061d30 0x561cc1064120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561cc0fcbe50 con 0x561cc1055480 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561cc0fbb280 con 0x561cc1055da0 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561cc0fbf090 con 0x561cc1061d30 2024-09-10T23:47:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055480 0x561cc1055860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055480 0x561cc1055860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42728/0 (socket says 172.21.15.16:42728) 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 -- 172.21.15.16:0/1364878337 learned_addr learned my addr 172.21.15.16:0/1364878337 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1061d30 0x561cc1064120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eef7fe640 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 -- 172.21.15.16:0/1364878337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1061d30 msgr2=0x561cc1064120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1061d30 0x561cc1064120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 -- 172.21.15.16:0/1364878337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 msgr2=0x561cc10617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 -- 172.21.15.16:0/1364878337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc0d19650 con 0x561cc1055480 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eef7fe640 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eecff9640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0edc0b5450 0x7f0edc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055480 0x561cc1055860 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009f20 tx=0x7f0ee800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45460b5c5e10aa3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ee5ffb640 1 -- 172.21.15.16:0/1364878337 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee801a070 con 0x561cc1055480 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0eef7fe640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0edc0b5450 0x7f0edc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.984+0000 7f0ee5ffb640 1 -- 172.21.15.16:0/1364878337 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee80158c0 con 0x561cc1055480 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ee5ffb640 1 -- 172.21.15.16:0/1364878337 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800a820 con 0x561cc1055480 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0eecff9640 1 -- 172.21.15.16:0/1762845030 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f0ee01068f0 con 0x7f0ef0101c90 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1364878337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055480 msgr2=0x561cc1055860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0eef7fe640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0edc0b5450 0x7f0edc0b7910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0104120 tx=0x7f0ee0031f10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055480 0x561cc1055860 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009f20 tx=0x7f0ee800c8b0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1364878337 shutdown_connections 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1061d30 0x561cc1064120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1364878337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055480 0x561cc1055860 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1364878337 >> 172.21.15.16:0/1364878337 conn(0x561cc10532b0 msgr2=0x561cc1054450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1364878337 shutdown_connections 2024-09-10T23:47:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.985+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1364878337 wait complete. 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 -- start start 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 Processor -- start 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1061660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc105eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561cc0e1c700 con 0x561cc1055da0 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561cc0f56110 con 0x561cc1061d30 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561cc10649b0 con 0x561cc1055480 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0ef83fc740 10 client.0 _ll_register_callbacks cb 0x561cc0f6f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc105eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc105eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42738/0 (socket says 172.21.15.16:42738) 2024-09-10T23:47:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0eeeffd640 1 -- 172.21.15.16:0/460246006 learned_addr learned my addr 172.21.15.16:0/460246006 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.986+0000 7f0eeffff640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1061660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeffff640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeeffd640 1 -- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 msgr2=0x561cc1061660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1061660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeeffd640 1 -- 172.21.15.16:0/460246006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 msgr2=0x561cc105f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeeffd640 1 -- 172.21.15.16:0/460246006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc0f83c40 con 0x561cc1055da0 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeffff640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc105eab0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800bfc0 tx=0x7f0ed80128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ffc9c90034f6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eceffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eceffd640 1 -- 172.21.15.16:0/460246006 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed801f060 con 0x561cc1055da0 2024-09-10T23:47:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee80158c0 con 0x561cc1055da0 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eceffd640 1 -- 172.21.15.16:0/460246006 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f0ed8010900 con 0x561cc1055da0 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eceffd640 1 -- 172.21.15.16:0/460246006 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ed8010b00 con 0x561cc1055da0 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0ef83fc740 10 client.16938 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561cc10703e0 con 0x561cc1055da0 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.987+0000 7f0eceffd640 1 -- 172.21.15.16:0/460246006 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ee80158c0 con 0x561cc1055da0 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0eceffd640 1 -- 172.21.15.16:0/460246006 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ed8019030 con 0x561cc1055da0 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0ef83fc740 10 client.16938 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0ef83fc740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0ef83fc740 20 client.16938 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc1071940 0x561cc1073d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0ef83fc740 4 client.16938 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc0fcdda0 con 0x561cc1071940 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0eeffff640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc1071940 0x561cc1073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0eeffff640 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc1071940 0x561cc1073d30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=899815e2992b93a7 server_cookie=c01e005962dcfa47 in_seq=0 out_seq=0 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.988+0000 7f0eceffd640 10 client.16938 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0eceffd640 1 -- 172.21.15.16:0/460246006 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561cc0fcdda0 con 0x561cc1071940 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0eceffd640 10 client.16938 handle_command_reply: tid=0 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 client.16938 shutdown 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 msgr2=0x561cc105eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc105eab0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800bfc0 tx=0x7f0ed80128e0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 shutdown_connections 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc1071940 0x561cc1073d30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc105eab0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0eceffd640 0 client.16938 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/460246006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 >> 172.21.15.16:0/460246006 conn(0x561cc10532b0 msgr2=0x561cc1058e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:32.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 shutdown_connections 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 1 -- 172.21.15.16:0/460246006 wait complete. 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:31.989+0000 7f0ef83fc740 20 client.16938 trim_cache size 0 max 16384 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 Processor -- start 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 -- start start 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1054a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc106dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01b31b0 con 0x561cc1055da0 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01b0a80 con 0x561cc1061d30 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01ae8f0 con 0x561cc1055480 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc106dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc106dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42754/0 (socket says 172.21.15.16:42754) 2024-09-10T23:47:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0eeeffd640 1 -- 172.21.15.16:0/1878147506 learned_addr learned my addr 172.21.15.16:0/1878147506 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1054a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0eeeffd640 1 -- 172.21.15.16:0/1878147506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 msgr2=0x561cc1054a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.007+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1054a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0eeeffd640 1 -- 172.21.15.16:0/1878147506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 msgr2=0x561cc105bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0eeeffd640 1 -- 172.21.15.16:0/1878147506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc1074390 con 0x561cc1055da0 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc106dc40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8023000 tx=0x7f0ed800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190e96b2b5558419 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0ee57fa640 1 -- 172.21.15.16:0/1878147506 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8032070 con 0x561cc1055da0 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0ee57fa640 1 -- 172.21.15.16:0/1878147506 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ed800fd40 con 0x561cc1055da0 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0ee57fa640 1 -- 172.21.15.16:0/1878147506 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8022380 con 0x561cc1055da0 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1878147506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 msgr2=0x561cc106dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.008+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc106dc40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8023000 tx=0x7f0ed800b7c0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1878147506 shutdown_connections 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1061d30 0x561cc105bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1055da0 0x561cc106dc40 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1878147506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1054a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1878147506 >> 172.21.15.16:0/1878147506 conn(0x561cc10532b0 msgr2=0x561cc1054370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1878147506 shutdown_connections 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1878147506 wait complete. 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- start start 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 Processor -- start 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1065c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10661b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1061d30 0x561cc10666f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01aef40 con 0x561cc1061d30 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01b03b0 con 0x561cc1055da0 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01af610 con 0x561cc1055480 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.009+0000 7f0ef83fc740 10 client.0 _ll_register_callbacks cb 0x7f0ed800bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1061d30 0x561cc10666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1061d30 0x561cc10666f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42762/0 (socket says 172.21.15.16:42762) 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 -- 172.21.15.16:0/1910653704 learned_addr learned my addr 172.21.15.16:0/1910653704 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1065c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 -- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 msgr2=0x561cc1065c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1065c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 -- 172.21.15.16:0/1910653704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 msgr2=0x561cc10661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 -- 172.21.15.16:0/1910653704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc10dd8d0 con 0x561cc1061d30 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eeffff640 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1061d30 0x561cc10666f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800cdb0 tx=0x7f0ed800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102003a20b1d4505 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:32.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eceffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eceffd640 1 -- 172.21.15.16:0/1910653704 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8035060 con 0x561cc1061d30 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ed800fd40 con 0x561cc1061d30 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eceffd640 1 -- 172.21.15.16:0/1910653704 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f0ee8015990 con 0x561cc1061d30 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0eceffd640 1 -- 172.21.15.16:0/1910653704 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ee801a040 con 0x561cc1061d30 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0ef83fc740 10 client.16944 fetch_fsmap learned FSMap version 25 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.010+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561cc10debe0 con 0x561cc1061d30 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0eceffd640 1 -- 172.21.15.16:0/1910653704 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ed800fd40 con 0x561cc1061d30 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0eceffd640 1 -- 172.21.15.16:0/1910653704 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ee8020040 con 0x561cc1061d30 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0ef83fc740 10 client.16944 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0ef83fc740 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:47:32.035 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "a58a062b-771a-4263-be8c-56213e24ce49", 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:47:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.038 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:47:32.042 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.043 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:47:32.044 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:47:32.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:47:32.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:47:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:47:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0ef83fc740 20 client.16944 populate_metadata read hostname 'smithi016' 2024-09-10T23:47:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc10def80 0x561cc10e1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0ef83fc740 4 client.16944 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:47:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561cc0fc9850 con 0x561cc10def80 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.011+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc10def80 0x561cc10e1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0eeeffd640 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc10def80 0x561cc10e1370 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ddbdda7e426a0a server_cookie=d609a6414ee0ff79 in_seq=0 out_seq=0 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0eceffd640 10 client.16944 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0eceffd640 1 -- 172.21.15.16:0/1910653704 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x561cc0fc9850 con 0x561cc10def80 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0eceffd640 10 client.16944 handle_command_reply: tid=0 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 client.16944 shutdown 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1061d30 msgr2=0x561cc10666f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1061d30 0x561cc10666f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800cdb0 tx=0x7f0ed800bb40 comp rx=0 tx=0).stop 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 shutdown_connections 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x561cc10def80 0x561cc10e1370 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561cc1061d30 0x561cc10666f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561cc1055da0 0x561cc10661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0eceffd640 0 client.16944 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 --2- 172.21.15.16:0/1910653704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cc1055480 0x561cc1065c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 >> 172.21.15.16:0/1910653704 conn(0x561cc10532b0 msgr2=0x561cc10600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 shutdown_connections 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 1 -- 172.21.15.16:0/1910653704 wait complete. 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.012+0000 7f0ef83fc740 20 client.16944 trim_cache size 0 max 16384 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0edc0b5450 msgr2=0x7f0edc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0edc0b5450 0x7f0edc0b7910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0104120 tx=0x7f0ee0031f10 comp rx=0 tx=0).stop 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 msgr2=0x7f0ef0197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0197f30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005ab0 tx=0x7f0ee0003cd0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 shutdown_connections 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ef0108020 0x7f0ef01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f0edc0b5450 0x7f0edc0b7910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef01076a0 0x7f0ef0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 --2- 172.21.15.16:0/1762845030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ef0101c90 0x7f0ef0197f30 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 >> 172.21.15.16:0/1762845030 conn(0x7f0ef00fd700 msgr2=0x7f0ef00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 shutdown_connections 2024-09-10T23:47:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:47:32.013+0000 7f0ef6027640 1 -- 172.21.15.16:0/1762845030 wait complete. 2024-09-10T23:47:32.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:31 smithi016 ceph-mon[30855]: pgmap v541: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:47:32.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:31 smithi071 ceph-mon[35018]: pgmap v541: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:47:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:31 smithi066 ceph-mon[34761]: pgmap v541: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:47:32.798 INFO:tasks.cephfs.filesystem:scrub status for tag:a58a062b-771a-4263-be8c-56213e24ce49 - {'path': '/', 'tag': 'a58a062b-771a-4263-be8c-56213e24ce49', 'options': 'recursive,force'} 2024-09-10T23:47:33.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:32 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:47:33.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:32 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:47:33.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:32 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:47:34.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:33 smithi016 ceph-mon[30855]: pgmap v542: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:47:34.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:33 smithi071 ceph-mon[35018]: pgmap v542: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:47:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:33 smithi066 ceph-mon[34761]: pgmap v542: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:47:36.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:35 smithi016 ceph-mon[30855]: pgmap v543: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:47:36.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:35 smithi071 ceph-mon[35018]: pgmap v543: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:47:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:35 smithi066 ceph-mon[34761]: pgmap v543: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:47:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:37 smithi016 ceph-mon[30855]: pgmap v544: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:47:38.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:37 smithi071 ceph-mon[35018]: pgmap v544: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:47:38.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:37 smithi066 ceph-mon[34761]: pgmap v544: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:47:40.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:39 smithi016 ceph-mon[30855]: pgmap v545: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:47:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:39 smithi071 ceph-mon[35018]: pgmap v545: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:47:40.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:39 smithi066 ceph-mon[34761]: pgmap v545: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:47:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:41 smithi016 ceph-mon[30855]: pgmap v546: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:47:42.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:41 smithi071 ceph-mon[35018]: pgmap v546: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:47:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:41 smithi066 ceph-mon[34761]: pgmap v546: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:47:44.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:43 smithi016 ceph-mon[30855]: pgmap v547: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:47:44.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:43 smithi071 ceph-mon[35018]: pgmap v547: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:47:44.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:43 smithi066 ceph-mon[34761]: pgmap v547: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:47:46.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:45 smithi016 ceph-mon[30855]: pgmap v548: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:47:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:45 smithi071 ceph-mon[35018]: pgmap v548: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:47:46.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:45 smithi066 ceph-mon[34761]: pgmap v548: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:47:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:47 smithi016 ceph-mon[30855]: pgmap v549: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:47:48.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:47 smithi071 ceph-mon[35018]: pgmap v549: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:47:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:47 smithi066 ceph-mon[34761]: pgmap v549: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:47:50.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:49 smithi016 ceph-mon[30855]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:47:50.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:49 smithi071 ceph-mon[35018]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:47:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:49 smithi066 ceph-mon[34761]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:47:52.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:51 smithi016 ceph-mon[30855]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:47:52.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:51 smithi071 ceph-mon[35018]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:47:52.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:51 smithi066 ceph-mon[34761]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:47:54.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:53 smithi016 ceph-mon[30855]: pgmap v552: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:47:54.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:53 smithi071 ceph-mon[35018]: pgmap v552: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:47:54.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:53 smithi066 ceph-mon[34761]: pgmap v552: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:47:56.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:55 smithi016 ceph-mon[30855]: pgmap v553: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:47:56.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:55 smithi071 ceph-mon[35018]: pgmap v553: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:47:56.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:55 smithi066 ceph-mon[34761]: pgmap v553: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:47:58.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:57 smithi016 ceph-mon[30855]: pgmap v554: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:47:58.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:57 smithi071 ceph-mon[35018]: pgmap v554: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:47:58.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:57 smithi066 ceph-mon[34761]: pgmap v554: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:48:00.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:47:59 smithi016 ceph-mon[30855]: pgmap v555: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:00.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:47:59 smithi071 ceph-mon[35018]: pgmap v555: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:00.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:47:59 smithi066 ceph-mon[34761]: pgmap v555: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:02.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:01 smithi016 ceph-mon[30855]: pgmap v556: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:02.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:01 smithi071 ceph-mon[35018]: pgmap v556: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:02.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:01 smithi066 ceph-mon[34761]: pgmap v556: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:02.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:48:03.078 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:03.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 -- 172.21.15.16:0/4070946556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 msgr2=0x7fd368102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 --2- 172.21.15.16:0/4070946556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368102070 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd358009980 tx=0x7fd35802c620 comp rx=0 tx=0).stop 2024-09-10T23:48:03.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 -- 172.21.15.16:0/4070946556 shutdown_connections 2024-09-10T23:48:03.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 --2- 172.21.15.16:0/4070946556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd368108020 0x7fd36810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 --2- 172.21.15.16:0/4070946556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3681076a0 0x7fd368107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 --2- 172.21.15.16:0/4070946556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368102070 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 -- 172.21.15.16:0/4070946556 >> 172.21.15.16:0/4070946556 conn(0x7fd3680fd700 msgr2=0x7fd3680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 -- 172.21.15.16:0/4070946556 shutdown_connections 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.615+0000 7fd36e292640 1 -- 172.21.15.16:0/4070946556 wait complete. 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.616+0000 7fd36e292640 1 Processor -- start 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.616+0000 7fd36e292640 1 -- start start 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.616+0000 7fd36e292640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.616+0000 7fd36e292640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3681076a0 0x7fd368197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.616+0000 7fd36e292640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368108020 0x7fd36819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.616+0000 7fd36e292640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd368110be0 con 0x7fd368101c90 2024-09-10T23:48:03.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd36e292640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd368110a60 con 0x7fd3681076a0 2024-09-10T23:48:03.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd36e292640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd368110d60 con 0x7fd368108020 2024-09-10T23:48:03.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52316/0 (socket says 172.21.15.16:52316) 2024-09-10T23:48:03.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 -- 172.21.15.16:0/3856673673 learned_addr learned my addr 172.21.15.16:0/3856673673 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:03.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd35ffff640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3681076a0 0x7fd368197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd36c82f640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368108020 0x7fd36819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 -- 172.21.15.16:0/3856673673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368108020 msgr2=0x7fd36819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368108020 0x7fd36819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 -- 172.21.15.16:0/3856673673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3681076a0 msgr2=0x7fd368197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3681076a0 0x7fd368197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 -- 172.21.15.16:0/3856673673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36819d0e0 con 0x7fd368101c90 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd36c82f640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368108020 0x7fd36819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd35ffff640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3681076a0 0x7fd368197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd367fff640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368197030 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd358005940 tx=0x7fd3580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd365ffb640 1 -- 172.21.15.16:0/3856673673 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358041030 con 0x7fd368101c90 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36819d370 con 0x7fd368101c90 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd365ffb640 1 -- 172.21.15.16:0/3856673673 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd358003cb0 con 0x7fd368101c90 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd365ffb640 1 -- 172.21.15.16:0/3856673673 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358037070 con 0x7fd368101c90 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.617+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3681a3a90 con 0x7fd368101c90 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.620+0000 7fd365ffb640 1 -- 172.21.15.16:0/3856673673 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd358003800 con 0x7fd368101c90 2024-09-10T23:48:03.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.620+0000 7fd370667740 1 Processor -- start 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.620+0000 7fd370667740 1 -- start start 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd370667740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd370667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd370667740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd370667740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557c1d11fe50 con 0x557c1d1a9480 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd370667740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557c1d10f280 con 0x557c1d1b5d30 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd370667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c1d113090 con 0x557c1d1a9da0 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52320/0 (socket says 172.21.15.16:52320) 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 -- 172.21.15.16:0/1548638724 learned_addr learned my addr 172.21.15.16:0/1548638724 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd367fff640 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd35ffff640 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 -- 172.21.15.16:0/1548638724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 msgr2=0x557c1d1b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 -- 172.21.15.16:0/1548638724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 msgr2=0x557c1d1b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 -- 172.21.15.16:0/1548638724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1ce6d650 con 0x557c1d1a9480 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd365ffb640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3540b5450 0x7fd3540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd35ffff640 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd367fff640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3540b5450 0x7fd3540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.621+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1a9860 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd360009ea0 tx=0x7fd360009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9371fa1271ec23a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.622+0000 7fd365ffb640 1 -- 172.21.15.16:0/3856673673 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fd358108ba0 con 0x7fd368101c90 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.622+0000 7fd35e7fc640 1 -- 172.21.15.16:0/1548638724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360004d20 con 0x557c1d1a9480 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.622+0000 7fd35e7fc640 1 -- 172.21.15.16:0/1548638724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3600054d0 con 0x557c1d1a9480 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.622+0000 7fd35e7fc640 1 -- 172.21.15.16:0/1548638724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3600117a0 con 0x557c1d1a9480 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd367fff640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3540b5450 0x7fd3540b7910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd3581063d0 tx=0x7fd35810c7d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:03.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 -- 172.21.15.16:0/1548638724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 msgr2=0x557c1d1a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1a9860 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd360009ea0 tx=0x7fd360009f90 comp rx=0 tx=0).stop 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 -- 172.21.15.16:0/1548638724 shutdown_connections 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 --2- 172.21.15.16:0/1548638724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1a9860 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 -- 172.21.15.16:0/1548638724 >> 172.21.15.16:0/1548638724 conn(0x557c1d1a72b0 msgr2=0x557c1d1a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 -- 172.21.15.16:0/1548638724 shutdown_connections 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 -- 172.21.15.16:0/1548638724 wait complete. 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.623+0000 7fd370667740 1 -- start start 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 1 Processor -- start 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9480 0x557c1d1b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1b5d30 0x557c1d1b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557c1cf70700 con 0x557c1d1b5d30 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557c1d0aa110 con 0x557c1d1a9480 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c1d1b89b0 con 0x557c1d1a9da0 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd370667740 10 client.0 _ll_register_callbacks cb 0x557c1d0c3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1b5d30 0x557c1d1b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1b5d30 0x557c1d1b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52332/0 (socket says 172.21.15.16:52332) 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd36c82f640 1 -- 172.21.15.16:0/1074846695 learned_addr learned my addr 172.21.15.16:0/1074846695 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd35ffff640 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.624+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9480 0x557c1d1b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd36c82f640 1 -- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 msgr2=0x557c1d1b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd36c82f640 1 -- 172.21.15.16:0/1074846695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9480 msgr2=0x557c1d1b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9480 0x557c1d1b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd36c82f640 1 -- 172.21.15.16:0/1074846695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c1d0d7c40 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1b5d30 0x557c1d1b3130 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd3600094c0 tx=0x7fd360011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cef13c09462596 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd3477fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd3477fe640 1 -- 172.21.15.16:0/1074846695 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36001d070 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd3477fe640 1 -- 172.21.15.16:0/1074846695 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fd360005890 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3600054d0 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd3477fe640 1 -- 172.21.15.16:0/1074846695 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd360005330 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd370667740 10 client.16956 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c1d1c4290 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.625+0000 7fd3477fe640 1 -- 172.21.15.16:0/1074846695 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3600054d0 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd3477fe640 1 -- 172.21.15.16:0/1074846695 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd3600194c0 con 0x557c1d1b5d30 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd370667740 10 client.16956 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd370667740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd370667740 20 client.16956 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd370667740 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d1c56f0 0x557c1d1c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd370667740 4 client.16956 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c1d121da0 con 0x557c1d1c56f0 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd35ffff640 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d1c56f0 0x557c1d1c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd3477fe640 10 client.16956 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.626+0000 7fd35ffff640 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d1c56f0 0x557c1d1c7ae0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e46a7a8f8382986a server_cookie=d8052f4598b3a8a9 in_seq=0 out_seq=0 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd3477fe640 1 -- 172.21.15.16:0/1074846695 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c1d121da0 con 0x557c1d1c56f0 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd3477fe640 10 client.16956 handle_command_reply: tid=0 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 client.16956 shutdown 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1b5d30 msgr2=0x557c1d1b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1b5d30 0x557c1d1b3130 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd3600094c0 tx=0x7fd360011440 comp rx=0 tx=0).stop 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 shutdown_connections 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d1c56f0 0x557c1d1c7ae0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1b5d30 0x557c1d1b3130 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd3477fe640 0 client.16956 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 --2- 172.21.15.16:0/1074846695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9480 0x557c1d1b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 >> 172.21.15.16:0/1074846695 conn(0x557c1d1a72b0 msgr2=0x557c1d1ace20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.627+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 shutdown_connections 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.628+0000 7fd370667740 1 -- 172.21.15.16:0/1074846695 wait complete. 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.628+0000 7fd370667740 20 client.16956 trim_cache size 0 max 16384 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.645+0000 7fd370667740 1 Processor -- start 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.645+0000 7fd370667740 1 -- start start 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd370667740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd370667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd370667740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd370667740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681aed70 con 0x557c1d1a9480 2024-09-10T23:48:03.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd370667740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681ac640 con 0x557c1d1b5d30 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd370667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681aa4b0 con 0x557c1d1a9da0 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd35ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52336/0 (socket says 172.21.15.16:52336) 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 -- 172.21.15.16:0/1042160316 learned_addr learned my addr 172.21.15.16:0/1042160316 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 -- 172.21.15.16:0/1042160316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 msgr2=0x557c1d1b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 -- 172.21.15.16:0/1042160316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 msgr2=0x557c1d1b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 -- 172.21.15.16:0/1042160316 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1d1b0fb0 con 0x557c1d1a9480 2024-09-10T23:48:03.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.646+0000 7fd36c82f640 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1c1be0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd36000fc40 tx=0x7fd3600052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10280b8fa97e1834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:03.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd35dffb640 1 -- 172.21.15.16:0/1042160316 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36001d070 con 0x557c1d1a9480 2024-09-10T23:48:03.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd35dffb640 1 -- 172.21.15.16:0/1042160316 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd360019bc0 con 0x557c1d1a9480 2024-09-10T23:48:03.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd35dffb640 1 -- 172.21.15.16:0/1042160316 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360005af0 con 0x557c1d1a9480 2024-09-10T23:48:03.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd370667740 1 -- 172.21.15.16:0/1042160316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 msgr2=0x557c1d1c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd370667740 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1c1be0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd36000fc40 tx=0x7fd3600052c0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd370667740 1 -- 172.21.15.16:0/1042160316 shutdown_connections 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd370667740 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1b5d30 0x557c1d1b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd370667740 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1a9da0 0x557c1d1b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd370667740 1 --2- 172.21.15.16:0/1042160316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1c1be0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.647+0000 7fd370667740 1 -- 172.21.15.16:0/1042160316 >> 172.21.15.16:0/1042160316 conn(0x557c1d1a72b0 msgr2=0x557c1d1b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 -- 172.21.15.16:0/1042160316 shutdown_connections 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 -- 172.21.15.16:0/1042160316 wait complete. 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 -- start start 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 Processor -- start 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1bdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9da0 0x557c1d1be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681aab00 con 0x557c1d1a9480 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681abf70 con 0x557c1d1a9da0 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681ab1d0 con 0x557c1d1b5d30 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.648+0000 7fd370667740 10 client.0 _ll_register_callbacks cb 0x7fd35810c6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1bdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd35ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9da0 0x557c1d1be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1bdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52346/0 (socket says 172.21.15.16:52346) 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 -- 172.21.15.16:0/2508778290 learned_addr learned my addr 172.21.15.16:0/2508778290 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 -- 172.21.15.16:0/2508778290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1b5d30 msgr2=0x557c1d1b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 -- 172.21.15.16:0/2508778290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9da0 msgr2=0x557c1d1be190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9da0 0x557c1d1be190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 -- 172.21.15.16:0/2508778290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c1d1be9c0 con 0x557c1d1a9480 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd36c82f640 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1bdc50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd360019910 tx=0x7fd3600115e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2eb598526dabac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:03.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd3477fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd3477fe640 1 -- 172.21.15.16:0/2508778290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36001d040 con 0x557c1d1a9480 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd3477fe640 1 -- 172.21.15.16:0/2508778290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fd3600049c0 con 0x557c1d1a9480 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd360019bc0 con 0x557c1d1a9480 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd3477fe640 1 -- 172.21.15.16:0/2508778290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd360009cf0 con 0x557c1d1a9480 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd370667740 10 client.16962 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.649+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c1d232950 con 0x557c1d1a9480 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd3477fe640 1 -- 172.21.15.16:0/2508778290 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd360019bc0 con 0x557c1d1a9480 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd3477fe640 1 -- 172.21.15.16:0/2508778290 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd36003fa90 con 0x557c1d1a9480 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd370667740 10 client.16962 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd370667740 10 client.16962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd370667740 20 client.16962 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd370667740 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d2330a0 0x557c1d2354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:03.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd370667740 4 client.16962 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c1d11d850 con 0x557c1d2330a0 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.650+0000 7fd35ffff640 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d2330a0 0x557c1d2354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd35ffff640 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d2330a0 0x557c1d2354c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f7f0d117e9fe75 server_cookie=79a682badf094015 in_seq=0 out_seq=0 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd3477fe640 10 client.16962 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd3477fe640 1 -- 172.21.15.16:0/2508778290 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x557c1d11d850 con 0x557c1d2330a0 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd3477fe640 10 client.16962 handle_command_reply: tid=0 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 client.16962 shutdown 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 msgr2=0x557c1d1bdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1bdc50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd360019910 tx=0x7fd3600115e0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 shutdown_connections 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x557c1d2330a0 0x557c1d2354c0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c1d1b5d30 0x557c1d1b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c1d1a9da0 0x557c1d1be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd3477fe640 0 client.16962 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:03.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 --2- 172.21.15.16:0/2508778290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557c1d1a9480 0x557c1d1bdc50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 >> 172.21.15.16:0/2508778290 conn(0x557c1d1a72b0 msgr2=0x557c1d1b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:03.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 shutdown_connections 2024-09-10T23:48:03.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 1 -- 172.21.15.16:0/2508778290 wait complete. 2024-09-10T23:48:03.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.651+0000 7fd370667740 20 client.16962 trim_cache size 0 max 16384 2024-09-10T23:48:03.670 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:48:03.670 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:48:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:48:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:48:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:48:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:48:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:48:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:48:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:48:03.673 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:48:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:48:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:48:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:48:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:48:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.676 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:48:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:48:03.677 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.678 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:48:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:48:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.679 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:48:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:48:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.680 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:48:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:48:03.681 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.682 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:48:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:48:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.683 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:48:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:48:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.684 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.686 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:48:03.687 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:03.688 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3540b5450 msgr2=0x7fd3540b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3540b5450 0x7fd3540b7910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd3581063d0 tx=0x7fd35810c7d0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 msgr2=0x7fd368197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368197030 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd358005940 tx=0x7fd3580042f0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 shutdown_connections 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd368108020 0x7fd36819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd3540b5450 0x7fd3540b7910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3681076a0 0x7fd368197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 --2- 172.21.15.16:0/3856673673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd368101c90 0x7fd368197030 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 >> 172.21.15.16:0/3856673673 conn(0x7fd3680fd700 msgr2=0x7fd3680ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:03.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 shutdown_connections 2024-09-10T23:48:03.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:03.652+0000 7fd36e292640 1 -- 172.21.15.16:0/3856673673 wait complete. 2024-09-10T23:48:04.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:03 smithi016 ceph-mon[30855]: pgmap v557: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:48:04.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:03 smithi071 ceph-mon[35018]: pgmap v557: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:48:04.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:03 smithi066 ceph-mon[34761]: pgmap v557: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:48:04.589 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:48:04.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:48:04.850 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:05.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 -- 172.21.15.16:0/3566534330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc01076e0 msgr2=0x7fbdc0107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:05.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 --2- 172.21.15.16:0/3566534330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc01076e0 0x7fbdc0107b20 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009900 tx=0x7fbda802a410 comp rx=0 tx=0).stop 2024-09-10T23:48:05.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 -- 172.21.15.16:0/3566534330 shutdown_connections 2024-09-10T23:48:05.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 --2- 172.21.15.16:0/3566534330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc0108060 0x7fbdc010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 --2- 172.21.15.16:0/3566534330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc01076e0 0x7fbdc0107b20 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 --2- 172.21.15.16:0/3566534330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc0101cd0 0x7fbdc01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 -- 172.21.15.16:0/3566534330 >> 172.21.15.16:0/3566534330 conn(0x7fbdc00fd700 msgr2=0x7fbdc00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 -- 172.21.15.16:0/3566534330 shutdown_connections 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 -- 172.21.15.16:0/3566534330 wait complete. 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 Processor -- start 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.370+0000 7fbdc6880640 1 -- start start 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc6880640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc0101cd0 0x7fbdc019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc6880640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01076e0 0x7fbdc019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc6880640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc0108060 0x7fbdc01a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc6880640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc0111d20 con 0x7fbdc0108060 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc6880640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc0111ba0 con 0x7fbdc0101cd0 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc6880640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc0111ea0 con 0x7fbdc01076e0 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc0108060 0x7fbdc01a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc0108060 0x7fbdc01a5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52368/0 (socket says 172.21.15.16:52368) 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 -- 172.21.15.16:0/488849781 learned_addr learned my addr 172.21.15.16:0/488849781 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:05.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdb7fff640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01076e0 0x7fbdc019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdbffff640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc0101cd0 0x7fbdc019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 -- 172.21.15.16:0/488849781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01076e0 msgr2=0x7fbdc019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01076e0 0x7fbdc019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 -- 172.21.15.16:0/488849781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc0101cd0 msgr2=0x7fbdc019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc0101cd0 0x7fbdc019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 -- 172.21.15.16:0/488849781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc01a5650 con 0x7fbdc0108060 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.371+0000 7fbdc4e1d640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc0108060 0x7fbdc01a5110 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800b970 tx=0x7fbdb800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.372+0000 7fbdbdffb640 1 -- 172.21.15.16:0/488849781 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8019070 con 0x7fbdc0108060 2024-09-10T23:48:05.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.372+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc01a5820 con 0x7fbdc0108060 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.372+0000 7fbdbdffb640 1 -- 172.21.15.16:0/488849781 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdb8014440 con 0x7fbdc0108060 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.372+0000 7fbdbdffb640 1 -- 172.21.15.16:0/488849781 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80075d0 con 0x7fbdc0108060 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.372+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc01a5d00 con 0x7fbdc0108060 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.373+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc01020b0 con 0x7fbdc0108060 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.374+0000 7fbdbdffb640 1 -- 172.21.15.16:0/488849781 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fbdb800cb40 con 0x7fbdc0108060 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.375+0000 7fbdbdffb640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdac0b5450 0x7fbdac0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.375+0000 7fbdbdffb640 1 -- 172.21.15.16:0/488849781 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7fbdb80e5700 con 0x7fbdc0108060 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.375+0000 7fbdbffff640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdac0b5450 0x7fbdac0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.375+0000 7fbdbffff640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdac0b5450 0x7fbdac0b7910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00058c0 tx=0x7fbdb000a4c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:05.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.379+0000 7fbdbdffb640 1 -- 172.21.15.16:0/488849781 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbdb80abc60 con 0x7fbdc0108060 2024-09-10T23:48:05.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.601+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdc006b900 con 0x7fbdc0108060 2024-09-10T23:48:05.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.602+0000 7fbdbdffb640 1 -- 172.21.15.16:0/488849781 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7fbdb80b0690 con 0x7fbdc0108060 2024-09-10T23:48:05.605 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:48:05.606 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:48:05.606 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:48:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdac0b5450 msgr2=0x7fbdac0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdac0b5450 0x7fbdac0b7910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00058c0 tx=0x7fbdb000a4c0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc0108060 msgr2=0x7fbdc01a5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:05.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc0108060 0x7fbdc01a5110 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fbdb800b970 tx=0x7fbdb800be30 comp rx=0 tx=0).stop 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 shutdown_connections 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdc0108060 0x7fbdc01a5110 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdc01076e0 0x7fbdc019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbdac0b5450 0x7fbdac0b7910 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 --2- 172.21.15.16:0/488849781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc0101cd0 0x7fbdc019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 >> 172.21.15.16:0/488849781 conn(0x7fbdc00fd700 msgr2=0x7fbdc00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 shutdown_connections 2024-09-10T23:48:05.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:05.605+0000 7fbdc6880640 1 -- 172.21.15.16:0/488849781 wait complete. 2024-09-10T23:48:06.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:05 smithi016 ceph-mon[30855]: pgmap v558: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:48:06.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:05 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/488849781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:48:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:05 smithi071 ceph-mon[35018]: pgmap v558: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:48:06.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:05 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/488849781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:48:06.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:05 smithi066 ceph-mon[34761]: pgmap v558: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:48:06.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:05 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/488849781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:48:06.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:48:06.717 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:07.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 -- 172.21.15.16:0/4149789877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 msgr2=0x7f776410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 --2- 172.21.15.16:0/4149789877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776410f950 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f775c009ca0 tx=0x7f775c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 -- 172.21.15.16:0/4149789877 shutdown_connections 2024-09-10T23:48:07.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 --2- 172.21.15.16:0/4149789877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776410f950 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 --2- 172.21.15.16:0/4149789877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77641087d0 0x7f7764108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 --2- 172.21.15.16:0/4149789877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7764102dc0 0x7f77641031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 -- 172.21.15.16:0/4149789877 >> 172.21.15.16:0/4149789877 conn(0x7f77640fe830 msgr2=0x7f7764100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 -- 172.21.15.16:0/4149789877 shutdown_connections 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 -- 172.21.15.16:0/4149789877 wait complete. 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.223+0000 7f7769e5a640 1 Processor -- start 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7769e5a640 1 -- start start 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7769e5a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7764102dc0 0x7f77641991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7769e5a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77641087d0 0x7f7764199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7769e5a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7769e5a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7764112e10 con 0x7f7764109150 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7769e5a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7764112c90 con 0x7f77641087d0 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7769e5a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7764112f90 con 0x7f7764102dc0 2024-09-10T23:48:07.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52392/0 (socket says 172.21.15.16:52392) 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 -- 172.21.15.16:0/3689790250 learned_addr learned my addr 172.21.15.16:0/3689790250 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f77637fe640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7764102dc0 0x7f77641991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7762ffd640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77641087d0 0x7f7764199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 -- 172.21.15.16:0/3689790250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7764102dc0 msgr2=0x7f77641991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7764102dc0 0x7f77641991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 -- 172.21.15.16:0/3689790250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77641087d0 msgr2=0x7f7764199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77641087d0 0x7f7764199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 -- 172.21.15.16:0/3689790250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776419f290 con 0x7f7764109150 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.224+0000 7f7763fff640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776419eac0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f775c005cc0 tx=0x7f775c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.225+0000 7f7760ff9640 1 -- 172.21.15.16:0/3689790250 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c003cf0 con 0x7f7764109150 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.225+0000 7f7760ff9640 1 -- 172.21.15.16:0/3689790250 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f775c0044f0 con 0x7f7764109150 2024-09-10T23:48:07.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.225+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776419f520 con 0x7f7764109150 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.225+0000 7f7760ff9640 1 -- 172.21.15.16:0/3689790250 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c02fd10 con 0x7f7764109150 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.225+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77641a5c40 con 0x7f7764109150 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 Processor -- start 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f7760ff9640 1 -- 172.21.15.16:0/3689790250 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f775c004040 con 0x7f7764109150 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 -- start start 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32dde0f0 0x55bf32dde4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32ddea10 0x55bf32dee870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32df11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bf32d54ea0 con 0x55bf32deedb0 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bf32d442d0 con 0x55bf32dde0f0 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.228+0000 7f776c22f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bf32d480e0 con 0x55bf32ddea10 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32df11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32df11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52402/0 (socket says 172.21.15.16:52402) 2024-09-10T23:48:07.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7762ffd640 1 -- 172.21.15.16:0/3456888766 learned_addr learned my addr 172.21.15.16:0/3456888766 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f77637fe640 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32ddea10 0x55bf32dee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7762ffd640 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32dde0f0 0x55bf32dde4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7760ff9640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f77500b5450 0x7f77500b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f77637fe640 1 -- 172.21.15.16:0/3456888766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32dde0f0 msgr2=0x55bf32dde4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f77637fe640 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32dde0f0 0x55bf32dde4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f77637fe640 1 -- 172.21.15.16:0/3456888766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 msgr2=0x55bf32df11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f77637fe640 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32df11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f77637fe640 1 -- 172.21.15.16:0/3456888766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf32aa2650 con 0x55bf32ddea10 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7762ffd640 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32df11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7763fff640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f77500b5450 0x7f77500b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f77637fe640 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32ddea10 0x55bf32dee870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f775400ab70 tx=0x7f775400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed6d2775fcc28fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:07.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7760ff9640 1 -- 172.21.15.16:0/3689790250 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f775c107610 con 0x7f7764109150 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7759ffb640 1 -- 172.21.15.16:0/3456888766 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754004220 con 0x55bf32ddea10 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7759ffb640 1 -- 172.21.15.16:0/3456888766 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77540043c0 con 0x55bf32ddea10 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.229+0000 7f7759ffb640 1 -- 172.21.15.16:0/3456888766 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754018710 con 0x55bf32ddea10 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 -- 172.21.15.16:0/3456888766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32ddea10 msgr2=0x55bf32dee870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f7763fff640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f77500b5450 0x7f77500b7910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f775c0cda50 tx=0x7f775c096d20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32ddea10 0x55bf32dee870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f775400ab70 tx=0x7f775400f790 comp rx=0 tx=0).stop 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 -- 172.21.15.16:0/3456888766 shutdown_connections 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32df11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32ddea10 0x55bf32dee870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 --2- 172.21.15.16:0/3456888766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32dde0f0 0x55bf32dde4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 -- 172.21.15.16:0/3456888766 >> 172.21.15.16:0/3456888766 conn(0x55bf32ddbf20 msgr2=0x55bf32ddd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 -- 172.21.15.16:0/3456888766 shutdown_connections 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 -- 172.21.15.16:0/3456888766 wait complete. 2024-09-10T23:48:07.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.230+0000 7f776c22f740 1 -- start start 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 1 Processor -- start 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32dde0f0 0x55bf32dee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32debb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32deedb0 0x55bf32dec140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bf32ba5700 con 0x55bf32dde0f0 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bf32cdf160 con 0x55bf32ddea10 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bf32df1a60 con 0x55bf32deedb0 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f776c22f740 10 client.0 _ll_register_callbacks cb 0x55bf32cf89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32dde0f0 0x55bf32dee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32dde0f0 0x55bf32dee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52404/0 (socket says 172.21.15.16:52404) 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 -- 172.21.15.16:0/579321515 learned_addr learned my addr 172.21.15.16:0/579321515 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f77637fe640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32debb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32deedb0 0x55bf32dec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 -- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32deedb0 msgr2=0x55bf32dec140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32deedb0 0x55bf32dec140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 -- 172.21.15.16:0/579321515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 msgr2=0x55bf32debb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32debb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f7762ffd640 1 -- 172.21.15.16:0/579321515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf32d0cc90 con 0x55bf32dde0f0 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.231+0000 7f77637fe640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32debb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f7762ffd640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32dde0f0 0x55bf32dee6c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f774c013e60 tx=0x7f774c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e93a078c1cb6387 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f7742ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f7742ffd640 1 -- 172.21.15.16:0/579321515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c013110 con 0x55bf32dde0f0 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f7742ffd640 1 -- 172.21.15.16:0/579321515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f774c00e6e0 con 0x55bf32dde0f0 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77540043c0 con 0x55bf32dde0f0 2024-09-10T23:48:07.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f7742ffd640 1 -- 172.21.15.16:0/579321515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f774c027050 con 0x55bf32dde0f0 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 10 client.16980 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bf32dfd450 con 0x55bf32dde0f0 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f7742ffd640 1 -- 172.21.15.16:0/579321515 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77540043c0 con 0x55bf32dde0f0 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f7742ffd640 1 -- 172.21.15.16:0/579321515 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f774c011710 con 0x55bf32dde0f0 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 10 client.16980 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 10 client.16980 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 20 client.16980 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32dfecc0 0x55bf32e01100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 4 client.16980 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.232+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf32d56df0 con 0x55bf32dfecc0 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.233+0000 7f77637fe640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32dfecc0 0x55bf32e01100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.233+0000 7f7742ffd640 10 client.16980 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:07.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.233+0000 7f77637fe640 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32dfecc0 0x55bf32e01100 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54bc81f675001245 server_cookie=8e5cb0c29540fd4b in_seq=0 out_seq=0 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f7742ffd640 1 -- 172.21.15.16:0/579321515 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf32d56df0 con 0x55bf32dfecc0 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f7742ffd640 10 client.16980 handle_command_reply: tid=0 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 client.16980 shutdown 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32dde0f0 msgr2=0x55bf32dee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32dde0f0 0x55bf32dee6c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f774c013e60 tx=0x7f774c015040 comp rx=0 tx=0).stop 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 shutdown_connections 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32dfecc0 0x55bf32e01100 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32deedb0 0x55bf32dec140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32debb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 --2- 172.21.15.16:0/579321515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32dde0f0 0x55bf32dee6c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 >> 172.21.15.16:0/579321515 conn(0x55bf32ddbf20 msgr2=0x55bf32de1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:07.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f7742ffd640 0 client.16980 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.234+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 shutdown_connections 2024-09-10T23:48:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.235+0000 7f776c22f740 1 -- 172.21.15.16:0/579321515 wait complete. 2024-09-10T23:48:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.235+0000 7f776c22f740 20 client.16980 trim_cache size 0 max 16384 2024-09-10T23:48:07.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 Processor -- start 2024-09-10T23:48:07.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 -- start start 2024-09-10T23:48:07.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32dfacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32ddea10 0x55bf32defcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32deedb0 0x55bf32df0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77641aeca0 con 0x55bf32ddea10 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77641ac570 con 0x55bf32deedb0 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f776c22f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77641aa3e0 con 0x55bf32dde0f0 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f77637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32ddea10 0x55bf32defcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f77637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32ddea10 0x55bf32defcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52420/0 (socket says 172.21.15.16:52420) 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f77637fe640 1 -- 172.21.15.16:0/2757421851 learned_addr learned my addr 172.21.15.16:0/2757421851 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.248+0000 7f7762ffd640 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32dfacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77637fe640 1 -- 172.21.15.16:0/2757421851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 msgr2=0x55bf32dfacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77637fe640 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32dfacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77637fe640 1 -- 172.21.15.16:0/2757421851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32deedb0 msgr2=0x55bf32df0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77637fe640 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32deedb0 0x55bf32df0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77637fe640 1 -- 172.21.15.16:0/2757421851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf32dec4b0 con 0x55bf32ddea10 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77637fe640 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32ddea10 0x55bf32defcd0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x55bf32de1270 tx=0x7f7754004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6b78390b99af18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:07.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77597fa640 1 -- 172.21.15.16:0/2757421851 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775400ae70 con 0x55bf32ddea10 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77597fa640 1 -- 172.21.15.16:0/2757421851 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77540054f0 con 0x55bf32ddea10 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.249+0000 7f77597fa640 1 -- 172.21.15.16:0/2757421851 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754003850 con 0x55bf32ddea10 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 -- 172.21.15.16:0/2757421851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32ddea10 msgr2=0x55bf32defcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32ddea10 0x55bf32defcd0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x55bf32de1270 tx=0x7f7754004570 comp rx=0 tx=0).stop 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 -- 172.21.15.16:0/2757421851 shutdown_connections 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32deedb0 0x55bf32df0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32ddea10 0x55bf32defcd0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 --2- 172.21.15.16:0/2757421851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32dfacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 -- 172.21.15.16:0/2757421851 >> 172.21.15.16:0/2757421851 conn(0x55bf32ddbf20 msgr2=0x55bf32ddcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 -- 172.21.15.16:0/2757421851 shutdown_connections 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 -- 172.21.15.16:0/2757421851 wait complete. 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 -- start start 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.250+0000 7f776c22f740 1 Processor -- start 2024-09-10T23:48:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f776c22f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32e06920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f776c22f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32e06e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f776c22f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32e073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f776c22f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77641aaa30 con 0x55bf32deedb0 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f776c22f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77641abea0 con 0x55bf32ddea10 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f776c22f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77641ab100 con 0x55bf32dde0f0 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f776c22f740 10 client.0 _ll_register_callbacks cb 0x7f774c013cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32e073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32e073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52430/0 (socket says 172.21.15.16:52430) 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 -- 172.21.15.16:0/2282334346 learned_addr learned my addr 172.21.15.16:0/2282334346 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32e06920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f77637fe640 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32e06e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 -- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 msgr2=0x55bf32e06920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32e06920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 -- 172.21.15.16:0/2282334346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 msgr2=0x55bf32e06e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32e06e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 -- 172.21.15.16:0/2282334346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf32df64a0 con 0x55bf32deedb0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7762ffd640 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32e073a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f774c013970 tx=0x7f774c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c761719a83013e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.251+0000 7f7742ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f7742ffd640 1 -- 172.21.15.16:0/2282334346 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c00b840 con 0x55bf32deedb0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77540054f0 con 0x55bf32deedb0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f7742ffd640 1 -- 172.21.15.16:0/2282334346 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8470+0+0 (secure 0 0 0) 0x7f774c01c040 con 0x55bf32deedb0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f7742ffd640 1 -- 172.21.15.16:0/2282334346 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f774c03e050 con 0x55bf32deedb0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 10 client.16986 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bf32e6bf90 con 0x55bf32deedb0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f7742ffd640 1 -- 172.21.15.16:0/2282334346 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77540054f0 con 0x55bf32deedb0 2024-09-10T23:48:07.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f7742ffd640 1 -- 172.21.15.16:0/2282334346 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f774c00e6e0 con 0x55bf32deedb0 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 10 client.16986 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 10 client.16986 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 20 client.16986 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32e6c5a0 0x55bf32e6e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 4 client.16986 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.252+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf32d528a0 con 0x55bf32e6c5a0 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f77637fe640 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32e6c5a0 0x55bf32e6e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f7742ffd640 10 client.16986 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f77637fe640 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32e6c5a0 0x55bf32e6e9c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1972d6b71f12534d server_cookie=72dd80a08cdd9e8 in_seq=0 out_seq=0 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f7742ffd640 1 -- 172.21.15.16:0/2282334346 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf32d528a0 con 0x55bf32e6c5a0 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f7742ffd640 10 client.16986 handle_command_reply: tid=0 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f776c22f740 1 client.16986 shutdown 2024-09-10T23:48:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 msgr2=0x55bf32e073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.253+0000 7f776c22f740 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32e073a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f774c013970 tx=0x7f774c00b460 comp rx=0 tx=0).stop 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 shutdown_connections 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55bf32e6c5a0 0x55bf32e6e9c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bf32deedb0 0x55bf32e073a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bf32ddea10 0x55bf32e06e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 --2- 172.21.15.16:0/2282334346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bf32dde0f0 0x55bf32e06920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 >> 172.21.15.16:0/2282334346 conn(0x55bf32ddbf20 msgr2=0x55bf32df0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7742ffd640 0 client.16986 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 shutdown_connections 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 1 -- 172.21.15.16:0/2282334346 wait complete. 2024-09-10T23:48:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f776c22f740 20 client.16986 trim_cache size 0 max 16384 2024-09-10T23:48:07.269 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:48:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f77500b5450 msgr2=0x7f77500b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f77500b5450 0x7f77500b7910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f775c0cda50 tx=0x7f775c096d20 comp rx=0 tx=0).stop 2024-09-10T23:48:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 msgr2=0x7f776419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776419eac0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f775c005cc0 tx=0x7f775c02f470 comp rx=0 tx=0).stop 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 shutdown_connections 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7764109150 0x7f776419eac0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f77500b5450 0x7f77500b7910 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77641087d0 0x7f7764199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.254+0000 7f7769e5a640 1 --2- 172.21.15.16:0/3689790250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7764102dc0 0x7f77641991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.255+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 >> 172.21.15.16:0/3689790250 conn(0x7f77640fe830 msgr2=0x7f7764101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.255+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 shutdown_connections 2024-09-10T23:48:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:07.255+0000 7f7769e5a640 1 -- 172.21.15.16:0/3689790250 wait complete. 2024-09-10T23:48:08.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:48:08.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:07 smithi016 ceph-mon[30855]: pgmap v559: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:48:08.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:07 smithi071 ceph-mon[35018]: pgmap v559: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:48:08.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:07 smithi066 ceph-mon[34761]: pgmap v559: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:48:08.363 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:08.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 -- 172.21.15.16:0/90450410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c103ce0 msgr2=0x7faa3c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 --2- 172.21.15.16:0/90450410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c103ce0 0x7faa3c1040c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009900 tx=0x7faa2c02a410 comp rx=0 tx=0).stop 2024-09-10T23:48:08.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 -- 172.21.15.16:0/90450410 shutdown_connections 2024-09-10T23:48:08.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 --2- 172.21.15.16:0/90450410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c10d140 0x7faa3c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 --2- 172.21.15.16:0/90450410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa3c104600 0x7faa3c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 --2- 172.21.15.16:0/90450410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c103ce0 0x7faa3c1040c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 -- 172.21.15.16:0/90450410 >> 172.21.15.16:0/90450410 conn(0x7faa3c0fd700 msgr2=0x7faa3c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 -- 172.21.15.16:0/90450410 shutdown_connections 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.866+0000 7faa40cd2640 1 -- 172.21.15.16:0/90450410 wait complete. 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 Processor -- start 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 -- start start 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c103ce0 0x7faa3c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c104600 0x7faa3c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa3c10d140 0x7faa3c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112db0 con 0x7faa3c104600 2024-09-10T23:48:08.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112c30 con 0x7faa3c103ce0 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.867+0000 7faa40cd2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112f30 con 0x7faa3c10d140 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c104600 0x7faa3c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c104600 0x7faa3c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52444/0 (socket says 172.21.15.16:52444) 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 -- 172.21.15.16:0/1459241366 learned_addr learned my addr 172.21.15.16:0/1459241366 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c103ce0 0x7faa3c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa3c10d140 0x7faa3c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 -- 172.21.15.16:0/1459241366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa3c10d140 msgr2=0x7faa3c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa3c10d140 0x7faa3c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 -- 172.21.15.16:0/1459241366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c103ce0 msgr2=0x7faa3c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c103ce0 0x7faa3c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 -- 172.21.15.16:0/1459241366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c19f3b0 con 0x7faa3c104600 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa3c10d140 0x7faa3c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa39d9b640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c104600 0x7faa3c199840 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7faa3000c970 tx=0x7faa3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa2b7fe640 1 -- 172.21.15.16:0/1459241366 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30004220 con 0x7faa3c104600 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa2b7fe640 1 -- 172.21.15.16:0/1459241366 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa300043c0 con 0x7faa3c104600 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c19f6a0 con 0x7faa3c104600 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa2b7fe640 1 -- 172.21.15.16:0/1459241366 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa300047c0 con 0x7faa3c104600 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.868+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c1a5d60 con 0x7faa3c104600 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.871+0000 7faa430a7740 1 Processor -- start 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.871+0000 7faa430a7740 1 -- start start 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.871+0000 7faa2b7fe640 1 -- 172.21.15.16:0/1459241366 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7faa300079b0 con 0x7faa3c104600 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.871+0000 7faa430a7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa430a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa430a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b2a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa430a7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f1b207ea0 con 0x562f1b2914d0 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa430a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562f1b1f72d0 con 0x562f1b291df0 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa430a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1b1fb0e0 con 0x562f1b29dd80 2024-09-10T23:48:08.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2918b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52448/0 (socket says 172.21.15.16:52448) 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 -- 172.21.15.16:0/96418063 learned_addr learned my addr 172.21.15.16:0/96418063 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa39d9b640 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b2a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3a59c640 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 -- 172.21.15.16:0/96418063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 msgr2=0x562f1b2a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b2a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 -- 172.21.15.16:0/96418063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 msgr2=0x562f1b29d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 -- 172.21.15.16:0/96418063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1af55650 con 0x562f1b2914d0 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa39d9b640 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b2a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3a59c640 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2918b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faa34009f10 tx=0x7faa3400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a286868c51bf3c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.872+0000 7faa28ff9640 1 -- 172.21.15.16:0/96418063 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34004d20 con 0x562f1b2914d0 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa28ff9640 1 -- 172.21.15.16:0/96418063 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa34013c20 con 0x562f1b2914d0 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa28ff9640 1 -- 172.21.15.16:0/96418063 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa340057a0 con 0x562f1b2914d0 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa2b7fe640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7faa240b5450 0x7faa240b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7faa240b5450 0x7faa240b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa2b7fe640 1 -- 172.21.15.16:0/1459241366 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7faa300e5d50 con 0x7faa3c104600 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa430a7740 1 -- 172.21.15.16:0/96418063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 msgr2=0x562f1b2918b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7faa240b5450 0x7faa240b7910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faa2c031440 tx=0x7faa2c005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa430a7740 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2918b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faa34009f10 tx=0x7faa3400e6c0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa430a7740 1 -- 172.21.15.16:0/96418063 shutdown_connections 2024-09-10T23:48:08.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa430a7740 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b2a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa430a7740 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa430a7740 1 --2- 172.21.15.16:0/96418063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2918b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.873+0000 7faa430a7740 1 -- 172.21.15.16:0/96418063 >> 172.21.15.16:0/96418063 conn(0x562f1b28f300 msgr2=0x562f1b2904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:08.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 -- 172.21.15.16:0/96418063 shutdown_connections 2024-09-10T23:48:08.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 -- 172.21.15.16:0/96418063 wait complete. 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 -- start start 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 Processor -- start 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b2914d0 0x562f1b29d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b29aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b29dd80 0x562f1b29b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f1b058700 con 0x562f1b29dd80 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562f1b192160 con 0x562f1b2914d0 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1b2a0a00 con 0x562f1b291df0 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa430a7740 10 client.0 _ll_register_callbacks cb 0x562f1b1ab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa3ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b29dd80 0x562f1b29b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa3ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b29dd80 0x562f1b29b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52460/0 (socket says 172.21.15.16:52460) 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa3ad9d640 1 -- 172.21.15.16:0/1856583518 learned_addr learned my addr 172.21.15.16:0/1856583518 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:08.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.874+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b2914d0 0x562f1b29d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa39d9b640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b29aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa3ad9d640 1 -- 172.21.15.16:0/1856583518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 msgr2=0x562f1b29aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b29aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa3ad9d640 1 -- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b2914d0 msgr2=0x562f1b29d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b2914d0 0x562f1b29d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa3ad9d640 1 -- 172.21.15.16:0/1856583518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1b1bfc90 con 0x562f1b29dd80 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa39d9b640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b29aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b29dd80 0x562f1b29b070 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faa34005c00 tx=0x7faa34005140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a5e208469e04bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa21ffb640 1 -- 172.21.15.16:0/1856583518 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34028020 con 0x562f1b29dd80 2024-09-10T23:48:08.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa21ffb640 1 -- 172.21.15.16:0/1856583518 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7faa34004c50 con 0x562f1b29dd80 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa34013c20 con 0x562f1b29dd80 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa21ffb640 1 -- 172.21.15.16:0/1856583518 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa34033050 con 0x562f1b29dd80 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa430a7740 10 client.16998 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562f1b2ac270 con 0x562f1b29dd80 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.875+0000 7faa21ffb640 1 -- 172.21.15.16:0/1856583518 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa34013c20 con 0x562f1b29dd80 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa21ffb640 1 -- 172.21.15.16:0/1856583518 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa3400f040 con 0x562f1b29dd80 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa430a7740 10 client.16998 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa430a7740 10 client.16998 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa430a7740 20 client.16998 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa430a7740 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b2afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa430a7740 4 client.16998 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f1b209df0 con 0x562f1b2ad6d0 2024-09-10T23:48:08.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.876+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b2afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b2afac0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb2263c93103c1e4 server_cookie=763ee82ddf0068d5 in_seq=0 out_seq=0 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa21ffb640 10 client.16998 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa21ffb640 1 -- 172.21.15.16:0/1856583518 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f1b209df0 con 0x562f1b2ad6d0 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa21ffb640 10 client.16998 handle_command_reply: tid=0 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 client.16998 shutdown 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b29dd80 msgr2=0x562f1b29b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b29dd80 0x562f1b29b070 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faa34005c00 tx=0x7faa34005140 comp rx=0 tx=0).stop 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 shutdown_connections 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b2afac0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa21ffb640 0 client.16998 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b29dd80 0x562f1b29b070 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b29aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 --2- 172.21.15.16:0/1856583518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b2914d0 0x562f1b29d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.877+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 >> 172.21.15.16:0/1856583518 conn(0x562f1b28f300 msgr2=0x562f1b294ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:08.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.878+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 shutdown_connections 2024-09-10T23:48:08.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.878+0000 7faa430a7740 1 -- 172.21.15.16:0/1856583518 wait complete. 2024-09-10T23:48:08.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.878+0000 7faa430a7740 20 client.16998 trim_cache size 0 max 16384 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 Processor -- start 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 -- start start 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b28ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b29cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1aeea0 con 0x562f1b2914d0 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1ac770 con 0x562f1b291df0 2024-09-10T23:48:08.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.891+0000 7faa430a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1aa5e0 con 0x562f1b29dd80 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b28ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b28ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52470/0 (socket says 172.21.15.16:52470) 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 -- 172.21.15.16:0/1972072440 learned_addr learned my addr 172.21.15.16:0/1972072440 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b29cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa39d9b640 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 -- 172.21.15.16:0/1972072440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 msgr2=0x562f1b29cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b29cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 -- 172.21.15.16:0/1972072440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 msgr2=0x562f1b29c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 -- 172.21.15.16:0/1972072440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1b290ea0 con 0x562f1b2914d0 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa3a59c640 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b28ec10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009900 tx=0x7faa2c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a582d133ccd32b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa23fff640 1 -- 172.21.15.16:0/1972072440 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c035040 con 0x562f1b2914d0 2024-09-10T23:48:08.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa23fff640 1 -- 172.21.15.16:0/1972072440 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa2c055070 con 0x562f1b2914d0 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.892+0000 7faa23fff640 1 -- 172.21.15.16:0/1972072440 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c004750 con 0x562f1b2914d0 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 -- 172.21.15.16:0/1972072440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 msgr2=0x562f1b28ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b28ec10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009900 tx=0x7faa2c03d000 comp rx=0 tx=0).stop 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 -- 172.21.15.16:0/1972072440 shutdown_connections 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b29dd80 0x562f1b29cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b291df0 0x562f1b29c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 --2- 172.21.15.16:0/1972072440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b28ec10 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 -- 172.21.15.16:0/1972072440 >> 172.21.15.16:0/1972072440 conn(0x562f1b28f300 msgr2=0x562f1b29c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 -- 172.21.15.16:0/1972072440 shutdown_connections 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.893+0000 7faa430a7740 1 -- 172.21.15.16:0/1972072440 wait complete. 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 -- start start 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 Processor -- start 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b2a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b29dd80 0x562f1b2a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1aac30 con 0x562f1b2914d0 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1ac0a0 con 0x562f1b29dd80 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1ab300 con 0x562f1b291df0 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa430a7740 10 client.0 _ll_register_callbacks cb 0x7faa34009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2a5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52478/0 (socket says 172.21.15.16:52478) 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 -- 172.21.15.16:0/2093874363 learned_addr learned my addr 172.21.15.16:0/2093874363 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa39d9b640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b2a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b29dd80 0x562f1b2a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 -- 172.21.15.16:0/2093874363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 msgr2=0x562f1b2a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b2a61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 -- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b29dd80 msgr2=0x562f1b2a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b29dd80 0x562f1b2a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3a59c640 1 -- 172.21.15.16:0/2093874363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1b2b5c70 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.894+0000 7faa3ad9d640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b29dd80 0x562f1b2a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa3a59c640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2a5ca0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7faa2c031950 tx=0x7faa2c031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212a5aa0429eb791 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa21ffb640 1 -- 172.21.15.16:0/2093874363 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c05d070 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa21ffb640 1 -- 172.21.15.16:0/2093874363 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7faa2c004450 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa2c055070 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa21ffb640 1 -- 172.21.15.16:0/2093874363 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa2c035040 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 10 client.17004 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562f1b31a740 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa21ffb640 1 -- 172.21.15.16:0/2093874363 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa2c055070 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa21ffb640 1 -- 172.21.15.16:0/2093874363 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa2c0035f0 con 0x562f1b2914d0 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 10 client.17004 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 10 client.17004 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:48:08.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 20 client.17004 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b31cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 4 client.17004 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.895+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f1b2058a0 con 0x562f1b2ad6d0 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.896+0000 7faa39d9b640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b31cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.896+0000 7faa39d9b640 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b31cea0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c01bd44fc5b36306 server_cookie=357c2de60163340 in_seq=0 out_seq=0 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.896+0000 7faa21ffb640 10 client.17004 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa21ffb640 1 -- 172.21.15.16:0/2093874363 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f1b2058a0 con 0x562f1b2ad6d0 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa21ffb640 10 client.17004 handle_command_reply: tid=0 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 client.17004 shutdown 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 msgr2=0x562f1b2a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2a5ca0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7faa2c031950 tx=0x7faa2c031660 comp rx=0 tx=0).stop 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 shutdown_connections 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562f1b2ad6d0 0x562f1b31cea0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562f1b29dd80 0x562f1b2a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1b291df0 0x562f1b2a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 --2- 172.21.15.16:0/2093874363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1b2914d0 0x562f1b2a5ca0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 >> 172.21.15.16:0/2093874363 conn(0x562f1b28f300 msgr2=0x562f1b29b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa21ffb640 0 client.17004 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 shutdown_connections 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 1 -- 172.21.15.16:0/2093874363 wait complete. 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa430a7740 20 client.17004 trim_cache size 0 max 16384 2024-09-10T23:48:08.906 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:48:08.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7faa240b5450 msgr2=0x7faa240b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa40cd2640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7faa240b5450 0x7faa240b7910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faa2c031440 tx=0x7faa2c005b50 comp rx=0 tx=0).stop 2024-09-10T23:48:08.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c104600 msgr2=0x7faa3c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa40cd2640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c104600 0x7faa3c199840 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7faa3000c970 tx=0x7faa3000ce30 comp rx=0 tx=0).stop 2024-09-10T23:48:08.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 shutdown_connections 2024-09-10T23:48:08.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa40cd2640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa3c10d140 0x7faa3c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.897+0000 7faa40cd2640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa3c104600 0x7faa3c199840 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.898+0000 7faa40cd2640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7faa240b5450 0x7faa240b7910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.898+0000 7faa40cd2640 1 --2- 172.21.15.16:0/1459241366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c103ce0 0x7faa3c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.898+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 >> 172.21.15.16:0/1459241366 conn(0x7faa3c0fd700 msgr2=0x7faa3c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:08.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.898+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 shutdown_connections 2024-09-10T23:48:08.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:08.898+0000 7faa40cd2640 1 -- 172.21.15.16:0/1459241366 wait complete. 2024-09-10T23:48:09.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:08 smithi016 ceph-mon[30855]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:48:09.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:08 smithi071 ceph-mon[35018]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:48:09.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:08 smithi066 ceph-mon[34761]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:48:09.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:48:10.081 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:10.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:09 smithi016 ceph-mon[30855]: pgmap v561: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:48:10.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:09 smithi071 ceph-mon[35018]: pgmap v561: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:48:10.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:09 smithi066 ceph-mon[34761]: pgmap v561: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:48:10.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 -- 172.21.15.16:0/4241113323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 msgr2=0x7f79681031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 --2- 172.21.15.16:0/4241113323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f79681031a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7958009900 tx=0x7f795802a410 comp rx=0 tx=0).stop 2024-09-10T23:48:10.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 -- 172.21.15.16:0/4241113323 shutdown_connections 2024-09-10T23:48:10.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 --2- 172.21.15.16:0/4241113323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7968109150 0x7f796810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 --2- 172.21.15.16:0/4241113323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79681087d0 0x7f7968108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 --2- 172.21.15.16:0/4241113323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f79681031a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 -- 172.21.15.16:0/4241113323 >> 172.21.15.16:0/4241113323 conn(0x7f79680fe870 msgr2=0x7f7968100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 -- 172.21.15.16:0/4241113323 shutdown_connections 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 -- 172.21.15.16:0/4241113323 wait complete. 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.618+0000 7f796eb2b640 1 Processor -- start 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796eb2b640 1 -- start start 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796eb2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f7968199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796eb2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79681087d0 0x7f79681997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796eb2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7968109150 0x7f796819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796eb2b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7968112e10 con 0x7f7968102dc0 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796eb2b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7968112c90 con 0x7f79681087d0 2024-09-10T23:48:10.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796eb2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7968112f90 con 0x7f7968109150 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f7968199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f7968199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52496/0 (socket says 172.21.15.16:52496) 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 -- 172.21.15.16:0/3439894648 learned_addr learned my addr 172.21.15.16:0/3439894648 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7968109150 0x7f796819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 -- 172.21.15.16:0/3439894648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7968109150 msgr2=0x7f796819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7968109150 0x7f796819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 -- 172.21.15.16:0/3439894648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79681087d0 msgr2=0x7f79681997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f7967fff640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79681087d0 0x7f79681997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79681087d0 0x7f79681997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 -- 172.21.15.16:0/3439894648 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796819f330 con 0x7f7968102dc0 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.619+0000 7f796c8c7640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f7968199280 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7958005940 tx=0x7f79580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.620+0000 7f7965ffb640 1 -- 172.21.15.16:0/3439894648 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795803f030 con 0x7f7968102dc0 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.620+0000 7f7965ffb640 1 -- 172.21.15.16:0/3439894648 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7958003cb0 con 0x7f7968102dc0 2024-09-10T23:48:10.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.620+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796819f5c0 con 0x7f7968102dc0 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.620+0000 7f7965ffb640 1 -- 172.21.15.16:0/3439894648 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958035070 con 0x7f7968102dc0 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.620+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79681a5ce0 con 0x7f7968102dc0 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.622+0000 7f7970f00740 1 Processor -- start 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.622+0000 7f7965ffb640 1 -- 172.21.15.16:0/3439894648 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f795803bbf0 con 0x7f7968102dc0 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.622+0000 7f7970f00740 1 -- start start 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7970f00740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f8b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7970f00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7970f00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f9c190 0x55d0f7f9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7970f00740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7f01ea0 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7970f00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7ef12d0 con 0x55d0f7f9c190 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7970f00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7ef50e0 con 0x55d0f7f8bdf0 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f8b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f8b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52504/0 (socket says 172.21.15.16:52504) 2024-09-10T23:48:10.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 -- 172.21.15.16:0/1727981570 learned_addr learned my addr 172.21.15.16:0/1727981570 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796c8c7640 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7967fff640 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f9c190 0x55d0f7f9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 -- 172.21.15.16:0/1727981570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 msgr2=0x55d0f7f9bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 -- 172.21.15.16:0/1727981570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f9c190 msgr2=0x55d0f7f9e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f9c190 0x55d0f7f9e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 -- 172.21.15.16:0/1727981570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f7c4f650 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f796d0c8640 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f8b8b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7960009e20 tx=0x7f796000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0365634ddd51e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f7965ffb640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f79540b5450 0x7f79540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.623+0000 7f795effd640 1 -- 172.21.15.16:0/1727981570 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960003b70 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f796c8c7640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f79540b5450 0x7f79540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f795effd640 1 -- 172.21.15.16:0/1727981570 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7960003d10 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f795effd640 1 -- 172.21.15.16:0/1727981570 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960011840 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7965ffb640 1 -- 172.21.15.16:0/3439894648 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7f79581068b0 con 0x7f7968102dc0 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f796c8c7640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f79540b5450 0x7f79540b7910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79581040b0 tx=0x7f7958032f60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 -- 172.21.15.16:0/1727981570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 msgr2=0x55d0f7f8b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f8b8b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7960009e20 tx=0x7f796000f730 comp rx=0 tx=0).stop 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 -- 172.21.15.16:0/1727981570 shutdown_connections 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f9c190 0x55d0f7f9e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 --2- 172.21.15.16:0/1727981570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f8b8b0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 -- 172.21.15.16:0/1727981570 >> 172.21.15.16:0/1727981570 conn(0x55d0f7f89300 msgr2=0x55d0f7f8a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 -- 172.21.15.16:0/1727981570 shutdown_connections 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.624+0000 7f7970f00740 1 -- 172.21.15.16:0/1727981570 wait complete. 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 -- start start 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 Processor -- start 2024-09-10T23:48:10.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f98e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f9c190 0x55d0f7f99380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7d52700 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7e8c160 con 0x55d0f7f8bdf0 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7f9ee40 con 0x55d0f7f9c190 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f7970f00740 10 client.0 _ll_register_callbacks cb 0x55d0f7ea59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52510/0 (socket says 172.21.15.16:52510) 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.625+0000 7f796d0c8640 1 -- 172.21.15.16:0/3608016050 learned_addr learned my addr 172.21.15.16:0/3608016050 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7967fff640 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f98e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f796d0c8640 1 -- 172.21.15.16:0/3608016050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f9c190 msgr2=0x55d0f7f99380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f9c190 0x55d0f7f99380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f796d0c8640 1 -- 172.21.15.16:0/3608016050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8bdf0 msgr2=0x55d0f7f98e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f98e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f796d0c8640 1 -- 172.21.15.16:0/3608016050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f7eb9c90 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9b9d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f79600046b0 tx=0x7f79600047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94f81d8a0700cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7947fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7947fff640 1 -- 172.21.15.16:0/3608016050 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960004c40 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7960003d10 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7947fff640 1 -- 172.21.15.16:0/3608016050 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7f7960004de0 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7947fff640 1 -- 172.21.15.16:0/3608016050 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f79600040f0 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7970f00740 10 client.17016 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0f7faa6d0 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.626+0000 7f7947fff640 1 -- 172.21.15.16:0/3608016050 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7960003d10 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7947fff640 1 -- 172.21.15.16:0/3608016050 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7960005040 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7970f00740 10 client.17016 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:10.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7970f00740 10 client.17016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7970f00740 20 client.17016 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7970f00740 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f7fabb30 0x55d0f7fadf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7970f00740 4 client.17016 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f7f03df0 con 0x55d0f7fabb30 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.627+0000 7f7967fff640 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f7fabb30 0x55d0f7fadf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7947fff640 10 client.17016 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7967fff640 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f7fabb30 0x55d0f7fadf20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b14a2fcc35fa619 server_cookie=df5e16fe36fa56ad in_seq=0 out_seq=0 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7947fff640 1 -- 172.21.15.16:0/3608016050 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0f7f03df0 con 0x55d0f7fabb30 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7947fff640 10 client.17016 handle_command_reply: tid=0 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 client.17016 shutdown 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 msgr2=0x55d0f7f9b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9b9d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f79600046b0 tx=0x7f79600047e0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 shutdown_connections 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f7fabb30 0x55d0f7fadf20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7947fff640 0 client.17016 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f9c190 0x55d0f7f99380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f98e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.628+0000 7f7970f00740 1 --2- 172.21.15.16:0/3608016050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9b9d0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.629+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 >> 172.21.15.16:0/3608016050 conn(0x55d0f7f89300 msgr2=0x55d0f7f8ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.629+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 shutdown_connections 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.629+0000 7f7970f00740 1 -- 172.21.15.16:0/3608016050 wait complete. 2024-09-10T23:48:10.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.629+0000 7f7970f00740 20 client.17016 trim_cache size 0 max 16384 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 Processor -- start 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 -- start start 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fb3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79681aed60 con 0x55d0f7f9c190 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79681ac630 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7970f00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79681aa4a0 con 0x55d0f7f8bdf0 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fb3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fb3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52526/0 (socket says 172.21.15.16:52526) 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f796d0c8640 1 -- 172.21.15.16:0/4080774147 learned_addr learned my addr 172.21.15.16:0/4080774147 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.642+0000 7f7967fff640 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f796d0c8640 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f796d0c8640 1 -- 172.21.15.16:0/4080774147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 msgr2=0x55d0f7f9e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f796d0c8640 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f796d0c8640 1 -- 172.21.15.16:0/4080774147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 msgr2=0x55d0f7f9ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f796d0c8640 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f796d0c8640 1 -- 172.21.15.16:0/4080774147 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f7f996f0 con 0x55d0f7f9c190 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f796d0c8640 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fb3550 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7960009e20 tx=0x7f796000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f0aec83f042f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f795e7fc640 1 -- 172.21.15.16:0/4080774147 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960005040 con 0x55d0f7f9c190 2024-09-10T23:48:10.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f795e7fc640 1 -- 172.21.15.16:0/4080774147 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7960022070 con 0x55d0f7f9c190 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.643+0000 7f795e7fc640 1 -- 172.21.15.16:0/4080774147 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600114b0 con 0x55d0f7f9c190 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 -- 172.21.15.16:0/4080774147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 msgr2=0x55d0f7fb3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fb3550 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7960009e20 tx=0x7f796000f730 comp rx=0 tx=0).stop 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 -- 172.21.15.16:0/4080774147 shutdown_connections 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fb3550 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7f9e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 --2- 172.21.15.16:0/4080774147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7f9ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 -- 172.21.15.16:0/4080774147 >> 172.21.15.16:0/4080774147 conn(0x55d0f7f89300 msgr2=0x55d0f7f976a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 -- 172.21.15.16:0/4080774147 shutdown_connections 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 -- 172.21.15.16:0/4080774147 wait complete. 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 -- start start 2024-09-10T23:48:10.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.644+0000 7f7970f00740 1 Processor -- start 2024-09-10T23:48:10.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7fa4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7fa4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fa1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79681aaaf0 con 0x55d0f7f9c190 2024-09-10T23:48:10.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79681abf60 con 0x55d0f7f8b4d0 2024-09-10T23:48:10.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79681ab1c0 con 0x55d0f7f8bdf0 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 10 client.0 _ll_register_callbacks cb 0x7f79500092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fa1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fa1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52532/0 (socket says 172.21.15.16:52532) 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 -- 172.21.15.16:0/3897719455 learned_addr learned my addr 172.21.15.16:0/3897719455 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7967fff640 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7fa4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7fa4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 -- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 msgr2=0x55d0f7fa4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7fa4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 -- 172.21.15.16:0/3897719455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 msgr2=0x55d0f7fa4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7fa4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 -- 172.21.15.16:0/3897719455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f7fa19c0 con 0x55d0f7f9c190 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f796d0c8640 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fa1190 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7960003ac0 tx=0x7f79600052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c46bccd5f2e5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:10.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7947fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7947fff640 1 -- 172.21.15.16:0/3897719455 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960005630 con 0x55d0f7f9c190 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7947fff640 1 -- 172.21.15.16:0/3897719455 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7f7960039040 con 0x55d0f7f9c190 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.645+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7960022070 con 0x55d0f7f9c190 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7947fff640 1 -- 172.21.15.16:0/3897719455 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7960044050 con 0x55d0f7f9c190 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 10 client.17022 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0f8019340 con 0x55d0f7f9c190 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7947fff640 1 -- 172.21.15.16:0/3897719455 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7960022070 con 0x55d0f7f9c190 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7947fff640 1 -- 172.21.15.16:0/3897719455 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f79600307b0 con 0x55d0f7f9c190 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 10 client.17022 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 10 client.17022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 20 client.17022 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f8019950 0x55d0f801bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 4 client.17022 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:48:10.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0f7eff8a0 con 0x55d0f8019950 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.646+0000 7f7967fff640 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f8019950 0x55d0f801bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7967fff640 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f8019950 0x55d0f801bd70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735398c49d5874d7 server_cookie=fa7f7359a0e2391a in_seq=0 out_seq=0 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7947fff640 10 client.17022 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7947fff640 1 -- 172.21.15.16:0/3897719455 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0f7eff8a0 con 0x55d0f8019950 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7947fff640 10 client.17022 handle_command_reply: tid=0 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 client.17022 shutdown 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 msgr2=0x55d0f7fa1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fa1190 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7960003ac0 tx=0x7f79600052f0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 shutdown_connections 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d0f8019950 0x55d0f801bd70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0f7f9c190 0x55d0f7fa1190 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d0f7f8bdf0 0x55d0f7fa4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 --2- 172.21.15.16:0/3897719455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d0f7f8b4d0 0x55d0f7fa4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 >> 172.21.15.16:0/3897719455 conn(0x55d0f7f89300 msgr2=0x55d0f7f9ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:10.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.647+0000 7f7947fff640 0 client.17022 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:10.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 shutdown_connections 2024-09-10T23:48:10.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f7970f00740 1 -- 172.21.15.16:0/3897719455 wait complete. 2024-09-10T23:48:10.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f7970f00740 20 client.17022 trim_cache size 0 max 16384 2024-09-10T23:48:10.655 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f79540b5450 msgr2=0x7f79540b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f79540b5450 0x7f79540b7910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79581040b0 tx=0x7f7958032f60 comp rx=0 tx=0).stop 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 msgr2=0x7f7968199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f7968199280 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7958005940 tx=0x7f79580042f0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 shutdown_connections 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7968109150 0x7f796819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f79540b5450 0x7f79540b7910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79681087d0 0x7f79681997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 --2- 172.21.15.16:0/3439894648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7968102dc0 0x7f7968199280 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 >> 172.21.15.16:0/3439894648 conn(0x7f79680fe870 msgr2=0x7f7968100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:10.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 shutdown_connections 2024-09-10T23:48:10.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:10.648+0000 7f796eb2b640 1 -- 172.21.15.16:0/3439894648 wait complete. 2024-09-10T23:48:12.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:11 smithi016 ceph-mon[30855]: pgmap v562: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:48:12.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:11 smithi071 ceph-mon[35018]: pgmap v562: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:48:12.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:11 smithi066 ceph-mon[34761]: pgmap v562: 97 pgs: 97 active+clean; 14 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:48:12.543 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:48:12.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:48:12.815 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/2359608875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c41087d0 msgr2=0x7fc6c4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/2359608875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c41087d0 0x7fc6c4108c10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009900 tx=0x7fc6b402a410 comp rx=0 tx=0).stop 2024-09-10T23:48:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/2359608875 shutdown_connections 2024-09-10T23:48:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/2359608875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6c4109150 0x7fc6c410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/2359608875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c41087d0 0x7fc6c4108c10 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/2359608875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c4102dc0 0x7fc6c41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/2359608875 >> 172.21.15.16:0/2359608875 conn(0x7fc6c40fe830 msgr2=0x7fc6c4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/2359608875 shutdown_connections 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.336+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/2359608875 wait complete. 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 Processor -- start 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 -- start start 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c4102dc0 0x7fc6c4199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6c41087d0 0x7fc6c4199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c4109150 0x7fc6c419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4112da0 con 0x7fc6c4102dc0 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4112c20 con 0x7fc6c41087d0 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6cbb8c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4112f20 con 0x7fc6c4109150 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6c9928640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c4102dc0 0x7fc6c4199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6c9928640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c4102dc0 0x7fc6c4199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52548/0 (socket says 172.21.15.16:52548) 2024-09-10T23:48:13.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6c9928640 1 -- 172.21.15.16:0/4111475671 learned_addr learned my addr 172.21.15.16:0/4111475671 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6c9127640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6c41087d0 0x7fc6c4199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6c9928640 1 -- 172.21.15.16:0/4111475671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c4109150 msgr2=0x7fc6c419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.337+0000 7fc6ca129640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c4109150 0x7fc6c419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6c9928640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c4109150 0x7fc6c419eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6c9928640 1 -- 172.21.15.16:0/4111475671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6c41087d0 msgr2=0x7fc6c4199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6c9928640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6c41087d0 0x7fc6c4199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6c9928640 1 -- 172.21.15.16:0/4111475671 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c419f300 con 0x7fc6c4102dc0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6c9127640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6c41087d0 0x7fc6c4199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6c9928640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c4102dc0 0x7fc6c4199250 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c920 tx=0x7fc6c000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6baffd640 1 -- 172.21.15.16:0/4111475671 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0007c70 con 0x7fc6c4102dc0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6baffd640 1 -- 172.21.15.16:0/4111475671 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6c0007e10 con 0x7fc6c4102dc0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c419f5f0 con 0x7fc6c4102dc0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6baffd640 1 -- 172.21.15.16:0/4111475671 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0018820 con 0x7fc6c4102dc0 2024-09-10T23:48:13.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.338+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c41a5e80 con 0x7fc6c4102dc0 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 Processor -- start 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 -- start start 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6baffd640 1 -- 172.21.15.16:0/4111475671 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc6c000f450 con 0x7fc6c4102dc0 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163dee0 0x55d25163e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d25164a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d25164cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d2515b4e60 con 0x55d25163dee0 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d2515a4290 con 0x55d25163e800 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d2515a80a0 con 0x55d25164a790 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6ca129640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163dee0 0x55d25163e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6ca129640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163dee0 0x55d25163e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52558/0 (socket says 172.21.15.16:52558) 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6ca129640 1 -- 172.21.15.16:0/2298250262 learned_addr learned my addr 172.21.15.16:0/2298250262 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6c9928640 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d25164a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.341+0000 7fc6c9127640 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d25164cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6ca129640 1 -- 172.21.15.16:0/2298250262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 msgr2=0x55d25164cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d25164cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6ca129640 1 -- 172.21.15.16:0/2298250262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 msgr2=0x55d25164a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d25164a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6ca129640 1 -- 172.21.15.16:0/2298250262 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d251302930 con 0x55d25163dee0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6c9928640 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d25164a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163dee0 0x55d25163e2c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc008d30 tx=0x7fc6bc00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0952de8c19ff09d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6affff640 1 -- 172.21.15.16:0/2298250262 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc018680 con 0x55d25163dee0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6baffd640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6b00b54d0 0x7fc6b00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6affff640 1 -- 172.21.15.16:0/2298250262 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6bc00f8d0 con 0x55d25163dee0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6affff640 1 -- 172.21.15.16:0/2298250262 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00e910 con 0x55d25163dee0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6c9928640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6b00b54d0 0x7fc6b00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.342+0000 7fc6baffd640 1 -- 172.21.15.16:0/4111475671 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7fc6c00e60c0 con 0x7fc6c4102dc0 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6c9928640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6b00b54d0 0x7fc6b00b7990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00e3960 tx=0x7fc6c00122d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2298250262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163dee0 msgr2=0x55d25163e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163dee0 0x55d25163e2c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc008d30 tx=0x7fc6bc00d710 comp rx=0 tx=0).stop 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2298250262 shutdown_connections 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d25164cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d25164a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2298250262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163dee0 0x55d25163e2c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2298250262 >> 172.21.15.16:0/2298250262 conn(0x55d25163bd10 msgr2=0x55d25163ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2298250262 shutdown_connections 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2298250262 wait complete. 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 -- start start 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.343+0000 7fc6cdf61740 1 Processor -- start 2024-09-10T23:48:13.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163dee0 0x55d251647720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163e800 0x55d251647c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d2516481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d251405890 con 0x55d25163e800 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d25153ed40 con 0x55d25163dee0 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d25164d440 con 0x55d25164a790 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6cdf61740 10 client.0 _ll_register_callbacks cb 0x55d2515a2c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163e800 0x55d251647c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163e800 0x55d251647c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52562/0 (socket says 172.21.15.16:52562) 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 -- 172.21.15.16:0/2560055823 learned_addr learned my addr 172.21.15.16:0/2560055823 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163dee0 0x55d251647720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d2516481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 -- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 msgr2=0x55d2516481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d2516481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 -- 172.21.15.16:0/2560055823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163dee0 msgr2=0x55d251647720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163dee0 0x55d251647720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 -- 172.21.15.16:0/2560055823 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2516567f0 con 0x55d25163e800 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163dee0 0x55d251647720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6c9127640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163e800 0x55d251647c60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009900 tx=0x7fc6b4031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3881cdabc1c534fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.344+0000 7fc6ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2560055823 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4035030 con 0x55d25163e800 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2560055823 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7fc6b4004460 con 0x55d25163e800 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6bc00f8d0 con 0x55d25163e800 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2560055823 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc6b4005030 con 0x55d25163e800 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 10 client.17034 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:13.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d2516591a0 con 0x55d25163e800 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2560055823 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6bc00f8d0 con 0x55d25163e800 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2560055823 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc6b40035f0 con 0x55d25163e800 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 10 client.17034 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 10 client.17034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 20 client.17034 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d25165a600 0x55d25165ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 4 client.17034 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.345+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2515b6db0 con 0x55d25165a600 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.346+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d25165a600 0x55d25165ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.346+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d25165a600 0x55d25165ca70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e167814c1f18fd50 server_cookie=572eab809541b4ab in_seq=0 out_seq=0 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.346+0000 7fc6ad7fa640 10 client.17034 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2560055823 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2515b6db0 con 0x55d25165a600 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6ad7fa640 10 client.17034 handle_command_reply: tid=0 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 client.17034 shutdown 2024-09-10T23:48:13.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163e800 msgr2=0x55d251647c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163e800 0x55d251647c60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009900 tx=0x7fc6b4031810 comp rx=0 tx=0).stop 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 shutdown_connections 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d25165a600 0x55d25165ca70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25164a790 0x55d2516481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25163e800 0x55d251647c60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2560055823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163dee0 0x55d251647720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6ad7fa640 0 client.17034 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 >> 172.21.15.16:0/2560055823 conn(0x55d25163bd10 msgr2=0x55d25163af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 shutdown_connections 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2560055823 wait complete. 2024-09-10T23:48:13.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.347+0000 7fc6cdf61740 20 client.17034 trim_cache size 0 max 16384 2024-09-10T23:48:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 Processor -- start 2024-09-10T23:48:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 -- start start 2024-09-10T23:48:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d25163d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251652ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251652ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41b0fe0 con 0x55d25164a790 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41ae8b0 con 0x55d25163e800 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41ac720 con 0x55d25163dee0 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6ca129640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251652ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6ca129640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251652ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52568/0 (socket says 172.21.15.16:52568) 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.365+0000 7fc6ca129640 1 -- 172.21.15.16:0/101877530 learned_addr learned my addr 172.21.15.16:0/101877530 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6ca129640 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d25163d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6c9127640 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251652ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6ca129640 1 -- 172.21.15.16:0/101877530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 msgr2=0x55d25163d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6ca129640 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d25163d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6ca129640 1 -- 172.21.15.16:0/101877530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 msgr2=0x55d251652ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6ca129640 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251652ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6ca129640 1 -- 172.21.15.16:0/101877530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25165d0f0 con 0x55d25164a790 2024-09-10T23:48:13.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6ca129640 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251652ff0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e580 tx=0x7fc6bc00e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702a8c03b1f3fecf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:13.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6af7fe640 1 -- 172.21.15.16:0/101877530 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc004bb0 con 0x55d25164a790 2024-09-10T23:48:13.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6af7fe640 1 -- 172.21.15.16:0/101877530 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6bc027040 con 0x55d25164a790 2024-09-10T23:48:13.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.366+0000 7fc6af7fe640 1 -- 172.21.15.16:0/101877530 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc005370 con 0x55d25164a790 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 -- 172.21.15.16:0/101877530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 msgr2=0x55d251652ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251652ff0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e580 tx=0x7fc6bc00e450 comp rx=0 tx=0).stop 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 -- 172.21.15.16:0/101877530 shutdown_connections 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251652ff0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251652ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/101877530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d25163d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 -- 172.21.15.16:0/101877530 >> 172.21.15.16:0/101877530 conn(0x55d25163bd10 msgr2=0x55d25163cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 -- 172.21.15.16:0/101877530 shutdown_connections 2024-09-10T23:48:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 -- 172.21.15.16:0/101877530 wait complete. 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 -- start start 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.367+0000 7fc6cdf61740 1 Processor -- start 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d251661440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251661980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6cdf61740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251661ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41acd70 con 0x55d25164a790 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41ae1e0 con 0x55d25163e800 2024-09-10T23:48:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6cdf61740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41ad440 con 0x55d25163dee0 2024-09-10T23:48:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6cdf61740 10 client.0 _ll_register_callbacks cb 0x7fc6b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251661ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251661ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52584/0 (socket says 172.21.15.16:52584) 2024-09-10T23:48:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 -- 172.21.15.16:0/2795185454 learned_addr learned my addr 172.21.15.16:0/2795185454 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6c9127640 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251661980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d251661440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 -- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 msgr2=0x55d251661440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d251661440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 -- 172.21.15.16:0/2795185454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 msgr2=0x55d251661980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251661980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 -- 172.21.15.16:0/2795185454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25163c790 con 0x55d25164a790 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ca129640 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251661ec0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc005e80 tx=0x7fc6bc004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dab7e40352f9b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.368+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2795185454 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0054c0 con 0x55d25164a790 2024-09-10T23:48:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6bc027040 con 0x55d25164a790 2024-09-10T23:48:13.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2795185454 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7fc6bc005660 con 0x55d25164a790 2024-09-10T23:48:13.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2795185454 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc040050 con 0x55d25164a790 2024-09-10T23:48:13.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 10 client.17040 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:13.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d2516cc8c0 con 0x55d25164a790 2024-09-10T23:48:13.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2795185454 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6bc027040 con 0x55d25164a790 2024-09-10T23:48:13.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2795185454 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc6bc0185f0 con 0x55d25164a790 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 10 client.17040 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 10 client.17040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 20 client.17040 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d2516ccca0 0x55d2516cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 4 client.17040 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.369+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d2515b2860 con 0x55d2516ccca0 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.370+0000 7fc6c9127640 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d2516ccca0 0x55d2516cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.370+0000 7fc6c9127640 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d2516ccca0 0x55d2516cf090 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8fb6cc9215c6047 server_cookie=81cc56a9956c1a2e in_seq=0 out_seq=0 2024-09-10T23:48:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.370+0000 7fc6ad7fa640 10 client.17040 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.371+0000 7fc6ad7fa640 1 -- 172.21.15.16:0/2795185454 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d2515b2860 con 0x55d2516ccca0 2024-09-10T23:48:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.371+0000 7fc6ad7fa640 10 client.17040 handle_command_reply: tid=0 2024-09-10T23:48:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.371+0000 7fc6cdf61740 1 client.17040 shutdown 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 msgr2=0x55d251661ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251661ec0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc005e80 tx=0x7fc6bc004f50 comp rx=0 tx=0).stop 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 shutdown_connections 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55d2516ccca0 0x55d2516cf090 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d25164a790 0x55d251661ec0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d25163e800 0x55d251661980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 --2- 172.21.15.16:0/2795185454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d25163dee0 0x55d251661440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6ad7fa640 0 client.17040 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 >> 172.21.15.16:0/2795185454 conn(0x55d25163bd10 msgr2=0x55d251648d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 shutdown_connections 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 1 -- 172.21.15.16:0/2795185454 wait complete. 2024-09-10T23:48:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.372+0000 7fc6cdf61740 20 client.17040 trim_cache size 0 max 16384 2024-09-10T23:48:13.381 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:48:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:48:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "dc39dd20-224e-45cc-87b8-22db618aa261", 2024-09-10T23:48:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:48:13.381 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6b00b54d0 msgr2=0x7fc6b00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6b00b54d0 0x7fc6b00b7990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00e3960 tx=0x7fc6c00122d0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c4102dc0 msgr2=0x7fc6c4199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c4102dc0 0x7fc6c4199250 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c920 tx=0x7fc6c000cde0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 shutdown_connections 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6c4109150 0x7fc6c419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc6b00b54d0 0x7fc6b00b7990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6c41087d0 0x7fc6c4199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 --2- 172.21.15.16:0/4111475671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6c4102dc0 0x7fc6c4199250 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 >> 172.21.15.16:0/4111475671 conn(0x7fc6c40fe830 msgr2=0x7fc6c4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 shutdown_connections 2024-09-10T23:48:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:13.373+0000 7fc6cbb8c640 1 -- 172.21.15.16:0/4111475671 wait complete. 2024-09-10T23:48:14.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:13 smithi016 ceph-mon[30855]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:48:14.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:13 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:48:14.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:13 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:14.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:13 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:48:14.212 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:13 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:14.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:48:14.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:13 smithi071 ceph-mon[35018]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:48:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:13 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:48:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:13 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:13 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:48:14.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:13 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:14.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:13 smithi066 ceph-mon[34761]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:48:14.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:13 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:48:14.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:13 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:14.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:13 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:48:14.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:13 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:14.497 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 -- 172.21.15.16:0/415958986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 msgr2=0x7fb8e810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/415958986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e810f3c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009ca0 tx=0x7fb8e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 -- 172.21.15.16:0/415958986 shutdown_connections 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/415958986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e810f3c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/415958986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e8104420 0x7fb8e810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/415958986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e8103b00 0x7fb8e8103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 -- 172.21.15.16:0/415958986 >> 172.21.15.16:0/415958986 conn(0x7fb8e80fd560 msgr2=0x7fb8e80ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 -- 172.21.15.16:0/415958986 shutdown_connections 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 -- 172.21.15.16:0/415958986 wait complete. 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 Processor -- start 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.979+0000 7fb8ed59f640 1 -- start start 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ed59f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e8103b00 0x7fb8e8198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ed59f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e8104420 0x7fb8e8199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ed59f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ed59f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8112bd0 con 0x7fb8e810cf60 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ed59f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8112a50 con 0x7fb8e8103b00 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ed59f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8112d50 con 0x7fb8e8104420 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e819e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38652/0 (socket says 172.21.15.16:38652) 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 -- 172.21.15.16:0/3264851172 learned_addr learned my addr 172.21.15.16:0/3264851172 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8dffff640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e8104420 0x7fb8e8199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e8103b00 0x7fb8e8198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 -- 172.21.15.16:0/3264851172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e8104420 msgr2=0x7fb8e8199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e8104420 0x7fb8e8199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 -- 172.21.15.16:0/3264851172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e8103b00 msgr2=0x7fb8e8198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e8103b00 0x7fb8e8198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 -- 172.21.15.16:0/3264851172 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e819f070 con 0x7fb8e810cf60 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8ecd9e640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e819e8a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005cc0 tx=0x7fb8e002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.980+0000 7fb8e5ffb640 1 -- 172.21.15.16:0/3264851172 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0003bf0 con 0x7fb8e810cf60 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.981+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e819f300 con 0x7fb8e810cf60 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.981+0000 7fb8e5ffb640 1 -- 172.21.15.16:0/3264851172 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0003d90 con 0x7fb8e810cf60 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.981+0000 7fb8e5ffb640 1 -- 172.21.15.16:0/3264851172 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e002fbc0 con 0x7fb8e810cf60 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.981+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e81a5a20 con 0x7fb8e810cf60 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.983+0000 7fb8f0bd6740 1 Processor -- start 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.983+0000 7fb8e5ffb640 1 -- 172.21.15.16:0/3264851172 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb8e0004610 con 0x7fb8e810cf60 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8f0bd6740 1 -- start start 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0be9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 0x55986f0c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55986f028e50 con 0x55986f0b2650 2024-09-10T23:48:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55986f018280 con 0x55986f0bef00 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55986f01c090 con 0x55986f0b2f70 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38668/0 (socket says 172.21.15.16:38668) 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 -- 172.21.15.16:0/648732709 learned_addr learned my addr 172.21.15.16:0/648732709 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0be9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 0x55986f0c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8e5ffb640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8d40b5500 0x7fb8d40b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 -- 172.21.15.16:0/648732709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 msgr2=0x55986f0be9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0be9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 -- 172.21.15.16:0/648732709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 msgr2=0x55986f0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 0x55986f0c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.984+0000 7fb8dffff640 1 -- 172.21.15.16:0/648732709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986ed76650 con 0x55986f0b2650 2024-09-10T23:48:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.985+0000 7fb8ecd9e640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8d40b5500 0x7fb8d40b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.985+0000 7fb8dffff640 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0b2a30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0013580 tx=0x7fb8d000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badedcdb0f72b52d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.985+0000 7fb8e5ffb640 1 -- 172.21.15.16:0/3264851172 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7fb8e01075f0 con 0x7fb8e810cf60 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.985+0000 7fb8de7fc640 1 -- 172.21.15.16:0/648732709 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0019030 con 0x55986f0b2650 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.985+0000 7fb8de7fc640 1 -- 172.21.15.16:0/648732709 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8d00118f0 con 0x55986f0b2650 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.985+0000 7fb8de7fc640 1 -- 172.21.15.16:0/648732709 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d001d740 con 0x55986f0b2650 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/648732709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 msgr2=0x55986f0b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8ecd9e640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8d40b5500 0x7fb8d40b79c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0104df0 tx=0x7fb8e009b000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0b2a30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0013580 tx=0x7fb8d000b660 comp rx=0 tx=0).stop 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/648732709 shutdown_connections 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 0x55986f0c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0be9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/648732709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0b2a30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/648732709 >> 172.21.15.16:0/648732709 conn(0x55986f0b0480 msgr2=0x55986f0b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:15.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/648732709 shutdown_connections 2024-09-10T23:48:15.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/648732709 wait complete. 2024-09-10T23:48:15.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 -- start start 2024-09-10T23:48:15.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.986+0000 7fb8f0bd6740 1 Processor -- start 2024-09-10T23:48:15.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 0x55986f0be840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55986ee79700 con 0x55986f0bef00 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55986efb3110 con 0x55986f0b2650 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55986f0c1b80 con 0x55986f0b2f70 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8f0bd6740 10 client.0 _ll_register_callbacks cb 0x55986efcc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8e7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38684/0 (socket says 172.21.15.16:38684) 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 -- 172.21.15.16:0/1421772231 learned_addr learned my addr 172.21.15.16:0/1421772231 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 0x55986f0be840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 -- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 msgr2=0x55986f0bbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0bbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 -- 172.21.15.16:0/1421772231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 msgr2=0x55986f0be840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 0x55986f0be840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 -- 172.21.15.16:0/1421772231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986efe0c40 con 0x55986f0bef00 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0bbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8dffff640 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0bc310 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b990 tx=0x7fb8d000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8057365eba0a6201 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.987+0000 7fb8c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8c77fe640 1 -- 172.21.15.16:0/1421772231 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0019040 con 0x55986f0bef00 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8c77fe640 1 -- 172.21.15.16:0/1421772231 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7fb8d0011aa0 con 0x55986f0bef00 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8d00118f0 con 0x55986f0bef00 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8c77fe640 1 -- 172.21.15.16:0/1421772231 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8d0031050 con 0x55986f0bef00 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 10 client.17052 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55986f0cd500 con 0x55986f0bef00 2024-09-10T23:48:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8c77fe640 1 -- 172.21.15.16:0/1421772231 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8d00118f0 con 0x55986f0bef00 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8c77fe640 1 -- 172.21.15.16:0/1421772231 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8d0004710 con 0x55986f0bef00 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 10 client.17052 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 20 client.17052 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f0ce960 0x55986f0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 4 client.17052 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.988+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55986f02ada0 con 0x55986f0ce960 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.989+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f0ce960 0x55986f0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.989+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f0ce960 0x55986f0d0d50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c4d3e4d956ea58 server_cookie=4830370f8a1e29a0 in_seq=0 out_seq=0 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.989+0000 7fb8c77fe640 10 client.17052 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8c77fe640 1 -- 172.21.15.16:0/1421772231 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55986f02ada0 con 0x55986f0ce960 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8c77fe640 10 client.17052 handle_command_reply: tid=0 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 client.17052 shutdown 2024-09-10T23:48:15.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 msgr2=0x55986f0bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0bc310 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b990 tx=0x7fb8d000b8a0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 shutdown_connections 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f0ce960 0x55986f0d0d50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0bc310 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0bbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/1421772231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 0x55986f0be840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 >> 172.21.15.16:0/1421772231 conn(0x55986f0b0480 msgr2=0x55986f0b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8c77fe640 0 client.17052 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 shutdown_connections 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/1421772231 wait complete. 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:14.990+0000 7fb8f0bd6740 20 client.17052 trim_cache size 0 max 16384 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 Processor -- start 2024-09-10T23:48:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 -- start start 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 0x55986f0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81b0d00 con 0x55986f0bef00 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81ae5d0 con 0x55986f0b2650 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81ac440 con 0x55986f0b2f70 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0c02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38694/0 (socket says 172.21.15.16:38694) 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 -- 172.21.15.16:0/2965777282 learned_addr learned my addr 172.21.15.16:0/2965777282 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 -- 172.21.15.16:0/2965777282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 msgr2=0x55986f0afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 --2- 172.21.15.16:0/2965777282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 -- 172.21.15.16:0/2965777282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 msgr2=0x55986f0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 --2- 172.21.15.16:0/2965777282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 0x55986f0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 -- 172.21.15.16:0/2965777282 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986f0b2da0 con 0x55986f0bef00 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.008+0000 7fb8dffff640 1 --2- 172.21.15.16:0/2965777282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0c02f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb8d001d550 tx=0x7fb8d001d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103ba5d23718b701 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8ddffb640 1 -- 172.21.15.16:0/2965777282 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0019040 con 0x55986f0bef00 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8ddffb640 1 -- 172.21.15.16:0/2965777282 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8d000bd80 con 0x55986f0bef00 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8ddffb640 1 -- 172.21.15.16:0/2965777282 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0013290 con 0x55986f0bef00 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/2965777282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 msgr2=0x55986f0c02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/2965777282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0c02f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb8d001d550 tx=0x7fb8d001d420 comp rx=0 tx=0).stop 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/2965777282 shutdown_connections 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/2965777282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0bef00 0x55986f0c02f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/2965777282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/2965777282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0b2650 0x55986f0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/2965777282 >> 172.21.15.16:0/2965777282 conn(0x55986f0b0480 msgr2=0x55986f0b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/2965777282 shutdown_connections 2024-09-10T23:48:15.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.009+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/2965777282 wait complete. 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 -- start start 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 Processor -- start 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 0x55986f0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81aca90 con 0x55986f0b2650 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81adf00 con 0x55986f0bef00 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e81ad160 con 0x55986f0b2f70 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8f0bd6740 10 client.0 _ll_register_callbacks cb 0x7fb8d800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0d5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38698/0 (socket says 172.21.15.16:38698) 2024-09-10T23:48:15.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 -- 172.21.15.16:0/3081816553 learned_addr learned my addr 172.21.15.16:0/3081816553 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 -- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 msgr2=0x55986f0d6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 -- 172.21.15.16:0/3081816553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 msgr2=0x55986f0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 0x55986f0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.010+0000 7fb8dffff640 1 -- 172.21.15.16:0/3081816553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986f0c6350 con 0x55986f0b2650 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8dffff640 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0d5b00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00048b0 tx=0x7fb8d000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664bb841d12e789b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8c77fe640 1 -- 172.21.15.16:0/3081816553 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0019070 con 0x55986f0b2650 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8c77fe640 1 -- 172.21.15.16:0/3081816553 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8514+0+0 (secure 0 0 0) 0x7fb8d0004230 con 0x55986f0b2650 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8d000bd80 con 0x55986f0b2650 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8c77fe640 1 -- 172.21.15.16:0/3081816553 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8d0004430 con 0x55986f0b2650 2024-09-10T23:48:15.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8f0bd6740 10 client.17058 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55986f0c7660 con 0x55986f0b2650 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8c77fe640 1 -- 172.21.15.16:0/3081816553 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8d000bd80 con 0x55986f0b2650 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.011+0000 7fb8c77fe640 1 -- 172.21.15.16:0/3081816553 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8d0011950 con 0x55986f0b2650 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.012+0000 7fb8f0bd6740 10 client.17058 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.012+0000 7fb8f0bd6740 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.012+0000 7fb8f0bd6740 20 client.17058 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.012+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f13b520 0x55986f13d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.012+0000 7fb8f0bd6740 4 client.17058 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.012+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55986f026850 con 0x55986f13b520 2024-09-10T23:48:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.013+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f13b520 0x55986f13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:15.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.013+0000 7fb8e7fff640 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f13b520 0x55986f13d910 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=525abe9b3dc60686 server_cookie=39ecaf8b5c3fdf8a in_seq=0 out_seq=0 2024-09-10T23:48:15.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.013+0000 7fb8c77fe640 10 client.17058 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8c77fe640 1 -- 172.21.15.16:0/3081816553 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x55986f026850 con 0x55986f13b520 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8c77fe640 10 client.17058 handle_command_reply: tid=0 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 client.17058 shutdown 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 msgr2=0x55986f0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0d5b00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00048b0 tx=0x7fb8d000b870 comp rx=0 tx=0).stop 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 shutdown_connections 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55986f13b520 0x55986f13d910 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55986f0bef00 0x55986f0c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55986f0b2f70 0x55986f0d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8c77fe640 0 client.17058 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 --2- 172.21.15.16:0/3081816553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55986f0b2650 0x55986f0d5b00 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 >> 172.21.15.16:0/3081816553 conn(0x55986f0b0480 msgr2=0x55986f0bd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 shutdown_connections 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 1 -- 172.21.15.16:0/3081816553 wait complete. 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.014+0000 7fb8f0bd6740 20 client.17058 trim_cache size 0 max 16384 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "dc39dd20-224e-45cc-87b8-22db618aa261": { 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "dc39dd20-224e-45cc-87b8-22db618aa261", 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:48:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:48:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:48:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:48:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "dc39dd20-224e-45cc-87b8-22db618aa261": { 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:13.371560+0000", 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:48:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8d40b5500 msgr2=0x7fb8d40b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8d40b5500 0x7fb8d40b79c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0104df0 tx=0x7fb8e009b000 comp rx=0 tx=0).stop 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 msgr2=0x7fb8e819e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e819e8a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005cc0 tx=0x7fb8e002f380 comp rx=0 tx=0).stop 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 shutdown_connections 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8e810cf60 0x7fb8e819e8a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e8104420 0x7fb8e8199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fb8d40b5500 0x7fb8d40b79c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 --2- 172.21.15.16:0/3264851172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8e8103b00 0x7fb8e8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:15.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 >> 172.21.15.16:0/3264851172 conn(0x7fb8e80fd560 msgr2=0x7fb8e810f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:15.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 shutdown_connections 2024-09-10T23:48:15.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:15.015+0000 7fb8ed59f640 1 -- 172.21.15.16:0/3264851172 wait complete. 2024-09-10T23:48:15.877 INFO:tasks.cephfs.filesystem:scrub status for tag:dc39dd20-224e-45cc-87b8-22db618aa261 - {'path': '/', 'tag': 'dc39dd20-224e-45cc-87b8-22db618aa261', 'options': 'recursive,force'} 2024-09-10T23:48:16.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:15 smithi016 ceph-mon[30855]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:16.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:15 smithi071 ceph-mon[35018]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:16.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:15 smithi066 ceph-mon[34761]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:18.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:17 smithi016 ceph-mon[30855]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:18.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:17 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:48:18.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:17 smithi016 ceph-mon[30855]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:48:18.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:17 smithi071 ceph-mon[35018]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:18.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:17 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:48:18.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:17 smithi071 ceph-mon[35018]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:48:18.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:17 smithi066 ceph-mon[34761]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:18.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:17 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:48:18.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:17 smithi066 ceph-mon[34761]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:48:20.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:19 smithi016 ceph-mon[30855]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:20.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:19 smithi071 ceph-mon[35018]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:20.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:19 smithi066 ceph-mon[34761]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:22.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:21 smithi016 ceph-mon[30855]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:22.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:21 smithi071 ceph-mon[35018]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:22.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:21 smithi066 ceph-mon[34761]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:48:24.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:23 smithi071 ceph-mon[35018]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:24.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:23 smithi066 ceph-mon[34761]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:23 smithi016 ceph-mon[30855]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:26.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:25 smithi071 ceph-mon[35018]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:26.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:25 smithi066 ceph-mon[34761]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:25 smithi016 ceph-mon[30855]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:28.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:27 smithi071 ceph-mon[35018]: pgmap v571: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:28.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:27 smithi066 ceph-mon[34761]: pgmap v571: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:27 smithi016 ceph-mon[30855]: pgmap v571: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:48:30.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:29 smithi071 ceph-mon[35018]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-10T23:48:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:30.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:29 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:48:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:29 smithi066 ceph-mon[34761]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-10T23:48:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:29 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:48:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:29 smithi016 ceph-mon[30855]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-10T23:48:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:29 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:48:32.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:31 smithi071 ceph-mon[35018]: pgmap v573: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:32.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:31 smithi066 ceph-mon[34761]: pgmap v573: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:31 smithi016 ceph-mon[30855]: pgmap v573: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:34.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:34 smithi071 ceph-mon[35018]: pgmap v574: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:34.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:34 smithi066 ceph-mon[34761]: pgmap v574: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:34 smithi016 ceph-mon[30855]: pgmap v574: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:36.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:36 smithi071 ceph-mon[35018]: pgmap v575: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:48:36.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:36 smithi016 ceph-mon[30855]: pgmap v575: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:48:36.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:36 smithi066 ceph-mon[34761]: pgmap v575: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:48:38.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:38 smithi071 ceph-mon[35018]: pgmap v576: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:48:38.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:38 smithi066 ceph-mon[34761]: pgmap v576: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:48:38.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:38 smithi016 ceph-mon[30855]: pgmap v576: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:48:40.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:40 smithi071 ceph-mon[35018]: pgmap v577: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:40.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:40 smithi066 ceph-mon[34761]: pgmap v577: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:40 smithi016 ceph-mon[30855]: pgmap v577: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:42.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:42 smithi071 ceph-mon[35018]: pgmap v578: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:42.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:42 smithi066 ceph-mon[34761]: pgmap v578: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:42 smithi016 ceph-mon[30855]: pgmap v578: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:44.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:44 smithi071 ceph-mon[35018]: pgmap v579: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:44.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:44 smithi066 ceph-mon[34761]: pgmap v579: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:44.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:44 smithi016 ceph-mon[30855]: pgmap v579: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:45.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:48:46.155 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:46.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:46 smithi016 ceph-mon[30855]: pgmap v580: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:48:46.269 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:46 smithi071 ceph-mon[35018]: pgmap v580: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:48:46.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:46 smithi066 ceph-mon[34761]: pgmap v580: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:48:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.625+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/2101832142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84102dc0 msgr2=0x7f8b841031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.625+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/2101832142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84102dc0 0x7f8b841031a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009900 tx=0x7f8b8002a410 comp rx=0 tx=0).stop 2024-09-10T23:48:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.625+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/2101832142 shutdown_connections 2024-09-10T23:48:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.625+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/2101832142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b84109150 0x7f8b8410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.625+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/2101832142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b841087d0 0x7f8b84108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.625+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/2101832142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84102dc0 0x7f8b841031a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.625+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/2101832142 >> 172.21.15.16:0/2101832142 conn(0x7f8b840fe830 msgr2=0x7f8b84100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/2101832142 shutdown_connections 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/2101832142 wait complete. 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 Processor -- start 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 -- start start 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b84102dc0 0x7f8b840754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b841087d0 0x7f8b840759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84109150 0x7f8b84075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84112e10 con 0x7f8b84109150 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84112c90 con 0x7f8b84102dc0 2024-09-10T23:48:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8bd8a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84112f90 con 0x7f8b841087d0 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.626+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84109150 0x7f8b84075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84109150 0x7f8b84075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56610/0 (socket says 172.21.15.16:56610) 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 -- 172.21.15.16:0/802239932 learned_addr learned my addr 172.21.15.16:0/802239932 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b89b26640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b84102dc0 0x7f8b840754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b89325640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b841087d0 0x7f8b840759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 -- 172.21.15.16:0/802239932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b841087d0 msgr2=0x7f8b840759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b841087d0 0x7f8b840759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 -- 172.21.15.16:0/802239932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b84102dc0 msgr2=0x7f8b840754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b84102dc0 0x7f8b840754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 -- 172.21.15.16:0/802239932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b841a76c0 con 0x7f8b84109150 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b89325640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b841087d0 0x7f8b840759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8a327640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84109150 0x7f8b84075f20 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00eaa0 tx=0x7f8b7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b7affd640 1 -- 172.21.15.16:0/802239932 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00cdb0 con 0x7f8b84109150 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b841a79b0 con 0x7f8b84109150 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b7affd640 1 -- 172.21.15.16:0/802239932 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7c005020 con 0x7f8b84109150 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b7affd640 1 -- 172.21.15.16:0/802239932 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0116d0 con 0x7f8b84109150 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.627+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b841a7ef0 con 0x7f8b84109150 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b7affd640 1 -- 172.21.15.16:0/802239932 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f8b7c00f040 con 0x7f8b84109150 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 Processor -- start 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 -- start start 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e053e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e053eda0 0x5615e054a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e054ad30 0x5615e054d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5615e04b4e50 con 0x5615e053eda0 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5615e04a4280 con 0x5615e053e480 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5615e04a8090 con 0x5615e054ad30 2024-09-10T23:48:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b89b26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e053eda0 0x5615e054a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.630+0000 7f8b89b26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e053eda0 0x5615e054a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56620/0 (socket says 172.21.15.16:56620) 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89b26640 1 -- 172.21.15.16:0/2332336710 learned_addr learned my addr 172.21.15.16:0/2332336710 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e053e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e054ad30 0x5615e054d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 -- 172.21.15.16:0/2332336710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e054ad30 msgr2=0x5615e054d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e054ad30 0x5615e054d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 -- 172.21.15.16:0/2332336710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e053eda0 msgr2=0x5615e054a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e053eda0 0x5615e054a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 -- 172.21.15.16:0/2332336710 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e0202650 con 0x5615e053e480 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b7affd640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8b700b5450 0x7f8b700b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89b26640 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e053eda0 0x5615e054a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89b26640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8b700b5450 0x7f8b700b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b89325640 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e053e860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009f70 tx=0x7f8b74009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93939cca31e954f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b7affd640 1 -- 172.21.15.16:0/802239932 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f8b7c0e5e20 con 0x7f8b84109150 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b6ffff640 1 -- 172.21.15.16:0/2332336710 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b740134c0 con 0x5615e053e480 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b6ffff640 1 -- 172.21.15.16:0/2332336710 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7401b070 con 0x5615e053e480 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.631+0000 7f8b6ffff640 1 -- 172.21.15.16:0/2332336710 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74012650 con 0x5615e053e480 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2332336710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 msgr2=0x5615e053e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b89b26640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8b700b5450 0x7f8b700b7910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5615e053d190 tx=0x7f8b80005c00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e053e860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009f70 tx=0x7f8b74009590 comp rx=0 tx=0).stop 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2332336710 shutdown_connections 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e054ad30 0x5615e054d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e053eda0 0x5615e054a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2332336710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e053e860 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2332336710 >> 172.21.15.16:0/2332336710 conn(0x5615e053c2b0 msgr2=0x5615e053d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:46.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2332336710 shutdown_connections 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.632+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2332336710 wait complete. 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 -- start start 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 Processor -- start 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e054a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e05479a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0547ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5615e0305700 con 0x5615e054ad30 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5615e043f110 con 0x5615e053eda0 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5615e054d950 con 0x5615e053e480 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8e15f740 10 client.0 _ll_register_callbacks cb 0x5615e0458990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0547ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0547ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56628/0 (socket says 172.21.15.16:56628) 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b8a327640 1 -- 172.21.15.16:0/3636166220 learned_addr learned my addr 172.21.15.16:0/3636166220 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b89325640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e05479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.633+0000 7f8b89b26640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e054a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8a327640 1 -- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 msgr2=0x5615e054a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8a327640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e054a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8a327640 1 -- 172.21.15.16:0/3636166220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 msgr2=0x5615e05479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8a327640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e05479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8a327640 1 -- 172.21.15.16:0/3636166220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e046cc40 con 0x5615e054ad30 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b89b26640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e054a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8a327640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0547ee0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0e3600 tx=0x7f8b7c0abb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89e0fa83fb68ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/3636166220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01f030 con 0x5615e054ad30 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/3636166220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f8b7c0cf070 con 0x5615e054ad30 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b7401b070 con 0x5615e054ad30 2024-09-10T23:48:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/3636166220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c0ac2d0 con 0x5615e054ad30 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8e15f740 10 client.17070 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5615e0559250 con 0x5615e054ad30 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/3636166220 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7401b070 con 0x5615e054ad30 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/3636166220 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b7c0a7c20 con 0x5615e054ad30 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8e15f740 10 client.17070 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.634+0000 7f8b8e15f740 10 client.17070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.635+0000 7f8b8e15f740 20 client.17070 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.635+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e055a7b0 0x5615e055cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.635+0000 7f8b8e15f740 4 client.17070 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.635+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615e04b6da0 con 0x5615e055a7b0 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.635+0000 7f8b89b26640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e055a7b0 0x5615e055cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.635+0000 7f8b89b26640 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e055a7b0 0x5615e055cbc0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=394e4d20a21aec9f server_cookie=e66f51bb13040f8f in_seq=0 out_seq=0 2024-09-10T23:48:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.635+0000 7f8b6d7fa640 10 client.17070 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/3636166220 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615e04b6da0 con 0x5615e055a7b0 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b6d7fa640 10 client.17070 handle_command_reply: tid=0 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 client.17070 shutdown 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 msgr2=0x5615e0547ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0547ee0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0e3600 tx=0x7f8b7c0abb60 comp rx=0 tx=0).stop 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 shutdown_connections 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e055a7b0 0x5615e055cbc0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0547ee0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e05479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/3636166220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e054a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 >> 172.21.15.16:0/3636166220 conn(0x5615e053c2b0 msgr2=0x5615e0541e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b6d7fa640 0 client.17070 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 shutdown_connections 2024-09-10T23:48:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 1 -- 172.21.15.16:0/3636166220 wait complete. 2024-09-10T23:48:46.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.636+0000 7f8b8e15f740 20 client.17070 trim_cache size 0 max 16384 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 Processor -- start 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 -- start start 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e053bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e0544bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0545110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841b3050 con 0x5615e054ad30 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841b0920 con 0x5615e053eda0 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841ae790 con 0x5615e053e480 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0545110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0545110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56640/0 (socket says 172.21.15.16:56640) 2024-09-10T23:48:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 -- 172.21.15.16:0/4189697877 learned_addr learned my addr 172.21.15.16:0/4189697877 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b89b26640 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e053bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b89325640 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e0544bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 -- 172.21.15.16:0/4189697877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 msgr2=0x5615e053bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e053bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 -- 172.21.15.16:0/4189697877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 msgr2=0x5615e0544bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e0544bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b8a327640 1 -- 172.21.15.16:0/4189697877 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e053cf90 con 0x5615e054ad30 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.654+0000 7f8b89325640 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e0544bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.655+0000 7f8b8a327640 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0545110 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0e3ba0 tx=0x7f8b7c0a8210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94c9a20c3074265 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.655+0000 7f8b6f7fe640 1 -- 172.21.15.16:0/4189697877 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01f030 con 0x5615e054ad30 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.655+0000 7f8b6f7fe640 1 -- 172.21.15.16:0/4189697877 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7c0b0db0 con 0x5615e054ad30 2024-09-10T23:48:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.655+0000 7f8b6f7fe640 1 -- 172.21.15.16:0/4189697877 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0ab070 con 0x5615e054ad30 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.655+0000 7f8b8e15f740 1 -- 172.21.15.16:0/4189697877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 msgr2=0x5615e0545110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.655+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0545110 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0e3ba0 tx=0x7f8b7c0a8210 comp rx=0 tx=0).stop 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.655+0000 7f8b8e15f740 1 -- 172.21.15.16:0/4189697877 shutdown_connections 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0545110 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053eda0 0x5615e0544bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/4189697877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053e480 0x5615e053bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 -- 172.21.15.16:0/4189697877 >> 172.21.15.16:0/4189697877 conn(0x5615e053c2b0 msgr2=0x5615e0548fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 -- 172.21.15.16:0/4189697877 shutdown_connections 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 -- 172.21.15.16:0/4189697877 wait complete. 2024-09-10T23:48:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 -- start start 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 Processor -- start 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e05532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053eda0 0x5615e054fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0550120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841aede0 con 0x5615e054ad30 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841b0250 con 0x5615e053e480 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841af4b0 con 0x5615e053eda0 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.656+0000 7f8b8e15f740 10 client.0 _ll_register_callbacks cb 0x7f8b7c0a8920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:46.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0550120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0550120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56650/0 (socket says 172.21.15.16:56650) 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 -- 172.21.15.16:0/2637132270 learned_addr learned my addr 172.21.15.16:0/2637132270 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b89b26640 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e05532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b89325640 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053eda0 0x5615e054fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 -- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053eda0 msgr2=0x5615e054fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053eda0 0x5615e054fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 -- 172.21.15.16:0/2637132270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 msgr2=0x5615e05532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e05532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 -- 172.21.15.16:0/2637132270 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e0550860 con 0x5615e054ad30 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8a327640 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0550120 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0abfd0 tx=0x7f8b7c0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889a527b74d361dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/2637132270 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0c6060 con 0x5615e054ad30 2024-09-10T23:48:46.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/2637132270 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f8b7c0cf070 con 0x5615e054ad30 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b7c0b0db0 con 0x5615e054ad30 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/2637132270 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c01f070 con 0x5615e054ad30 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8e15f740 10 client.17076 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.657+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5615e05c8520 con 0x5615e054ad30 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/2637132270 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7c0b0db0 con 0x5615e054ad30 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/2637132270 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b7c0c8070 con 0x5615e054ad30 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b8e15f740 10 client.17076 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b8e15f740 10 client.17076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b8e15f740 20 client.17076 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e05c89f0 0x5615e05cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b8e15f740 4 client.17076 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5615e04b2850 con 0x5615e05c89f0 2024-09-10T23:48:46.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b89b26640 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e05c89f0 0x5615e05cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b89b26640 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e05c89f0 0x5615e05cade0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb7e01b18d6529e server_cookie=ae0349cbfbb978a7 in_seq=0 out_seq=0 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.658+0000 7f8b6d7fa640 10 client.17076 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b6d7fa640 1 -- 172.21.15.16:0/2637132270 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x5615e04b2850 con 0x5615e05c89f0 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b6d7fa640 10 client.17076 handle_command_reply: tid=0 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 client.17076 shutdown 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 msgr2=0x5615e0550120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0550120 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0abfd0 tx=0x7f8b7c0054f0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 shutdown_connections 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5615e05c89f0 0x5615e05cade0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615e054ad30 0x5615e0550120 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5615e053eda0 0x5615e054fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 --2- 172.21.15.16:0/2637132270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615e053e480 0x5615e05532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b6d7fa640 0 client.17076 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 >> 172.21.15.16:0/2637132270 conn(0x5615e053c2b0 msgr2=0x5615e05460f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:46.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 shutdown_connections 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 1 -- 172.21.15.16:0/2637132270 wait complete. 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.659+0000 7f8b8e15f740 20 client.17076 trim_cache size 0 max 16384 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.666 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:48:46.667 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.669 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.670 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.671 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:48:46.672 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.673 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "dc39dd20-224e-45cc-87b8-22db618aa261": { 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:13.371560+0000", 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:48:46.675 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8b700b5450 msgr2=0x7f8b700b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8b700b5450 0x7f8b700b7910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5615e053d190 tx=0x7f8b80005c00 comp rx=0 tx=0).stop 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84109150 msgr2=0x7f8b84075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:46.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84109150 0x7f8b84075f20 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00eaa0 tx=0x7f8b7c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 shutdown_connections 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b84109150 0x7f8b84075f20 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b841087d0 0x7f8b840759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8b700b5450 0x7f8b700b7910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 --2- 172.21.15.16:0/802239932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b84102dc0 0x7f8b840754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 >> 172.21.15.16:0/802239932 conn(0x7f8b840fe830 msgr2=0x7f8b84100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 shutdown_connections 2024-09-10T23:48:46.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:46.660+0000 7f8b8bd8a640 1 -- 172.21.15.16:0/802239932 wait complete. 2024-09-10T23:48:47.596 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:48:47.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:48:47.859 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:48.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:48 smithi016 ceph-mon[30855]: pgmap v581: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:48:48.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:48 smithi066 ceph-mon[34761]: pgmap v581: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:48:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 -- 172.21.15.16:0/2242587001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794108060 msgr2=0x7f879410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 --2- 172.21.15.16:0/2242587001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794108060 0x7f879410e860 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f878c009ca0 tx=0x7f878c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 -- 172.21.15.16:0/2242587001 shutdown_connections 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 --2- 172.21.15.16:0/2242587001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794108060 0x7f879410e860 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 --2- 172.21.15.16:0/2242587001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87941076e0 0x7f8794107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 --2- 172.21.15.16:0/2242587001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8794101cd0 0x7f87941020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 -- 172.21.15.16:0/2242587001 >> 172.21.15.16:0/2242587001 conn(0x7f87940fd700 msgr2=0x7f87940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 -- 172.21.15.16:0/2242587001 shutdown_connections 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.375+0000 7f879bea0640 1 -- 172.21.15.16:0/2242587001 wait complete. 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 Processor -- start 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 -- start start 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794101cd0 0x7f87940fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87941076e0 0x7f87940fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8794108060 0x7f87940fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8794111d20 con 0x7f8794101cd0 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8794111ba0 con 0x7f8794108060 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f879bea0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8794111ea0 con 0x7f87941076e0 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f8799c3c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794101cd0 0x7f87940fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f8799c3c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794101cd0 0x7f87940fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56680/0 (socket says 172.21.15.16:56680) 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.376+0000 7f8799c3c640 1 -- 172.21.15.16:0/2425238677 learned_addr learned my addr 172.21.15.16:0/2425238677 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f879a43d640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8794108060 0x7f87940fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f8799c3c640 1 -- 172.21.15.16:0/2425238677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87941076e0 msgr2=0x7f87940fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f8799c3c640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87941076e0 0x7f87940fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f8799c3c640 1 -- 172.21.15.16:0/2425238677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8794108060 msgr2=0x7f87940fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f8799c3c640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8794108060 0x7f87940fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f8799c3c640 1 -- 172.21.15.16:0/2425238677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87941a76d0 con 0x7f8794101cd0 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f879a43d640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8794108060 0x7f87940fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f8799c3c640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794101cd0 0x7f87940fdc00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f879000b4a0 tx=0x7f879000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f878affd640 1 -- 172.21.15.16:0/2425238677 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790014070 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f878affd640 1 -- 172.21.15.16:0/2425238677 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8790010ac0 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87941a79c0 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f878affd640 1 -- 172.21.15.16:0/2425238677 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790017c30 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.377+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87941a7fd0 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.378+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87941020b0 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.380+0000 7f878affd640 1 -- 172.21.15.16:0/2425238677 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f8790010610 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.380+0000 7f878affd640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87800b54d0 0x7f87800b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.380+0000 7f878affd640 1 -- 172.21.15.16:0/2425238677 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f87900e5890 con 0x7f8794101cd0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.380+0000 7f879943b640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87800b54d0 0x7f87800b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.381+0000 7f879943b640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87800b54d0 0x7f87800b7990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f87940ff6f0 tx=0x7f8784005bf0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.385+0000 7f878affd640 1 -- 172.21.15.16:0/2425238677 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f87900ac440 con 0x7f8794101cd0 2024-09-10T23:48:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:48 smithi071 ceph-mon[35018]: pgmap v581: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:48:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.611+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87940fef00 con 0x7f8794101cd0 2024-09-10T23:48:48.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.612+0000 7f878affd640 1 -- 172.21.15.16:0/2425238677 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f87900abd40 con 0x7f8794101cd0 2024-09-10T23:48:48.614 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:48:48.614 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:48:48.614 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:48:48.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87800b54d0 msgr2=0x7f87800b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:48.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87800b54d0 0x7f87800b7990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f87940ff6f0 tx=0x7f8784005bf0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794101cd0 msgr2=0x7f87940fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:48.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794101cd0 0x7f87940fdc00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f879000b4a0 tx=0x7f879000b960 comp rx=0 tx=0).stop 2024-09-10T23:48:48.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 shutdown_connections 2024-09-10T23:48:48.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f87800b54d0 0x7f87800b7990 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8794108060 0x7f87940fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87941076e0 0x7f87940fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 --2- 172.21.15.16:0/2425238677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8794101cd0 0x7f87940fdc00 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:48.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 >> 172.21.15.16:0/2425238677 conn(0x7f87940fd700 msgr2=0x7f879406b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:48.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 shutdown_connections 2024-09-10T23:48:48.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:48.615+0000 7f879bea0640 1 -- 172.21.15.16:0/2425238677 wait complete. 2024-09-10T23:48:49.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:49 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2425238677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:48:49.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:49 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2425238677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:48:49.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:48:49.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:49 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2425238677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:48:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:50.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 -- 172.21.15.16:0/3073653795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 msgr2=0x7f1a30104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 --2- 172.21.15.16:0/3073653795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30104080 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009ca0 tx=0x7f1a2002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 -- 172.21.15.16:0/3073653795 shutdown_connections 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 --2- 172.21.15.16:0/3073653795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a3010d100 0x7f1a3010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 --2- 172.21.15.16:0/3073653795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a301045c0 0x7f1a3010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 --2- 172.21.15.16:0/3073653795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30104080 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 -- 172.21.15.16:0/3073653795 >> 172.21.15.16:0/3073653795 conn(0x7f1a300fd700 msgr2=0x7f1a300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 -- 172.21.15.16:0/3073653795 shutdown_connections 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.117+0000 7f1a34950640 1 -- 172.21.15.16:0/3073653795 wait complete. 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 Processor -- start 2024-09-10T23:48:50.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 -- start start 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a301045c0 0x7f1a301997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3010d100 0x7f1a3019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112d70 con 0x7f1a30103ca0 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112bf0 con 0x7f1a3010d100 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a34950640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30112ef0 con 0x7f1a301045c0 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56688/0 (socket says 172.21.15.16:56688) 2024-09-10T23:48:50.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 -- 172.21.15.16:0/2431104699 learned_addr learned my addr 172.21.15.16:0/2431104699 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a301045c0 0x7f1a301997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3010d100 0x7f1a3019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 -- 172.21.15.16:0/2431104699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a301045c0 msgr2=0x7f1a301997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a301045c0 0x7f1a301997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 -- 172.21.15.16:0/2431104699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3010d100 msgr2=0x7f1a3019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3010d100 0x7f1a3019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2e59c640 1 -- 172.21.15.16:0/2431104699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3019f310 con 0x7f1a30103ca0 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.118+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3010d100 0x7f1a3019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:50.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.119+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30199260 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1a20006010 tx=0x7f1a200319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:50.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.119+0000 7f1a1f7fe640 1 -- 172.21.15.16:0/2431104699 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20003bf0 con 0x7f1a30103ca0 2024-09-10T23:48:50.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.119+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3019f5a0 con 0x7f1a30103ca0 2024-09-10T23:48:50.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.119+0000 7f1a1f7fe640 1 -- 172.21.15.16:0/2431104699 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a20003d90 con 0x7f1a30103ca0 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.119+0000 7f1a1f7fe640 1 -- 172.21.15.16:0/2431104699 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2002fc20 con 0x7f1a30103ca0 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.119+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301a5cc0 con 0x7f1a30103ca0 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.121+0000 7f1a1f7fe640 1 -- 172.21.15.16:0/2431104699 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f1a200046a0 con 0x7f1a30103ca0 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.121+0000 7f1a36d25740 1 Processor -- start 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a36d25740 1 -- start start 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e45684d0 0x5565e45688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4568df0 0x5565e4574840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e4577170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a36d25740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5565e44deea0 con 0x5565e4574d80 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a36d25740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5565e44ce2d0 con 0x5565e4568df0 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a36d25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565e44d20e0 con 0x5565e45684d0 2024-09-10T23:48:50.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a2dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e4577170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a2dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e4577170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56702/0 (socket says 172.21.15.16:56702) 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3875945284 learned_addr learned my addr 172.21.15.16:0/3875945284 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4568df0 0x5565e4574840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.122+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e45684d0 0x5565e45688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3875945284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e45684d0 msgr2=0x5565e45688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e45684d0 0x5565e45688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3875945284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4568df0 msgr2=0x5565e4574840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4568df0 0x5565e4574840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3875945284 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e422c650 con 0x5565e4574d80 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a1f7fe640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a180b5450 0x7f1a180b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e4577170 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400bc60 tx=0x7f1a240107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d13e24494b6fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a180b5450 0x7f1a180b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a1f7fe640 1 -- 172.21.15.16:0/2431104699 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f1a20107370 con 0x7f1a30103ca0 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a1cff9640 1 -- 172.21.15.16:0/3875945284 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24004220 con 0x5565e4574d80 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a1cff9640 1 -- 172.21.15.16:0/3875945284 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a2400be10 con 0x5565e4574d80 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.123+0000 7f1a1cff9640 1 -- 172.21.15.16:0/3875945284 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24004ce0 con 0x5565e4574d80 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 -- 172.21.15.16:0/3875945284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 msgr2=0x5565e4577170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a180b5450 0x7f1a180b7910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800bd60 tx=0x7f1a2800b550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e4577170 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400bc60 tx=0x7f1a240107a0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 -- 172.21.15.16:0/3875945284 shutdown_connections 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e4577170 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4568df0 0x5565e4574840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3875945284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e45684d0 0x5565e45688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 -- 172.21.15.16:0/3875945284 >> 172.21.15.16:0/3875945284 conn(0x5565e4566300 msgr2=0x5565e45674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 -- 172.21.15.16:0/3875945284 shutdown_connections 2024-09-10T23:48:50.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 -- 172.21.15.16:0/3875945284 wait complete. 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.124+0000 7f1a36d25740 1 -- start start 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 1 Processor -- start 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e45684d0 0x5565e45746b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4571b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4574d80 0x5565e4572180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5565e432f700 con 0x5565e45684d0 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5565e4469160 con 0x5565e4574d80 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565e457be10 con 0x5565e4568df0 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a36d25740 10 client.0 _ll_register_callbacks cb 0x5565e44829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e45684d0 0x5565e45746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e45684d0 0x5565e45746b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56710/0 (socket says 172.21.15.16:56710) 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 -- 172.21.15.16:0/3373882241 learned_addr learned my addr 172.21.15.16:0/3373882241 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4571b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4574d80 0x5565e4572180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 -- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 msgr2=0x5565e4571b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4571b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 -- 172.21.15.16:0/3373882241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4574d80 msgr2=0x5565e4572180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4574d80 0x5565e4572180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2e59c640 1 -- 172.21.15.16:0/3373882241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e4496c90 con 0x5565e45684d0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.125+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4574d80 0x5565e4572180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e45684d0 0x5565e45746b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1a200caa30 tx=0x7f1a20009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e281a848d29b78ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a15ffb640 1 -- 172.21.15.16:0/3373882241 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a200cd590 con 0x5565e45684d0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a15ffb640 1 -- 172.21.15.16:0/3373882241 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f1a200cdc20 con 0x5565e45684d0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a2400be10 con 0x5565e45684d0 2024-09-10T23:48:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a15ffb640 1 -- 172.21.15.16:0/3373882241 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a20104f20 con 0x5565e45684d0 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 10 client.17094 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565e45877b0 con 0x5565e45684d0 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a15ffb640 1 -- 172.21.15.16:0/3373882241 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a2400be10 con 0x5565e45684d0 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a15ffb640 1 -- 172.21.15.16:0/3373882241 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a200d68c0 con 0x5565e45684d0 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 10 client.17094 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 10 client.17094 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 20 client.17094 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e4588cb0 0x5565e458b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 4 client.17094 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.126+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565e44e0df0 con 0x5565e4588cb0 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.127+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e4588cb0 0x5565e458b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.127+0000 7f1a15ffb640 10 client.17094 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.127+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e4588cb0 0x5565e458b0e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c37bf900724494a7 server_cookie=c7f15e24cef541a1 in_seq=0 out_seq=0 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a15ffb640 1 -- 172.21.15.16:0/3373882241 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565e44e0df0 con 0x5565e4588cb0 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a15ffb640 10 client.17094 handle_command_reply: tid=0 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 client.17094 shutdown 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e45684d0 msgr2=0x5565e45746b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e45684d0 0x5565e45746b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1a200caa30 tx=0x7f1a20009900 comp rx=0 tx=0).stop 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 shutdown_connections 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e4588cb0 0x5565e458b0e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e4574d80 0x5565e4572180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4571b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3373882241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e45684d0 0x5565e45746b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 >> 172.21.15.16:0/3373882241 conn(0x5565e4566300 msgr2=0x5565e456be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a15ffb640 0 client.17094 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 shutdown_connections 2024-09-10T23:48:50.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 1 -- 172.21.15.16:0/3373882241 wait complete. 2024-09-10T23:48:50.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.128+0000 7f1a36d25740 20 client.17094 trim_cache size 0 max 16384 2024-09-10T23:48:50.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.141+0000 7f1a36d25740 1 Processor -- start 2024-09-10T23:48:50.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.141+0000 7f1a36d25740 1 -- start start 2024-09-10T23:48:50.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e4585070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4568df0 0x5565e4576170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4574d80 0x5565e45766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a36d25740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301aec20 con 0x5565e4568df0 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a36d25740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ac4f0 con 0x5565e45684d0 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a36d25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301aa360 con 0x5565e4574d80 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4568df0 0x5565e4576170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4568df0 0x5565e4576170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56726/0 (socket says 172.21.15.16:56726) 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3107939706 learned_addr learned my addr 172.21.15.16:0/3107939706 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4574d80 0x5565e45766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e4585070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3107939706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4574d80 msgr2=0x5565e45766b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4574d80 0x5565e45766b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3107939706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 msgr2=0x5565e4585070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e4585070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 -- 172.21.15.16:0/3107939706 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e4572a50 con 0x5565e4568df0 2024-09-10T23:48:50.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4574d80 0x5565e45766b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:50.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4568df0 0x5565e4576170 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400bc60 tx=0x7f1a24013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ebbb8e35213fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:50.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a17fff640 1 -- 172.21.15.16:0/3107939706 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400b880 con 0x5565e4568df0 2024-09-10T23:48:50.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a17fff640 1 -- 172.21.15.16:0/3107939706 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a24005050 con 0x5565e4568df0 2024-09-10T23:48:50.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.142+0000 7f1a17fff640 1 -- 172.21.15.16:0/3107939706 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a240048e0 con 0x5565e4568df0 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 -- 172.21.15.16:0/3107939706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4568df0 msgr2=0x5565e4576170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4568df0 0x5565e4576170 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400bc60 tx=0x7f1a24013040 comp rx=0 tx=0).stop 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 -- 172.21.15.16:0/3107939706 shutdown_connections 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4574d80 0x5565e45766b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4568df0 0x5565e4576170 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 --2- 172.21.15.16:0/3107939706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e4585070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 -- 172.21.15.16:0/3107939706 >> 172.21.15.16:0/3107939706 conn(0x5565e4566300 msgr2=0x5565e4570380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 -- 172.21.15.16:0/3107939706 shutdown_connections 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 -- 172.21.15.16:0/3107939706 wait complete. 2024-09-10T23:48:50.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 -- start start 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.143+0000 7f1a36d25740 1 Processor -- start 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e45810e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4581620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a36d25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e457c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a36d25740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301aa9b0 con 0x5565e4574d80 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a36d25740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301abe20 con 0x5565e45684d0 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a36d25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ab080 con 0x5565e4568df0 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a36d25740 10 client.0 _ll_register_callbacks cb 0x7f1a20005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e457c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e45810e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e457c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56736/0 (socket says 172.21.15.16:56736) 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 -- 172.21.15.16:0/1820213532 learned_addr learned my addr 172.21.15.16:0/1820213532 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2dd9b640 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4581620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 -- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 msgr2=0x5565e4581620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4581620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 -- 172.21.15.16:0/1820213532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 msgr2=0x5565e45810e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e45810e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 -- 172.21.15.16:0/1820213532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e4581e50 con 0x5565e4574d80 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e45810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a2ed9d640 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e457c090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1a2801d770 tx=0x7f1a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540dfac3f35e2579 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.144+0000 7f1a15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a15ffb640 1 -- 172.21.15.16:0/1820213532 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2802b060 con 0x5565e4574d80 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a15ffb640 1 -- 172.21.15.16:0/1820213532 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f1a28010810 con 0x5565e4574d80 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a24005050 con 0x5565e4574d80 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a15ffb640 1 -- 172.21.15.16:0/1820213532 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a28010a10 con 0x5565e4574d80 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 10 client.17100 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565e45f6180 con 0x5565e4574d80 2024-09-10T23:48:50.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a15ffb640 1 -- 172.21.15.16:0/1820213532 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a24005050 con 0x5565e4574d80 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a15ffb640 1 -- 172.21.15.16:0/1820213532 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a28025070 con 0x5565e4574d80 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 10 client.17100 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 10 client.17100 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 20 client.17100 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e45f6930 0x5565e45f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 4 client.17100 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565e44dc8a0 con 0x5565e45f6930 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.145+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e45f6930 0x5565e45f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a2e59c640 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e45f6930 0x5565e45f8d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a0a66f7b9b4c32e server_cookie=5d9b22def1b19813 in_seq=0 out_seq=0 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a15ffb640 10 client.17100 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a15ffb640 1 -- 172.21.15.16:0/1820213532 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565e44dc8a0 con 0x5565e45f6930 2024-09-10T23:48:50.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a15ffb640 10 client.17100 handle_command_reply: tid=0 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 client.17100 shutdown 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 msgr2=0x5565e457c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e457c090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1a2801d770 tx=0x7f1a280046c0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 shutdown_connections 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x5565e45f6930 0x5565e45f8d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5565e4574d80 0x5565e457c090 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565e4568df0 0x5565e4581620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 --2- 172.21.15.16:0/1820213532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5565e45684d0 0x5565e45810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 >> 172.21.15.16:0/1820213532 conn(0x5565e4566300 msgr2=0x5565e4565420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a15ffb640 0 client.17100 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 shutdown_connections 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 1 -- 172.21.15.16:0/1820213532 wait complete. 2024-09-10T23:48:50.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.146+0000 7f1a36d25740 20 client.17100 trim_cache size 0 max 16384 2024-09-10T23:48:50.154 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:48:50.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a180b5450 msgr2=0x7f1a180b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a180b5450 0x7f1a180b7910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800bd60 tx=0x7f1a2800b550 comp rx=0 tx=0).stop 2024-09-10T23:48:50.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 msgr2=0x7f1a30199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30199260 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1a20006010 tx=0x7f1a200319f0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 shutdown_connections 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1a180b5450 0x7f1a180b7910 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3010d100 0x7f1a3019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a301045c0 0x7f1a301997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 --2- 172.21.15.16:0/2431104699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a30103ca0 0x7f1a30199260 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 >> 172.21.15.16:0/2431104699 conn(0x7f1a300fd700 msgr2=0x7f1a300fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 shutdown_connections 2024-09-10T23:48:50.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:50.147+0000 7f1a34950640 1 -- 172.21.15.16:0/2431104699 wait complete. 2024-09-10T23:48:50.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:50 smithi066 ceph-mon[34761]: pgmap v582: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:50.472 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:50 smithi016 ceph-mon[30855]: pgmap v582: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:50 smithi071 ceph-mon[35018]: pgmap v582: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:48:50.964 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:48:51.224 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:51.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 -- 172.21.15.16:0/4011702002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 msgr2=0x7f34341031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 --2- 172.21.15.16:0/4011702002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f34341031a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3424009900 tx=0x7f342402a410 comp rx=0 tx=0).stop 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 -- 172.21.15.16:0/4011702002 shutdown_connections 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 --2- 172.21.15.16:0/4011702002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3434109150 0x7f343410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 --2- 172.21.15.16:0/4011702002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34341087d0 0x7f3434108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 --2- 172.21.15.16:0/4011702002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f34341031a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 -- 172.21.15.16:0/4011702002 >> 172.21.15.16:0/4011702002 conn(0x7f34340fe830 msgr2=0x7f3434100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 -- 172.21.15.16:0/4011702002 shutdown_connections 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.710+0000 7f3438f1c640 1 -- 172.21.15.16:0/4011702002 wait complete. 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 Processor -- start 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 -- start start 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f3434199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34341087d0 0x7f3434199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3434109150 0x7f343419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3434112e60 con 0x7f3434102dc0 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3434112ce0 con 0x7f3434109150 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3438f1c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3434112fe0 con 0x7f34341087d0 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f3434199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f3434199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56746/0 (socket says 172.21.15.16:56746) 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 -- 172.21.15.16:0/3231649074 learned_addr learned my addr 172.21.15.16:0/3231649074 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f342bfff640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34341087d0 0x7f3434199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f3432d9d640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3434109150 0x7f343419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 -- 172.21.15.16:0/3231649074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34341087d0 msgr2=0x7f3434199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34341087d0 0x7f3434199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 -- 172.21.15.16:0/3231649074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3434109150 msgr2=0x7f343419ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3434109150 0x7f343419ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f343259c640 1 -- 172.21.15.16:0/3231649074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343419f3c0 con 0x7f3434102dc0 2024-09-10T23:48:51.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.711+0000 7f342bfff640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34341087d0 0x7f3434199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.712+0000 7f343259c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f3434199310 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3424005ab0 tx=0x7f3424003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.712+0000 7f342b7fe640 1 -- 172.21.15.16:0/3231649074 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342403f070 con 0x7f3434102dc0 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.712+0000 7f342b7fe640 1 -- 172.21.15.16:0/3231649074 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3424031d60 con 0x7f3434102dc0 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.712+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343419f650 con 0x7f3434102dc0 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.712+0000 7f342b7fe640 1 -- 172.21.15.16:0/3231649074 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424035030 con 0x7f3434102dc0 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.712+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34341a5d70 con 0x7f3434102dc0 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.714+0000 7f343b2f1740 1 Processor -- start 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.714+0000 7f343b2f1740 1 -- start start 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef73f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef74e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343b2f1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef6b5ea0 con 0x55b9ef73f4d0 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343b2f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef6a52d0 con 0x55b9ef74bd80 2024-09-10T23:48:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343b2f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef6a90e0 con 0x55b9ef73fdf0 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f342b7fe640 1 -- 172.21.15.16:0/3231649074 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f342403b580 con 0x7f3434102dc0 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef73f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef73f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56750/0 (socket says 172.21.15.16:56750) 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 -- 172.21.15.16:0/415977497 learned_addr learned my addr 172.21.15.16:0/415977497 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f342bfff640 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef74e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343259c640 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 -- 172.21.15.16:0/415977497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 msgr2=0x55b9ef74b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 -- 172.21.15.16:0/415977497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 msgr2=0x55b9ef74e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef74e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 -- 172.21.15.16:0/415977497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ef403650 con 0x55b9ef73f4d0 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f343259c640 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:51.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.715+0000 7f3432d9d640 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef73f8b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f342c009f20 tx=0x7f342c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce84f52f3be950e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.716+0000 7f3428ff9640 1 -- 172.21.15.16:0/415977497 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c013790 con 0x55b9ef73f4d0 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.716+0000 7f342b7fe640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f34200b5450 0x7f34200b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.716+0000 7f3428ff9640 1 -- 172.21.15.16:0/415977497 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f342c017070 con 0x55b9ef73f4d0 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.716+0000 7f3428ff9640 1 -- 172.21.15.16:0/415977497 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c00abe0 con 0x55b9ef73f4d0 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.716+0000 7f343259c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f34200b5450 0x7f34200b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.716+0000 7f342b7fe640 1 -- 172.21.15.16:0/3231649074 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f3424106df0 con 0x7f3434102dc0 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- 172.21.15.16:0/415977497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 msgr2=0x55b9ef73f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343259c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f34200b5450 0x7f34200b7910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55b9ef73e1e0 tx=0x7f3424009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef73f8b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f342c009f20 tx=0x7f342c00c8b0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- 172.21.15.16:0/415977497 shutdown_connections 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef74e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 --2- 172.21.15.16:0/415977497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef73f8b0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- 172.21.15.16:0/415977497 >> 172.21.15.16:0/415977497 conn(0x55b9ef73d300 msgr2=0x55b9ef73e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- 172.21.15.16:0/415977497 shutdown_connections 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- 172.21.15.16:0/415977497 wait complete. 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- start start 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 Processor -- start 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef74b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef748ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef7490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef506700 con 0x55b9ef73f4d0 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef640160 con 0x55b9ef74bd80 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.717+0000 7f343b2f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef74ea00 con 0x55b9ef73fdf0 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f343b2f1740 10 client.0 _ll_register_callbacks cb 0x55b9ef6599e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef74b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef74b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56760/0 (socket says 172.21.15.16:56760) 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 -- 172.21.15.16:0/2390013010 learned_addr learned my addr 172.21.15.16:0/2390013010 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f342bfff640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef748ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef7490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 -- 172.21.15.16:0/2390013010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 msgr2=0x55b9ef748ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef748ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 -- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 msgr2=0x55b9ef7490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef7490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 -- 172.21.15.16:0/2390013010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ef66dc90 con 0x55b9ef73f4d0 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f342bfff640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef748ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3432d9d640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef74b670 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f342c009420 tx=0x7f342c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1dfd78e361e826 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3419ffb640 1 -- 172.21.15.16:0/2390013010 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c013790 con 0x55b9ef73f4d0 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3419ffb640 1 -- 172.21.15.16:0/2390013010 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f342c013930 con 0x55b9ef73f4d0 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342c017070 con 0x55b9ef73f4d0 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.718+0000 7f3419ffb640 1 -- 172.21.15.16:0/2390013010 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f342c013b30 con 0x55b9ef73f4d0 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 10 client.17112 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b9ef75a2d0 con 0x55b9ef73f4d0 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f3419ffb640 1 -- 172.21.15.16:0/2390013010 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f342c017070 con 0x55b9ef73f4d0 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f3419ffb640 1 -- 172.21.15.16:0/2390013010 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f342c027070 con 0x55b9ef73f4d0 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 10 client.17112 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 10 client.17112 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 20 client.17112 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef75b680 0x55b9ef75da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 4 client.17112 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ef6b7df0 con 0x55b9ef75b680 2024-09-10T23:48:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.719+0000 7f342bfff640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef75b680 0x55b9ef75da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.720+0000 7f342bfff640 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef75b680 0x55b9ef75da70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7ae0de6497013cb server_cookie=4be5cabb072b9f81 in_seq=0 out_seq=0 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.720+0000 7f3419ffb640 10 client.17112 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f3419ffb640 1 -- 172.21.15.16:0/2390013010 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9ef6b7df0 con 0x55b9ef75b680 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f3419ffb640 10 client.17112 handle_command_reply: tid=0 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 client.17112 shutdown 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 msgr2=0x55b9ef74b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef74b670 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f342c009420 tx=0x7f342c0093b0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 shutdown_connections 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef75b680 0x55b9ef75da70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef74bd80 0x55b9ef7490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef73fdf0 0x55b9ef748ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f3419ffb640 0 client.17112 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 --2- 172.21.15.16:0/2390013010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73f4d0 0x55b9ef74b670 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 >> 172.21.15.16:0/2390013010 conn(0x55b9ef73d300 msgr2=0x55b9ef742e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 shutdown_connections 2024-09-10T23:48:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 1 -- 172.21.15.16:0/2390013010 wait complete. 2024-09-10T23:48:51.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.721+0000 7f343b2f1740 20 client.17112 trim_cache size 0 max 16384 2024-09-10T23:48:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.734+0000 7f343b2f1740 1 Processor -- start 2024-09-10T23:48:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.734+0000 7f343b2f1740 1 -- start start 2024-09-10T23:48:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef757c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef73c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f343b2f1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f34341aed70 con 0x55b9ef73fdf0 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f343b2f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f34341ac640 con 0x55b9ef73f4d0 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f343b2f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34341aa490 con 0x55b9ef74bd80 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef73c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef73c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56772/0 (socket says 172.21.15.16:56772) 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 -- 172.21.15.16:0/4209412679 learned_addr learned my addr 172.21.15.16:0/4209412679 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f3432d9d640 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f3432d9d640 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef757c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 -- 172.21.15.16:0/4209412679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 msgr2=0x55b9ef74d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 -- 172.21.15.16:0/4209412679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 msgr2=0x55b9ef757c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef757c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 -- 172.21.15.16:0/4209412679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ef73dfe0 con 0x55b9ef73fdf0 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f3432d9d640 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f342bfff640 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef73c310 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x55b9ef75e1d0 tx=0x7f341c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0fc21582e0d0c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.735+0000 7f341bfff640 1 -- 172.21.15.16:0/4209412679 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c005020 con 0x55b9ef73fdf0 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f341bfff640 1 -- 172.21.15.16:0/4209412679 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f341c01e030 con 0x55b9ef73fdf0 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f341bfff640 1 -- 172.21.15.16:0/4209412679 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c011440 con 0x55b9ef73fdf0 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 -- 172.21.15.16:0/4209412679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 msgr2=0x55b9ef73c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef73c310 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x55b9ef75e1d0 tx=0x7f341c00c740 comp rx=0 tx=0).stop 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 -- 172.21.15.16:0/4209412679 shutdown_connections 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef73c310 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 --2- 172.21.15.16:0/4209412679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef757c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 -- 172.21.15.16:0/4209412679 >> 172.21.15.16:0/4209412679 conn(0x55b9ef73d300 msgr2=0x55b9ef73bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 -- 172.21.15.16:0/4209412679 shutdown_connections 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.736+0000 7f343b2f1740 1 -- 172.21.15.16:0/4209412679 wait complete. 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 -- start start 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 Processor -- start 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef754300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f34341aab00 con 0x55b9ef73fdf0 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f34341abf70 con 0x55b9ef73f4d0 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34341ab1d0 con 0x55b9ef74bd80 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f343b2f1740 10 client.0 _ll_register_callbacks cb 0x7f342c009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:51.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56784/0 (socket says 172.21.15.16:56784) 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 -- 172.21.15.16:0/3318359794 learned_addr learned my addr 172.21.15.16:0/3318359794 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f3432d9d640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef754300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f3432d9d640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 -- 172.21.15.16:0/3318359794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 msgr2=0x55b9ef74f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 -- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 msgr2=0x55b9ef754300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef754300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f342bfff640 1 -- 172.21.15.16:0/3318359794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ef74f880 con 0x55b9ef73fdf0 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.737+0000 7f3432d9d640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef754300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f342bfff640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74ec80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f341c00cb40 tx=0x7f341c013230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939940ec1687eb29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f3419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f3419ffb640 1 -- 172.21.15.16:0/3318359794 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c005230 con 0x55b9ef73fdf0 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f3419ffb640 1 -- 172.21.15.16:0/3318359794 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f341c0053d0 con 0x55b9ef73fdf0 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f341c01e030 con 0x55b9ef73fdf0 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f3419ffb640 1 -- 172.21.15.16:0/3318359794 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f341c0055d0 con 0x55b9ef73fdf0 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f343b2f1740 10 client.17118 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b9ef7c9350 con 0x55b9ef73fdf0 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f3419ffb640 1 -- 172.21.15.16:0/3318359794 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f341c01e030 con 0x55b9ef73fdf0 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f3419ffb640 1 -- 172.21.15.16:0/3318359794 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f341c02f880 con 0x55b9ef73fdf0 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f343b2f1740 10 client.17118 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f343b2f1740 10 client.17118 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.738+0000 7f343b2f1740 20 client.17118 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f343b2f1740 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef7c9a50 0x55b9ef7cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f343b2f1740 4 client.17118 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9ef6b38a0 con 0x55b9ef7c9a50 2024-09-10T23:48:51.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f3432d9d640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef7c9a50 0x55b9ef7cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f3419ffb640 10 client.17118 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f3432d9d640 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef7c9a50 0x55b9ef7cbe70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa7669fefe7bf3c2 server_cookie=407417460978d4f2 in_seq=0 out_seq=0 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f3419ffb640 1 -- 172.21.15.16:0/3318359794 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9ef6b38a0 con 0x55b9ef7c9a50 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f3419ffb640 10 client.17118 handle_command_reply: tid=0 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.739+0000 7f343b2f1740 1 client.17118 shutdown 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 msgr2=0x55b9ef74ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74ec80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f341c00cb40 tx=0x7f341c013230 comp rx=0 tx=0).stop 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 shutdown_connections 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x55b9ef7c9a50 0x55b9ef7cbe70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9ef74bd80 0x55b9ef74f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b9ef73fdf0 0x55b9ef74ec80 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 --2- 172.21.15.16:0/3318359794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9ef73f4d0 0x55b9ef754300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 >> 172.21.15.16:0/3318359794 conn(0x55b9ef73d300 msgr2=0x55b9ef74a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3419ffb640 0 client.17118 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:48:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 shutdown_connections 2024-09-10T23:48:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 1 -- 172.21.15.16:0/3318359794 wait complete. 2024-09-10T23:48:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f343b2f1740 20 client.17118 trim_cache size 0 max 16384 2024-09-10T23:48:51.749 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f34200b5450 msgr2=0x7f34200b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f34200b5450 0x7f34200b7910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55b9ef73e1e0 tx=0x7f3424009260 comp rx=0 tx=0).stop 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 msgr2=0x7f3434199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f3434199310 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3424005ab0 tx=0x7f3424003d50 comp rx=0 tx=0).stop 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 shutdown_connections 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f34200b5450 0x7f34200b7910 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3434109150 0x7f343419ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34341087d0 0x7f3434199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 --2- 172.21.15.16:0/3231649074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434102dc0 0x7f3434199310 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 >> 172.21.15.16:0/3231649074 conn(0x7f34340fe830 msgr2=0x7f3434100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.740+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 shutdown_connections 2024-09-10T23:48:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:51.741+0000 7f3438f1c640 1 -- 172.21.15.16:0/3231649074 wait complete. 2024-09-10T23:48:52.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:52 smithi066 ceph-mon[34761]: pgmap v583: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:52.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:52 smithi016 ceph-mon[30855]: pgmap v583: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:52.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:52 smithi071 ceph-mon[35018]: pgmap v583: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:48:52.574 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:48:52.835 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 -- 172.21.15.16:0/165372966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c109150 msgr2=0x7fea2c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 --2- 172.21.15.16:0/165372966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c109150 0x7fea2c10f950 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fea24009ca0 tx=0x7fea2402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 -- 172.21.15.16:0/165372966 shutdown_connections 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 --2- 172.21.15.16:0/165372966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c109150 0x7fea2c10f950 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 --2- 172.21.15.16:0/165372966 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea2c1087d0 0x7fea2c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 --2- 172.21.15.16:0/165372966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea2c102dc0 0x7fea2c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 -- 172.21.15.16:0/165372966 >> 172.21.15.16:0/165372966 conn(0x7fea2c0fe830 msgr2=0x7fea2c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 -- 172.21.15.16:0/165372966 shutdown_connections 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.296+0000 7fea3296d640 1 -- 172.21.15.16:0/165372966 wait complete. 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 Processor -- start 2024-09-10T23:48:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 -- start start 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea2c102dc0 0x7fea2c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c1087d0 0x7fea2c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea2c109150 0x7fea2c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c112dd0 con 0x7fea2c1087d0 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c112c50 con 0x7fea2c102dc0 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea3296d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c112f50 con 0x7fea2c109150 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.297+0000 7fea2b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c1087d0 0x7fea2c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c1087d0 0x7fea2c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56790/0 (socket says 172.21.15.16:56790) 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 -- 172.21.15.16:0/3652279243 learned_addr learned my addr 172.21.15.16:0/3652279243 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2bfff640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea2c102dc0 0x7fea2c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea30f0a640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea2c109150 0x7fea2c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 -- 172.21.15.16:0/3652279243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea2c109150 msgr2=0x7fea2c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea2c109150 0x7fea2c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 -- 172.21.15.16:0/3652279243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea2c102dc0 msgr2=0x7fea2c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea2c102dc0 0x7fea2c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 -- 172.21.15.16:0/3652279243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2c1a7600 con 0x7fea2c1087d0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c1087d0 0x7fea2c0759e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fea2000d770 tx=0x7fea2000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea297fa640 1 -- 172.21.15.16:0/3652279243 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20017070 con 0x7fea2c1087d0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea297fa640 1 -- 172.21.15.16:0/3652279243 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea20009820 con 0x7fea2c1087d0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea297fa640 1 -- 172.21.15.16:0/3652279243 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20004bc0 con 0x7fea2c1087d0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2c1a78f0 con 0x7fea2c1087d0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.298+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea2c1a7de0 con 0x7fea2c1087d0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 Processor -- start 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 -- start start 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea297fa640 1 -- 172.21.15.16:0/3652279243 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fea20005220 con 0x7fea2c1087d0 2024-09-10T23:48:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f964d0 0x559e21f968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21fa2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e21f0cea0 con 0x559e21fa2d80 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e21efc2d0 con 0x559e21f96df0 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea34d42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e21f000e0 con 0x559e21f964d0 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.301+0000 7fea2b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56802/0 (socket says 172.21.15.16:56802) 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 -- 172.21.15.16:0/986167279 learned_addr learned my addr 172.21.15.16:0/986167279 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2bfff640 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21fa2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea30f0a640 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f964d0 0x559e21f968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 -- 172.21.15.16:0/986167279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f964d0 msgr2=0x559e21f968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f964d0 0x559e21f968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 -- 172.21.15.16:0/986167279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 msgr2=0x559e21fa2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21fa2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 -- 172.21.15.16:0/986167279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e21c5a650 con 0x559e21fa2d80 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea30f0a640 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f964d0 0x559e21f968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea297fa640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fea140b5450 0x7fea140b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5170 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fea200e30d0 tx=0x7fea200e9e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e8224916a6f0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea30f0a640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fea140b5450 0x7fea140b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea127fc640 1 -- 172.21.15.16:0/986167279 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea200e5e60 con 0x559e21fa2d80 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea297fa640 1 -- 172.21.15.16:0/3652279243 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7fea200e5a70 con 0x7fea2c1087d0 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.302+0000 7fea127fc640 1 -- 172.21.15.16:0/986167279 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea200ab9d0 con 0x559e21fa2d80 2024-09-10T23:48:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea127fc640 1 -- 172.21.15.16:0/986167279 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea200abc90 con 0x559e21fa2d80 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 -- 172.21.15.16:0/986167279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 msgr2=0x559e21fa5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea30f0a640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fea140b5450 0x7fea140b7910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fea24006010 tx=0x7fea24005fa0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5170 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fea200e30d0 tx=0x7fea200e9e60 comp rx=0 tx=0).stop 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 -- 172.21.15.16:0/986167279 shutdown_connections 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5170 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21fa2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 --2- 172.21.15.16:0/986167279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f964d0 0x559e21f968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 -- 172.21.15.16:0/986167279 >> 172.21.15.16:0/986167279 conn(0x559e21f94300 msgr2=0x559e21f954a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 -- 172.21.15.16:0/986167279 shutdown_connections 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.303+0000 7fea34d42740 1 -- 172.21.15.16:0/986167279 wait complete. 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 -- start start 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 Processor -- start 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21f964d0 0x559e21fa2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21f9fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21fa2d80 0x559e21fa0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e21d5d700 con 0x559e21f964d0 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e21e97160 con 0x559e21f96df0 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559e21fa5a00 con 0x559e21fa2d80 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea34d42740 10 client.0 _ll_register_callbacks cb 0x559e21eb09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea2bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21f964d0 0x559e21fa2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea2bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21f964d0 0x559e21fa2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56814/0 (socket says 172.21.15.16:56814) 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea2bfff640 1 -- 172.21.15.16:0/3788429670 learned_addr learned my addr 172.21.15.16:0/3788429670 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21f9fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.304+0000 7fea30f0a640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21fa2d80 0x559e21fa0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea2bfff640 1 -- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21fa2d80 msgr2=0x559e21fa0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea2bfff640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21fa2d80 0x559e21fa0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea2bfff640 1 -- 172.21.15.16:0/3788429670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 msgr2=0x559e21f9fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea2bfff640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21f9fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea2bfff640 1 -- 172.21.15.16:0/3788429670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e21ec4c90 con 0x559e21f964d0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21f9fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea30f0a640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21fa2d80 0x559e21fa0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea2bfff640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21f964d0 0x559e21fa2690 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fea1c010780 tx=0x7fea1c010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8081f5d9a661acbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea0b7fe640 1 -- 172.21.15.16:0/3788429670 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c01e060 con 0x559e21f964d0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea0b7fe640 1 -- 172.21.15.16:0/3788429670 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7fea1c00fb90 con 0x559e21f964d0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea200ab9d0 con 0x559e21f964d0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea0b7fe640 1 -- 172.21.15.16:0/3788429670 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea1c00fd90 con 0x559e21f964d0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea34d42740 10 client.17130 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559e21fb13f0 con 0x559e21f964d0 2024-09-10T23:48:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea0b7fe640 1 -- 172.21.15.16:0/3788429670 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea200ab9d0 con 0x559e21f964d0 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.305+0000 7fea0b7fe640 1 -- 172.21.15.16:0/3788429670 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fea1c0214a0 con 0x559e21f964d0 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea34d42740 10 client.17130 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea34d42740 10 client.17130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea34d42740 20 client.17130 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea34d42740 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e21fb2900 0x559e21fb4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea34d42740 4 client.17130 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e21f0edf0 con 0x559e21fb2900 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e21fb2900 0x559e21fb4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea0b7fe640 10 client.17130 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.306+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e21fb2900 0x559e21fb4d60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53f772a0e530e244 server_cookie=bd8d7c5631890421 in_seq=0 out_seq=0 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea0b7fe640 1 -- 172.21.15.16:0/3788429670 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e21f0edf0 con 0x559e21fb2900 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea0b7fe640 10 client.17130 handle_command_reply: tid=0 2024-09-10T23:48:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 client.17130 shutdown 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21f964d0 msgr2=0x559e21fa2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21f964d0 0x559e21fa2690 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fea1c010780 tx=0x7fea1c010c40 comp rx=0 tx=0).stop 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 shutdown_connections 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e21fb2900 0x559e21fb4d60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21fa2d80 0x559e21fa0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f96df0 0x559e21f9fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 --2- 172.21.15.16:0/3788429670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21f964d0 0x559e21fa2690 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea0b7fe640 0 client.17130 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 >> 172.21.15.16:0/3788429670 conn(0x559e21f94300 msgr2=0x559e21f99e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 shutdown_connections 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 1 -- 172.21.15.16:0/3788429670 wait complete. 2024-09-10T23:48:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.307+0000 7fea34d42740 20 client.17130 trim_cache size 0 max 16384 2024-09-10T23:48:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 Processor -- start 2024-09-10T23:48:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 -- start start 2024-09-10T23:48:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21f93c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fa1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c1b30e0 con 0x559e21fa2d80 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c1b09b0 con 0x559e21f964d0 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea34d42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c1ae820 con 0x559e21f96df0 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56824/0 (socket says 172.21.15.16:56824) 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 -- 172.21.15.16:0/315159201 learned_addr learned my addr 172.21.15.16:0/315159201 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fa1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea2bfff640 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21f93c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 -- 172.21.15.16:0/315159201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 msgr2=0x559e21fa1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fa1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 -- 172.21.15.16:0/315159201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 msgr2=0x559e21f93c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21f93c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea30f0a640 1 -- 172.21.15.16:0/315159201 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e21fb53e0 con 0x559e21fa2d80 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.321+0000 7fea2bfff640 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21f93c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea30f0a640 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa1d60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fea24035000 tx=0x7fea24041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9861261fc2ce5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea11ffb640 1 -- 172.21.15.16:0/315159201 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2402f660 con 0x559e21fa2d80 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea11ffb640 1 -- 172.21.15.16:0/315159201 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea24036050 con 0x559e21fa2d80 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea11ffb640 1 -- 172.21.15.16:0/315159201 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea240309f0 con 0x559e21fa2d80 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea34d42740 1 -- 172.21.15.16:0/315159201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 msgr2=0x559e21fa1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea34d42740 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa1d60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fea24035000 tx=0x7fea24041000 comp rx=0 tx=0).stop 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea34d42740 1 -- 172.21.15.16:0/315159201 shutdown_connections 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.322+0000 7fea34d42740 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa1d60 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fa1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 --2- 172.21.15.16:0/315159201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21f93c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 -- 172.21.15.16:0/315159201 >> 172.21.15.16:0/315159201 conn(0x559e21f94300 msgr2=0x559e21fa1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 -- 172.21.15.16:0/315159201 shutdown_connections 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 -- 172.21.15.16:0/315159201 wait complete. 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 -- start start 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 Processor -- start 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21faacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fab210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c1aee70 con 0x559e21fa2d80 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c1b02e0 con 0x559e21f964d0 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c1af540 con 0x559e21f96df0 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.323+0000 7fea34d42740 10 client.0 _ll_register_callbacks cb 0x7fea1c005c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56840/0 (socket says 172.21.15.16:56840) 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 -- 172.21.15.16:0/746289818 learned_addr learned my addr 172.21.15.16:0/746289818 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea2b7fe640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea2bfff640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21faacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 -- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 msgr2=0x559e21fab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 -- 172.21.15.16:0/746289818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 msgr2=0x559e21faacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21faacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 -- 172.21.15.16:0/746289818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e21faba10 con 0x559e21fa2d80 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea2bfff640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21faacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea30f0a640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5c80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fea24054040 tx=0x7fea24030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be75108e7552853e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea0b7fe640 1 -- 172.21.15.16:0/746289818 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2405f060 con 0x559e21fa2d80 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea0b7fe640 1 -- 172.21.15.16:0/746289818 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7fea24042040 con 0x559e21fa2d80 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea24036050 con 0x559e21fa2d80 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea0b7fe640 1 -- 172.21.15.16:0/746289818 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea240305c0 con 0x559e21fa2d80 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea34d42740 10 client.17136 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.324+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559e2201fda0 con 0x559e21fa2d80 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea0b7fe640 1 -- 172.21.15.16:0/746289818 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea24036050 con 0x559e21fa2d80 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea0b7fe640 1 -- 172.21.15.16:0/746289818 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fea240476d0 con 0x559e21fa2d80 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea34d42740 10 client.17136 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea34d42740 10 client.17136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea34d42740 20 client.17136 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea34d42740 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e220204c0 0x559e220228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea34d42740 4 client.17136 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e21f0a8a0 con 0x559e220204c0 2024-09-10T23:48:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.325+0000 7fea2bfff640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e220204c0 0x559e220228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea2bfff640 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e220204c0 0x559e220228e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=416ec40f1859a30d server_cookie=a7c3fe09caa8c in_seq=0 out_seq=0 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea0b7fe640 10 client.17136 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea0b7fe640 1 -- 172.21.15.16:0/746289818 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e21f0a8a0 con 0x559e220204c0 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea0b7fe640 10 client.17136 handle_command_reply: tid=0 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 client.17136 shutdown 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 msgr2=0x559e21fa5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5c80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fea24054040 tx=0x7fea24030d80 comp rx=0 tx=0).stop 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 shutdown_connections 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x559e220204c0 0x559e220228e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e21fa2d80 0x559e21fa5c80 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559e21f96df0 0x559e21fab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 --2- 172.21.15.16:0/746289818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e21f964d0 0x559e21faacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 >> 172.21.15.16:0/746289818 conn(0x559e21f94300 msgr2=0x559e21fa1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea0b7fe640 0 client.17136 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 shutdown_connections 2024-09-10T23:48:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 1 -- 172.21.15.16:0/746289818 wait complete. 2024-09-10T23:48:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.326+0000 7fea34d42740 20 client.17136 trim_cache size 0 max 16384 2024-09-10T23:48:53.334 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fea140b5450 msgr2=0x7fea140b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fea140b5450 0x7fea140b7910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fea24006010 tx=0x7fea24005fa0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c1087d0 msgr2=0x7fea2c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c1087d0 0x7fea2c0759e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fea2000d770 tx=0x7fea2000db70 comp rx=0 tx=0).stop 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 shutdown_connections 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea2c109150 0x7fea2c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea2c1087d0 0x7fea2c0759e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fea140b5450 0x7fea140b7910 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 --2- 172.21.15.16:0/3652279243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea2c102dc0 0x7fea2c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 >> 172.21.15.16:0/3652279243 conn(0x7fea2c0fe830 msgr2=0x7fea2c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 shutdown_connections 2024-09-10T23:48:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:53.327+0000 7fea3296d640 1 -- 172.21.15.16:0/3652279243 wait complete. 2024-09-10T23:48:54.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:54 smithi066 ceph-mon[34761]: pgmap v584: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:54.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:54 smithi016 ceph-mon[30855]: pgmap v584: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:54.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:54 smithi071 ceph-mon[35018]: pgmap v584: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:48:55.120 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:48:55.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:48:55.389 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 -- 172.21.15.16:0/2440835566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 msgr2=0x7f28e4107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 --2- 172.21.15.16:0/2440835566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e4107b00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009900 tx=0x7f28cc02a410 comp rx=0 tx=0).stop 2024-09-10T23:48:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 -- 172.21.15.16:0/2440835566 shutdown_connections 2024-09-10T23:48:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 --2- 172.21.15.16:0/2440835566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28e4108040 0x7f28e410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 --2- 172.21.15.16:0/2440835566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e4107b00 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 --2- 172.21.15.16:0/2440835566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4101cb0 0x7f28e4102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 -- 172.21.15.16:0/2440835566 >> 172.21.15.16:0/2440835566 conn(0x7f28e40fd700 msgr2=0x7f28e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 -- 172.21.15.16:0/2440835566 shutdown_connections 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.874+0000 7f28e9b67640 1 -- 172.21.15.16:0/2440835566 wait complete. 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 Processor -- start 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 -- start start 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4101cb0 0x7f28e41992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e41997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28e4108040 0x7f28e419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4111c90 con 0x7f28e41076c0 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4111b10 con 0x7f28e4101cb0 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e9b67640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4111e10 con 0x7f28e4108040 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e41997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e41997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42950/0 (socket says 172.21.15.16:42950) 2024-09-10T23:48:55.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.875+0000 7f28e2ffd640 1 -- 172.21.15.16:0/12262834 learned_addr learned my addr 172.21.15.16:0/12262834 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e37fe640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4101cb0 0x7f28e41992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e3fff640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28e4108040 0x7f28e419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e2ffd640 1 -- 172.21.15.16:0/12262834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28e4108040 msgr2=0x7f28e419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28e4108040 0x7f28e419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e2ffd640 1 -- 172.21.15.16:0/12262834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4101cb0 msgr2=0x7f28e41992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4101cb0 0x7f28e41992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e2ffd640 1 -- 172.21.15.16:0/12262834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e419f360 con 0x7f28e41076c0 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e3fff640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28e4108040 0x7f28e419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e41997f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f28cc005940 tx=0x7f28cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e0ff9640 1 -- 172.21.15.16:0/12262834 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc03f030 con 0x7f28e41076c0 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e419f5f0 con 0x7f28e41076c0 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e0ff9640 1 -- 172.21.15.16:0/12262834 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28cc003cb0 con 0x7f28e41076c0 2024-09-10T23:48:55.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41a5d10 con 0x7f28e41076c0 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.876+0000 7f28e0ff9640 1 -- 172.21.15.16:0/12262834 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc049060 con 0x7f28e41076c0 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e0ff9640 1 -- 172.21.15.16:0/12262834 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f28cc003800 con 0x7f28e41076c0 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 Processor -- start 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 -- start start 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147bb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147bb790 0x5648147bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564814725e60 con 0x5648147af800 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564814715290 con 0x5648147aeee0 2024-09-10T23:48:55.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5648147190a0 con 0x5648147bb790 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147bb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147bb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42962/0 (socket says 172.21.15.16:42962) 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 -- 172.21.15.16:0/4217684198 learned_addr learned my addr 172.21.15.16:0/4217684198 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e3fff640 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147bb790 0x5648147bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 -- 172.21.15.16:0/4217684198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147bb790 msgr2=0x5648147bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147bb790 0x5648147bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 -- 172.21.15.16:0/4217684198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 msgr2=0x5648147af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e37fe640 1 -- 172.21.15.16:0/4217684198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564814473930 con 0x5648147af800 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147bb790 0x5648147bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.879+0000 7f28e3fff640 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.880+0000 7f28e0ff9640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d00b5450 0x7f28d00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.880+0000 7f28e37fe640 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147bb250 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f28d400af70 tx=0x7f28d400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685e4b246bb7195a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.880+0000 7f28e3fff640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d00b5450 0x7f28d00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.880+0000 7f28d9ffb640 1 -- 172.21.15.16:0/4217684198 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d401d070 con 0x5648147af800 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.880+0000 7f28e0ff9640 1 -- 172.21.15.16:0/12262834 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f28cc106b80 con 0x7f28e41076c0 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.880+0000 7f28d9ffb640 1 -- 172.21.15.16:0/4217684198 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28d4010db0 con 0x5648147af800 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.880+0000 7f28d9ffb640 1 -- 172.21.15.16:0/4217684198 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4018dd0 con 0x5648147af800 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 -- 172.21.15.16:0/4217684198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 msgr2=0x5648147bb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28e3fff640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d00b5450 0x7f28d00b7910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f28dc005fd0 tx=0x7f28dc005f40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147bb250 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f28d400af70 tx=0x7f28d400f850 comp rx=0 tx=0).stop 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 -- 172.21.15.16:0/4217684198 shutdown_connections 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147bb790 0x5648147bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147bb250 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/4217684198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 -- 172.21.15.16:0/4217684198 >> 172.21.15.16:0/4217684198 conn(0x5648147acd10 msgr2=0x5648147adeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 -- 172.21.15.16:0/4217684198 shutdown_connections 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 -- 172.21.15.16:0/4217684198 wait complete. 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 -- start start 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 Processor -- start 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147aeee0 0x5648147bb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.881+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147bb790 0x5648147b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564814576890 con 0x5648147af800 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5648146afd40 con 0x5648147bb790 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5648147be440 con 0x5648147aeee0 2024-09-10T23:48:55.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 10 client.0 _ll_register_callbacks cb 0x564814713c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147b86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42968/0 (socket says 172.21.15.16:42968) 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 -- 172.21.15.16:0/393596471 learned_addr learned my addr 172.21.15.16:0/393596471 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e3fff640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147bb790 0x5648147b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e37fe640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147aeee0 0x5648147bb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 -- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147aeee0 msgr2=0x5648147bb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147aeee0 0x5648147bb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 -- 172.21.15.16:0/393596471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147bb790 msgr2=0x5648147b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147bb790 0x5648147b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 -- 172.21.15.16:0/393596471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648147c77d0 con 0x5648147af800 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e3fff640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147bb790 0x5648147b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147b86c0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f28cc104300 tx=0x7f28cc0c9620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74be332a932b49c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28c2ffd640 1 -- 172.21.15.16:0/393596471 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc035070 con 0x5648147af800 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28c2ffd640 1 -- 172.21.15.16:0/393596471 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f28cc0cd430 con 0x5648147af800 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28d4010db0 con 0x5648147af800 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28c2ffd640 1 -- 172.21.15.16:0/393596471 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f28cc0cc920 con 0x5648147af800 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 10 client.17148 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.882+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5648147ca070 con 0x5648147af800 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28c2ffd640 1 -- 172.21.15.16:0/393596471 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28d4010db0 con 0x5648147af800 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28c2ffd640 1 -- 172.21.15.16:0/393596471 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f28cc0d60d0 con 0x5648147af800 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28ebf3c740 10 client.17148 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28ebf3c740 10 client.17148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28ebf3c740 20 client.17148 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5648147cb570 0x5648147cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28ebf3c740 4 client.17148 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564814727db0 con 0x5648147cb570 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.883+0000 7f28e37fe640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5648147cb570 0x5648147cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28e37fe640 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5648147cb570 0x5648147cd9a0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2964247e3972ca server_cookie=26263e7a99076957 in_seq=0 out_seq=0 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28c2ffd640 10 client.17148 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28c2ffd640 1 -- 172.21.15.16:0/393596471 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564814727db0 con 0x5648147cb570 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28c2ffd640 10 client.17148 handle_command_reply: tid=0 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 client.17148 shutdown 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 msgr2=0x5648147b86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147b86c0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f28cc104300 tx=0x7f28cc0c9620 comp rx=0 tx=0).stop 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 shutdown_connections 2024-09-10T23:48:55.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5648147cb570 0x5648147cd9a0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147bb790 0x5648147b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147af800 0x5648147b86c0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28c2ffd640 0 client.17148 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/393596471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147aeee0 0x5648147bb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.884+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 >> 172.21.15.16:0/393596471 conn(0x5648147acd10 msgr2=0x5648147abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.885+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 shutdown_connections 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.885+0000 7f28ebf3c740 1 -- 172.21.15.16:0/393596471 wait complete. 2024-09-10T23:48:55.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.885+0000 7f28ebf3c740 20 client.17148 trim_cache size 0 max 16384 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.902+0000 7f28ebf3c740 1 Processor -- start 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.902+0000 7f28ebf3c740 1 -- start start 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x5648147b8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41b0f30 con 0x5648147bb790 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ae800 con 0x5648147aeee0 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ac670 con 0x5648147af800 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x5648147b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x5648147b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42978/0 (socket says 172.21.15.16:42978) 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 -- 172.21.15.16:0/3187585481 learned_addr learned my addr 172.21.15.16:0/3187585481 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:55.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 -- 172.21.15.16:0/3187585481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 msgr2=0x5648147b7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 -- 172.21.15.16:0/3187585481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 msgr2=0x5648147c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e37fe640 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 -- 172.21.15.16:0/3187585481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648147ad790 con 0x5648147bb790 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28e3fff640 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x5648147b8360 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00ff80 tx=0x7f28dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6978c9b9501e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.903+0000 7f28d97fa640 1 -- 172.21.15.16:0/3187585481 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc01f630 con 0x5648147bb790 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28d97fa640 1 -- 172.21.15.16:0/3187585481 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28dc01fc80 con 0x5648147bb790 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28d97fa640 1 -- 172.21.15.16:0/3187585481 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc027c00 con 0x5648147bb790 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 -- 172.21.15.16:0/3187585481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 msgr2=0x5648147b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x5648147b8360 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00ff80 tx=0x7f28dc012000 comp rx=0 tx=0).stop 2024-09-10T23:48:55.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 -- 172.21.15.16:0/3187585481 shutdown_connections 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x5648147b8360 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/3187585481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 -- 172.21.15.16:0/3187585481 >> 172.21.15.16:0/3187585481 conn(0x5648147acd10 msgr2=0x5648147c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 -- 172.21.15.16:0/3187585481 shutdown_connections 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.904+0000 7f28ebf3c740 1 -- 172.21.15.16:0/3187585481 wait complete. 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 -- start start 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 Processor -- start 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x56481483c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41accc0 con 0x5648147bb790 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ae130 con 0x5648147aeee0 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41ad390 con 0x5648147af800 2024-09-10T23:48:55.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28ebf3c740 10 client.0 _ll_register_callbacks cb 0x7f28cc005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x56481483c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28e37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x56481483c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42984/0 (socket says 172.21.15.16:42984) 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28e3fff640 1 -- 172.21.15.16:0/131286707 learned_addr learned my addr 172.21.15.16:0/131286707 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.905+0000 7f28e2ffd640 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28e3fff640 1 -- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 msgr2=0x5648147b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28e3fff640 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28e3fff640 1 -- 172.21.15.16:0/131286707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 msgr2=0x5648147b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28e3fff640 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28e3fff640 1 -- 172.21.15.16:0/131286707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648147b34e0 con 0x5648147bb790 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28e37fe640 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28e3fff640 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x56481483c4b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0093a0 tx=0x7f28dc027630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a0b99a87720ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:55.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28c2ffd640 1 -- 172.21.15.16:0/131286707 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc036060 con 0x5648147bb790 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28c2ffd640 1 -- 172.21.15.16:0/131286707 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7f28dc027bf0 con 0x5648147bb790 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28dc01fc80 con 0x5648147bb790 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28c2ffd640 1 -- 172.21.15.16:0/131286707 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f28dc027e10 con 0x5648147bb790 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28ebf3c740 10 client.17154 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56481483dc10 con 0x5648147bb790 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.906+0000 7f28c2ffd640 1 -- 172.21.15.16:0/131286707 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28dc01fc80 con 0x5648147bb790 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28c2ffd640 1 -- 172.21.15.16:0/131286707 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f28dc03b750 con 0x5648147bb790 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28ebf3c740 10 client.17154 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28ebf3c740 10 client.17154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28ebf3c740 20 client.17154 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56481483e300 0x564814840720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28ebf3c740 4 client.17154 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:48:55.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564814723860 con 0x56481483e300 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28e37fe640 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56481483e300 0x564814840720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28c2ffd640 10 client.17154 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.907+0000 7f28e37fe640 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56481483e300 0x564814840720 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc4c8db41ad445 server_cookie=1f81ddbc9002319b in_seq=0 out_seq=0 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28c2ffd640 1 -- 172.21.15.16:0/131286707 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564814723860 con 0x56481483e300 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28c2ffd640 10 client.17154 handle_command_reply: tid=0 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 client.17154 shutdown 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 msgr2=0x56481483c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x56481483c4b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0093a0 tx=0x7f28dc027630 comp rx=0 tx=0).stop 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 shutdown_connections 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56481483e300 0x564814840720 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648147bb790 0x56481483c4b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648147af800 0x5648147b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 --2- 172.21.15.16:0/131286707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648147aeee0 0x5648147b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 >> 172.21.15.16:0/131286707 conn(0x5648147acd10 msgr2=0x5648147abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28c2ffd640 0 client.17154 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 shutdown_connections 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.909+0000 7f28ebf3c740 1 -- 172.21.15.16:0/131286707 wait complete. 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28ebf3c740 20 client.17154 trim_cache size 0 max 16384 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "14ec25e9-6e3c-4668-8e31-7445d91560fb", 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:48:55.918 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:48:55.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d00b5450 msgr2=0x7f28d00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d00b5450 0x7f28d00b7910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f28dc005fd0 tx=0x7f28dc005f40 comp rx=0 tx=0).stop 2024-09-10T23:48:55.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 msgr2=0x7f28e41997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:55.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e41997f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f28cc005940 tx=0x7f28cc0042f0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 shutdown_connections 2024-09-10T23:48:55.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28e4108040 0x7f28e419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e41076c0 0x7f28e41997f0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f28d00b5450 0x7f28d00b7910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 --2- 172.21.15.16:0/12262834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4101cb0 0x7f28e41992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:55.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 >> 172.21.15.16:0/12262834 conn(0x7f28e40fd700 msgr2=0x7f28e406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:55.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 shutdown_connections 2024-09-10T23:48:55.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:55.910+0000 7f28e9b67640 1 -- 172.21.15.16:0/12262834 wait complete. 2024-09-10T23:48:56.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:56 smithi066 ceph-mon[34761]: pgmap v585: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-10T23:48:56.322 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:56 smithi071 ceph-mon[35018]: pgmap v585: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-10T23:48:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:56 smithi016 ceph-mon[30855]: pgmap v585: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-10T23:48:56.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:48:56.911 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:57.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:57 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:48:57.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:57 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:57.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:57 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:48:57.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:57 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:57.301 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:57 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:48:57.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:57 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:57.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:57 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:48:57.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:57 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:57.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 -- 172.21.15.16:0/1450171468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74109150 msgr2=0x7fad7410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 --2- 172.21.15.16:0/1450171468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74109150 0x7fad7410f950 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009ca0 tx=0x7fad6c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 -- 172.21.15.16:0/1450171468 shutdown_connections 2024-09-10T23:48:57.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 --2- 172.21.15.16:0/1450171468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74109150 0x7fad7410f950 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 --2- 172.21.15.16:0/1450171468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad741087d0 0x7fad74108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 --2- 172.21.15.16:0/1450171468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad74102dc0 0x7fad741031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 -- 172.21.15.16:0/1450171468 >> 172.21.15.16:0/1450171468 conn(0x7fad740fe830 msgr2=0x7fad74100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 -- 172.21.15.16:0/1450171468 shutdown_connections 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.380+0000 7fad7af38640 1 -- 172.21.15.16:0/1450171468 wait complete. 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 Processor -- start 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 -- start start 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad74102dc0 0x7fad74199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad741087d0 0x7fad74199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad74109150 0x7fad7419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad74112e10 con 0x7fad741087d0 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad74112c90 con 0x7fad74102dc0 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad7af38640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad74112f90 con 0x7fad74109150 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad741087d0 0x7fad74199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad741087d0 0x7fad74199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43004/0 (socket says 172.21.15.16:43004) 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.381+0000 7fad6bfff640 1 -- 172.21.15.16:0/2253501388 learned_addr learned my addr 172.21.15.16:0/2253501388 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad794d5640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad74109150 0x7fad7419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad78cd4640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad74102dc0 0x7fad74199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad6bfff640 1 -- 172.21.15.16:0/2253501388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad74109150 msgr2=0x7fad7419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad6bfff640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad74109150 0x7fad7419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad6bfff640 1 -- 172.21.15.16:0/2253501388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad74102dc0 msgr2=0x7fad74199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad6bfff640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad74102dc0 0x7fad74199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad6bfff640 1 -- 172.21.15.16:0/2253501388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7419f2d0 con 0x7fad741087d0 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad794d5640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad74109150 0x7fad7419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:57.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad6bfff640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad741087d0 0x7fad74199760 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fad6400d950 tx=0x7fad6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad69ffb640 1 -- 172.21.15.16:0/2253501388 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64017070 con 0x7fad741087d0 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad69ffb640 1 -- 172.21.15.16:0/2253501388 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad64009c30 con 0x7fad741087d0 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7419f5c0 con 0x7fad741087d0 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad69ffb640 1 -- 172.21.15.16:0/2253501388 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6400f620 con 0x7fad741087d0 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.382+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad741a5c80 con 0x7fad741087d0 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 Processor -- start 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 -- start start 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad69ffb640 1 -- 172.21.15.16:0/2253501388 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fad64010460 con 0x7fad741087d0 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f749860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f7557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f758120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b46f6bfe50 con 0x55b46f749480 2024-09-10T23:48:57.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b46f6af280 con 0x55b46f749da0 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad7d30d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b46f6b3090 con 0x55b46f755d30 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad794d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f749860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad794d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f749860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43008/0 (socket says 172.21.15.16:43008) 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad794d5640 1 -- 172.21.15.16:0/3068046405 learned_addr learned my addr 172.21.15.16:0/3068046405 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad6bfff640 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f758120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad78cd4640 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f7557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad794d5640 1 -- 172.21.15.16:0/3068046405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 msgr2=0x55b46f758120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.385+0000 7fad794d5640 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f758120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad794d5640 1 -- 172.21.15.16:0/3068046405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 msgr2=0x55b46f7557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad794d5640 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f7557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad794d5640 1 -- 172.21.15.16:0/3068046405 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46f40d650 con 0x55b46f749480 2024-09-10T23:48:57.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad78cd4640 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f7557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad794d5640 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f749860 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fad6c031b70 tx=0x7fad6c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8316707be00e0834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad69ffb640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad78cd4640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad5affd640 1 -- 172.21.15.16:0/3068046405 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c031650 con 0x55b46f749480 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad69ffb640 1 -- 172.21.15.16:0/2253501388 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7fad640e5d00 con 0x7fad741087d0 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad5affd640 1 -- 172.21.15.16:0/3068046405 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad6c036040 con 0x55b46f749480 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.386+0000 7fad5affd640 1 -- 172.21.15.16:0/3068046405 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0044a0 con 0x55b46f749480 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 -- 172.21.15.16:0/3068046405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 msgr2=0x55b46f749860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad78cd4640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fad70005fd0 tx=0x7fad70005ee0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f749860 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fad6c031b70 tx=0x7fad6c009a20 comp rx=0 tx=0).stop 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 -- 172.21.15.16:0/3068046405 shutdown_connections 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f758120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f7557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 --2- 172.21.15.16:0/3068046405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f749860 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 -- 172.21.15.16:0/3068046405 >> 172.21.15.16:0/3068046405 conn(0x55b46f7472b0 msgr2=0x55b46f748450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 -- 172.21.15.16:0/3068046405 shutdown_connections 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 -- 172.21.15.16:0/3068046405 wait complete. 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 -- start start 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.387+0000 7fad7d30d740 1 Processor -- start 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f7555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f752ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f753050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad7d30d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b46f510700 con 0x55b46f749480 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad7d30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b46f64a110 con 0x55b46f755d30 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad7d30d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b46f75ccd0 con 0x55b46f749da0 2024-09-10T23:48:57.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad7d30d740 10 client.0 _ll_register_callbacks cb 0x55b46f663990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f7555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f7555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43018/0 (socket says 172.21.15.16:43018) 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 -- 172.21.15.16:0/54242369 learned_addr learned my addr 172.21.15.16:0/54242369 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad6bfff640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f752ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad794d5640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f753050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 -- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 msgr2=0x55b46f752ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f752ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 -- 172.21.15.16:0/54242369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 msgr2=0x55b46f753050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f753050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 -- 172.21.15.16:0/54242369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46f677c40 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad794d5640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f753050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad78cd4640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f7555c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fad700116f0 tx=0x7fad70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef97de13f893985 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.388+0000 7fad53fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad53fff640 1 -- 172.21.15.16:0/54242369 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70022070 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad6c036040 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad53fff640 1 -- 172.21.15.16:0/54242369 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7fad70005220 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad53fff640 1 -- 172.21.15.16:0/54242369 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad7002d050 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 10 client.17166 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b46f7685c0 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad53fff640 1 -- 172.21.15.16:0/54242369 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad6c036040 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad53fff640 1 -- 172.21.15.16:0/54242369 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad700048c0 con 0x55b46f749480 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 10 client.17166 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:57.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 20 client.17166 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f769a70 0x55b46f76bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 4 client.17166 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.389+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b46f6c1da0 con 0x55b46f769a70 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.390+0000 7fad6bfff640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f769a70 0x55b46f76bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.390+0000 7fad53fff640 10 client.17166 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.390+0000 7fad6bfff640 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f769a70 0x55b46f76bed0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b9f0a303e54bce server_cookie=605564238aeec7d2 in_seq=0 out_seq=0 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad53fff640 1 -- 172.21.15.16:0/54242369 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b46f6c1da0 con 0x55b46f769a70 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad53fff640 10 client.17166 handle_command_reply: tid=0 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 client.17166 shutdown 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 msgr2=0x55b46f7555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f7555c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fad700116f0 tx=0x7fad70004730 comp rx=0 tx=0).stop 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 shutdown_connections 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f769a70 0x55b46f76bed0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f753050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f752ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 --2- 172.21.15.16:0/54242369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f7555c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 >> 172.21.15.16:0/54242369 conn(0x55b46f7472b0 msgr2=0x55b46f74ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:57.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad53fff640 0 client.17166 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:57.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 shutdown_connections 2024-09-10T23:48:57.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 1 -- 172.21.15.16:0/54242369 wait complete. 2024-09-10T23:48:57.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.391+0000 7fad7d30d740 20 client.17166 trim_cache size 0 max 16384 2024-09-10T23:48:57.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 Processor -- start 2024-09-10T23:48:57.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 -- start start 2024-09-10T23:48:57.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f76ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f746bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f757120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad741aed70 con 0x55b46f749480 2024-09-10T23:48:57.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad741ac640 con 0x55b46f749da0 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad7d30d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad741aa4b0 con 0x55b46f755d30 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad78cd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f76ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad78cd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f76ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43022/0 (socket says 172.21.15.16:43022) 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad78cd4640 1 -- 172.21.15.16:0/4050622450 learned_addr learned my addr 172.21.15.16:0/4050622450 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad6bfff640 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f746bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.409+0000 7fad794d5640 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f757120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad78cd4640 1 -- 172.21.15.16:0/4050622450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 msgr2=0x55b46f757120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad78cd4640 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f757120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad78cd4640 1 -- 172.21.15.16:0/4050622450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 msgr2=0x55b46f746bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad78cd4640 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f746bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad78cd4640 1 -- 172.21.15.16:0/4050622450 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46f749bd0 con 0x55b46f749480 2024-09-10T23:48:57.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad78cd4640 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f76ba80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fad7000a8d0 tx=0x7fad7000fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb1e40e9d230d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:57.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad5a7fc640 1 -- 172.21.15.16:0/4050622450 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70022040 con 0x55b46f749480 2024-09-10T23:48:57.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad5a7fc640 1 -- 172.21.15.16:0/4050622450 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad70035020 con 0x55b46f749480 2024-09-10T23:48:57.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.410+0000 7fad5a7fc640 1 -- 172.21.15.16:0/4050622450 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70005130 con 0x55b46f749480 2024-09-10T23:48:57.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 -- 172.21.15.16:0/4050622450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 msgr2=0x55b46f76ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f76ba80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fad7000a8d0 tx=0x7fad7000fc50 comp rx=0 tx=0).stop 2024-09-10T23:48:57.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 -- 172.21.15.16:0/4050622450 shutdown_connections 2024-09-10T23:48:57.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f755d30 0x55b46f757120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f749da0 0x55b46f746bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 --2- 172.21.15.16:0/4050622450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f76ba80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 -- 172.21.15.16:0/4050622450 >> 172.21.15.16:0/4050622450 conn(0x55b46f7472b0 msgr2=0x55b46f74dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 -- 172.21.15.16:0/4050622450 shutdown_connections 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 -- 172.21.15.16:0/4050622450 wait complete. 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 -- start start 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.411+0000 7fad7d30d740 1 Processor -- start 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f761fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f762500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad7d30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f75cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad7d30d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad741aab00 con 0x55b46f749480 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad7d30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad741abf70 con 0x55b46f755d30 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad7d30d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad741ab1d0 con 0x55b46f749da0 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad7d30d740 10 client.0 _ll_register_callbacks cb 0x7fad70015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f761fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f761fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43036/0 (socket says 172.21.15.16:43036) 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 -- 172.21.15.16:0/859559499 learned_addr learned my addr 172.21.15.16:0/859559499 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad6bfff640 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f762500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad794d5640 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f75cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 -- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 msgr2=0x55b46f762500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f762500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 -- 172.21.15.16:0/859559499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 msgr2=0x55b46f75cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f75cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 -- 172.21.15.16:0/859559499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46f762ce0 con 0x55b46f749480 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad78cd4640 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f761fc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad70004d80 tx=0x7fad7000a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83600c1c202fcc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.412+0000 7fad53fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad53fff640 1 -- 172.21.15.16:0/859559499 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7003e070 con 0x55b46f749480 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad53fff640 1 -- 172.21.15.16:0/859559499 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8470+0+0 (secure 0 0 0) 0x7fad700109f0 con 0x55b46f749480 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad70035020 con 0x55b46f749480 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad53fff640 1 -- 172.21.15.16:0/859559499 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad7004a050 con 0x55b46f749480 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 10 client.17172 fetch_fsmap learned FSMap version 25 2024-09-10T23:48:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b46f7d6fa0 con 0x55b46f749480 2024-09-10T23:48:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad53fff640 1 -- 172.21.15.16:0/859559499 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad70035020 con 0x55b46f749480 2024-09-10T23:48:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad53fff640 1 -- 172.21.15.16:0/859559499 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad7001e450 con 0x55b46f749480 2024-09-10T23:48:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 10 client.17172 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:48:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:48:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 20 client.17172 populate_metadata read hostname 'smithi016' 2024-09-10T23:48:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f7d7610 0x55b46f7d9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 4 client.17172 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b46f6bd850 con 0x55b46f7d7610 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.413+0000 7fad6bfff640 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f7d7610 0x55b46f7d9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad6bfff640 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f7d7610 0x55b46f7d9a30 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ff5b267d77d37a server_cookie=e79fb3772d03851f in_seq=0 out_seq=0 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad53fff640 10 client.17172 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad53fff640 1 -- 172.21.15.16:0/859559499 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x55b46f6bd850 con 0x55b46f7d7610 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad53fff640 10 client.17172 handle_command_reply: tid=0 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 client.17172 shutdown 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 msgr2=0x55b46f761fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f761fc0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad70004d80 tx=0x7fad7000a5d0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 shutdown_connections 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55b46f7d7610 0x55b46f7d9a30 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b46f755d30 0x55b46f75cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b46f749da0 0x55b46f762500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 --2- 172.21.15.16:0/859559499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b46f749480 0x55b46f761fc0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 >> 172.21.15.16:0/859559499 conn(0x55b46f7472b0 msgr2=0x55b46f753db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.414+0000 7fad53fff640 0 client.17172 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 shutdown_connections 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7d30d740 1 -- 172.21.15.16:0/859559499 wait complete. 2024-09-10T23:48:57.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7d30d740 20 client.17172 trim_cache size 0 max 16384 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "14ec25e9-6e3c-4668-8e31-7445d91560fb": { 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "14ec25e9-6e3c-4668-8e31-7445d91560fb", 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:48:57.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "14ec25e9-6e3c-4668-8e31-7445d91560fb": { 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:55.907798+0000", 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:48:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.427 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.428 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.429 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:48:57.430 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.431 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.432 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.433 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "dc39dd20-224e-45cc-87b8-22db618aa261": { 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:13.371560+0000", 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.437 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:48:57.438 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:48:57.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 msgr2=0x7fad5c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fad70005fd0 tx=0x7fad70005ee0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad741087d0 msgr2=0x7fad74199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad741087d0 0x7fad74199760 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fad6400d950 tx=0x7fad6400de10 comp rx=0 tx=0).stop 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 shutdown_connections 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad74109150 0x7fad7419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad741087d0 0x7fad74199760 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 --2- 172.21.15.16:0/2253501388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad74102dc0 0x7fad74199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:57.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 >> 172.21.15.16:0/2253501388 conn(0x7fad740fe830 msgr2=0x7fad74100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:57.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 shutdown_connections 2024-09-10T23:48:57.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:48:57.415+0000 7fad7af38640 1 -- 172.21.15.16:0/2253501388 wait complete. 2024-09-10T23:48:57.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:57 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:48:57.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:57 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:57.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:57 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:48:57.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:57 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:48:58.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:58 smithi016 ceph-mon[30855]: pgmap v586: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-10T23:48:58.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:48:58 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:48:58.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:58 smithi066 ceph-mon[34761]: pgmap v586: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-10T23:48:58.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:48:58 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:48:58.345 INFO:tasks.cephfs.filesystem:scrub status for tag:14ec25e9-6e3c-4668-8e31-7445d91560fb - {'path': '/', 'tag': '14ec25e9-6e3c-4668-8e31-7445d91560fb', 'options': 'recursive,force'} 2024-09-10T23:48:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:58 smithi071 ceph-mon[35018]: pgmap v586: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-10T23:48:58.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:48:58 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:49:00.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:00 smithi066 ceph-mon[34761]: pgmap v587: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:49:00.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:00 smithi016 ceph-mon[30855]: pgmap v587: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:49:00.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:00 smithi071 ceph-mon[35018]: pgmap v587: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-10T23:49:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:02 smithi016 ceph-mon[30855]: pgmap v588: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:49:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:02 smithi071 ceph-mon[35018]: pgmap v588: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:49:02.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:02 smithi066 ceph-mon[34761]: pgmap v588: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T23:49:04.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:04 smithi016 ceph-mon[30855]: pgmap v589: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:49:04.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:04 smithi071 ceph-mon[35018]: pgmap v589: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:49:04.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:04 smithi066 ceph-mon[34761]: pgmap v589: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:49:06.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:06 smithi016 ceph-mon[30855]: pgmap v590: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:49:06.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:06 smithi071 ceph-mon[35018]: pgmap v590: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:49:06.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:06 smithi066 ceph-mon[34761]: pgmap v590: 97 pgs: 97 active+clean; 14 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:49:08.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:08 smithi016 ceph-mon[30855]: pgmap v591: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:49:08.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:08 smithi071 ceph-mon[35018]: pgmap v591: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:49:08.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:08 smithi066 ceph-mon[34761]: pgmap v591: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:49:09.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:09 smithi016 ceph-mon[30855]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:49:09.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:09 smithi071 ceph-mon[35018]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:49:09.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:09 smithi066 ceph-mon[34761]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:49:10.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:10 smithi016 ceph-mon[30855]: pgmap v593: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:49:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:10 smithi071 ceph-mon[35018]: pgmap v593: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:49:10.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:10 smithi066 ceph-mon[34761]: pgmap v593: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:49:12.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:12 smithi016 ceph-mon[30855]: pgmap v594: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:49:12.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:12 smithi071 ceph-mon[35018]: pgmap v594: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:49:12.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:12 smithi066 ceph-mon[34761]: pgmap v594: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:49:14.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:14 smithi016 ceph-mon[30855]: pgmap v595: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:49:14.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:14 smithi071 ceph-mon[35018]: pgmap v595: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:49:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:14 smithi066 ceph-mon[34761]: pgmap v595: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:49:16.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:16 smithi016 ceph-mon[30855]: pgmap v596: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:16.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:16 smithi071 ceph-mon[35018]: pgmap v596: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:16.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:16 smithi066 ceph-mon[34761]: pgmap v596: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:18 smithi016 ceph-mon[30855]: pgmap v597: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:18 smithi016 ceph-mon[30855]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:49:18.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:18 smithi071 ceph-mon[35018]: pgmap v597: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:18.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:18 smithi071 ceph-mon[35018]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:49:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:18 smithi066 ceph-mon[34761]: pgmap v597: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:18 smithi066 ceph-mon[34761]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:49:20.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:20 smithi016 ceph-mon[30855]: pgmap v599: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:20.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:20 smithi071 ceph-mon[35018]: pgmap v599: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:20.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:20 smithi066 ceph-mon[34761]: pgmap v599: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:22 smithi016 ceph-mon[30855]: pgmap v600: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:22.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:22 smithi071 ceph-mon[35018]: pgmap v600: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:22.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:22 smithi066 ceph-mon[34761]: pgmap v600: 97 pgs: 97 active+clean; 14 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:49:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:24 smithi016 ceph-mon[30855]: pgmap v601: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:24.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:24 smithi071 ceph-mon[35018]: pgmap v601: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:24.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:24 smithi066 ceph-mon[34761]: pgmap v601: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:26.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:26 smithi016 ceph-mon[30855]: pgmap v602: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:26.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:26 smithi071 ceph-mon[35018]: pgmap v602: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:26.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:26 smithi066 ceph-mon[34761]: pgmap v602: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:28.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:49:28.354 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:28 smithi066 ceph-mon[34761]: pgmap v603: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:28.376 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:28 smithi016 ceph-mon[30855]: pgmap v603: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:28.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:28 smithi071 ceph-mon[35018]: pgmap v603: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-10T23:49:28.618 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 -- 172.21.15.16:0/157618428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 msgr2=0x7f4680108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 --2- 172.21.15.16:0/157618428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680108c10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4668009900 tx=0x7f466802a410 comp rx=0 tx=0).stop 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 -- 172.21.15.16:0/157618428 shutdown_connections 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 --2- 172.21.15.16:0/157618428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4680109150 0x7f468010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 --2- 172.21.15.16:0/157618428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680108c10 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 --2- 172.21.15.16:0/157618428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4680102dc0 0x7f46801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 -- 172.21.15.16:0/157618428 >> 172.21.15.16:0/157618428 conn(0x7f46800fe830 msgr2=0x7f4680100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 -- 172.21.15.16:0/157618428 shutdown_connections 2024-09-10T23:49:29.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.124+0000 7f46852e9640 1 -- 172.21.15.16:0/157618428 wait complete. 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 Processor -- start 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 -- start start 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4680102dc0 0x7f4680199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4680109150 0x7f468019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4680112e10 con 0x7f46801087d0 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4680112c90 con 0x7f4680109150 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f46852e9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4680112f90 con 0x7f4680102dc0 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f4677fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f4677fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35430/0 (socket says 172.21.15.16:35430) 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f4677fff640 1 -- 172.21.15.16:0/681201839 learned_addr learned my addr 172.21.15.16:0/681201839 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:29.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.125+0000 7f467effd640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4680102dc0 0x7f4680199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f467f7fe640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4680109150 0x7f468019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f4677fff640 1 -- 172.21.15.16:0/681201839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4680102dc0 msgr2=0x7f4680199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f4677fff640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4680102dc0 0x7f4680199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f4677fff640 1 -- 172.21.15.16:0/681201839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4680109150 msgr2=0x7f468019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f4677fff640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4680109150 0x7f468019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f4677fff640 1 -- 172.21.15.16:0/681201839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468019f2d0 con 0x7f46801087d0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f4677fff640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680199760 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4668005940 tx=0x7f46680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f467cff9640 1 -- 172.21.15.16:0/681201839 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466803f030 con 0x7f46801087d0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f467cff9640 1 -- 172.21.15.16:0/681201839 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4668003cb0 con 0x7f46801087d0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468019f560 con 0x7f46801087d0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f467cff9640 1 -- 172.21.15.16:0/681201839 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668035070 con 0x7f46801087d0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.126+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46801a5c80 con 0x7f46801087d0 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 Processor -- start 2024-09-10T23:49:29.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 -- start start 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f467cff9640 1 -- 172.21.15.16:0/681201839 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f466803bbf0 con 0x7f46801087d0 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51b30a0 0x5590c51b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51bf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51bf950 0x5590c51c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5590c5129e50 con 0x5590c51b39c0 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5590c5119280 con 0x5590c51bf950 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.129+0000 7f46876be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5590c511d090 con 0x5590c51b30a0 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51bf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35434/0 (socket says 172.21.15.16:35434) 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 -- 172.21.15.16:0/739960702 learned_addr learned my addr 172.21.15.16:0/739960702 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f4677fff640 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51bf950 0x5590c51c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467f7fe640 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51b30a0 0x5590c51b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 -- 172.21.15.16:0/739960702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51b30a0 msgr2=0x5590c51b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51b30a0 0x5590c51b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 -- 172.21.15.16:0/739960702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51bf950 msgr2=0x5590c51c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51bf950 0x5590c51c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 -- 172.21.15.16:0/739960702 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c4e77650 con 0x5590c51b39c0 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467f7fe640 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51b30a0 0x5590c51b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467effd640 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51bf410 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f467000b760 tx=0x7f467000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521d0de71a849499 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467cff9640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f466c0b54d0 0x7f466c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f46757fa640 1 -- 172.21.15.16:0/739960702 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670003dd0 con 0x5590c51b39c0 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f46757fa640 1 -- 172.21.15.16:0/739960702 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4670015070 con 0x5590c51b39c0 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f46757fa640 1 -- 172.21.15.16:0/739960702 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670004e00 con 0x5590c51b39c0 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.130+0000 7f467f7fe640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f466c0b54d0 0x7f466c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f467cff9640 1 -- 172.21.15.16:0/681201839 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7f4668106ab0 con 0x7f46801087d0 2024-09-10T23:49:29.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 -- 172.21.15.16:0/739960702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 msgr2=0x5590c51bf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51bf410 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f467000b760 tx=0x7f467000bc20 comp rx=0 tx=0).stop 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f467f7fe640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f466c0b54d0 0x7f466c0b7990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4678007470 tx=0x7f4678007400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 -- 172.21.15.16:0/739960702 shutdown_connections 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51bf950 0x5590c51c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51bf410 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 --2- 172.21.15.16:0/739960702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51b30a0 0x5590c51b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 -- 172.21.15.16:0/739960702 >> 172.21.15.16:0/739960702 conn(0x5590c51b0ed0 msgr2=0x5590c51b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 -- 172.21.15.16:0/739960702 shutdown_connections 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.131+0000 7f46876be740 1 -- 172.21.15.16:0/739960702 wait complete. 2024-09-10T23:49:29.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 -- start start 2024-09-10T23:49:29.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 Processor -- start 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b30a0 0x5590c51bf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b39c0 0x5590c51bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51bccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5590c4f7a700 con 0x5590c51b30a0 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5590c50b4110 con 0x5590c51b39c0 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5590c51c25d0 con 0x5590c51bf950 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f46876be740 10 client.0 _ll_register_callbacks cb 0x5590c50cd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f467effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b30a0 0x5590c51bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f467effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b30a0 0x5590c51bf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35446/0 (socket says 172.21.15.16:35446) 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.132+0000 7f467effd640 1 -- 172.21.15.16:0/3587236199 learned_addr learned my addr 172.21.15.16:0/3587236199 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467f7fe640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51bccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f4677fff640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b39c0 0x5590c51bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467effd640 1 -- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 msgr2=0x5590c51bccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467effd640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51bccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467effd640 1 -- 172.21.15.16:0/3587236199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b39c0 msgr2=0x5590c51bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467effd640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b39c0 0x5590c51bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467effd640 1 -- 172.21.15.16:0/3587236199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c50e1c40 con 0x5590c51b30a0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467f7fe640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51bccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f4677fff640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b39c0 0x5590c51bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f467effd640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b30a0 0x5590c51bf250 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4670005d30 tx=0x7f4670004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fc08c33359acf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f46667fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f46667fc640 1 -- 172.21.15.16:0/3587236199 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670003f20 con 0x5590c51b30a0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f46667fc640 1 -- 172.21.15.16:0/3587236199 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7f4670011440 con 0x5590c51b30a0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4670015070 con 0x5590c51b30a0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f46667fc640 1 -- 172.21.15.16:0/3587236199 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4670011640 con 0x5590c51b30a0 2024-09-10T23:49:29.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f46876be740 10 client.17184 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.133+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5590c51cdf50 con 0x5590c51b30a0 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46667fc640 1 -- 172.21.15.16:0/3587236199 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4670015070 con 0x5590c51b30a0 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46667fc640 1 -- 172.21.15.16:0/3587236199 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4670025850 con 0x5590c51b30a0 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46876be740 10 client.17184 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46876be740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46876be740 20 client.17184 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46876be740 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c51cf350 0x5590c51d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46876be740 4 client.17184 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590c512bda0 con 0x5590c51cf350 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.134+0000 7f4677fff640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c51cf350 0x5590c51d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.135+0000 7f4677fff640 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c51cf350 0x5590c51d1740 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d4ce85b533a360 server_cookie=cffa703a45d5c63c in_seq=0 out_seq=0 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.135+0000 7f46667fc640 10 client.17184 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:29.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.135+0000 7f46667fc640 1 -- 172.21.15.16:0/3587236199 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590c512bda0 con 0x5590c51cf350 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.135+0000 7f46667fc640 10 client.17184 handle_command_reply: tid=0 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.135+0000 7f46876be740 1 client.17184 shutdown 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.135+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b30a0 msgr2=0x5590c51bf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.135+0000 7f46876be740 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b30a0 0x5590c51bf250 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4670005d30 tx=0x7f4670004a80 comp rx=0 tx=0).stop 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 shutdown_connections 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c51cf350 0x5590c51d1740 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51bccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b39c0 0x5590c51bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46667fc640 0 client.17184 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 --2- 172.21.15.16:0/3587236199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b30a0 0x5590c51bf250 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 >> 172.21.15.16:0/3587236199 conn(0x5590c51b0ed0 msgr2=0x5590c51b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 shutdown_connections 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 1 -- 172.21.15.16:0/3587236199 wait complete. 2024-09-10T23:49:29.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.136+0000 7f46876be740 20 client.17184 trim_cache size 0 max 16384 2024-09-10T23:49:29.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.153+0000 7f46876be740 1 Processor -- start 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.153+0000 7f46876be740 1 -- start start 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f46876be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f46876be740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f46876be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f46876be740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f46801b0e50 con 0x5590c51b39c0 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f46876be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f46801ae720 con 0x5590c51b30a0 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f46876be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46801ac590 con 0x5590c51bf950 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35462/0 (socket says 172.21.15.16:35462) 2024-09-10T23:49:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 -- 172.21.15.16:0/3582572592 learned_addr learned my addr 172.21.15.16:0/3582572592 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f467effd640 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 -- 172.21.15.16:0/3582572592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 msgr2=0x5590c51c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f467f7fe640 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 -- 172.21.15.16:0/3582572592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 msgr2=0x5590c51b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 -- 172.21.15.16:0/3582572592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c51baba0 con 0x5590c51b39c0 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f467effd640 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f467f7fe640 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4677fff640 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51b22c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4668006010 tx=0x7f46680045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce54431a42b517a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.154+0000 7f4674ff9640 1 -- 172.21.15.16:0/3582572592 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668049040 con 0x5590c51b39c0 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f4674ff9640 1 -- 172.21.15.16:0/3582572592 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46680cca70 con 0x5590c51b39c0 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f4674ff9640 1 -- 172.21.15.16:0/3582572592 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46680c91d0 con 0x5590c51b39c0 2024-09-10T23:49:29.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 -- 172.21.15.16:0/3582572592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 msgr2=0x5590c51b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51b22c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4668006010 tx=0x7f46680045a0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 -- 172.21.15.16:0/3582572592 shutdown_connections 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51b22c0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 --2- 172.21.15.16:0/3582572592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 -- 172.21.15.16:0/3582572592 >> 172.21.15.16:0/3582572592 conn(0x5590c51b0ed0 msgr2=0x5590c51b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 -- 172.21.15.16:0/3582572592 shutdown_connections 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.155+0000 7f46876be740 1 -- 172.21.15.16:0/3582572592 wait complete. 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 -- start start 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 Processor -- start 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51c8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f46801acbe0 con 0x5590c51b39c0 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f46801ae050 con 0x5590c51b30a0 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46801ad2b0 con 0x5590c51bf950 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f46876be740 10 client.0 _ll_register_callbacks cb 0x7f4670004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f4677fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f4677fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35470/0 (socket says 172.21.15.16:35470) 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f4677fff640 1 -- 172.21.15.16:0/1153897742 learned_addr learned my addr 172.21.15.16:0/1153897742 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f467effd640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.156+0000 7f467f7fe640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f4677fff640 1 -- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 msgr2=0x5590c51c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f4677fff640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f4677fff640 1 -- 172.21.15.16:0/1153897742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 msgr2=0x5590c51c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f4677fff640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f4677fff640 1 -- 172.21.15.16:0/1153897742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c51c3080 con 0x5590c51b39c0 2024-09-10T23:49:29.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f467f7fe640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f4677fff640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51c8070 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f46680c9530 tx=0x7f46681046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec37fb00eddbfec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46667fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46667fc640 1 -- 172.21.15.16:0/1153897742 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668049040 con 0x5590c51b39c0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46667fc640 1 -- 172.21.15.16:0/1153897742 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7f46680cd1c0 con 0x5590c51b39c0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46680cca70 con 0x5590c51b39c0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46667fc640 1 -- 172.21.15.16:0/1153897742 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f46680d1a40 con 0x5590c51b39c0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46876be740 10 client.17190 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5590c523cb50 con 0x5590c51b39c0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46667fc640 1 -- 172.21.15.16:0/1153897742 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46680cca70 con 0x5590c51b39c0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.157+0000 7f46667fc640 1 -- 172.21.15.16:0/1153897742 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f46680d6060 con 0x5590c51b39c0 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f46876be740 10 client.17190 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f46876be740 10 client.17190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f46876be740 20 client.17190 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:29.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f46876be740 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c523d100 0x5590c523f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:29.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f46876be740 4 client.17190 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:49:29.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5590c5127850 con 0x5590c523d100 2024-09-10T23:49:29.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f467effd640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c523d100 0x5590c523f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f46667fc640 10 client.17190 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.158+0000 7f467effd640 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c523d100 0x5590c523f520 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc6ae85ccbd1e268 server_cookie=f93e94e2924ac2c5 in_seq=0 out_seq=0 2024-09-10T23:49:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46667fc640 1 -- 172.21.15.16:0/1153897742 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x5590c5127850 con 0x5590c523d100 2024-09-10T23:49:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46667fc640 10 client.17190 handle_command_reply: tid=0 2024-09-10T23:49:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 client.17190 shutdown 2024-09-10T23:49:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 msgr2=0x5590c51c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51c8070 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f46680c9530 tx=0x7f46681046c0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 shutdown_connections 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5590c523d100 0x5590c523f520 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5590c51bf950 0x5590c51c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c51b39c0 0x5590c51c8070 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 --2- 172.21.15.16:0/1153897742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590c51b30a0 0x5590c51c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 >> 172.21.15.16:0/1153897742 conn(0x5590c51b0ed0 msgr2=0x5590c51b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46667fc640 0 client.17190 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 shutdown_connections 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 1 -- 172.21.15.16:0/1153897742 wait complete. 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.159+0000 7f46876be740 20 client.17190 trim_cache size 0 max 16384 2024-09-10T23:49:29.165 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "14ec25e9-6e3c-4668-8e31-7445d91560fb": { 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:55.907798+0000", 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:49:29.166 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.168 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:49:29.169 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.170 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.171 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.172 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "dc39dd20-224e-45cc-87b8-22db618aa261": { 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:13.371560+0000", 2024-09-10T23:49:29.173 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:29.175 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:49:29.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:49:29.176 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:49:29.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f466c0b54d0 msgr2=0x7f466c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f466c0b54d0 0x7f466c0b7990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4678007470 tx=0x7f4678007400 comp rx=0 tx=0).stop 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 msgr2=0x7f4680199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680199760 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4668005940 tx=0x7f46680042f0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 shutdown_connections 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f466c0b54d0 0x7f466c0b7990 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4680109150 0x7f468019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46801087d0 0x7f4680199760 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 --2- 172.21.15.16:0/681201839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4680102dc0 0x7f4680199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 >> 172.21.15.16:0/681201839 conn(0x7f46800fe830 msgr2=0x7f4680100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 shutdown_connections 2024-09-10T23:49:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:29.160+0000 7f46852e9640 1 -- 172.21.15.16:0/681201839 wait complete. 2024-09-10T23:49:30.243 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:49:30.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:49:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:30 smithi016 ceph-mon[30855]: pgmap v604: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:49:30.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:30 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:30 smithi071 ceph-mon[35018]: pgmap v604: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:49:30.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:30 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:30.548 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:30.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:30 smithi066 ceph-mon[34761]: pgmap v604: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:49:30.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:30 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:31.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.135+0000 7f500aedb640 1 -- 172.21.15.16:0/1431042365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004108020 msgr2=0x7f500410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.135+0000 7f500aedb640 1 --2- 172.21.15.16:0/1431042365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004108020 0x7f500410e820 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009ca0 tx=0x7f4ffc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- 172.21.15.16:0/1431042365 shutdown_connections 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 --2- 172.21.15.16:0/1431042365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004108020 0x7f500410e820 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 --2- 172.21.15.16:0/1431042365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50041076a0 0x7f5004107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 --2- 172.21.15.16:0/1431042365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5004101c90 0x7f5004102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- 172.21.15.16:0/1431042365 >> 172.21.15.16:0/1431042365 conn(0x7f50040fd6e0 msgr2=0x7f50040ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- 172.21.15.16:0/1431042365 shutdown_connections 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- 172.21.15.16:0/1431042365 wait complete. 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 Processor -- start 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- start start 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004101c90 0x7f5004199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50041076a0 0x7f50041997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5004108020 0x7f500419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5004112de0 con 0x7f5004101c90 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5004112c60 con 0x7f50041076a0 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.136+0000 7f500aedb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5004112f60 con 0x7f5004108020 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004101c90 0x7f5004199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004101c90 0x7f5004199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35492/0 (socket says 172.21.15.16:35492) 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 -- 172.21.15.16:0/2177014512 learned_addr learned my addr 172.21.15.16:0/2177014512 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5003fff640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50041076a0 0x7f50041997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5009478640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5004108020 0x7f500419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 -- 172.21.15.16:0/2177014512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5004108020 msgr2=0x7f500419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5004108020 0x7f500419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 -- 172.21.15.16:0/2177014512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50041076a0 msgr2=0x7f50041997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50041076a0 0x7f50041997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 -- 172.21.15.16:0/2177014512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500419f320 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5009478640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5004108020 0x7f500419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5008c77640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004101c90 0x7f5004199270 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800e9f0 tx=0x7f4ff800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5001ffb640 1 -- 172.21.15.16:0/2177014512 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800cd80 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500419f610 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5001ffb640 1 -- 172.21.15.16:0/2177014512 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff80054d0 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f5001ffb640 1 -- 172.21.15.16:0/2177014512 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8010690 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.137+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50041a5cd0 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.138+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5004102070 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.140+0000 7f5001ffb640 1 -- 172.21.15.16:0/2177014512 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4ff8004e90 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.140+0000 7f5001ffb640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b5450 0x7f4ff40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.141+0000 7f5001ffb640 1 -- 172.21.15.16:0/2177014512 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7f4ff80e64d0 con 0x7f5004101c90 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.141+0000 7f5003fff640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b5450 0x7f4ff40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:31.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.141+0000 7f5003fff640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b5450 0x7f4ff40b7910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5004100f40 tx=0x7f4ff000a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:31.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.145+0000 7f5001ffb640 1 -- 172.21.15.16:0/2177014512 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4ff80ad020 con 0x7f5004101c90 2024-09-10T23:49:31.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.367+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f500402e5c0 con 0x7f5004101c90 2024-09-10T23:49:31.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:31.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:31.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:49:31.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.368+0000 7f5001ffb640 1 -- 172.21.15.16:0/2177014512 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f4ff80ac920 con 0x7f5004101c90 2024-09-10T23:49:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:49:31.370 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:49:31.370 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:49:31.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.370+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b5450 msgr2=0x7f4ff40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.370+0000 7f500aedb640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b5450 0x7f4ff40b7910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5004100f40 tx=0x7f4ff000a250 comp rx=0 tx=0).stop 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.370+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004101c90 msgr2=0x7f5004199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.370+0000 7f500aedb640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004101c90 0x7f5004199270 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800e9f0 tx=0x7f4ff800edf0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 shutdown_connections 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5004108020 0x7f500419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4ff40b5450 0x7f4ff40b7910 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50041076a0 0x7f50041997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 --2- 172.21.15.16:0/2177014512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5004101c90 0x7f5004199270 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 >> 172.21.15.16:0/2177014512 conn(0x7f50040fd6e0 msgr2=0x7f50040ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 shutdown_connections 2024-09-10T23:49:31.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:31.371+0000 7f500aedb640 1 -- 172.21.15.16:0/2177014512 wait complete. 2024-09-10T23:49:31.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:31.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:31.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:49:31.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:31.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:31.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:49:32.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:49:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:32.464 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:32 smithi016 ceph-mon[30855]: pgmap v605: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:49:32.464 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:32 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2177014512' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:49:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:32 smithi071 ceph-mon[35018]: pgmap v605: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:49:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:32 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2177014512' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:49:32.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:32 smithi066 ceph-mon[34761]: pgmap v605: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:49:32.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:32 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2177014512' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 -- 172.21.15.16:0/3148513519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad7010d100 msgr2=0x7fad7010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 --2- 172.21.15.16:0/3148513519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad7010d100 0x7fad7010f560 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fad60009900 tx=0x7fad6002a410 comp rx=0 tx=0).stop 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 -- 172.21.15.16:0/3148513519 shutdown_connections 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 --2- 172.21.15.16:0/3148513519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad7010d100 0x7fad7010f560 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 --2- 172.21.15.16:0/3148513519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad701045c0 0x7fad7010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 --2- 172.21.15.16:0/3148513519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad70103ca0 0x7fad70104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 -- 172.21.15.16:0/3148513519 >> 172.21.15.16:0/3148513519 conn(0x7fad700fd700 msgr2=0x7fad700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 -- 172.21.15.16:0/3148513519 shutdown_connections 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 -- 172.21.15.16:0/3148513519 wait complete. 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 Processor -- start 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 -- start start 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad70103ca0 0x7fad70199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad701045c0 0x7fad701997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.954+0000 7fad76dde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad7010d100 0x7fad7019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad76dde640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad70112d70 con 0x7fad701045c0 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad76dde640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad70112bf0 con 0x7fad7010d100 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad76dde640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad70112ef0 con 0x7fad70103ca0 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad701045c0 0x7fad701997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad701045c0 0x7fad701997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35512/0 (socket says 172.21.15.16:35512) 2024-09-10T23:49:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 -- 172.21.15.16:0/4015209696 learned_addr learned my addr 172.21.15.16:0/4015209696 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad74b7a640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad70103ca0 0x7fad70199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad7537b640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad7010d100 0x7fad7019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 -- 172.21.15.16:0/4015209696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad70103ca0 msgr2=0x7fad70199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad70103ca0 0x7fad70199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 -- 172.21.15.16:0/4015209696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad7010d100 msgr2=0x7fad7019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad7010d100 0x7fad7019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 -- 172.21.15.16:0/4015209696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7019f310 con 0x7fad701045c0 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad7537b640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad7010d100 0x7fad7019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad74b7a640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad70103ca0 0x7fad70199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6ffff640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad701045c0 0x7fad701997a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fad5800d740 tx=0x7fad5800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6dffb640 1 -- 172.21.15.16:0/4015209696 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58017020 con 0x7fad701045c0 2024-09-10T23:49:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6dffb640 1 -- 172.21.15.16:0/4015209696 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad5800de50 con 0x7fad701045c0 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7019f600 con 0x7fad701045c0 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.955+0000 7fad6dffb640 1 -- 172.21.15.16:0/4015209696 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5800f620 con 0x7fad701045c0 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.956+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad701a5cc0 con 0x7fad701045c0 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 Processor -- start 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad6dffb640 1 -- 172.21.15.16:0/4015209696 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fad58010460 con 0x7fad701045c0 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 -- start start 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9db4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a25c951ea0 con 0x55a25c9e79a0 2024-09-10T23:49:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a25c9412d0 con 0x55a25c9db0f0 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.958+0000 7fad791b3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a25c9450e0 con 0x55a25c9dba10 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35524/0 (socket says 172.21.15.16:35524) 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 -- 172.21.15.16:0/4134443918 learned_addr learned my addr 172.21.15.16:0/4134443918 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad7537b640 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9db4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad74b7a640 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 -- 172.21.15.16:0/4134443918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 msgr2=0x55a25c9e7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 -- 172.21.15.16:0/4134443918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 msgr2=0x55a25c9db4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9db4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 -- 172.21.15.16:0/4134443918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25c69f650 con 0x55a25c9e79a0 2024-09-10T23:49:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6dffb640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad7537b640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6ffff640 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e9d90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fad580e3810 tx=0x7fad580ee910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a4a579824766a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.959+0000 7fad6dffb640 1 -- 172.21.15.16:0/4015209696 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7fad580e6120 con 0x7fad701045c0 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad66ffd640 1 -- 172.21.15.16:0/4134443918 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad580a8c20 con 0x55a25c9e79a0 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad66ffd640 1 -- 172.21.15.16:0/4134443918 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad580ac0e0 con 0x55a25c9e79a0 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad66ffd640 1 -- 172.21.15.16:0/4134443918 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad580abd40 con 0x55a25c9e79a0 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 -- 172.21.15.16:0/4134443918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 msgr2=0x55a25c9e9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad7537b640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad60005940 tx=0x7fad600058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e9d90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fad580e3810 tx=0x7fad580ee910 comp rx=0 tx=0).stop 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 -- 172.21.15.16:0/4134443918 shutdown_connections 2024-09-10T23:49:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e9d90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 --2- 172.21.15.16:0/4134443918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9db4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 -- 172.21.15.16:0/4134443918 >> 172.21.15.16:0/4134443918 conn(0x55a25c9d8f20 msgr2=0x55a25c9da0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 -- 172.21.15.16:0/4134443918 shutdown_connections 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.960+0000 7fad791b3740 1 -- 172.21.15.16:0/4134443918 wait complete. 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 -- start start 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 Processor -- start 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9e7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a25c7a2700 con 0x55a25c9e79a0 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a25c8dc160 con 0x55a25c9db0f0 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a25c9ea620 con 0x55a25c9dba10 2024-09-10T23:49:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad791b3740 10 client.0 _ll_register_callbacks cb 0x55a25c8f59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad7537b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad7537b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35530/0 (socket says 172.21.15.16:35530) 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.961+0000 7fad7537b640 1 -- 172.21.15.16:0/13463473 learned_addr learned my addr 172.21.15.16:0/13463473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad74b7a640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad6ffff640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad7537b640 1 -- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 msgr2=0x55a25c9e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad7537b640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad7537b640 1 -- 172.21.15.16:0/13463473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 msgr2=0x55a25c9e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad7537b640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9e7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad7537b640 1 -- 172.21.15.16:0/13463473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a25c909c90 con 0x55a25c9e79a0 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad6ffff640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad7537b640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e4de0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fad60033000 tx=0x7fad60009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f318d8cbfc42e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad4ffff640 1 -- 172.21.15.16:0/13463473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6004c070 con 0x55a25c9e79a0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad4ffff640 1 -- 172.21.15.16:0/13463473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7fad60005460 con 0x55a25c9e79a0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad580ac0e0 con 0x55a25c9e79a0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad4ffff640 1 -- 172.21.15.16:0/13463473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad60058050 con 0x55a25c9e79a0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad791b3740 10 client.17208 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.962+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a25c9f6000 con 0x55a25c9e79a0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad4ffff640 1 -- 172.21.15.16:0/13463473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad580ac0e0 con 0x55a25c9e79a0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad4ffff640 1 -- 172.21.15.16:0/13463473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad60003710 con 0x55a25c9e79a0 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad791b3740 10 client.17208 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad791b3740 10 client.17208 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad791b3740 20 client.17208 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad791b3740 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25c9f7480 0x55a25c9f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad791b3740 4 client.17208 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:49:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a25c953df0 con 0x55a25c9f7480 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.963+0000 7fad74b7a640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25c9f7480 0x55a25c9f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad74b7a640 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25c9f7480 0x55a25c9f98e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ec996184e14b049 server_cookie=29816914382e49a7 in_seq=0 out_seq=0 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad4ffff640 10 client.17208 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad4ffff640 1 -- 172.21.15.16:0/13463473 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a25c953df0 con 0x55a25c9f7480 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad4ffff640 10 client.17208 handle_command_reply: tid=0 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 client.17208 shutdown 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 msgr2=0x55a25c9e4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e4de0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fad60033000 tx=0x7fad60009260 comp rx=0 tx=0).stop 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 shutdown_connections 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25c9f7480 0x55a25c9f98e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9e79a0 0x55a25c9e4de0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 --2- 172.21.15.16:0/13463473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9db0f0 0x55a25c9e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad4ffff640 0 client.17208 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:49:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.964+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 >> 172.21.15.16:0/13463473 conn(0x55a25c9d8f20 msgr2=0x55a25c9dea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.965+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 shutdown_connections 2024-09-10T23:49:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.965+0000 7fad791b3740 1 -- 172.21.15.16:0/13463473 wait complete. 2024-09-10T23:49:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.965+0000 7fad791b3740 20 client.17208 trim_cache size 0 max 16384 2024-09-10T23:49:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 Processor -- start 2024-09-10T23:49:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 -- start start 2024-09-10T23:49:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9db0f0 0x55a25c9f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 0x55a25c9e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad701b0ff0 con 0x55a25c9db0f0 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad701ae8c0 con 0x55a25c9e79a0 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad791b3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad701ac730 con 0x55a25c9dba10 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad74b7a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9db0f0 0x55a25c9f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad74b7a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9db0f0 0x55a25c9f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35542/0 (socket says 172.21.15.16:35542) 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.978+0000 7fad74b7a640 1 -- 172.21.15.16:0/736197102 learned_addr learned my addr 172.21.15.16:0/736197102 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad74b7a640 1 -- 172.21.15.16:0/736197102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 msgr2=0x55a25c9e64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad74b7a640 1 --2- 172.21.15.16:0/736197102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad74b7a640 1 -- 172.21.15.16:0/736197102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 msgr2=0x55a25c9e8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad74b7a640 1 --2- 172.21.15.16:0/736197102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 0x55a25c9e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad74b7a640 1 -- 172.21.15.16:0/736197102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25c9e2c60 con 0x55a25c9db0f0 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad74b7a640 1 --2- 172.21.15.16:0/736197102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9db0f0 0x55a25c9f3880 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x55a25c9fa1a0 tx=0x7fad68014e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a770815cfb2cef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad667fc640 1 -- 172.21.15.16:0/736197102 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68022040 con 0x55a25c9db0f0 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad667fc640 1 -- 172.21.15.16:0/736197102 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad68004d20 con 0x55a25c9db0f0 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.979+0000 7fad667fc640 1 -- 172.21.15.16:0/736197102 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68005760 con 0x55a25c9db0f0 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 -- 172.21.15.16:0/736197102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9db0f0 msgr2=0x55a25c9f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 --2- 172.21.15.16:0/736197102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9db0f0 0x55a25c9f3880 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x55a25c9fa1a0 tx=0x7fad68014e10 comp rx=0 tx=0).stop 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 -- 172.21.15.16:0/736197102 shutdown_connections 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 --2- 172.21.15.16:0/736197102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 0x55a25c9e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 --2- 172.21.15.16:0/736197102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9dba10 0x55a25c9e64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 --2- 172.21.15.16:0/736197102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9db0f0 0x55a25c9f3880 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 -- 172.21.15.16:0/736197102 >> 172.21.15.16:0/736197102 conn(0x55a25c9d8f20 msgr2=0x55a25c9e5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 -- 172.21.15.16:0/736197102 shutdown_connections 2024-09-10T23:49:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 -- 172.21.15.16:0/736197102 wait complete. 2024-09-10T23:49:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 -- start start 2024-09-10T23:49:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.980+0000 7fad791b3740 1 Processor -- start 2024-09-10T23:49:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9db0f0 0x55a25c9f0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9dba10 0x55a25c9ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 0x55a25c9eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad701acd80 con 0x55a25c9dba10 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad701ae1f0 con 0x55a25c9e79a0 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad701ad450 con 0x55a25c9db0f0 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 10 client.0 _ll_register_callbacks cb 0x7fad60031910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9dba10 0x55a25c9ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9dba10 0x55a25c9ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35554/0 (socket says 172.21.15.16:35554) 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 -- 172.21.15.16:0/3554755117 learned_addr learned my addr 172.21.15.16:0/3554755117 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad74b7a640 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9db0f0 0x55a25c9f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 -- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9db0f0 msgr2=0x55a25c9f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9db0f0 0x55a25c9f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 -- 172.21.15.16:0/3554755117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 msgr2=0x55a25c9eaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad7537b640 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 0x55a25c9eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 0x55a25c9eaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 -- 172.21.15.16:0/3554755117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a25ca64400 con 0x55a25c9dba10 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad6ffff640 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9dba10 0x55a25c9ea8a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fad580ac2d0 tx=0x7fad580e9c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3fc354e1654ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad4ffff640 1 -- 172.21.15.16:0/3554755117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad580abf20 con 0x55a25c9dba10 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad4ffff640 1 -- 172.21.15.16:0/3554755117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7fad58010780 con 0x55a25c9dba10 2024-09-10T23:49:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.981+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad68004d20 con 0x55a25c9dba10 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad4ffff640 1 -- 172.21.15.16:0/3554755117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad580ac3a0 con 0x55a25c9dba10 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 10 client.17214 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a25ca65690 con 0x55a25c9dba10 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad4ffff640 1 -- 172.21.15.16:0/3554755117 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad68004d20 con 0x55a25c9dba10 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad4ffff640 1 -- 172.21.15.16:0/3554755117 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad580192c0 con 0x55a25c9dba10 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 10 client.17214 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 10 client.17214 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 20 client.17214 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25ca659d0 0x55a25ca67dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 4 client.17214 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.982+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a25c94f8a0 con 0x55a25ca659d0 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad74b7a640 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25ca659d0 0x55a25ca67dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad4ffff640 10 client.17214 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:49:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad74b7a640 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25ca659d0 0x55a25ca67dc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a72c31e270500ba4 server_cookie=7eabcca98765f152 in_seq=0 out_seq=0 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad4ffff640 1 -- 172.21.15.16:0/3554755117 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a25c94f8a0 con 0x55a25ca659d0 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad4ffff640 10 client.17214 handle_command_reply: tid=0 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 client.17214 shutdown 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9dba10 msgr2=0x55a25c9ea8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9dba10 0x55a25c9ea8a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fad580ac2d0 tx=0x7fad580e9c70 comp rx=0 tx=0).stop 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 shutdown_connections 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a25ca659d0 0x55a25ca67dc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a25c9e79a0 0x55a25c9eaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a25c9dba10 0x55a25c9ea8a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 --2- 172.21.15.16:0/3554755117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a25c9db0f0 0x55a25c9f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad4ffff640 0 client.17214 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:49:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.983+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 >> 172.21.15.16:0/3554755117 conn(0x55a25c9d8f20 msgr2=0x55a25c9e65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 shutdown_connections 2024-09-10T23:49:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad791b3740 1 -- 172.21.15.16:0/3554755117 wait complete. 2024-09-10T23:49:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad791b3740 20 client.17214 trim_cache size 0 max 16384 2024-09-10T23:49:32.992 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 msgr2=0x7fad5c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad60005940 tx=0x7fad600058b0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad701045c0 msgr2=0x7fad701997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad701045c0 0x7fad701997a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fad5800d740 tx=0x7fad5800dc00 comp rx=0 tx=0).stop 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 shutdown_connections 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fad5c0b5450 0x7fad5c0b7910 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad7010d100 0x7fad7019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad701045c0 0x7fad701997a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 --2- 172.21.15.16:0/4015209696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad70103ca0 0x7fad70199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.984+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 >> 172.21.15.16:0/4015209696 conn(0x7fad700fd700 msgr2=0x7fad7010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.985+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 shutdown_connections 2024-09-10T23:49:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:32.985+0000 7fad76dde640 1 -- 172.21.15.16:0/4015209696 wait complete. 2024-09-10T23:49:33.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:49:33.983 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:34 smithi016 ceph-mon[30855]: pgmap v606: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:49:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:34 smithi071 ceph-mon[35018]: pgmap v606: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:49:34.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:34 smithi066 ceph-mon[34761]: pgmap v606: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:49:34.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 -- 172.21.15.16:0/1030814009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040104550 msgr2=0x7ff04010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1030814009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040104550 0x7ff04010cb30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff028009900 tx=0x7ff02802a410 comp rx=0 tx=0).stop 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 -- 172.21.15.16:0/1030814009 shutdown_connections 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1030814009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04010d100 0x7ff04010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1030814009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040104550 0x7ff04010cb30 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1030814009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040103b50 0x7ff040103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 -- 172.21.15.16:0/1030814009 >> 172.21.15.16:0/1030814009 conn(0x7ff0400fd700 msgr2=0x7ff0400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 -- 172.21.15.16:0/1030814009 shutdown_connections 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 -- 172.21.15.16:0/1030814009 wait complete. 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.570+0000 7ff0452ae640 1 Processor -- start 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff0452ae640 1 -- start start 2024-09-10T23:49:34.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff0452ae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040103b50 0x7ff0401992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff0452ae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040104550 0x7ff0401997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff0452ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04010d100 0x7ff04019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff0452ae640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff040112d60 con 0x7ff040103b50 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff0452ae640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff040112be0 con 0x7ff04010d100 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff0452ae640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff040112ee0 con 0x7ff040104550 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040103b50 0x7ff0401992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040103b50 0x7ff0401992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52920/0 (socket says 172.21.15.16:52920) 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 -- 172.21.15.16:0/1225632688 learned_addr learned my addr 172.21.15.16:0/1225632688 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040104550 0x7ff0401997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 -- 172.21.15.16:0/1225632688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040104550 msgr2=0x7ff0401997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040104550 0x7ff0401997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 -- 172.21.15.16:0/1225632688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04010d100 msgr2=0x7ff04019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04010d100 0x7ff04019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04010d100 0x7ff04019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 -- 172.21.15.16:0/1225632688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04019f360 con 0x7ff040103b50 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04010d100 0x7ff04019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.571+0000 7ff03effd640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040103b50 0x7ff0401992b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff03000d770 tx=0x7ff03000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.572+0000 7ff037fff640 1 -- 172.21.15.16:0/1225632688 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030017070 con 0x7ff040103b50 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.572+0000 7ff037fff640 1 -- 172.21.15.16:0/1225632688 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0300054d0 con 0x7ff040103b50 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.572+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04019f650 con 0x7ff040103b50 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.572+0000 7ff037fff640 1 -- 172.21.15.16:0/1225632688 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030004c30 con 0x7ff040103b50 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.572+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0401a5d10 con 0x7ff040103b50 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.574+0000 7ff047683740 1 Processor -- start 2024-09-10T23:49:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.574+0000 7ff047683740 1 -- start start 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.574+0000 7ff037fff640 1 -- 172.21.15.16:0/1225632688 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff030004e10 con 0x7ff040103b50 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff047683740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3a4d0 0x562ef4b3a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff047683740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b46840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff047683740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b49170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff047683740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562ef4ab0ea0 con 0x562ef4b46d80 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff047683740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562ef4aa02d0 con 0x562ef4b3a4d0 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff047683740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ef4aa40e0 con 0x562ef4b3adf0 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b49170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b49170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52922/0 (socket says 172.21.15.16:52922) 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 -- 172.21.15.16:0/397117306 learned_addr learned my addr 172.21.15.16:0/397117306 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3a4d0 0x562ef4b3a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03effd640 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b46840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 -- 172.21.15.16:0/397117306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 msgr2=0x562ef4b46840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b46840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 -- 172.21.15.16:0/397117306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3a4d0 msgr2=0x562ef4b3a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3a4d0 0x562ef4b3a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.575+0000 7ff03e7fc640 1 -- 172.21.15.16:0/397117306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef47fe650 con 0x562ef4b46d80 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.576+0000 7ff037fff640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff02c0b5450 0x7ff02c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.576+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b49170 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff028009900 tx=0x7ff028032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d494ab0d8684c4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.576+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff02c0b5450 0x7ff02c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.576+0000 7ff0357fa640 1 -- 172.21.15.16:0/397117306 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028040070 con 0x562ef4b46d80 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.576+0000 7ff037fff640 1 -- 172.21.15.16:0/1225632688 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7ff0300e5ab0 con 0x7ff040103b50 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.576+0000 7ff0357fa640 1 -- 172.21.15.16:0/397117306 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff028004030 con 0x562ef4b46d80 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.576+0000 7ff0357fa640 1 -- 172.21.15.16:0/397117306 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028035040 con 0x562ef4b46d80 2024-09-10T23:49:34.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- 172.21.15.16:0/397117306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 msgr2=0x562ef4b49170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff02c0b5450 0x7ff02c0b7910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff038005fd0 tx=0x7ff038009790 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b49170 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff028009900 tx=0x7ff028032bd0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- 172.21.15.16:0/397117306 shutdown_connections 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b49170 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b46840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 --2- 172.21.15.16:0/397117306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3a4d0 0x562ef4b3a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- 172.21.15.16:0/397117306 >> 172.21.15.16:0/397117306 conn(0x562ef4b38300 msgr2=0x562ef4b394a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- 172.21.15.16:0/397117306 shutdown_connections 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- 172.21.15.16:0/397117306 wait complete. 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- start start 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 Processor -- start 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b3a4d0 0x562ef4b46690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b43ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b46d80 0x562ef4b44110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562ef4901700 con 0x562ef4b3a4d0 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562ef4a3b160 con 0x562ef4b46d80 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.577+0000 7ff047683740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562ef4b499a0 con 0x562ef4b3adf0 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff047683740 10 client.0 _ll_register_callbacks cb 0x562ef4a549e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b3a4d0 0x562ef4b46690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b3a4d0 0x562ef4b46690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52936/0 (socket says 172.21.15.16:52936) 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 -- 172.21.15.16:0/367921913 learned_addr learned my addr 172.21.15.16:0/367921913 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b43ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b46d80 0x562ef4b44110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 -- 172.21.15.16:0/367921913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 msgr2=0x562ef4b43ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b43ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 -- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b46d80 msgr2=0x562ef4b44110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b46d80 0x562ef4b44110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 -- 172.21.15.16:0/367921913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef4a68c90 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff03effd640 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b3a4d0 0x562ef4b46690 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff03000d740 tx=0x7ff0300e91f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ce5b1e2e475eda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff0267fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff0267fc640 1 -- 172.21.15.16:0/367921913 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030020070 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff0267fc640 1 -- 172.21.15.16:0/367921913 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7ff0300930f0 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff028004030 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.578+0000 7ff0267fc640 1 -- 172.21.15.16:0/367921913 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0300ab6d0 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 10 client.17226 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ef4b55300 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff0267fc640 1 -- 172.21.15.16:0/367921913 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0300eb070 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff0267fc640 1 -- 172.21.15.16:0/367921913 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff0300a78b0 con 0x562ef4b3a4d0 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 10 client.17226 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 10 client.17226 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:49:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 20 client.17226 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4b567c0 0x562ef4b58c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 4 client.17226 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ef4ab2df0 con 0x562ef4b567c0 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.579+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4b567c0 0x562ef4b58c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.580+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4b567c0 0x562ef4b58c30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64ce4f2eb6295e96 server_cookie=eeb6ffbfa5c8b2da in_seq=0 out_seq=0 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.580+0000 7ff0267fc640 10 client.17226 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.580+0000 7ff0267fc640 1 -- 172.21.15.16:0/367921913 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ef4ab2df0 con 0x562ef4b567c0 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff0267fc640 10 client.17226 handle_command_reply: tid=0 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 client.17226 shutdown 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b3a4d0 msgr2=0x562ef4b46690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b3a4d0 0x562ef4b46690 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff03000d740 tx=0x7ff0300e91f0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 shutdown_connections 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4b567c0 0x562ef4b58c30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b46d80 0x562ef4b44110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3adf0 0x562ef4b43ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff0267fc640 0 client.17226 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 --2- 172.21.15.16:0/367921913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b3a4d0 0x562ef4b46690 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 >> 172.21.15.16:0/367921913 conn(0x562ef4b38300 msgr2=0x562ef4b3dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 shutdown_connections 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 1 -- 172.21.15.16:0/367921913 wait complete. 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.581+0000 7ff047683740 20 client.17226 trim_cache size 0 max 16384 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 Processor -- start 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 -- start start 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b37c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b48170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b486b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401b0f30 con 0x562ef4b46d80 2024-09-10T23:49:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401ae800 con 0x562ef4b3adf0 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.594+0000 7ff047683740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401ac670 con 0x562ef4b3a4d0 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52942/0 (socket says 172.21.15.16:52942) 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 -- 172.21.15.16:0/222838679 learned_addr learned my addr 172.21.15.16:0/222838679 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b48170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03effd640 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b37c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 -- 172.21.15.16:0/222838679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 msgr2=0x562ef4b37c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b37c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 -- 172.21.15.16:0/222838679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 msgr2=0x562ef4b48170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b48170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 -- 172.21.15.16:0/222838679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef4b44480 con 0x562ef4b46d80 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b486b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff038012950 tx=0x7ff038014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f2ee36b421749d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff034ff9640 1 -- 172.21.15.16:0/222838679 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038003b70 con 0x562ef4b46d80 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff034ff9640 1 -- 172.21.15.16:0/222838679 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff03801fdf0 con 0x562ef4b46d80 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.595+0000 7ff034ff9640 1 -- 172.21.15.16:0/222838679 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038004750 con 0x562ef4b46d80 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 -- 172.21.15.16:0/222838679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 msgr2=0x562ef4b486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b486b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff038012950 tx=0x7ff038014000 comp rx=0 tx=0).stop 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 -- 172.21.15.16:0/222838679 shutdown_connections 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b486b0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b48170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 --2- 172.21.15.16:0/222838679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b37c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 -- 172.21.15.16:0/222838679 >> 172.21.15.16:0/222838679 conn(0x562ef4b38300 msgr2=0x562ef4b42360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 -- 172.21.15.16:0/222838679 shutdown_connections 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 -- 172.21.15.16:0/222838679 wait complete. 2024-09-10T23:49:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 -- start start 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.596+0000 7ff047683740 1 Processor -- start 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff047683740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b49d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff047683740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b4a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff047683740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b4a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff047683740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401accc0 con 0x562ef4b46d80 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff047683740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401ae130 con 0x562ef4b3adf0 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff047683740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401ad390 con 0x562ef4b3a4d0 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff047683740 10 client.0 _ll_register_callbacks cb 0x7ff0300a85b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b4a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b4a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52948/0 (socket says 172.21.15.16:52948) 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 -- 172.21.15.16:0/2716214800 learned_addr learned my addr 172.21.15.16:0/2716214800 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03e7fc640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b4a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03effd640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b49d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 -- 172.21.15.16:0/2716214800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 msgr2=0x562ef4b49d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b49d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 -- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 msgr2=0x562ef4b4a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b4a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 -- 172.21.15.16:0/2716214800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef4bc3950 con 0x562ef4b46d80 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03effd640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b49d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff03f7fe640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b4a800 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff0380042f0 tx=0x7ff038005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ecda69763d8246 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.597+0000 7ff0267fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff0267fc640 1 -- 172.21.15.16:0/2716214800 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038039060 con 0x562ef4b46d80 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff0267fc640 1 -- 172.21.15.16:0/2716214800 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7ff03801fb50 con 0x562ef4b46d80 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff03801fdf0 con 0x562ef4b46d80 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff0267fc640 1 -- 172.21.15.16:0/2716214800 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0380040c0 con 0x562ef4b46d80 2024-09-10T23:49:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 10 client.17232 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ef4bc4c50 con 0x562ef4b46d80 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff0267fc640 1 -- 172.21.15.16:0/2716214800 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff03801fdf0 con 0x562ef4b46d80 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff0267fc640 1 -- 172.21.15.16:0/2716214800 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff03800f040 con 0x562ef4b46d80 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 10 client.17232 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 10 client.17232 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 20 client.17232 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4bc52c0 0x562ef4bc76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 4 client.17232 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ef4aae8a0 con 0x562ef4bc52c0 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.598+0000 7ff03effd640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4bc52c0 0x562ef4bc76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff03effd640 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4bc52c0 0x562ef4bc76e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=50ef36d1ce36b59 server_cookie=f729f5c6eae9b030 in_seq=0 out_seq=0 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff0267fc640 10 client.17232 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff0267fc640 1 -- 172.21.15.16:0/2716214800 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ef4aae8a0 con 0x562ef4bc52c0 2024-09-10T23:49:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff0267fc640 10 client.17232 handle_command_reply: tid=0 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 client.17232 shutdown 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 msgr2=0x562ef4b4a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b4a800 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff0380042f0 tx=0x7ff038005ae0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 shutdown_connections 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x562ef4bc52c0 0x562ef4bc76e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562ef4b46d80 0x562ef4b4a800 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ef4b3adf0 0x562ef4b4a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 --2- 172.21.15.16:0/2716214800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562ef4b3a4d0 0x562ef4b49d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff0267fc640 0 client.17232 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 >> 172.21.15.16:0/2716214800 conn(0x562ef4b38300 msgr2=0x562ef4b45110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 shutdown_connections 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 1 -- 172.21.15.16:0/2716214800 wait complete. 2024-09-10T23:49:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.599+0000 7ff047683740 20 client.17232 trim_cache size 0 max 16384 2024-09-10T23:49:34.620 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:49:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff02c0b5450 msgr2=0x7ff02c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff02c0b5450 0x7ff02c0b7910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff038005fd0 tx=0x7ff038009790 comp rx=0 tx=0).stop 2024-09-10T23:49:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040103b50 msgr2=0x7ff0401992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040103b50 0x7ff0401992b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff03000d770 tx=0x7ff03000dc30 comp rx=0 tx=0).stop 2024-09-10T23:49:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 shutdown_connections 2024-09-10T23:49:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff02c0b5450 0x7ff02c0b7910 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff04010d100 0x7ff04019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040104550 0x7ff0401997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 --2- 172.21.15.16:0/1225632688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff040103b50 0x7ff0401992b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 >> 172.21.15.16:0/1225632688 conn(0x7ff0400fd700 msgr2=0x7ff0400fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 shutdown_connections 2024-09-10T23:49:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:34.600+0000 7ff0452ae640 1 -- 172.21.15.16:0/1225632688 wait complete. 2024-09-10T23:49:35.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:49:35.699 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 -- 172.21.15.16:0/905972425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 msgr2=0x7ff744108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 --2- 172.21.15.16:0/905972425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744108c10 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009900 tx=0x7ff72c02a410 comp rx=0 tx=0).stop 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 -- 172.21.15.16:0/905972425 shutdown_connections 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 --2- 172.21.15.16:0/905972425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff744109150 0x7ff74410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 --2- 172.21.15.16:0/905972425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744108c10 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 --2- 172.21.15.16:0/905972425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff744102dc0 0x7ff7441031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 -- 172.21.15.16:0/905972425 >> 172.21.15.16:0/905972425 conn(0x7ff7440fe830 msgr2=0x7ff744100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 -- 172.21.15.16:0/905972425 shutdown_connections 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 -- 172.21.15.16:0/905972425 wait complete. 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.203+0000 7ff748cfe640 1 Processor -- start 2024-09-10T23:49:36.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff748cfe640 1 -- start start 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff748cfe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff744102dc0 0x7ff7441992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff748cfe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff748cfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff744109150 0x7ff74419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff748cfe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff744112dd0 con 0x7ff7441087d0 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff748cfe640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff744112c50 con 0x7ff744109150 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff748cfe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff744112f50 con 0x7ff744102dc0 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52964/0 (socket says 172.21.15.16:52964) 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 -- 172.21.15.16:0/3774977203 learned_addr learned my addr 172.21.15.16:0/3774977203 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff74259c640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff744102dc0 0x7ff7441992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff742d9d640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff744109150 0x7ff74419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 -- 172.21.15.16:0/3774977203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff744102dc0 msgr2=0x7ff7441992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff744102dc0 0x7ff7441992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 -- 172.21.15.16:0/3774977203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff744109150 msgr2=0x7ff74419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff744109150 0x7ff74419ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.204+0000 7ff739d9b640 1 -- 172.21.15.16:0/3774977203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74419f390 con 0x7ff7441087d0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.205+0000 7ff739d9b640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744199820 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005940 tx=0x7ff72c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.205+0000 7ff73bfff640 1 -- 172.21.15.16:0/3774977203 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c03f030 con 0x7ff7441087d0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.205+0000 7ff73bfff640 1 -- 172.21.15.16:0/3774977203 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff72c003cb0 con 0x7ff7441087d0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.205+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74419f620 con 0x7ff7441087d0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.205+0000 7ff73bfff640 1 -- 172.21.15.16:0/3774977203 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c035070 con 0x7ff7441087d0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.205+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7441a5d40 con 0x7ff7441087d0 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.207+0000 7ff74b0d3740 1 Processor -- start 2024-09-10T23:49:36.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff73bfff640 1 -- 172.21.15.16:0/3774977203 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff72c03bbf0 con 0x7ff7441087d0 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74b0d3740 1 -- start start 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f7294d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f735460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f737d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a12f69fea0 con 0x55a12f7290f0 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a12f68f2d0 con 0x55a12f7359a0 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a12f6930e0 con 0x55a12f729a10 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff742d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f7294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff742d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f7294d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52976/0 (socket says 172.21.15.16:52976) 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff742d9d640 1 -- 172.21.15.16:0/3767083970 learned_addr learned my addr 172.21.15.16:0/3767083970 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:36.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff739d9b640 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f737d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.208+0000 7ff74259c640 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f735460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff742d9d640 1 -- 172.21.15.16:0/3767083970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 msgr2=0x55a12f735460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff742d9d640 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f735460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff742d9d640 1 -- 172.21.15.16:0/3767083970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 msgr2=0x55a12f737d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff742d9d640 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f737d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff742d9d640 1 -- 172.21.15.16:0/3767083970 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12f3ed650 con 0x55a12f7290f0 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff73bfff640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff7300b54d0 0x7ff7300b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff742d9d640 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f7294d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009df0 tx=0x7ff73c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af06b3db05fc526 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff74259c640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff7300b54d0 0x7ff7300b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff738d99640 1 -- 172.21.15.16:0/3767083970 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003970 con 0x55a12f7290f0 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff73bfff640 1 -- 172.21.15.16:0/3774977203 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7ff72c106b60 con 0x7ff7441087d0 2024-09-10T23:49:36.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff738d99640 1 -- 172.21.15.16:0/3767083970 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff73c004030 con 0x55a12f7290f0 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.209+0000 7ff738d99640 1 -- 172.21.15.16:0/3767083970 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011770 con 0x55a12f7290f0 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 -- 172.21.15.16:0/3767083970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 msgr2=0x55a12f7294d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74259c640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff7300b54d0 0x7ff7300b7990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff734005fd0 tx=0x7ff73400b650 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f7294d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009df0 tx=0x7ff73c00f730 comp rx=0 tx=0).stop 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 -- 172.21.15.16:0/3767083970 shutdown_connections 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f737d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f735460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/3767083970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f7294d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 -- 172.21.15.16:0/3767083970 >> 172.21.15.16:0/3767083970 conn(0x55a12f726f20 msgr2=0x55a12f7280c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 -- 172.21.15.16:0/3767083970 shutdown_connections 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 -- 172.21.15.16:0/3767083970 wait complete. 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 -- start start 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.210+0000 7ff74b0d3740 1 Processor -- start 2024-09-10T23:49:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7290f0 0x55a12f735260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f729a10 0x55a12f7326b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7359a0 0x55a12f732c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a12f4f0700 con 0x55a12f7359a0 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a12f62a160 con 0x55a12f729a10 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a12f738620 con 0x55a12f7290f0 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74b0d3740 10 client.0 _ll_register_callbacks cb 0x55a12f6439e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7359a0 0x55a12f732c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7359a0 0x55a12f732c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52978/0 (socket says 172.21.15.16:52978) 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 -- 172.21.15.16:0/584740808 learned_addr learned my addr 172.21.15.16:0/584740808 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff739d9b640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f729a10 0x55a12f7326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74259c640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7290f0 0x55a12f735260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 -- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7290f0 msgr2=0x55a12f735260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7290f0 0x55a12f735260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 -- 172.21.15.16:0/584740808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f729a10 msgr2=0x55a12f7326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f729a10 0x55a12f7326b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 -- 172.21.15.16:0/584740808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12f657c90 con 0x55a12f7359a0 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff739d9b640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f729a10 0x55a12f7326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff74259c640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7290f0 0x55a12f735260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff742d9d640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7359a0 0x55a12f732c90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009b30 tx=0x7ff73c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ffc1d67222367a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.211+0000 7ff729ffb640 1 -- 172.21.15.16:0/584740808 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004d50 con 0x55a12f7359a0 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff729ffb640 1 -- 172.21.15.16:0/584740808 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7ff73c0041e0 con 0x55a12f7359a0 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff73c004030 con 0x55a12f7359a0 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff729ffb640 1 -- 172.21.15.16:0/584740808 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff73c0043e0 con 0x55a12f7359a0 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 10 client.17244 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a12f743f50 con 0x55a12f7359a0 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff729ffb640 1 -- 172.21.15.16:0/584740808 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff73c004030 con 0x55a12f7359a0 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff729ffb640 1 -- 172.21.15.16:0/584740808 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff73c011940 con 0x55a12f7359a0 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 10 client.17244 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 10 client.17244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 20 client.17244 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f745350 0x55a12f747740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 4 client.17244 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.212+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a12f6a1df0 con 0x55a12f745350 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.213+0000 7ff74259c640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f745350 0x55a12f747740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.213+0000 7ff74259c640 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f745350 0x55a12f747740 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b349d3c61ab84e54 server_cookie=c044b05cba1da5f2 in_seq=0 out_seq=0 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.213+0000 7ff729ffb640 10 client.17244 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff729ffb640 1 -- 172.21.15.16:0/584740808 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a12f6a1df0 con 0x55a12f745350 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff729ffb640 10 client.17244 handle_command_reply: tid=0 2024-09-10T23:49:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 client.17244 shutdown 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7359a0 msgr2=0x55a12f732c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7359a0 0x55a12f732c90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009b30 tx=0x7ff73c0048a0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 shutdown_connections 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f745350 0x55a12f747740 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7359a0 0x55a12f732c90 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f729a10 0x55a12f7326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff729ffb640 0 client.17244 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/584740808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7290f0 0x55a12f735260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 >> 172.21.15.16:0/584740808 conn(0x55a12f726f20 msgr2=0x55a12f72ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 shutdown_connections 2024-09-10T23:49:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 1 -- 172.21.15.16:0/584740808 wait complete. 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.214+0000 7ff74b0d3740 20 client.17244 trim_cache size 0 max 16384 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 Processor -- start 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 -- start start 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f726760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f7343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f73dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441b0f20 con 0x55a12f7290f0 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ae7f0 con 0x55a12f7359a0 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.227+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ac660 con 0x55a12f729a10 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f7343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f7343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:40532/0 (socket says 172.21.15.16:40532) 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 -- 172.21.15.16:0/1828362116 learned_addr learned my addr 172.21.15.16:0/1828362116 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff742d9d640 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f73dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff74259c640 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f726760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 -- 172.21.15.16:0/1828362116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 msgr2=0x55a12f73dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f73dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 -- 172.21.15.16:0/1828362116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 msgr2=0x55a12f726760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f726760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 -- 172.21.15.16:0/1828362116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12f730bb0 con 0x55a12f729a10 2024-09-10T23:49:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.228+0000 7ff739d9b640 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f7343f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0ca280 tx=0x7ff72c03b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd10c7f7fd3128ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff72bfff640 1 -- 172.21.15.16:0/1828362116 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c049070 con 0x55a12f729a10 2024-09-10T23:49:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff72bfff640 1 -- 172.21.15.16:0/1828362116 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff72c0ccb20 con 0x55a12f729a10 2024-09-10T23:49:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff72bfff640 1 -- 172.21.15.16:0/1828362116 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c005d50 con 0x55a12f729a10 2024-09-10T23:49:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1828362116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 msgr2=0x55a12f7343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f7343f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0ca280 tx=0x7ff72c03b6b0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1828362116 shutdown_connections 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7359a0 0x55a12f73dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f729a10 0x55a12f7343f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1828362116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f7290f0 0x55a12f726760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1828362116 >> 172.21.15.16:0/1828362116 conn(0x55a12f726f20 msgr2=0x55a12f733ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1828362116 shutdown_connections 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1828362116 wait complete. 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.229+0000 7ff74b0d3740 1 -- start start 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 1 Processor -- start 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7290f0 0x55a12f74d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f729a10 0x55a12f72f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7359a0 0x55a12f72ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441accb0 con 0x55a12f729a10 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ae120 con 0x55a12f7290f0 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ad380 con 0x55a12f7359a0 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74b0d3740 10 client.0 _ll_register_callbacks cb 0x7ff72c10a580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f729a10 0x55a12f72f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f729a10 0x55a12f72f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53000/0 (socket says 172.21.15.16:53000) 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 -- 172.21.15.16:0/1438703392 learned_addr learned my addr 172.21.15.16:0/1438703392 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff74259c640 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7290f0 0x55a12f74d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff742d9d640 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7359a0 0x55a12f72ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 -- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7359a0 msgr2=0x55a12f72ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7359a0 0x55a12f72ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 -- 172.21.15.16:0/1438703392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7290f0 msgr2=0x55a12f74d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7290f0 0x55a12f74d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.230+0000 7ff739d9b640 1 -- 172.21.15.16:0/1438703392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12f74bd60 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff739d9b640 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f729a10 0x55a12f72f8e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0ccd10 tx=0x7ff72c10a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbf3204bbe02448 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff729ffb640 1 -- 172.21.15.16:0/1438703392 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c049040 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff729ffb640 1 -- 172.21.15.16:0/1438703392 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7ff72c0b8170 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff72c0ccb20 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff729ffb640 1 -- 172.21.15.16:0/1438703392 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff72c0c9660 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 10 client.17250 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a12f7b7170 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff729ffb640 1 -- 172.21.15.16:0/1438703392 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff72c0ccb20 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff729ffb640 1 -- 172.21.15.16:0/1438703392 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff72c0cd270 con 0x55a12f729a10 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 10 client.17250 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 20 client.17250 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f7b7760 0x55a12f7b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 4 client.17250 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.231+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a12f69d8a0 con 0x55a12f7b7760 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74259c640 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f7b7760 0x55a12f7b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74259c640 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f7b7760 0x55a12f7b9b80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18bcbe84bc0d7c79 server_cookie=cc0fefa2243e8ca2 in_seq=0 out_seq=0 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff729ffb640 10 client.17250 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff729ffb640 1 -- 172.21.15.16:0/1438703392 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a12f69d8a0 con 0x55a12f7b7760 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff729ffb640 10 client.17250 handle_command_reply: tid=0 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 client.17250 shutdown 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f729a10 msgr2=0x55a12f72f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f729a10 0x55a12f72f8e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0ccd10 tx=0x7ff72c10a720 comp rx=0 tx=0).stop 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 shutdown_connections 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55a12f7b7760 0x55a12f7b9b80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a12f7359a0 0x55a12f72ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a12f729a10 0x55a12f72f8e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 --2- 172.21.15.16:0/1438703392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a12f7290f0 0x55a12f74d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.232+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 >> 172.21.15.16:0/1438703392 conn(0x55a12f726f20 msgr2=0x55a12f734500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff729ffb640 0 client.17250 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 shutdown_connections 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff74b0d3740 1 -- 172.21.15.16:0/1438703392 wait complete. 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff74b0d3740 20 client.17250 trim_cache size 0 max 16384 2024-09-10T23:49:36.250 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff7300b54d0 msgr2=0x7ff7300b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff7300b54d0 0x7ff7300b7990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff734005fd0 tx=0x7ff73400b650 comp rx=0 tx=0).stop 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 msgr2=0x7ff744199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744199820 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005940 tx=0x7ff72c0042f0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 shutdown_connections 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7ff7300b54d0 0x7ff7300b7990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff744109150 0x7ff74419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7441087d0 0x7ff744199820 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 --2- 172.21.15.16:0/3774977203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff744102dc0 0x7ff7441992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 >> 172.21.15.16:0/3774977203 conn(0x7ff7440fe830 msgr2=0x7ff744100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 shutdown_connections 2024-09-10T23:49:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:36.233+0000 7ff748cfe640 1 -- 172.21.15.16:0/3774977203 wait complete. 2024-09-10T23:49:36.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:36 smithi016 ceph-mon[30855]: pgmap v607: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:49:36.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:36 smithi071 ceph-mon[35018]: pgmap v607: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:49:36.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:36 smithi066 ceph-mon[34761]: pgmap v607: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:49:37.925 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T23:49:37.925 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T23:49:38.197 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:38.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:38 smithi016 ceph-mon[30855]: pgmap v608: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:49:38.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:38 smithi071 ceph-mon[35018]: pgmap v608: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:49:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:38 smithi066 ceph-mon[34761]: pgmap v608: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:49:38.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 -- 172.21.15.16:0/2218038392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c10d120 msgr2=0x7f656c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 --2- 172.21.15.16:0/2218038392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c10d120 0x7f656c10f550 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6564009ca0 tx=0x7f656402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 -- 172.21.15.16:0/2218038392 shutdown_connections 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 --2- 172.21.15.16:0/2218038392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c10d120 0x7f656c10f550 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 --2- 172.21.15.16:0/2218038392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c104570 0x7f656c10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 --2- 172.21.15.16:0/2218038392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c103b70 0x7f656c103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 -- 172.21.15.16:0/2218038392 >> 172.21.15.16:0/2218038392 conn(0x7f656c0fd700 msgr2=0x7f656c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 -- 172.21.15.16:0/2218038392 shutdown_connections 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.689+0000 7f65728d5640 1 -- 172.21.15.16:0/2218038392 wait complete. 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 Processor -- start 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 -- start start 2024-09-10T23:49:38.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c103b70 0x7f656c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c104570 0x7f656c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c10d120 0x7f656c19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f656c112d60 con 0x7f656c104570 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f656c112be0 con 0x7f656c103b70 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f65728d5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f656c112ee0 con 0x7f656c10d120 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f6563fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c104570 0x7f656c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f6563fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c104570 0x7f656c199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53020/0 (socket says 172.21.15.16:53020) 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f6563fff640 1 -- 172.21.15.16:0/536095458 learned_addr learned my addr 172.21.15.16:0/536095458 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f656bfff640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c103b70 0x7f656c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.690+0000 7f6570e72640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c10d120 0x7f656c19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6563fff640 1 -- 172.21.15.16:0/536095458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c10d120 msgr2=0x7f656c19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6563fff640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c10d120 0x7f656c19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6563fff640 1 -- 172.21.15.16:0/536095458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c103b70 msgr2=0x7f656c1991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6563fff640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c103b70 0x7f656c1991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6563fff640 1 -- 172.21.15.16:0/536095458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656c19f280 con 0x7f656c104570 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6563fff640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c104570 0x7f656c199710 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f655400d770 tx=0x7f655400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6569ffb640 1 -- 172.21.15.16:0/536095458 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554017070 con 0x7f656c104570 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656c19f570 con 0x7f656c104570 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6569ffb640 1 -- 172.21.15.16:0/536095458 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65540054d0 con 0x7f656c104570 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f6569ffb640 1 -- 172.21.15.16:0/536095458 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554004c30 con 0x7f656c104570 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.691+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656c1a5c30 con 0x7f656c104570 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 Processor -- start 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 -- start start 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6569ffb640 1 -- 172.21.15.16:0/536095458 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f6554004e10 con 0x7f656c104570 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3eee0 0x560170c3f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3f800 0x560170c4b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c4b790 0x560170c4db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560170bb5e60 con 0x560170c3eee0 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560170ba5290 con 0x560170c3f800 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6574caa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560170ba90a0 con 0x560170c4b790 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3eee0 0x560170c3f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3eee0 0x560170c3f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53032/0 (socket says 172.21.15.16:53032) 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 -- 172.21.15.16:0/2123416163 learned_addr learned my addr 172.21.15.16:0/2123416163 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6563fff640 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c4b790 0x560170c4db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f656bfff640 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3f800 0x560170c4b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 -- 172.21.15.16:0/2123416163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c4b790 msgr2=0x560170c4db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c4b790 0x560170c4db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 -- 172.21.15.16:0/2123416163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3f800 msgr2=0x560170c4b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3f800 0x560170c4b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f6570e72640 1 -- 172.21.15.16:0/2123416163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560170903930 con 0x560170c3eee0 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.694+0000 7f656bfff640 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3f800 0x560170c4b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.695+0000 7f6569ffb640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5450 0x7f65580b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.695+0000 7f6570e72640 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3eee0 0x560170c3f2c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6564005fa0 tx=0x7f65640093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6ff602d9446981 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.695+0000 7f656bfff640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5450 0x7f65580b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.695+0000 7f65627fc640 1 -- 172.21.15.16:0/2123416163 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564031cf0 con 0x560170c3eee0 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.695+0000 7f6569ffb640 1 -- 172.21.15.16:0/536095458 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7f65540e5ab0 con 0x7f656c104570 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.695+0000 7f65627fc640 1 -- 172.21.15.16:0/2123416163 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6564040030 con 0x560170c3eee0 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.695+0000 7f65627fc640 1 -- 172.21.15.16:0/2123416163 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65640042a0 con 0x560170c3eee0 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 -- 172.21.15.16:0/2123416163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3eee0 msgr2=0x560170c3f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f656bfff640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5450 0x7f65580b7910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x560170c42060 tx=0x7f655c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3eee0 0x560170c3f2c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6564005fa0 tx=0x7f65640093e0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 -- 172.21.15.16:0/2123416163 shutdown_connections 2024-09-10T23:49:38.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c4b790 0x560170c4db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3f800 0x560170c4b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 --2- 172.21.15.16:0/2123416163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3eee0 0x560170c3f2c0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 -- 172.21.15.16:0/2123416163 >> 172.21.15.16:0/2123416163 conn(0x560170c3cd10 msgr2=0x560170c3deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 -- 172.21.15.16:0/2123416163 shutdown_connections 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 -- 172.21.15.16:0/2123416163 wait complete. 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 -- start start 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.696+0000 7f6574caa740 1 Processor -- start 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6574caa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170c487b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6574caa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170c48cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6574caa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170c49230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6574caa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560170a06890 con 0x560170c4b790 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6574caa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560170b3fd40 con 0x560170c3eee0 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6574caa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560170c4e3e0 con 0x560170c3f800 2024-09-10T23:49:38.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6574caa740 10 client.0 _ll_register_callbacks cb 0x560170ba3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170c49230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170c49230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53038/0 (socket says 172.21.15.16:53038) 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 -- 172.21.15.16:0/3672596565 learned_addr learned my addr 172.21.15.16:0/3672596565 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f656bfff640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170c487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6563fff640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170c48cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 -- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 msgr2=0x560170c48cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170c48cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 -- 172.21.15.16:0/3672596565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 msgr2=0x560170c487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170c487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 -- 172.21.15.16:0/3672596565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560170c57810 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6563fff640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170c48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f6570e72640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170c49230 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6564009620 tx=0x7f6564004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbb8d18e76e5931 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f654b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.697+0000 7f654b7fe640 1 -- 172.21.15.16:0/3672596565 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564052060 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f654b7fe640 1 -- 172.21.15.16:0/3672596565 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7f6564031650 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6564040030 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f654b7fe640 1 -- 172.21.15.16:0/3672596565 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6564031850 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 10 client.17262 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560170c5a1c0 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f654b7fe640 1 -- 172.21.15.16:0/3672596565 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6564040030 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f654b7fe640 1 -- 172.21.15.16:0/3672596565 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6564030890 con 0x560170c4b790 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 10 client.17262 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:38.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 20 client.17262 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170c5b510 0x560170c5d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 4 client.17262 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.698+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560170bb7db0 con 0x560170c5b510 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.699+0000 7f656bfff640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170c5b510 0x560170c5d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.699+0000 7f656bfff640 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170c5b510 0x560170c5d900 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfcfefc8d9d1fd0b server_cookie=79181ea1d8a78549 in_seq=0 out_seq=0 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.699+0000 7f654b7fe640 10 client.17262 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f654b7fe640 1 -- 172.21.15.16:0/3672596565 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560170bb7db0 con 0x560170c5b510 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f654b7fe640 10 client.17262 handle_command_reply: tid=0 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 client.17262 shutdown 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 msgr2=0x560170c49230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170c49230 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6564009620 tx=0x7f6564004a40 comp rx=0 tx=0).stop 2024-09-10T23:49:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 shutdown_connections 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170c5b510 0x560170c5d900 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170c49230 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170c48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f654b7fe640 0 client.17262 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 --2- 172.21.15.16:0/3672596565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170c487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 >> 172.21.15.16:0/3672596565 conn(0x560170c3cd10 msgr2=0x560170c3bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 shutdown_connections 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 1 -- 172.21.15.16:0/3672596565 wait complete. 2024-09-10T23:49:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.700+0000 7f6574caa740 20 client.17262 trim_cache size 0 max 16384 2024-09-10T23:49:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.718+0000 7f6574caa740 1 Processor -- start 2024-09-10T23:49:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.718+0000 7f6574caa740 1 -- start start 2024-09-10T23:49:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f6574caa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3eee0 0x560170c459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f6574caa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3f800 0x560170c45f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f6574caa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c4b790 0x560170c60930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f6574caa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f656c1b3090 con 0x560170c3f800 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f6574caa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f656c1b0960 con 0x560170c4b790 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f6574caa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f656c1ae7d0 con 0x560170c3eee0 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f6563fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3f800 0x560170c45f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3eee0 0x560170c459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3eee0 0x560170c459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.16:40572/0 (socket says 172.21.15.16:40572) 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 -- 172.21.15.16:0/1073656005 learned_addr learned my addr 172.21.15.16:0/1073656005 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 -- 172.21.15.16:0/1073656005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c4b790 msgr2=0x560170c60930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 --2- 172.21.15.16:0/1073656005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c4b790 0x560170c60930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 -- 172.21.15.16:0/1073656005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3f800 msgr2=0x560170c45f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 --2- 172.21.15.16:0/1073656005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3f800 0x560170c45f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 -- 172.21.15.16:0/1073656005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560170c3f630 con 0x560170c3eee0 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.719+0000 7f656bfff640 1 --2- 172.21.15.16:0/1073656005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3eee0 0x560170c459c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x560170bb5fb0 tx=0x7f655c015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2175ac3563238bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6561ffb640 1 -- 172.21.15.16:0/1073656005 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c005020 con 0x560170c3eee0 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6561ffb640 1 -- 172.21.15.16:0/1073656005 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f655c0047a0 con 0x560170c3eee0 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6561ffb640 1 -- 172.21.15.16:0/1073656005 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c028690 con 0x560170c3eee0 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 -- 172.21.15.16:0/1073656005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3eee0 msgr2=0x560170c459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 --2- 172.21.15.16:0/1073656005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3eee0 0x560170c459c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x560170bb5fb0 tx=0x7f655c015000 comp rx=0 tx=0).stop 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 -- 172.21.15.16:0/1073656005 shutdown_connections 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 --2- 172.21.15.16:0/1073656005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c4b790 0x560170c60930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 --2- 172.21.15.16:0/1073656005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c3f800 0x560170c45f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 --2- 172.21.15.16:0/1073656005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3eee0 0x560170c459c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 -- 172.21.15.16:0/1073656005 >> 172.21.15.16:0/1073656005 conn(0x560170c3cd10 msgr2=0x560170c56e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 -- 172.21.15.16:0/1073656005 shutdown_connections 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.720+0000 7f6574caa740 1 -- 172.21.15.16:0/1073656005 wait complete. 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 -- start start 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 Processor -- start 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170cbc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170cbc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170cc10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f656c1aee20 con 0x560170c4b790 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f656c1b0290 con 0x560170c3eee0 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f656c1af4f0 con 0x560170c3f800 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6574caa740 10 client.0 _ll_register_callbacks cb 0x7f65540e94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6570e72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170cc10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6570e72640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170cc10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53048/0 (socket says 172.21.15.16:53048) 2024-09-10T23:49:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6570e72640 1 -- 172.21.15.16:0/2257059587 learned_addr learned my addr 172.21.15.16:0/2257059587 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.721+0000 7f6563fff640 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170cbc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f656bfff640 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170cbc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6570e72640 1 -- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 msgr2=0x560170cbc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6570e72640 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170cbc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6570e72640 1 -- 172.21.15.16:0/2257059587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 msgr2=0x560170cbc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6570e72640 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170cbc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6570e72640 1 -- 172.21.15.16:0/2257059587 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560170cc17e0 con 0x560170c4b790 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6570e72640 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170cc10d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f656402ade0 tx=0x7f6564004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813eed1a8f876947 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f654b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f654b7fe640 1 -- 172.21.15.16:0/2257059587 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6564030ed0 con 0x560170c4b790 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f654b7fe640 1 -- 172.21.15.16:0/2257059587 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7f656402f860 con 0x560170c4b790 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f655c0047a0 con 0x560170c4b790 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f654b7fe640 1 -- 172.21.15.16:0/2257059587 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6564066050 con 0x560170c4b790 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6574caa740 10 client.17268 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560170cc8cb0 con 0x560170c4b790 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.722+0000 7f654b7fe640 1 -- 172.21.15.16:0/2257059587 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f655c0047a0 con 0x560170c4b790 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f654b7fe640 1 -- 172.21.15.16:0/2257059587 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6564056530 con 0x560170c4b790 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f6574caa740 10 client.17268 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f6574caa740 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f6574caa740 20 client.17268 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f6574caa740 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170cc93d0 0x560170ccb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:38.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f6574caa740 4 client.17268 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560170bb3860 con 0x560170cc93d0 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f656bfff640 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170cc93d0 0x560170ccb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f654b7fe640 10 client.17268 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.723+0000 7f656bfff640 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170cc93d0 0x560170ccb7f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cd3b266297e718a server_cookie=cd1fda6797fb7b50 in_seq=0 out_seq=0 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.725+0000 7f654b7fe640 1 -- 172.21.15.16:0/2257059587 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560170bb3860 con 0x560170cc93d0 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.725+0000 7f654b7fe640 10 client.17268 handle_command_reply: tid=0 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.725+0000 7f6574caa740 1 client.17268 shutdown 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 msgr2=0x560170cc10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170cc10d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f656402ade0 tx=0x7f6564004ab0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 shutdown_connections 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x560170cc93d0 0x560170ccb7f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560170c4b790 0x560170cc10d0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560170c3f800 0x560170cbc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f654b7fe640 0 client.17268 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 --2- 172.21.15.16:0/2257059587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560170c3eee0 0x560170cbc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 >> 172.21.15.16:0/2257059587 conn(0x560170c3cd10 msgr2=0x560170c49de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 shutdown_connections 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 1 -- 172.21.15.16:0/2257059587 wait complete. 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.726+0000 7f6574caa740 20 client.17268 trim_cache size 0 max 16384 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "return_code": 0, 2024-09-10T23:49:38.736 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_tag": "a1902b44-17af-45fe-af50-a5a25ddf2503", 2024-09-10T23:49:38.737 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": "asynchronous" 2024-09-10T23:49:38.737 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:49:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5450 msgr2=0x7f65580b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5450 0x7f65580b7910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x560170c42060 tx=0x7f655c00b390 comp rx=0 tx=0).stop 2024-09-10T23:49:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c104570 msgr2=0x7f656c199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c104570 0x7f656c199710 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f655400d770 tx=0x7f655400dc30 comp rx=0 tx=0).stop 2024-09-10T23:49:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 shutdown_connections 2024-09-10T23:49:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f656c10d120 0x7f656c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f656c104570 0x7f656c199710 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f65580b5450 0x7f65580b7910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 --2- 172.21.15.16:0/536095458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f656c103b70 0x7f656c1991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 >> 172.21.15.16:0/536095458 conn(0x7f656c0fd700 msgr2=0x7f656c10f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 shutdown_connections 2024-09-10T23:49:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:38.727+0000 7f65728d5640 1 -- 172.21.15.16:0/536095458 wait complete. 2024-09-10T23:49:39.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:49:39.728 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 -- 172.21.15.16:0/1946356076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 msgr2=0x7fdee810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/1946356076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810e820 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009ca0 tx=0x7fdee002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 -- 172.21.15.16:0/1946356076 shutdown_connections 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/1946356076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810e820 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/1946356076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdee81076a0 0x7fdee8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/1946356076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee8101c90 0x7fdee8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 -- 172.21.15.16:0/1946356076 >> 172.21.15.16:0/1946356076 conn(0x7fdee80fd700 msgr2=0x7fdee80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:40.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 -- 172.21.15.16:0/1946356076 shutdown_connections 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 -- 172.21.15.16:0/1946356076 wait complete. 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.227+0000 7fdeedc6b640 1 Processor -- start 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdeedc6b640 1 -- start start 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdeedc6b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdee8101c90 0x7fdee810f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdeedc6b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee81076a0 0x7fdee810f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdeedc6b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdeedc6b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdee8112dd0 con 0x7fdee8108020 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdeedc6b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdee8112c50 con 0x7fdee81076a0 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdeedc6b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdee8112f50 con 0x7fdee8101c90 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53068/0 (socket says 172.21.15.16:53068) 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 -- 172.21.15.16:0/3485373099 learned_addr learned my addr 172.21.15.16:0/3485373099 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:40.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee77fe640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdee8101c90 0x7fdee810f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee81076a0 0x7fdee810f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 -- 172.21.15.16:0/3485373099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdee8101c90 msgr2=0x7fdee810f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdee8101c90 0x7fdee810f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 -- 172.21.15.16:0/3485373099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee81076a0 msgr2=0x7fdee810f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee81076a0 0x7fdee810f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.228+0000 7fdee7fff640 1 -- 172.21.15.16:0/3485373099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee81a7600 con 0x7fdee8108020 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.229+0000 7fdee7fff640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810fa80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fdee0005cc0 tx=0x7fdee002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.229+0000 7fdee4ff9640 1 -- 172.21.15.16:0/3485373099 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0003cf0 con 0x7fdee8108020 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.229+0000 7fdee4ff9640 1 -- 172.21.15.16:0/3485373099 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee00044f0 con 0x7fdee8108020 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.229+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee81a7890 con 0x7fdee8108020 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.229+0000 7fdee4ff9640 1 -- 172.21.15.16:0/3485373099 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee002fd10 con 0x7fdee8108020 2024-09-10T23:49:40.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.229+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee81a7e20 con 0x7fdee8108020 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.231+0000 7fdee4ff9640 1 -- 172.21.15.16:0/3485373099 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fdee0004040 con 0x7fdee8108020 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.231+0000 7fdef0040740 1 Processor -- start 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdef0040740 1 -- start start 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdef0040740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdef0040740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355dd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdef0040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdef0040740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561235547e50 con 0x5612355d10a0 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdef0040740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561235537280 con 0x5612355d19c0 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdef0040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56123553b090 con 0x5612355dd950 2024-09-10T23:49:40.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53074/0 (socket says 172.21.15.16:53074) 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 -- 172.21.15.16:0/2730870104 learned_addr learned my addr 172.21.15.16:0/2730870104 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee77fe640 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 -- 172.21.15.16:0/2730870104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 msgr2=0x5612355dfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 -- 172.21.15.16:0/2730870104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 msgr2=0x5612355dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355dd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.232+0000 7fdee6ffd640 1 -- 172.21.15.16:0/2730870104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561235295650 con 0x5612355d10a0 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.233+0000 7fdee4ff9640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fded00b54d0 0x7fded00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.233+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355d1480 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00cfa0 tx=0x7fdedc00c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a41e061ed0842a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.233+0000 7fdee77fe640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fded00b54d0 0x7fded00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.233+0000 7fdee4ff9640 1 -- 172.21.15.16:0/3485373099 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7fdee01075a0 con 0x7fdee8108020 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.233+0000 7fdecdffb640 1 -- 172.21.15.16:0/2730870104 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc018030 con 0x5612355d10a0 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.233+0000 7fdecdffb640 1 -- 172.21.15.16:0/2730870104 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc0054d0 con 0x5612355d10a0 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.233+0000 7fdecdffb640 1 -- 172.21.15.16:0/2730870104 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc010880 con 0x5612355d10a0 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 -- 172.21.15.16:0/2730870104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 msgr2=0x5612355d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdee77fe640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fded00b54d0 0x7fded00b7990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5612355cfdb0 tx=0x7fded800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355d1480 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00cfa0 tx=0x7fdedc00c620 comp rx=0 tx=0).stop 2024-09-10T23:49:40.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 -- 172.21.15.16:0/2730870104 shutdown_connections 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 --2- 172.21.15.16:0/2730870104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355d1480 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 -- 172.21.15.16:0/2730870104 >> 172.21.15.16:0/2730870104 conn(0x5612355ceed0 msgr2=0x5612355d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 -- 172.21.15.16:0/2730870104 shutdown_connections 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 -- 172.21.15.16:0/2730870104 wait complete. 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 -- start start 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.234+0000 7fdef0040740 1 Processor -- start 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdef0040740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355dd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdef0040740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355da620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdef0040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdef0040740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561235398700 con 0x5612355d10a0 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdef0040740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5612354d2110 con 0x5612355d19c0 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdef0040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5612355e05d0 con 0x5612355dd950 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdef0040740 10 client.0 _ll_register_callbacks cb 0x5612354eb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355dd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355dd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53080/0 (socket says 172.21.15.16:53080) 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 -- 172.21.15.16:0/3208437978 learned_addr learned my addr 172.21.15.16:0/3208437978 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee7fff640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355da620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 -- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 msgr2=0x5612355dabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 -- 172.21.15.16:0/3208437978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 msgr2=0x5612355da620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355da620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 -- 172.21.15.16:0/3208437978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612354ffc40 con 0x5612355d10a0 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee7fff640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355da620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdee77fe640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355dd1d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fded801cbe0 tx=0x7fded8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d3435cfe8b7091 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.235+0000 7fdec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdec6ffd640 1 -- 172.21.15.16:0/3208437978 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded802c060 con 0x5612355d10a0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdec6ffd640 1 -- 172.21.15.16:0/3208437978 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7fded8016030 con 0x5612355d10a0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc0054d0 con 0x5612355d10a0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdec6ffd640 1 -- 172.21.15.16:0/3208437978 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fded800adf0 con 0x5612355d10a0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 10 client.17280 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5612355ebf60 con 0x5612355d10a0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdec6ffd640 1 -- 172.21.15.16:0/3208437978 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc0054d0 con 0x5612355d10a0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdec6ffd640 1 -- 172.21.15.16:0/3208437978 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fded801a6d0 con 0x5612355d10a0 2024-09-10T23:49:40.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 10 client.17280 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 20 client.17280 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5612355ed420 0x5612355ef890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 4 client.17280 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.236+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561235549da0 con 0x5612355ed420 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.237+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5612355ed420 0x5612355ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.238+0000 7fdec6ffd640 10 client.17280 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.238+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5612355ed420 0x5612355ef890 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f16d9cd960f66d27 server_cookie=354ec8523948d954 in_seq=0 out_seq=0 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdec6ffd640 1 -- 172.21.15.16:0/3208437978 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561235549da0 con 0x5612355ed420 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdec6ffd640 10 client.17280 handle_command_reply: tid=0 2024-09-10T23:49:40.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 client.17280 shutdown 2024-09-10T23:49:40.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 msgr2=0x5612355dd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355dd1d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fded801cbe0 tx=0x7fded8004730 comp rx=0 tx=0).stop 2024-09-10T23:49:40.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 shutdown_connections 2024-09-10T23:49:40.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x5612355ed420 0x5612355ef890 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612355dabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355da620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 --2- 172.21.15.16:0/3208437978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355dd1d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdec6ffd640 0 client.17280 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 >> 172.21.15.16:0/3208437978 conn(0x5612355ceed0 msgr2=0x5612355d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 shutdown_connections 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.239+0000 7fdef0040740 1 -- 172.21.15.16:0/3208437978 wait complete. 2024-09-10T23:49:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.240+0000 7fdef0040740 20 client.17280 trim_cache size 0 max 16384 2024-09-10T23:49:40.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 Processor -- start 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 -- start start 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d10a0 0x5612355d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355d19c0 0x5612355d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355dd950 0x5612355f5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdee81b3060 con 0x5612355dd950 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdee81b0930 con 0x5612355d10a0 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdef0040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdee81ae7a0 con 0x5612355d19c0 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355dd950 0x5612355f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355dd950 0x5612355f5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53092/0 (socket says 172.21.15.16:53092) 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 -- 172.21.15.16:0/1140306132 learned_addr learned my addr 172.21.15.16:0/1140306132 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355d19c0 0x5612355d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee77fe640 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d10a0 0x5612355d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 -- 172.21.15.16:0/1140306132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355d19c0 msgr2=0x5612355d7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355d19c0 0x5612355d7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 -- 172.21.15.16:0/1140306132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d10a0 msgr2=0x5612355d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d10a0 0x5612355d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 -- 172.21.15.16:0/1140306132 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612355da3d0 con 0x5612355dd950 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.258+0000 7fdee7fff640 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355dd950 0x5612355f5160 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdee0104d20 tx=0x7fdee00c9950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48f54ac69c63a4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdecd7fa640 1 -- 172.21.15.16:0/1140306132 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00d2020 con 0x5612355dd950 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdecd7fa640 1 -- 172.21.15.16:0/1140306132 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee0036040 con 0x5612355dd950 2024-09-10T23:49:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdecd7fa640 1 -- 172.21.15.16:0/1140306132 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00cd500 con 0x5612355dd950 2024-09-10T23:49:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 -- 172.21.15.16:0/1140306132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355dd950 msgr2=0x5612355f5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355dd950 0x5612355f5160 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdee0104d20 tx=0x7fdee00c9950 comp rx=0 tx=0).stop 2024-09-10T23:49:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 -- 172.21.15.16:0/1140306132 shutdown_connections 2024-09-10T23:49:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355dd950 0x5612355f5160 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355d19c0 0x5612355d7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 --2- 172.21.15.16:0/1140306132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d10a0 0x5612355d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 -- 172.21.15.16:0/1140306132 >> 172.21.15.16:0/1140306132 conn(0x5612355ceed0 msgr2=0x5612355dc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 -- 172.21.15.16:0/1140306132 shutdown_connections 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.259+0000 7fdef0040740 1 -- 172.21.15.16:0/1140306132 wait complete. 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 -- start start 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 Processor -- start 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355e2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612356534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdee81aedf0 con 0x5612355d10a0 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdee81b0260 con 0x5612355d19c0 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdee81af4c0 con 0x5612355dd950 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdef0040740 10 client.0 _ll_register_callbacks cb 0x7fded800a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355e23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53096/0 (socket says 172.21.15.16:53096) 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdee77fe640 1 -- 172.21.15.16:0/4255442511 learned_addr learned my addr 172.21.15.16:0/4255442511 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.260+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee7fff640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612356534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee77fe640 1 -- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 msgr2=0x5612356534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee77fe640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612356534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee77fe640 1 -- 172.21.15.16:0/4255442511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 msgr2=0x5612355e2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee77fe640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355e2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee77fe640 1 -- 172.21.15.16:0/4255442511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561235653c20 con 0x5612355d10a0 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee7fff640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612356534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355e2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdee77fe640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355e23e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fded801aaf0 tx=0x7fded801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b048c930340079e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdec6ffd640 1 -- 172.21.15.16:0/4255442511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded801a5b0 con 0x5612355d10a0 2024-09-10T23:49:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdee0036040 con 0x5612355d10a0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdec6ffd640 1 -- 172.21.15.16:0/4255442511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8470+0+0 (secure 0 0 0) 0x7fded801a750 con 0x5612355d10a0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdec6ffd640 1 -- 172.21.15.16:0/4255442511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fded800f7f0 con 0x5612355d10a0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdef0040740 10 client.17286 fetch_fsmap learned FSMap version 25 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.261+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56123565b0e0 con 0x5612355d10a0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdec6ffd640 1 -- 172.21.15.16:0/4255442511 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee0036040 con 0x5612355d10a0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdec6ffd640 1 -- 172.21.15.16:0/4255442511 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fded8031920 con 0x5612355d10a0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdef0040740 10 client.17286 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdef0040740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdef0040740 20 client.17286 populate_metadata read hostname 'smithi016' 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdef0040740 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56123565b8e0 0x56123565dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdef0040740 4 client.17286 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561235545850 con 0x56123565b8e0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56123565b8e0 0x56123565dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdee6ffd640 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56123565b8e0 0x56123565dd00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4fa21184f3fe169 server_cookie=459779e6a12b7e1c in_seq=0 out_seq=0 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.262+0000 7fdec6ffd640 10 client.17286 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdec6ffd640 1 -- 172.21.15.16:0/4255442511 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x561235545850 con 0x56123565b8e0 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdec6ffd640 10 client.17286 handle_command_reply: tid=0 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 client.17286 shutdown 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 msgr2=0x5612355e23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355e23e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fded801aaf0 tx=0x7fded801ace0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 shutdown_connections 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x56123565b8e0 0x56123565dd00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612355dd950 0x5612356534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612355d19c0 0x5612355e2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 --2- 172.21.15.16:0/4255442511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5612355d10a0 0x5612355e23e0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdec6ffd640 0 client.17286 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 >> 172.21.15.16:0/4255442511 conn(0x5612355ceed0 msgr2=0x5612355cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 shutdown_connections 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 1 -- 172.21.15.16:0/4255442511 wait complete. 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.263+0000 7fdef0040740 20 client.17286 trim_cache size 0 max 16384 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": { 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout: "a1902b44-17af-45fe-af50-a5a25ddf2503": { 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout: "tag": "a1902b44-17af-45fe-af50-a5a25ddf2503", 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout: "options": "recursive,force" 2024-09-10T23:49:40.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "a1902b44-17af-45fe-af50-a5a25ddf2503": { 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:49:38.723030+0000", 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "14ec25e9-6e3c-4668-8e31-7445d91560fb": { 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:55.907798+0000", 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.271 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:49:40.272 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.274 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.275 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:49:40.276 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.278 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "dc39dd20-224e-45cc-87b8-22db618aa261": { 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:13.371560+0000", 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.279 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:49:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:49:40.281 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fded00b54d0 msgr2=0x7fded00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fded00b54d0 0x7fded00b7990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5612355cfdb0 tx=0x7fded800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 msgr2=0x7fdee810fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810fa80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fdee0005cc0 tx=0x7fdee002f470 comp rx=0 tx=0).stop 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 shutdown_connections 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee8108020 0x7fdee810fa80 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fded00b54d0 0x7fded00b7990 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdee81076a0 0x7fdee810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 --2- 172.21.15.16:0/3485373099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdee8101c90 0x7fdee810f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 >> 172.21.15.16:0/3485373099 conn(0x7fdee80fd700 msgr2=0x7fdee80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 shutdown_connections 2024-09-10T23:49:40.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:49:40.264+0000 7fdeedc6b640 1 -- 172.21.15.16:0/3485373099 wait complete. 2024-09-10T23:49:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:40 smithi016 ceph-mon[30855]: pgmap v609: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:49:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:40 smithi016 ceph-mon[30855]: scrub queued for path: / 2024-09-10T23:49:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:40 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:49:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:40 smithi016 ceph-mon[30855]: scrub summary: active paths [/] 2024-09-10T23:49:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:40 smithi016 ceph-mon[30855]: scrub summary: idle+waiting paths [/] 2024-09-10T23:49:40.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:40 smithi071 ceph-mon[35018]: pgmap v609: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:49:40.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:40 smithi071 ceph-mon[35018]: scrub queued for path: / 2024-09-10T23:49:40.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:40 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:49:40.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:40 smithi071 ceph-mon[35018]: scrub summary: active paths [/] 2024-09-10T23:49:40.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:40 smithi071 ceph-mon[35018]: scrub summary: idle+waiting paths [/] 2024-09-10T23:49:40.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:40 smithi066 ceph-mon[34761]: pgmap v609: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:49:40.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:40 smithi066 ceph-mon[34761]: scrub queued for path: / 2024-09-10T23:49:40.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:40 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:49:40.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:40 smithi066 ceph-mon[34761]: scrub summary: active paths [/] 2024-09-10T23:49:40.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:40 smithi066 ceph-mon[34761]: scrub summary: idle+waiting paths [/] 2024-09-10T23:49:40.987 INFO:tasks.cephfs.filesystem:scrub status for tag:a1902b44-17af-45fe-af50-a5a25ddf2503 - {'path': '/', 'tag': 'a1902b44-17af-45fe-af50-a5a25ddf2503', 'options': 'recursive,force'} 2024-09-10T23:49:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:42 smithi016 ceph-mon[30855]: pgmap v610: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:49:42.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:42 smithi071 ceph-mon[35018]: pgmap v610: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:49:42.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:42 smithi066 ceph-mon[34761]: pgmap v610: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:49:43.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:43 smithi016 ceph-mon[30855]: scrub summary: idle 2024-09-10T23:49:43.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:43 smithi071 ceph-mon[35018]: scrub summary: idle 2024-09-10T23:49:43.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:43 smithi066 ceph-mon[34761]: scrub summary: idle 2024-09-10T23:49:44.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:44 smithi016 ceph-mon[30855]: pgmap v611: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:49:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:44 smithi071 ceph-mon[35018]: pgmap v611: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:49:44.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:44 smithi066 ceph-mon[34761]: pgmap v611: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-10T23:49:46.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:46 smithi016 ceph-mon[30855]: pgmap v612: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:49:46.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:46 smithi071 ceph-mon[35018]: pgmap v612: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:49:46.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:46 smithi066 ceph-mon[34761]: pgmap v612: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-10T23:49:48.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:48 smithi016 ceph-mon[30855]: pgmap v613: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:49:48.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:48 smithi071 ceph-mon[35018]: pgmap v613: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:49:48.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:48 smithi066 ceph-mon[34761]: pgmap v613: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:49:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:50 smithi016 ceph-mon[30855]: pgmap v614: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:49:50.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:50 smithi071 ceph-mon[35018]: pgmap v614: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:49:50.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:50 smithi066 ceph-mon[34761]: pgmap v614: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T23:49:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:52 smithi016 ceph-mon[30855]: pgmap v615: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:49:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:52 smithi071 ceph-mon[35018]: pgmap v615: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:49:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:52 smithi066 ceph-mon[34761]: pgmap v615: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:49:54.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:54 smithi016 ceph-mon[30855]: pgmap v616: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:49:54.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:54 smithi071 ceph-mon[35018]: pgmap v616: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:49:54.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:54 smithi066 ceph-mon[34761]: pgmap v616: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:49:56.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:56 smithi016 ceph-mon[30855]: pgmap v617: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:49:56.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:56 smithi071 ceph-mon[35018]: pgmap v617: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:49:56.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:56 smithi066 ceph-mon[34761]: pgmap v617: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-10T23:49:58.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:49:58 smithi016 ceph-mon[30855]: pgmap v618: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:49:58.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:49:58 smithi071 ceph-mon[35018]: pgmap v618: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:49:58.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:49:58 smithi066 ceph-mon[34761]: pgmap v618: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:50:00.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:00 smithi016 ceph-mon[30855]: pgmap v619: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:50:00.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:00 smithi016 ceph-mon[30855]: overall HEALTH_OK 2024-09-10T23:50:00.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:00 smithi071 ceph-mon[35018]: pgmap v619: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:50:00.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:00 smithi071 ceph-mon[35018]: overall HEALTH_OK 2024-09-10T23:50:00.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:00 smithi066 ceph-mon[34761]: pgmap v619: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:50:00.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:00 smithi066 ceph-mon[34761]: overall HEALTH_OK 2024-09-10T23:50:02.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:02 smithi016 ceph-mon[30855]: pgmap v620: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:02.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:02 smithi071 ceph-mon[35018]: pgmap v620: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:02.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:02 smithi066 ceph-mon[34761]: pgmap v620: 97 pgs: 97 active+clean; 14 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:04.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:04 smithi016 ceph-mon[30855]: pgmap v621: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:50:04.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:04 smithi071 ceph-mon[35018]: pgmap v621: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:50:04.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:04 smithi066 ceph-mon[34761]: pgmap v621: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-10T23:50:06.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:06 smithi016 ceph-mon[30855]: pgmap v622: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:50:06.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:06 smithi071 ceph-mon[35018]: pgmap v622: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:50:06.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:06 smithi066 ceph-mon[34761]: pgmap v622: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:50:08.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:08 smithi016 ceph-mon[30855]: pgmap v623: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:50:08.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:08 smithi071 ceph-mon[35018]: pgmap v623: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:50:08.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:08 smithi066 ceph-mon[34761]: pgmap v623: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-10T23:50:09.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:09 smithi016 ceph-mon[30855]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:50:09.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:09 smithi071 ceph-mon[35018]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:50:09.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:09 smithi066 ceph-mon[34761]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:50:10.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:10 smithi016 ceph-mon[30855]: pgmap v625: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:50:10.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:10 smithi071 ceph-mon[35018]: pgmap v625: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:50:10.617 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:10 smithi066 ceph-mon[34761]: pgmap v625: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:50:10.988 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T23:50:11.262 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 -- 172.21.15.16:0/1322859983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 msgr2=0x7f70a8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 --2- 172.21.15.16:0/1322859983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a8102070 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009900 tx=0x7f70a402a410 comp rx=0 tx=0).stop 2024-09-10T23:50:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 -- 172.21.15.16:0/1322859983 shutdown_connections 2024-09-10T23:50:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 --2- 172.21.15.16:0/1322859983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a8108020 0x7f70a810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 --2- 172.21.15.16:0/1322859983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70a81076a0 0x7f70a8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 --2- 172.21.15.16:0/1322859983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a8102070 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 -- 172.21.15.16:0/1322859983 >> 172.21.15.16:0/1322859983 conn(0x7f70a80fd700 msgr2=0x7f70a80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 -- 172.21.15.16:0/1322859983 shutdown_connections 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 -- 172.21.15.16:0/1322859983 wait complete. 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 Processor -- start 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.757+0000 7f70b04e4640 1 -- start start 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70b04e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70b04e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a81076a0 0x7f70a819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70b04e4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70a8108020 0x7f70a819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70b04e4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8111ca0 con 0x7f70a8101c90 2024-09-10T23:50:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70b04e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8111b20 con 0x7f70a81076a0 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70b04e4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8111e20 con 0x7f70a8108020 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a819a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58452/0 (socket says 172.21.15.16:58452) 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 -- 172.21.15.16:0/252496750 learned_addr learned my addr 172.21.15.16:0/252496750 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ada7f640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a81076a0 0x7f70a819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70aea81640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70a8108020 0x7f70a819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 -- 172.21.15.16:0/252496750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70a8108020 msgr2=0x7f70a819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70a8108020 0x7f70a819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 -- 172.21.15.16:0/252496750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a81076a0 msgr2=0x7f70a819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a81076a0 0x7f70a819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 -- 172.21.15.16:0/252496750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a81a5430 con 0x7f70a8101c90 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70aea81640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70a8108020 0x7f70a819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70ae280640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a819a050 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005940 tx=0x7f70a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f709f7fe640 1 -- 172.21.15.16:0/252496750 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a403f030 con 0x7f70a8101c90 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f709f7fe640 1 -- 172.21.15.16:0/252496750 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a4003cb0 con 0x7f70a8101c90 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a81a56c0 con 0x7f70a8101c90 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.758+0000 7f709f7fe640 1 -- 172.21.15.16:0/252496750 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4035070 con 0x7f70a8101c90 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.759+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81a5bf0 con 0x7f70a8101c90 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.761+0000 7f70b28b9740 1 Processor -- start 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.761+0000 7f709f7fe640 1 -- 172.21.15.16:0/252496750 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f70a4003800 con 0x7f70a8101c90 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.761+0000 7f70b28b9740 1 -- start start 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e61480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e6d950 0x555af0e6fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70b28b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555af0dd7e50 con 0x555af0e610a0 2024-09-10T23:50:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70b28b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555af0dc7280 con 0x555af0e619c0 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70b28b9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555af0dcb090 con 0x555af0e6d950 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e61480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e61480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58468/0 (socket says 172.21.15.16:58468) 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 -- 172.21.15.16:0/2467053089 learned_addr learned my addr 172.21.15.16:0/2467053089 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70ada7f640 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e6d950 0x555af0e6fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70ae280640 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 -- 172.21.15.16:0/2467053089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e6d950 msgr2=0x555af0e6fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e6d950 0x555af0e6fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 -- 172.21.15.16:0/2467053089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 msgr2=0x555af0e6d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 -- 172.21.15.16:0/2467053089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af0b25650 con 0x555af0e610a0 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70ada7f640 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e6d950 0x555af0e6fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f709f7fe640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f70940b54d0 0x7f70940b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.762+0000 7f70aea81640 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e61480 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009f70 tx=0x7f70a0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff9bab6e8bf03b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70ae280640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f70940b54d0 0x7f70940b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f709cff9640 1 -- 172.21.15.16:0/2467053089 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0016070 con 0x555af0e610a0 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f709cff9640 1 -- 172.21.15.16:0/2467053089 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a0004d20 con 0x555af0e610a0 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f709cff9640 1 -- 172.21.15.16:0/2467053089 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a00127c0 con 0x555af0e610a0 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f709f7fe640 1 -- 172.21.15.16:0/252496750 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7f70a4106ad0 con 0x7f70a8101c90 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70ae280640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f70940b54d0 0x7f70940b7990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70a41042d0 tx=0x7f70a40b4040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70b28b9740 1 -- 172.21.15.16:0/2467053089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 msgr2=0x555af0e61480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70b28b9740 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e61480 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009f70 tx=0x7f70a0010800 comp rx=0 tx=0).stop 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70b28b9740 1 -- 172.21.15.16:0/2467053089 shutdown_connections 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70b28b9740 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e6d950 0x555af0e6fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70b28b9740 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70b28b9740 1 --2- 172.21.15.16:0/2467053089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e61480 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.763+0000 7f70b28b9740 1 -- 172.21.15.16:0/2467053089 >> 172.21.15.16:0/2467053089 conn(0x555af0e5eed0 msgr2=0x555af0e60070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 -- 172.21.15.16:0/2467053089 shutdown_connections 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 -- 172.21.15.16:0/2467053089 wait complete. 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 -- start start 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 Processor -- start 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e610a0 0x555af0e6d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e6a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555af0c28700 con 0x555af0e6d950 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555af0d62110 con 0x555af0e610a0 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555af0e705d0 con 0x555af0e619c0 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70b28b9740 10 client.0 _ll_register_callbacks cb 0x555af0d7b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.764+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58484/0 (socket says 172.21.15.16:58484) 2024-09-10T23:50:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 -- 172.21.15.16:0/1304859330 learned_addr learned my addr 172.21.15.16:0/1304859330 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e610a0 0x555af0e6d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70ada7f640 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e6a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 -- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 msgr2=0x555af0e6a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e6a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 -- 172.21.15.16:0/1304859330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e610a0 msgr2=0x555af0e6d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e610a0 0x555af0e6d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 -- 172.21.15.16:0/1304859330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af0d8fc40 con 0x555af0e6d950 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70aea81640 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6ae60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000f80 tx=0x7f70a0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b3d100f7ef5714 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f7091ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f7091ffb640 1 -- 172.21.15.16:0/1304859330 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0016040 con 0x555af0e6d950 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f7091ffb640 1 -- 172.21.15.16:0/1304859330 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7f70a0012770 con 0x555af0e6d950 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a0004d20 con 0x555af0e6d950 2024-09-10T23:50:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f7091ffb640 1 -- 172.21.15.16:0/1304859330 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f70a0012970 con 0x555af0e6d950 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70b28b9740 10 client.17298 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.765+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555af0e7bff0 con 0x555af0e6d950 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f7091ffb640 1 -- 172.21.15.16:0/1304859330 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a0004d20 con 0x555af0e6d950 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f7091ffb640 1 -- 172.21.15.16:0/1304859330 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f70a0025030 con 0x555af0e6d950 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f70b28b9740 10 client.17298 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f70b28b9740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f70b28b9740 20 client.17298 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0e7d340 0x555af0e7f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f70b28b9740 4 client.17298 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555af0dd9da0 con 0x555af0e7d340 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.766+0000 7f70ada7f640 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0e7d340 0x555af0e7f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.767+0000 7f70ada7f640 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0e7d340 0x555af0e7f730 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3849009b206a7c7c server_cookie=4d17840a515ee036 in_seq=0 out_seq=0 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.767+0000 7f7091ffb640 10 client.17298 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.767+0000 7f7091ffb640 1 -- 172.21.15.16:0/1304859330 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555af0dd9da0 con 0x555af0e7d340 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.767+0000 7f7091ffb640 10 client.17298 handle_command_reply: tid=0 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 client.17298 shutdown 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 msgr2=0x555af0e6ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6ae60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000f80 tx=0x7f70a0005a50 comp rx=0 tx=0).stop 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 shutdown_connections 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0e7d340 0x555af0e7f730 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6ae60 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e6a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f7091ffb640 0 client.17298 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1304859330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e610a0 0x555af0e6d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 >> 172.21.15.16:0/1304859330 conn(0x555af0e5eed0 msgr2=0x555af0e64a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:11.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 shutdown_connections 2024-09-10T23:50:11.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 1 -- 172.21.15.16:0/1304859330 wait complete. 2024-09-10T23:50:11.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.768+0000 7f70b28b9740 20 client.17298 trim_cache size 0 max 16384 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 Processor -- start 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 -- start start 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e610a0 0x555af0e79800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81b0f10 con 0x555af0e6d950 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ae7e0 con 0x555af0e619c0 2024-09-10T23:50:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70b28b9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ac650 con 0x555af0e610a0 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58496/0 (socket says 172.21.15.16:58496) 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.786+0000 7f70aea81640 1 -- 172.21.15.16:0/4145101412 learned_addr learned my addr 172.21.15.16:0/4145101412 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70aea81640 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e610a0 0x555af0e79800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70ada7f640 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70aea81640 1 -- 172.21.15.16:0/4145101412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e610a0 msgr2=0x555af0e79800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70aea81640 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e610a0 0x555af0e79800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70aea81640 1 -- 172.21.15.16:0/4145101412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 msgr2=0x555af0e6ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70aea81640 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70aea81640 1 -- 172.21.15.16:0/4145101412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af0e6aba0 con 0x555af0e6d950 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70ada7f640 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f70aea81640 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6f280 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f70a00124b0 tx=0x7f70a0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1755a8f7943df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f7093fff640 1 -- 172.21.15.16:0/4145101412 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0016040 con 0x555af0e6d950 2024-09-10T23:50:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f7093fff640 1 -- 172.21.15.16:0/4145101412 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a0010d00 con 0x555af0e6d950 2024-09-10T23:50:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.787+0000 7f7093fff640 1 -- 172.21.15.16:0/4145101412 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a002b2e0 con 0x555af0e6d950 2024-09-10T23:50:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- 172.21.15.16:0/4145101412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 msgr2=0x555af0e6f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6f280 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f70a00124b0 tx=0x7f70a0010800 comp rx=0 tx=0).stop 2024-09-10T23:50:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- 172.21.15.16:0/4145101412 shutdown_connections 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e6d950 0x555af0e6f280 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e619c0 0x555af0e6ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 --2- 172.21.15.16:0/4145101412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e610a0 0x555af0e79800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- 172.21.15.16:0/4145101412 >> 172.21.15.16:0/4145101412 conn(0x555af0e5eed0 msgr2=0x555af0e659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- 172.21.15.16:0/4145101412 shutdown_connections 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- 172.21.15.16:0/4145101412 wait complete. 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- start start 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 Processor -- start 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e75840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e75d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e6d950 0x555af0e707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81acca0 con 0x555af0e610a0 2024-09-10T23:50:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ae110 con 0x555af0e6d950 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.788+0000 7f70b28b9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ad370 con 0x555af0e619c0 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70b28b9740 10 client.0 _ll_register_callbacks cb 0x7f70a0009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e75840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e75840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58506/0 (socket says 172.21.15.16:58506) 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 -- 172.21.15.16:0/1837520190 learned_addr learned my addr 172.21.15.16:0/1837520190 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e6d950 0x555af0e707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70ada7f640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e75d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 -- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 msgr2=0x555af0e75d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e75d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 -- 172.21.15.16:0/1837520190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e6d950 msgr2=0x555af0e707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e6d950 0x555af0e707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 -- 172.21.15.16:0/1837520190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af0e70d30 con 0x555af0e610a0 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70ada7f640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e75d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:50:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70aea81640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e75840 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009d00 tx=0x7f70a0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f27f2039264732e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f7091ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f7091ffb640 1 -- 172.21.15.16:0/1837520190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0016070 con 0x555af0e610a0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f7091ffb640 1 -- 172.21.15.16:0/1837520190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7f70a0005390 con 0x555af0e610a0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a0010d00 con 0x555af0e610a0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f7091ffb640 1 -- 172.21.15.16:0/1837520190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f70a0045050 con 0x555af0e610a0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70b28b9740 10 client.17304 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.789+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555af0eea760 con 0x555af0e610a0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f7091ffb640 1 -- 172.21.15.16:0/1837520190 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a0010d00 con 0x555af0e610a0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f7091ffb640 1 -- 172.21.15.16:0/1837520190 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f70a003c070 con 0x555af0e610a0 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f70b28b9740 10 client.17304 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f70b28b9740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f70b28b9740 20 client.17304 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0eeadd0 0x555af0eed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f70b28b9740 4 client.17304 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555af0dd5850 con 0x555af0eeadd0 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.790+0000 7f70ada7f640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0eeadd0 0x555af0eed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70ada7f640 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0eeadd0 0x555af0eed1f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb1af7c182a831c server_cookie=b4d71755d720878c in_seq=0 out_seq=0 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f7091ffb640 10 client.17304 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f7091ffb640 1 -- 172.21.15.16:0/1837520190 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x555af0dd5850 con 0x555af0eeadd0 2024-09-10T23:50:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f7091ffb640 10 client.17304 handle_command_reply: tid=0 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 client.17304 shutdown 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 msgr2=0x555af0e75840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e75840 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009d00 tx=0x7f70a0005f90 comp rx=0 tx=0).stop 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 shutdown_connections 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x555af0eeadd0 0x555af0eed1f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555af0e6d950 0x555af0e707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555af0e619c0 0x555af0e75d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 --2- 172.21.15.16:0/1837520190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555af0e610a0 0x555af0e75840 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 >> 172.21.15.16:0/1837520190 conn(0x555af0e5eed0 msgr2=0x555af0e6bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f7091ffb640 0 client.17304 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 shutdown_connections 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 1 -- 172.21.15.16:0/1837520190 wait complete. 2024-09-10T23:50:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.791+0000 7f70b28b9740 20 client.17304 trim_cache size 0 max 16384 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "status": "no active scrubs running", 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "scrubs": {}, 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_stats": { 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "a1902b44-17af-45fe-af50-a5a25ddf2503": { 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:49:38.723030+0000", 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.799 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "14ec25e9-6e3c-4668-8e31-7445d91560fb": { 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:55.907798+0000", 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "a58a062b-771a-4263-be8c-56213e24ce49": { 2024-09-10T23:50:11.800 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:47:30.314330+0000", 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "1d0ed6ce-6b6c-4189-b8c6-0f7bc090ea21": { 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:12.359119+0000", 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "98d86a4c-6edc-4306-8e2e-ff62ec168211": { 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:40:55.897348+0000", 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "e7bd41a8-95dd-412c-bf4d-e4e14a4e76b8": { 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:50.282386+0000", 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.802 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "c875b0be-baec-4865-af9f-deac35c2ab7b": { 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:37.111281+0000", 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "035cb11d-5a0e-460f-836d-8711666c4efa": { 2024-09-10T23:50:11.803 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:47.630093+0000", 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "baece9df-456d-49dd-97ef-4dda3c1d83f8": { 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:41:08.043133+0000", 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.804 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "639441ff-19fd-4ae8-8724-9893c482cd8c": { 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:46:26.786466+0000", 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "929418da-1031-4c88-ab22-3439cedacaf4": { 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:02.565968+0000", 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.805 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "28040b4e-b0ec-451e-ab01-68613a292947": { 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:42:32.531634+0000", 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "343dfa4b-bfad-4056-b8bf-5f4133f990f0": { 2024-09-10T23:50:11.806 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:45:44.620218+0000", 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "8c5c25f8-0d7f-493c-bf0c-92c1d3c9bf3d": { 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:08.835920+0000", 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "dc39dd20-224e-45cc-87b8-22db618aa261": { 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:48:13.371560+0000", 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "b4d8eb92-df0e-4fca-b2e9-ea75bebd5309": { 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:14.864880+0000", 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.808 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "5cd42502-33fa-4478-8794-e352e38ba9ee": { 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:43:57.423123+0000", 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "69534c25-e99f-40d5-a5d4-5ef1d97f7982": { 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "start_time": "2024-09-10T23:44:51.683161+0000", 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-10T23:50:11.809 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_started": 0, 2024-09-10T23:50:11.810 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_passed": 0, 2024-09-10T23:50:11.810 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_failed": 0, 2024-09-10T23:50:11.810 INFO:teuthology.orchestra.run.smithi016.stdout: "uninline_skipped": 0 2024-09-10T23:50:11.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:11.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:11.810 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:50:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f70940b54d0 msgr2=0x7f70940b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f70940b54d0 0x7f70940b7990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70a41042d0 tx=0x7f70a40b4040 comp rx=0 tx=0).stop 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 msgr2=0x7f70a819a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a819a050 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005940 tx=0x7f70a40042f0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 shutdown_connections 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70a8108020 0x7f70a819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f70940b54d0 0x7f70940b7990 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a81076a0 0x7f70a819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 --2- 172.21.15.16:0/252496750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a8101c90 0x7f70a819a050 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 >> 172.21.15.16:0/252496750 conn(0x7f70a80fd700 msgr2=0x7f70a80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 shutdown_connections 2024-09-10T23:50:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:11.792+0000 7f70b04e4640 1 -- 172.21.15.16:0/252496750 wait complete. 2024-09-10T23:50:12.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:12 smithi016 ceph-mon[30855]: pgmap v626: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:50:12.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:12 smithi071 ceph-mon[35018]: pgmap v626: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:50:12.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:12 smithi066 ceph-mon[34761]: pgmap v626: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-10T23:50:12.602 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:50:12.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:50:12.863 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:13.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 -- 172.21.15.16:0/891987441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 msgr2=0x7f14fc10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 --2- 172.21.15.16:0/891987441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc10f5a0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009ca0 tx=0x7f14f402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 -- 172.21.15.16:0/891987441 shutdown_connections 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 --2- 172.21.15.16:0/891987441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc10f5a0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 --2- 172.21.15.16:0/891987441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14fc104600 0x7f14fc10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 --2- 172.21.15.16:0/891987441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14fc103ce0 0x7f14fc1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 -- 172.21.15.16:0/891987441 >> 172.21.15.16:0/891987441 conn(0x7f14fc0fd700 msgr2=0x7f14fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 -- 172.21.15.16:0/891987441 shutdown_connections 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.363+0000 7f1501782640 1 -- 172.21.15.16:0/891987441 wait complete. 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 Processor -- start 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 -- start start 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14fc103ce0 0x7f14fc101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14fc104600 0x7f14fc101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc112e10 con 0x7f14fc10d140 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc112c90 con 0x7f14fc103ce0 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f1501782640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc112f90 con 0x7f14fc104600 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f14fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f14fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58534/0 (socket says 172.21.15.16:58534) 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f14fb7fe640 1 -- 172.21.15.16:0/991044244 learned_addr learned my addr 172.21.15.16:0/991044244 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f14f3fff640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14fc104600 0x7f14fc101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.364+0000 7f14faffd640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14fc103ce0 0x7f14fc101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14fb7fe640 1 -- 172.21.15.16:0/991044244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14fc104600 msgr2=0x7f14fc101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14fb7fe640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14fc104600 0x7f14fc101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14fb7fe640 1 -- 172.21.15.16:0/991044244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14fc103ce0 msgr2=0x7f14fc101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14fb7fe640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14fc103ce0 0x7f14fc101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14fb7fe640 1 -- 172.21.15.16:0/991044244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc1a76e0 con 0x7f14fc10d140 2024-09-10T23:50:13.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14faffd640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14fc103ce0 0x7f14fc101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14fb7fe640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc102410 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005cc0 tx=0x7f14f402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14f8ff9640 1 -- 172.21.15.16:0/991044244 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4003bf0 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14fc1a7970 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14f8ff9640 1 -- 172.21.15.16:0/991044244 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14f4003d90 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f14f8ff9640 1 -- 172.21.15.16:0/991044244 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f402fbc0 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.365+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14fc1a7f30 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.366+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14fc1040c0 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.368+0000 7f14f8ff9640 1 -- 172.21.15.16:0/991044244 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f14f4004610 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.368+0000 7f14f8ff9640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f14dc0b5450 0x7f14dc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.368+0000 7f14faffd640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f14dc0b5450 0x7f14dc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.368+0000 7f14f8ff9640 1 -- 172.21.15.16:0/991044244 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7f14f4107610 con 0x7f14fc10d140 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.369+0000 7f14faffd640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f14dc0b5450 0x7f14dc0b7910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0058c0 tx=0x7f14ec005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.371+0000 7f14f8ff9640 1 -- 172.21.15.16:0/991044244 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f14f40ce190 con 0x7f14fc10d140 2024-09-10T23:50:13.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.594+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14fc102c90 con 0x7f14fc10d140 2024-09-10T23:50:13.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.595+0000 7f14f8ff9640 1 -- 172.21.15.16:0/991044244 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f14f40cda90 con 0x7f14fc10d140 2024-09-10T23:50:13.596 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:50:13.596 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:50:13.597 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:50:13.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f14dc0b5450 msgr2=0x7f14dc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f14dc0b5450 0x7f14dc0b7910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0058c0 tx=0x7f14ec005850 comp rx=0 tx=0).stop 2024-09-10T23:50:13.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 msgr2=0x7f14fc102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc102410 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005cc0 tx=0x7f14f402f380 comp rx=0 tx=0).stop 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 shutdown_connections 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14fc10d140 0x7f14fc102410 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14fc104600 0x7f14fc101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f14dc0b5450 0x7f14dc0b7910 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 --2- 172.21.15.16:0/991044244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14fc103ce0 0x7f14fc101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 >> 172.21.15.16:0/991044244 conn(0x7f14fc0fd700 msgr2=0x7f14fc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 shutdown_connections 2024-09-10T23:50:13.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.598+0000 7f1501782640 1 -- 172.21.15.16:0/991044244 wait complete. 2024-09-10T23:50:13.731 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T23:50:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- 172.21.15.16:0/525115894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444101c10 msgr2=0x7fe444101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 --2- 172.21.15.16:0/525115894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444101c10 0x7fe444101ff0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe434009900 tx=0x7fe43402a410 comp rx=0 tx=0).stop 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- 172.21.15.16:0/525115894 shutdown_connections 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 --2- 172.21.15.16:0/525115894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe444107f90 0x7fe44410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 --2- 172.21.15.16:0/525115894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe444107610 0x7fe444107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 --2- 172.21.15.16:0/525115894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444101c10 0x7fe444101ff0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- 172.21.15.16:0/525115894 >> 172.21.15.16:0/525115894 conn(0x7fe4440fd690 msgr2=0x7fe4440ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- 172.21.15.16:0/525115894 shutdown_connections 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- 172.21.15.16:0/525115894 wait complete. 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 Processor -- start 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- start start 2024-09-10T23:50:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe444101c10 0x7fe444199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe444107610 0x7fe4441997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444107f90 0x7fe44419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe444111c50 con 0x7fe444107f90 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe444111ad0 con 0x7fe444101c10 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.836+0000 7fe4497f3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe444111dd0 con 0x7fe444107610 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444107f90 0x7fe44419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444107f90 0x7fe44419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60834/0 (socket says 172.21.15.16:60834) 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 -- 172.21.15.16:0/1363296179 learned_addr learned my addr 172.21.15.16:0/1363296179 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe442ffd640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe444101c10 0x7fe444199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe43bfff640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe444107610 0x7fe4441997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 -- 172.21.15.16:0/1363296179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe444107610 msgr2=0x7fe4441997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe444107610 0x7fe4441997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 -- 172.21.15.16:0/1363296179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe444101c10 msgr2=0x7fe444199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe444101c10 0x7fe444199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 -- 172.21.15.16:0/1363296179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44419f330 con 0x7fe444107f90 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4437fe640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444107f90 0x7fe44419eb60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00eaa0 tx=0x7fe43c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe440ff9640 1 -- 172.21.15.16:0/1363296179 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00cdb0 con 0x7fe444107f90 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe440ff9640 1 -- 172.21.15.16:0/1363296179 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe43c005020 con 0x7fe444107f90 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44419f620 con 0x7fe444107f90 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe440ff9640 1 -- 172.21.15.16:0/1363296179 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0116d0 con 0x7fe444107f90 2024-09-10T23:50:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.837+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4441a5ce0 con 0x7fe444107f90 2024-09-10T23:50:13.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.838+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe444101ff0 con 0x7fe444107f90 2024-09-10T23:50:13.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.840+0000 7fe440ff9640 1 -- 172.21.15.16:0/1363296179 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe43c00f040 con 0x7fe444107f90 2024-09-10T23:50:13.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.840+0000 7fe440ff9640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe4300b5450 0x7fe4300b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:13.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.840+0000 7fe442ffd640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe4300b5450 0x7fe4300b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:13.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.840+0000 7fe440ff9640 1 -- 172.21.15.16:0/1363296179 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7fe43c0e61a0 con 0x7fe444107f90 2024-09-10T23:50:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.841+0000 7fe442ffd640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe4300b5450 0x7fe4300b7910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe434031440 tx=0x7fe434005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:13.843+0000 7fe440ff9640 1 -- 172.21.15.16:0/1363296179 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe43c016030 con 0x7fe444107f90 2024-09-10T23:50:14.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.053+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fe444063590 con 0x7fe4300b5450 2024-09-10T23:50:14.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.061+0000 7fe440ff9640 1 -- 172.21.15.16:0/1363296179 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fe444063590 con 0x7fe4300b5450 2024-09-10T23:50:14.062 INFO:teuthology.orchestra.run.smithi016.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T23:40:11", "first": "2024-09-10T23:41:00", "last": "2024-09-10T23:50:00", "last_pruned": "2024-09-10T23:50:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-10T23:50:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe4300b5450 msgr2=0x7fe4300b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe4300b5450 0x7fe4300b7910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe434031440 tx=0x7fe434005b50 comp rx=0 tx=0).stop 2024-09-10T23:50:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444107f90 msgr2=0x7fe44419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444107f90 0x7fe44419eb60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00eaa0 tx=0x7fe43c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:50:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 shutdown_connections 2024-09-10T23:50:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe444107f90 0x7fe44419eb60 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe444107610 0x7fe4441997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe4300b5450 0x7fe4300b7910 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 --2- 172.21.15.16:0/1363296179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe444101c10 0x7fe444199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 >> 172.21.15.16:0/1363296179 conn(0x7fe4440fd690 msgr2=0x7fe44406b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 shutdown_connections 2024-09-10T23:50:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.063+0000 7fe4497f3640 1 -- 172.21.15.16:0/1363296179 wait complete. 2024-09-10T23:50:14.075 DEBUG:teuthology.orchestra.run.smithi016:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T23:50:14.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 -- 172.21.15.16:0/1056945518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 msgr2=0x7f291810f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:14.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 --2- 172.21.15.16:0/1056945518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291810f870 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f2910009ca0 tx=0x7f291002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 -- 172.21.15.16:0/1056945518 shutdown_connections 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 --2- 172.21.15.16:0/1056945518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291810f870 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 --2- 172.21.15.16:0/1056945518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29181086f0 0x7f2918108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 --2- 172.21.15.16:0/1056945518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2918102cf0 0x7f29181030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 -- 172.21.15.16:0/1056945518 >> 172.21.15.16:0/1056945518 conn(0x7f29180fe6f0 msgr2=0x7f2918100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 -- 172.21.15.16:0/1056945518 shutdown_connections 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 -- 172.21.15.16:0/1056945518 wait complete. 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 Processor -- start 2024-09-10T23:50:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.182+0000 7f291e30e640 1 -- start start 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291e30e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2918102cf0 0x7f2918199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291e30e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29181086f0 0x7f29181997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291e30e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291e30e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2918112d40 con 0x7f2918109070 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291e30e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2918112bc0 con 0x7f2918102cf0 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291e30e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2918112ec0 con 0x7f29181086f0 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:14.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291819eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60852/0 (socket says 172.21.15.16:60852) 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 -- 172.21.15.16:0/2870984768 learned_addr learned my addr 172.21.15.16:0/2870984768 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f2917fff640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2918102cf0 0x7f2918199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f29177fe640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29181086f0 0x7f29181997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 -- 172.21.15.16:0/2870984768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29181086f0 msgr2=0x7f29181997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29181086f0 0x7f29181997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 -- 172.21.15.16:0/2870984768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2918102cf0 msgr2=0x7f2918199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2918102cf0 0x7f2918199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 -- 172.21.15.16:0/2870984768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291819f300 con 0x7f2918109070 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.183+0000 7f291c8ab640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291819eb30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f291002f540 tx=0x7f29100316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.184+0000 7f29157fa640 1 -- 172.21.15.16:0/2870984768 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910003b70 con 0x7f2918109070 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.184+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291819f590 con 0x7f2918109070 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.184+0000 7f29157fa640 1 -- 172.21.15.16:0/2870984768 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2910003d10 con 0x7f2918109070 2024-09-10T23:50:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.184+0000 7f29157fa640 1 -- 172.21.15.16:0/2870984768 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291002f990 con 0x7f2918109070 2024-09-10T23:50:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.184+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29181a5cb0 con 0x7f2918109070 2024-09-10T23:50:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.185+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29181030d0 con 0x7f2918109070 2024-09-10T23:50:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.186+0000 7f29157fa640 1 -- 172.21.15.16:0/2870984768 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f291002fb30 con 0x7f2918109070 2024-09-10T23:50:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.187+0000 7f29157fa640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29000b5450 0x7f29000b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.187+0000 7f2917fff640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29000b5450 0x7f29000b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.187+0000 7f29157fa640 1 -- 172.21.15.16:0/2870984768 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7f2910107390 con 0x7f2918109070 2024-09-10T23:50:14.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.187+0000 7f2917fff640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29000b5450 0x7f29000b7910 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2908009bd0 tx=0x7f2908005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:14.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.190+0000 7f29157fa640 1 -- 172.21.15.16:0/2870984768 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f29100cdeb0 con 0x7f2918109070 2024-09-10T23:50:14.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:14 smithi016 ceph-mon[30855]: pgmap v627: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:50:14.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:14 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/991044244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:14.315 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T23:50:14.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.400+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 --> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2918063590 con 0x7f29000b5450 2024-09-10T23:50:14.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.408+0000 7f29157fa640 1 -- 172.21.15.16:0/2870984768 <== mgr.14220 v2:172.21.15.16:6800/3253461284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2918063590 con 0x7f29000b5450 2024-09-10T23:50:14.414 INFO:teuthology.orchestra.run.smithi016.stdout:/ 1m 6m3h 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29000b5450 msgr2=0x7f29000b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29000b5450 0x7f29000b7910 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2908009bd0 tx=0x7f2908005f90 comp rx=0 tx=0).stop 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 msgr2=0x7f291819eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291819eb30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f291002f540 tx=0x7f29100316f0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 shutdown_connections 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2918109070 0x7f291819eb30 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29181086f0 0x7f29181997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f29000b5450 0x7f29000b7910 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 --2- 172.21.15.16:0/2870984768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2918102cf0 0x7f2918199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:14.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 >> 172.21.15.16:0/2870984768 conn(0x7f29180fe6f0 msgr2=0x7f29180ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:14.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 shutdown_connections 2024-09-10T23:50:14.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:14.411+0000 7f291e30e640 1 -- 172.21.15.16:0/2870984768 wait complete. 2024-09-10T23:50:14.423 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T23:50:14.434 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T23:50:14.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:14 smithi071 ceph-mon[35018]: pgmap v627: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:50:14.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:14 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/991044244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:14 smithi066 ceph-mon[34761]: pgmap v627: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T23:50:14.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:14 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/991044244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:14.574 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.049+0000 7fc27c415640 1 -- 172.21.15.16:0/3309527986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 msgr2=0x7fc2741031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.049+0000 7fc27c415640 1 --2- 172.21.15.16:0/3309527986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc2741031a0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc264009ca0 tx=0x7fc26402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.049+0000 7fc27c415640 1 -- 172.21.15.16:0/3309527986 shutdown_connections 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.049+0000 7fc27c415640 1 --2- 172.21.15.16:0/3309527986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109150 0x7fc27410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.049+0000 7fc27c415640 1 --2- 172.21.15.16:0/3309527986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2741087d0 0x7fc274108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.049+0000 7fc27c415640 1 --2- 172.21.15.16:0/3309527986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc2741031a0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.049+0000 7fc27c415640 1 -- 172.21.15.16:0/3309527986 >> 172.21.15.16:0/3309527986 conn(0x7fc2740fe830 msgr2=0x7fc274100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.050+0000 7fc27c415640 1 -- 172.21.15.16:0/3309527986 shutdown_connections 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.050+0000 7fc27c415640 1 -- 172.21.15.16:0/3309527986 wait complete. 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.050+0000 7fc27c415640 1 Processor -- start 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.050+0000 7fc27c415640 1 -- start start 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc27419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2741087d0 0x7fc27419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109150 0x7fc2741a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc274112e10 con 0x7fc274102dc0 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc274112c90 con 0x7fc274109150 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc274112f90 con 0x7fc2741087d0 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc27419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc27419b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60876/0 (socket says 172.21.15.16:60876) 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 -- 172.21.15.16:0/4097814242 learned_addr learned my addr 172.21.15.16:0/4097814242 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc2799b0640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2741087d0 0x7fc27419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 -- 172.21.15.16:0/4097814242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2741087d0 msgr2=0x7fc27419ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2741087d0 0x7fc27419ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 -- 172.21.15.16:0/4097814242 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109150 msgr2=0x7fc2741a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109150 0x7fc2741a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 -- 172.21.15.16:0/4097814242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2741a1590 con 0x7fc274102dc0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc2799b0640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2741087d0 0x7fc27419ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc27419b4e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc264006010 tx=0x7fc2640319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc2737fe640 1 -- 172.21.15.16:0/4097814242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264003bf0 con 0x7fc274102dc0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc2737fe640 1 -- 172.21.15.16:0/4097814242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc264003d90 con 0x7fc274102dc0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2741a1820 con 0x7fc274102dc0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc2737fe640 1 -- 172.21.15.16:0/4097814242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26402fc20 con 0x7fc274102dc0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.051+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741a7f40 con 0x7fc274102dc0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.054+0000 7fc27e7ea740 1 Processor -- start 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.054+0000 7fc2737fe640 1 -- 172.21.15.16:0/4097814242 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc2640046a0 con 0x7fc274102dc0 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.054+0000 7fc27e7ea740 1 -- start start 2024-09-10T23:50:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e7e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e8a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a640df4ea0 con 0x55a640e8ad80 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a640de42d0 con 0x55a640e7edf0 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a640de80e0 con 0x55a640e7e4d0 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60890/0 (socket says 172.21.15.16:60890) 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 -- 172.21.15.16:0/5157764 learned_addr learned my addr 172.21.15.16:0/5157764 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e7e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e8a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2737fe640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc25c0b54d0 0x7fc25c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 -- 172.21.15.16:0/5157764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 msgr2=0x55a640e7e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e7e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 -- 172.21.15.16:0/5157764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 msgr2=0x55a640e8a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e8a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 -- 172.21.15.16:0/5157764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a640b42650 con 0x55a640e8ad80 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc25c0b54d0 0x7fc25c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2737fe640 1 -- 172.21.15.16:0/4097814242 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7fc264107380 con 0x7fc274102dc0 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.055+0000 7fc2799b0640 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8d170 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc268009c20 tx=0x7fc26800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f029d13ed561dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc270de6640 1 -- 172.21.15.16:0/5157764 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268016070 con 0x55a640e8ad80 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc270de6640 1 -- 172.21.15.16:0/5157764 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc268011920 con 0x55a640e8ad80 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc270de6640 1 -- 172.21.15.16:0/5157764 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2680107f0 con 0x55a640e8ad80 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27e7ea740 1 -- 172.21.15.16:0/5157764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 msgr2=0x55a640e8d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8d170 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc268009c20 tx=0x7fc26800e6c0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc25c0b54d0 0x7fc25c0b7990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005fd0 tx=0x7fc26c00a750 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27e7ea740 1 -- 172.21.15.16:0/5157764 shutdown_connections 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8d170 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e8a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/5157764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e7e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.056+0000 7fc27e7ea740 1 -- 172.21.15.16:0/5157764 >> 172.21.15.16:0/5157764 conn(0x55a640e7c300 msgr2=0x55a640e7d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 -- 172.21.15.16:0/5157764 shutdown_connections 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 -- 172.21.15.16:0/5157764 wait complete. 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 -- start start 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 Processor -- start 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e8a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e87a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e88030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a640c45700 con 0x55a640e8ad80 2024-09-10T23:50:15.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a640d7f160 con 0x55a640e7edf0 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.057+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a640e8da00 con 0x55a640e7e4d0 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27e7ea740 10 client.0 _ll_register_callbacks cb 0x55a640d989e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e88030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e88030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60902/0 (socket says 172.21.15.16:60902) 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 -- 172.21.15.16:0/849102180 learned_addr learned my addr 172.21.15.16:0/849102180 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc2799b0640 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e87a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e8a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 -- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 msgr2=0x55a640e8a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e8a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 -- 172.21.15.16:0/849102180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 msgr2=0x55a640e87a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e87a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 -- 172.21.15.16:0/849102180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a640dacc90 con 0x55a640e8ad80 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e88030 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0126d0 tx=0x7fc26c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1596eb0ff7e97a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc259ffb640 1 -- 172.21.15.16:0/849102180 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c01d8c0 con 0x55a640e8ad80 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc259ffb640 1 -- 172.21.15.16:0/849102180 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7fc26c01da60 con 0x55a640e8ad80 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.058+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc268011920 con 0x55a640e8ad80 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc259ffb640 1 -- 172.21.15.16:0/849102180 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc26c01dc60 con 0x55a640e8ad80 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 10 client.17334 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a640e99350 con 0x55a640e8ad80 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc259ffb640 1 -- 172.21.15.16:0/849102180 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc268011920 con 0x55a640e8ad80 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc259ffb640 1 -- 172.21.15.16:0/849102180 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc26c024070 con 0x55a640e8ad80 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 10 client.17334 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 10 client.17334 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 20 client.17334 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640e9a900 0x55a640e9cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 4 client.17334 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a640df6df0 con 0x55a640e9a900 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.059+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640e9a900 0x55a640e9cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.060+0000 7fc259ffb640 10 client.17334 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.060+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640e9a900 0x55a640e9cd30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=489d4752f8f76813 server_cookie=ac2a826185045279 in_seq=0 out_seq=0 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc259ffb640 1 -- 172.21.15.16:0/849102180 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a640df6df0 con 0x55a640e9a900 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc259ffb640 10 client.17334 handle_command_reply: tid=0 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 client.17334 shutdown 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 msgr2=0x55a640e88030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e88030 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0126d0 tx=0x7fc26c005f60 comp rx=0 tx=0).stop 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 shutdown_connections 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640e9a900 0x55a640e9cd30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e88030 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e87a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc259ffb640 0 client.17334 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/849102180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e8a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 >> 172.21.15.16:0/849102180 conn(0x55a640e7c300 msgr2=0x55a640e81ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 shutdown_connections 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 1 -- 172.21.15.16:0/849102180 wait complete. 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.061+0000 7fc27e7ea740 20 client.17334 trim_cache size 0 max 16384 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 Processor -- start 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 -- start start 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e7e4d0 0x55a640e96c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7edf0 0x55a640e8c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e8ad80 0x55a640e8c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b31e0 con 0x55a640e7e4d0 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b0ab0 con 0x55a640e8ad80 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.074+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741ae920 con 0x55a640e7edf0 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e7e4d0 0x55a640e96c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e7e4d0 0x55a640e96c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60918/0 (socket says 172.21.15.16:60918) 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 -- 172.21.15.16:0/3210396141 learned_addr learned my addr 172.21.15.16:0/3210396141 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e8ad80 0x55a640e8c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc2799b0640 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7edf0 0x55a640e8c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 -- 172.21.15.16:0/3210396141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7edf0 msgr2=0x55a640e8c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7edf0 0x55a640e8c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 -- 172.21.15.16:0/3210396141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e8ad80 msgr2=0x55a640e8c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e8ad80 0x55a640e8c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 -- 172.21.15.16:0/3210396141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a640e8d4c0 con 0x55a640e7e4d0 2024-09-10T23:50:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e7e4d0 0x55a640e96c30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc2640c9dd0 tx=0x7fc2640095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e35e4924fc55f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc25bfff640 1 -- 172.21.15.16:0/3210396141 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640cdf00 con 0x55a640e7e4d0 2024-09-10T23:50:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc25bfff640 1 -- 172.21.15.16:0/3210396141 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc264036040 con 0x55a640e7e4d0 2024-09-10T23:50:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.075+0000 7fc25bfff640 1 -- 172.21.15.16:0/3210396141 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640c9a70 con 0x55a640e7e4d0 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 -- 172.21.15.16:0/3210396141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e7e4d0 msgr2=0x55a640e96c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e7e4d0 0x55a640e96c30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc2640c9dd0 tx=0x7fc2640095c0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 -- 172.21.15.16:0/3210396141 shutdown_connections 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e8ad80 0x55a640e8c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7edf0 0x55a640e8c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/3210396141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e7e4d0 0x55a640e96c30 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 -- 172.21.15.16:0/3210396141 >> 172.21.15.16:0/3210396141 conn(0x55a640e7c300 msgr2=0x55a640e7d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 -- 172.21.15.16:0/3210396141 shutdown_connections 2024-09-10T23:50:15.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 -- 172.21.15.16:0/3210396141 wait complete. 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 -- start start 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.076+0000 7fc27e7ea740 1 Processor -- start 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e92ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e931e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27e7ea740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741aef70 con 0x55a640e8ad80 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b03e0 con 0x55a640e7edf0 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27e7ea740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741af640 con 0x55a640e7e4d0 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27e7ea740 10 client.0 _ll_register_callbacks cb 0x7fc26c00a8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a9b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a1b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e92ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a9b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60920/0 (socket says 172.21.15.16:60920) 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a9b2640 1 -- 172.21.15.16:0/4097806712 learned_addr learned my addr 172.21.15.16:0/4097806712 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:15.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc2799b0640 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a1b1640 1 -- 172.21.15.16:0/4097806712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 msgr2=0x55a640e931e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e931e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a1b1640 1 -- 172.21.15.16:0/4097806712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 msgr2=0x55a640e8dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a1b1640 1 -- 172.21.15.16:0/4097806712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a640e8e190 con 0x55a640e7e4d0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a9b2640 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc27a1b1640 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e92ca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cd4b0 tx=0x7fc26402f6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953d5bb189aaba6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.077+0000 7fc259ffb640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc259ffb640 1 -- 172.21.15.16:0/4097806712 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640d22e0 con 0x55a640e7e4d0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc259ffb640 1 -- 172.21.15.16:0/4097806712 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7fc2640c9a70 con 0x55a640e7e4d0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc264036040 con 0x55a640e7e4d0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc259ffb640 1 -- 172.21.15.16:0/4097806712 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc2640cdf00 con 0x55a640e7e4d0 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 10 client.26701 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:15.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a640f07f80 con 0x55a640e7e4d0 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc259ffb640 1 -- 172.21.15.16:0/4097806712 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc264036040 con 0x55a640e7e4d0 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc259ffb640 1 -- 172.21.15.16:0/4097806712 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc2640d6900 con 0x55a640e7e4d0 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 10 client.26701 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 10 client.26701 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 20 client.26701 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640f08640 0x55a640f0aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 4 client.26701 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.078+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 --> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a640df28a0 con 0x55a640f08640 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc2799b0640 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640f08640 0x55a640f0aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc259ffb640 10 client.26701 ms_handle_connect on v2:172.21.15.71:6836/1674889906 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc2799b0640 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640f08640 0x55a640f0aa60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb16f500d40628fb server_cookie=884a2915d878380e in_seq=0 out_seq=0 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc259ffb640 1 -- 172.21.15.16:0/4097806712 <== mds.2 v2:172.21.15.71:6836/1674889906 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a640df28a0 con 0x55a640f08640 2024-09-10T23:50:15.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc259ffb640 10 client.26701 handle_command_reply: tid=0 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 client.26701 shutdown 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 msgr2=0x55a640e92ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e92ca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cd4b0 tx=0x7fc26402f6f0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 shutdown_connections 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:6836/1674889906,v1:172.21.15.71:6837/1674889906] conn(0x55a640f08640 0x55a640f0aa60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a640e8ad80 0x55a640e8dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a640e7edf0 0x55a640e931e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc259ffb640 0 client.26701 ms_handle_reset on v2:172.21.15.71:6836/1674889906 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 --2- 172.21.15.16:0/4097806712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a640e7e4d0 0x55a640e92ca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 >> 172.21.15.16:0/4097806712 conn(0x55a640e7c300 msgr2=0x55a640e890a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.079+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 shutdown_connections 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27e7ea740 1 -- 172.21.15.16:0/4097806712 wait complete. 2024-09-10T23:50:15.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27e7ea740 20 client.26701 trim_cache size 0 max 16384 2024-09-10T23:50:15.097 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:50:15.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc25c0b54d0 msgr2=0x7fc25c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc25c0b54d0 0x7fc25c0b7990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005fd0 tx=0x7fc26c00a750 comp rx=0 tx=0).stop 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 msgr2=0x7fc27419b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc27419b4e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc264006010 tx=0x7fc2640319f0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 shutdown_connections 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fc25c0b54d0 0x7fc25c0b7990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109150 0x7fc2741a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2741087d0 0x7fc27419ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 --2- 172.21.15.16:0/4097814242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc274102dc0 0x7fc27419b4e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 >> 172.21.15.16:0/4097814242 conn(0x7fc2740fe830 msgr2=0x7fc274104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 shutdown_connections 2024-09-10T23:50:15.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:15.080+0000 7fc27c415640 1 -- 172.21.15.16:0/4097814242 wait complete. 2024-09-10T23:50:15.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:15 smithi016 ceph-mon[30855]: from='client.17316 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:15.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:15 smithi071 ceph-mon[35018]: from='client.17316 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:15.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:15 smithi066 ceph-mon[34761]: from='client.17316 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:15.787 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T23:50:16.045 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:16.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:16 smithi066 ceph-mon[34761]: from='client.17322 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:16.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:16 smithi066 ceph-mon[34761]: pgmap v628: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:50:16.466 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:16 smithi016 ceph-mon[30855]: from='client.17322 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:16.466 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:16 smithi016 ceph-mon[30855]: pgmap v628: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:50:16.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:16 smithi071 ceph-mon[35018]: from='client.17322 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:16.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:16 smithi071 ceph-mon[35018]: pgmap v628: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 -- 172.21.15.16:0/213553857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa500108060 msgr2=0x7fa50010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 --2- 172.21.15.16:0/213553857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa500108060 0x7fa50010e860 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009ca0 tx=0x7fa4f802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 -- 172.21.15.16:0/213553857 shutdown_connections 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 --2- 172.21.15.16:0/213553857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa500108060 0x7fa50010e860 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 --2- 172.21.15.16:0/213553857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa5001076e0 0x7fa500107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 --2- 172.21.15.16:0/213553857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa500101cd0 0x7fa5001020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 -- 172.21.15.16:0/213553857 >> 172.21.15.16:0/213553857 conn(0x7fa5000fd700 msgr2=0x7fa5000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 -- 172.21.15.16:0/213553857 shutdown_connections 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 -- 172.21.15.16:0/213553857 wait complete. 2024-09-10T23:50:16.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 Processor -- start 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.549+0000 7fa5061c3640 1 -- start start 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa5061c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500101cd0 0x7fa5000fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa5061c3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5001076e0 0x7fa5000fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa5061c3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa500108060 0x7fa5000fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa5061c3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa500111d20 con 0x7fa5001076e0 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa5061c3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa500111ba0 con 0x7fa500108060 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa5061c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa500111ea0 con 0x7fa500101cd0 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5001076e0 0x7fa5000fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5001076e0 0x7fa5000fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60942/0 (socket says 172.21.15.16:60942) 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 -- 172.21.15.16:0/362649291 learned_addr learned my addr 172.21.15.16:0/362649291 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500101cd0 0x7fa5000fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4fffff640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa500108060 0x7fa5000fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 -- 172.21.15.16:0/362649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500101cd0 msgr2=0x7fa5000fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500101cd0 0x7fa5000fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 -- 172.21.15.16:0/362649291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa500108060 msgr2=0x7fa5000fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa500108060 0x7fa5000fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 -- 172.21.15.16:0/362649291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5001a76a0 con 0x7fa5001076e0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4feffd640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5001076e0 0x7fa5000fe140 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e9f0 tx=0x7fa4f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.550+0000 7fa4fcff9640 1 -- 172.21.15.16:0/362649291 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f400ccc0 con 0x7fa5001076e0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.551+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5001a7990 con 0x7fa5001076e0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.551+0000 7fa4fcff9640 1 -- 172.21.15.16:0/362649291 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f40108e0 con 0x7fa5001076e0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.551+0000 7fa4fcff9640 1 -- 172.21.15.16:0/362649291 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4018880 con 0x7fa5001076e0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.551+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5001a7fa0 con 0x7fa5001076e0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 Processor -- start 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 -- start start 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa4fcff9640 1 -- 172.21.15.16:0/362649291 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa4f4010430 con 0x7fa5001076e0 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941a0f0 0x563d1941a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19426460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d194269a0 0x563d19428d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563d19390ea0 con 0x563d1941aa10 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563d193802d0 con 0x563d194269a0 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa508598740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d193840e0 con 0x563d1941a0f0 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.553+0000 7fa4ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19426460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4fffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941a0f0 0x563d1941a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19426460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60948/0 (socket says 172.21.15.16:60948) 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 -- 172.21.15.16:0/1717962054 learned_addr learned my addr 172.21.15.16:0/1717962054 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4feffd640 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d194269a0 0x563d19428d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 -- 172.21.15.16:0/1717962054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941a0f0 msgr2=0x563d1941a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941a0f0 0x563d1941a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 -- 172.21.15.16:0/1717962054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d194269a0 msgr2=0x563d19428d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d194269a0 0x563d19428d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 -- 172.21.15.16:0/1717962054 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d190de650 con 0x563d1941aa10 2024-09-10T23:50:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19426460 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009a70 tx=0x7fa4f0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d00a62f7a79f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4fcff9640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa4e80b54d0 0x7fa4e80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1717962054 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0017070 con 0x563d1941aa10 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1717962054 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f0013470 con 0x563d1941aa10 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4e5ffb640 1 -- 172.21.15.16:0/1717962054 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0012630 con 0x563d1941aa10 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4fffff640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa4e80b54d0 0x7fa4e80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.554+0000 7fa4fcff9640 1 -- 172.21.15.16:0/362649291 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7fa4f40e6400 con 0x7fa5001076e0 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 -- 172.21.15.16:0/1717962054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 msgr2=0x563d19426460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa4fffff640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa4e80b54d0 0x7fa4e80b7990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8006010 tx=0x7fa4f8005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19426460 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009a70 tx=0x7fa4f0009f30 comp rx=0 tx=0).stop 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 -- 172.21.15.16:0/1717962054 shutdown_connections 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d194269a0 0x563d19428d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19426460 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 --2- 172.21.15.16:0/1717962054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941a0f0 0x563d1941a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 -- 172.21.15.16:0/1717962054 >> 172.21.15.16:0/1717962054 conn(0x563d19417f20 msgr2=0x563d194190c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 -- 172.21.15.16:0/1717962054 shutdown_connections 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 -- 172.21.15.16:0/1717962054 wait complete. 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.555+0000 7fa508598740 1 -- start start 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 1 Processor -- start 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d194262b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19423700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d19423d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563d191e1700 con 0x563d1941aa10 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563d1931b160 con 0x563d1941a0f0 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d19429620 con 0x563d194269a0 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa508598740 10 client.0 _ll_register_callbacks cb 0x563d193349e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19423700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19423700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60954/0 (socket says 172.21.15.16:60954) 2024-09-10T23:50:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 -- 172.21.15.16:0/138931694 learned_addr learned my addr 172.21.15.16:0/138931694 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4fffff640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d19423d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d194262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 -- 172.21.15.16:0/138931694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 msgr2=0x563d19423d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d19423d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 -- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 msgr2=0x563d194262b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d194262b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4feffd640 1 -- 172.21.15.16:0/138931694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d19348c90 con 0x563d1941aa10 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.556+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d194262b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa4feffd640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19423700 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e9c0 tx=0x7fa4f40e9b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b345ec4c9a2438b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa4deffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa4deffd640 1 -- 172.21.15.16:0/138931694 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40ac650 con 0x563d1941aa10 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa4deffd640 1 -- 172.21.15.16:0/138931694 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7fa4f40abce0 con 0x563d1941aa10 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f0013470 con 0x563d1941aa10 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa4deffd640 1 -- 172.21.15.16:0/138931694 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa4f40abff0 con 0x563d1941aa10 2024-09-10T23:50:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 10 client.17352 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d19434fb0 con 0x563d1941aa10 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa4deffd640 1 -- 172.21.15.16:0/138931694 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f0013470 con 0x563d1941aa10 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa4deffd640 1 -- 172.21.15.16:0/138931694 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa4f40cfbd0 con 0x563d1941aa10 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 10 client.17352 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 10 client.17352 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 20 client.17352 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d19436470 0x563d19438860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 4 client.17352 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.557+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d19392df0 con 0x563d19436470 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.558+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d19436470 0x563d19438860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.558+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d19436470 0x563d19438860 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59a4acc92e08c03 server_cookie=53a864715a1479b8 in_seq=0 out_seq=0 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.558+0000 7fa4deffd640 10 client.17352 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa4deffd640 1 -- 172.21.15.16:0/138931694 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d19392df0 con 0x563d19436470 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa4deffd640 10 client.17352 handle_command_reply: tid=0 2024-09-10T23:50:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 client.17352 shutdown 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 msgr2=0x563d19423700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19423700 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e9c0 tx=0x7fa4f40e9b40 comp rx=0 tx=0).stop 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 shutdown_connections 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d19436470 0x563d19438860 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d19423d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa4deffd640 0 client.17352 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d19423700 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 --2- 172.21.15.16:0/138931694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d194262b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 >> 172.21.15.16:0/138931694 conn(0x563d19417f20 msgr2=0x563d1941dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 shutdown_connections 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 1 -- 172.21.15.16:0/138931694 wait complete. 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.559+0000 7fa508598740 20 client.17352 trim_cache size 0 max 16384 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.572+0000 7fa508598740 1 Processor -- start 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.572+0000 7fa508598740 1 -- start start 2024-09-10T23:50:16.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa508598740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d19432880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa508598740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941aa10 0x563d1941e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa508598740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d194269a0 0x563d1941eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa508598740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5001b32e0 con 0x563d194269a0 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa508598740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5001b0bb0 con 0x563d1941a0f0 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa508598740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5001aea20 con 0x563d1941aa10 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d194269a0 0x563d1941eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d194269a0 0x563d1941eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60958/0 (socket says 172.21.15.16:60958) 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 -- 172.21.15.16:0/1781331797 learned_addr learned my addr 172.21.15.16:0/1781331797 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4feffd640 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941aa10 0x563d1941e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d19432880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 -- 172.21.15.16:0/1781331797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941aa10 msgr2=0x563d1941e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941aa10 0x563d1941e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 -- 172.21.15.16:0/1781331797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 msgr2=0x563d19432880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d19432880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 -- 172.21.15.16:0/1781331797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d19438e90 con 0x563d194269a0 2024-09-10T23:50:16.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.573+0000 7fa4fffff640 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d194269a0 0x563d1941eef0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8035000 tx=0x7fa4f8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab7f5373bab6753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa4e57fa640 1 -- 172.21.15.16:0/1781331797 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80318e0 con 0x563d194269a0 2024-09-10T23:50:16.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa4e57fa640 1 -- 172.21.15.16:0/1781331797 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f8036050 con 0x563d194269a0 2024-09-10T23:50:16.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa4e57fa640 1 -- 172.21.15.16:0/1781331797 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80305e0 con 0x563d194269a0 2024-09-10T23:50:16.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 -- 172.21.15.16:0/1781331797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d194269a0 msgr2=0x563d1941eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d194269a0 0x563d1941eef0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8035000 tx=0x7fa4f8040000 comp rx=0 tx=0).stop 2024-09-10T23:50:16.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 -- 172.21.15.16:0/1781331797 shutdown_connections 2024-09-10T23:50:16.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d194269a0 0x563d1941eef0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d1941aa10 0x563d1941e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 --2- 172.21.15.16:0/1781331797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d19432880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 -- 172.21.15.16:0/1781331797 >> 172.21.15.16:0/1781331797 conn(0x563d19417f20 msgr2=0x563d19418fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 -- 172.21.15.16:0/1781331797 shutdown_connections 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.574+0000 7fa508598740 1 -- 172.21.15.16:0/1781331797 wait complete. 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 -- start start 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 Processor -- start 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d1942e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d1942ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d194298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5001af070 con 0x563d1941aa10 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5001b04e0 con 0x563d1941a0f0 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa5001af740 con 0x563d194269a0 2024-09-10T23:50:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa508598740 10 client.0 _ll_register_callbacks cb 0x7fa4f40e9c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d1942ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa4ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d1942e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa4ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d1942e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.16:35308/0 (socket says 172.21.15.16:35308) 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa4feffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d1942ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60960/0 (socket says 172.21.15.16:60960) 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.575+0000 7fa4ff7fe640 1 -- 172.21.15.16:0/3453142161 learned_addr learned my addr 172.21.15.16:0/3453142161 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4fffff640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d194298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4feffd640 1 -- 172.21.15.16:0/3453142161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 msgr2=0x563d194298a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4feffd640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d194298a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4feffd640 1 -- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 msgr2=0x563d1942e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4feffd640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d1942e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4feffd640 1 -- 172.21.15.16:0/3453142161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d19429e10 con 0x563d1941aa10 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4fffff640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d194298a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d1942e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4feffd640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d1942ee30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40e4150 tx=0x7fa4f40b5f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c7f6b3bf0cdb08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4deffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4deffd640 1 -- 172.21.15.16:0/3453142161 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40ac1d0 con 0x563d1941aa10 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4deffd640 1 -- 172.21.15.16:0/3453142161 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8514+0+0 (secure 0 0 0) 0x7fa4f40abae0 con 0x563d1941aa10 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f8036050 con 0x563d1941aa10 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa4deffd640 1 -- 172.21.15.16:0/3453142161 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa4f40ac650 con 0x563d1941aa10 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa508598740 10 client.17358 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.576+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d194a3b20 con 0x563d1941aa10 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa4deffd640 1 -- 172.21.15.16:0/3453142161 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f8036050 con 0x563d1941aa10 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa4deffd640 1 -- 172.21.15.16:0/3453142161 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa4f40ab550 con 0x563d1941aa10 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa508598740 10 client.17358 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa508598740 10 client.17358 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa508598740 20 client.17358 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa508598740 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d194a4290 0x563d194a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa508598740 4 client.17358 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:50:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 --> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d1938e8a0 con 0x563d194a4290 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.577+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d194a4290 0x563d194a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa4deffd640 10 client.17358 ms_handle_connect on v2:172.21.15.66:6838/3877648369 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa4ff7fe640 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d194a4290 0x563d194a6680 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d8285e2f23e8e99 server_cookie=ab0196f13eb5b143 in_seq=0 out_seq=0 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa4deffd640 1 -- 172.21.15.16:0/3453142161 <== mds.1 v2:172.21.15.66:6838/3877648369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d1938e8a0 con 0x563d194a4290 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa4deffd640 10 client.17358 handle_command_reply: tid=0 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 client.17358 shutdown 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 msgr2=0x563d1942ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d1942ee30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40e4150 tx=0x7fa4f40b5f20 comp rx=0 tx=0).stop 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 shutdown_connections 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:6838/3877648369,v1:172.21.15.66:6839/3877648369] conn(0x563d194a4290 0x563d194a6680 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa4deffd640 0 client.17358 ms_handle_reset on v2:172.21.15.66:6838/3877648369 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d194269a0 0x563d194298a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563d1941aa10 0x563d1942ee30 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 --2- 172.21.15.16:0/3453142161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d1941a0f0 0x563d1942e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 >> 172.21.15.16:0/3453142161 conn(0x563d19417f20 msgr2=0x563d1941e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:16.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 shutdown_connections 2024-09-10T23:50:16.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 1 -- 172.21.15.16:0/3453142161 wait complete. 2024-09-10T23:50:16.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.578+0000 7fa508598740 20 client.17358 trim_cache size 0 max 16384 2024-09-10T23:50:16.594 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa4e80b54d0 msgr2=0x7fa4e80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa4e80b54d0 0x7fa4e80b7990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8006010 tx=0x7fa4f8005c30 comp rx=0 tx=0).stop 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5001076e0 msgr2=0x7fa5000fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5001076e0 0x7fa5000fe140 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e9f0 tx=0x7fa4f400edf0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 shutdown_connections 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fa4e80b54d0 0x7fa4e80b7990 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa500108060 0x7fa5000fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5001076e0 0x7fa5000fe140 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 --2- 172.21.15.16:0/362649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa500101cd0 0x7fa5000fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 >> 172.21.15.16:0/362649291 conn(0x7fa5000fd700 msgr2=0x7fa50006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 shutdown_connections 2024-09-10T23:50:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:16.579+0000 7fa5061c3640 1 -- 172.21.15.16:0/362649291 wait complete. 2024-09-10T23:50:17.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T23:50:17.537 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:18.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 -- 172.21.15.16:0/4071566636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf0109150 msgr2=0x7f6bf010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/4071566636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf0109150 0x7f6bf010f950 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009900 tx=0x7f6be802a410 comp rx=0 tx=0).stop 2024-09-10T23:50:18.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 -- 172.21.15.16:0/4071566636 shutdown_connections 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/4071566636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf0109150 0x7f6bf010f950 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/4071566636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf01087d0 0x7f6bf0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/4071566636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf0102dc0 0x7f6bf01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 -- 172.21.15.16:0/4071566636 >> 172.21.15.16:0/4071566636 conn(0x7f6bf00fe830 msgr2=0x7f6bf0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 -- 172.21.15.16:0/4071566636 shutdown_connections 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 -- 172.21.15.16:0/4071566636 wait complete. 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 Processor -- start 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.008+0000 7f6bf73fd640 1 -- start start 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf73fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf0102dc0 0x7f6bf0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf73fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf01087d0 0x7f6bf01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf73fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0109150 0x7f6bf019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf73fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0112dd0 con 0x7f6bf01087d0 2024-09-10T23:50:18.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf73fd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0112c50 con 0x7f6bf0102dc0 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf73fd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0112f50 con 0x7f6bf0109150 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf01087d0 0x7f6bf01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf01087d0 0x7f6bf01997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60976/0 (socket says 172.21.15.16:60976) 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 -- 172.21.15.16:0/3744443594 learned_addr learned my addr 172.21.15.16:0/3744443594 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0109150 0x7f6bf019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf5199640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf0102dc0 0x7f6bf0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 -- 172.21.15.16:0/3744443594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0109150 msgr2=0x7f6bf019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0109150 0x7f6bf019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 -- 172.21.15.16:0/3744443594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf0102dc0 msgr2=0x7f6bf0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf0102dc0 0x7f6bf0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 -- 172.21.15.16:0/3744443594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf019f330 con 0x7f6bf01087d0 2024-09-10T23:50:18.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0109150 0x7f6bf019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6bf4998640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf01087d0 0x7f6bf01997c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6be000d770 tx=0x7f6be000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.009+0000 7f6be67fc640 1 -- 172.21.15.16:0/3744443594 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0017070 con 0x7f6bf01087d0 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.010+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf019f620 con 0x7f6bf01087d0 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.010+0000 7f6be67fc640 1 -- 172.21.15.16:0/3744443594 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be00054d0 con 0x7f6bf01087d0 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.010+0000 7f6be67fc640 1 -- 172.21.15.16:0/3744443594 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0004c30 con 0x7f6bf01087d0 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.010+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf01a5ce0 con 0x7f6bf01087d0 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.012+0000 7f6be67fc640 1 -- 172.21.15.16:0/3744443594 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f6be0004e10 con 0x7f6bf01087d0 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 Processor -- start 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 -- start start 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c91a10 0x55e352c9d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352c9fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e352c07ea0 con 0x55e352c91a10 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e352bf72d0 con 0x55e352c9d9a0 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e352bfb0e0 con 0x55e352c910f0 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c91a10 0x55e352c9d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c91a10 0x55e352c9d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60982/0 (socket says 172.21.15.16:60982) 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 -- 172.21.15.16:0/3252319168 learned_addr learned my addr 172.21.15.16:0/3252319168 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf4998640 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352c9fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6be67fc640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6bdc0b5450 0x7f6bdc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 -- 172.21.15.16:0/3252319168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 msgr2=0x55e352c914d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c914d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 -- 172.21.15.16:0/3252319168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 msgr2=0x55e352c9fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352c9fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf5199640 1 -- 172.21.15.16:0/3252319168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e352955650 con 0x55e352c91a10 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.013+0000 7f6bf4998640 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352c9fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.014+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6bdc0b5450 0x7f6bdc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.014+0000 7f6be67fc640 1 -- 172.21.15.16:0/3744443594 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f6be00e5ab0 con 0x7f6bf01087d0 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.014+0000 7f6bf5199640 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c91a10 0x55e352c9d460 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0039f0 tx=0x7f6bec003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b454cdc905d41d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.014+0000 7f6bdb7fe640 1 -- 172.21.15.16:0/3252319168 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec004b20 con 0x55e352c91a10 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.014+0000 7f6bdb7fe640 1 -- 172.21.15.16:0/3252319168 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bec004cc0 con 0x55e352c91a10 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.014+0000 7f6bdb7fe640 1 -- 172.21.15.16:0/3252319168 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0126b0 con 0x55e352c91a10 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3252319168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c91a10 msgr2=0x55e352c9d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6bdc0b5450 0x7f6bdc0b7910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6be8005940 tx=0x7f6be8009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c91a10 0x55e352c9d460 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0039f0 tx=0x7f6bec003eb0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3252319168 shutdown_connections 2024-09-10T23:50:18.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352c9fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c91a10 0x55e352c9d460 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3252319168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3252319168 >> 172.21.15.16:0/3252319168 conn(0x55e352c8ef20 msgr2=0x55e352c900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3252319168 shutdown_connections 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3252319168 wait complete. 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 -- start start 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.015+0000 7f6bf97d2740 1 Processor -- start 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c9d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c9a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c9ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e352a58700 con 0x55e352c9d9a0 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e352b92160 con 0x55e352c91a10 2024-09-10T23:50:18.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e352ca0620 con 0x55e352c910f0 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf97d2740 10 client.0 _ll_register_callbacks cb 0x55e352bab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c9ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c9ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60998/0 (socket says 172.21.15.16:60998) 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 -- 172.21.15.16:0/3710931735 learned_addr learned my addr 172.21.15.16:0/3710931735 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf5199640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c9d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf4998640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c9a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 -- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 msgr2=0x55e352c9d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c9d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 -- 172.21.15.16:0/3710931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 msgr2=0x55e352c9a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c9a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 -- 172.21.15.16:0/3710931735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e352bbfc90 con 0x55e352c9d9a0 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf4998640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c9a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bf599a640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c9ac60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6be8033000 tx=0x7f6be80058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77af8cbaedc42211 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.016+0000 7f6bd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/3710931735 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8035040 con 0x55e352c9d9a0 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/3710931735 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f6be8005450 con 0x55e352c9d9a0 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bec004cc0 con 0x55e352c9d9a0 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/3710931735 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6be8057050 con 0x55e352c9d9a0 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 10 client.17370 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e352cabeb0 con 0x55e352c9d9a0 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/3710931735 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bec004cc0 con 0x55e352c9d9a0 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/3710931735 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6be80035f0 con 0x55e352c9d9a0 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 10 client.17370 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 10 client.17370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 20 client.17370 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352caf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 4 client.17370 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.017+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e352c09df0 con 0x55e352cad410 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.018+0000 7f6bf5199640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352caf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.018+0000 7f6bf5199640 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352caf8b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffcb8f591b3614e4 server_cookie=72dab9582013597e in_seq=0 out_seq=0 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.018+0000 7f6bd8ff9640 10 client.17370 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/3710931735 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e352c09df0 con 0x55e352cad410 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bd8ff9640 10 client.17370 handle_command_reply: tid=0 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 client.17370 shutdown 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 msgr2=0x55e352c9ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c9ac60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6be8033000 tx=0x7f6be80058b0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 shutdown_connections 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352caf8b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bd8ff9640 0 client.17370 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c9ac60 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c9a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/3710931735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352c9d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 >> 172.21.15.16:0/3710931735 conn(0x55e352c8ef20 msgr2=0x55e352c94ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 shutdown_connections 2024-09-10T23:50:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 1 -- 172.21.15.16:0/3710931735 wait complete. 2024-09-10T23:50:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.019+0000 7f6bf97d2740 20 client.17370 trim_cache size 0 max 16384 2024-09-10T23:50:18.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 Processor -- start 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 -- start start 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352ca9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c97df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01b0f50 con 0x55e352c9d9a0 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01ae820 con 0x55e352c91a10 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01ac690 con 0x55e352c910f0 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c97df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c97df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32776/0 (socket says 172.21.15.16:32776) 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 -- 172.21.15.16:0/2579524708 learned_addr learned my addr 172.21.15.16:0/2579524708 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf5199640 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352ca9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf4998640 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 -- 172.21.15.16:0/2579524708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 msgr2=0x55e352ca9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352ca9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 -- 172.21.15.16:0/2579524708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 msgr2=0x55e352c978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf599a640 1 -- 172.21.15.16:0/2579524708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e352c953a0 con 0x55e352c9d9a0 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.033+0000 7f6bf5199640 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352ca9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.034+0000 7f6bf599a640 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c97df0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6be802a930 tx=0x7f6be8009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa522a12675094c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.034+0000 7f6bdaffd640 1 -- 172.21.15.16:0/2579524708 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8035070 con 0x55e352c9d9a0 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.034+0000 7f6bdaffd640 1 -- 172.21.15.16:0/2579524708 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be804e070 con 0x55e352c9d9a0 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.034+0000 7f6bdaffd640 1 -- 172.21.15.16:0/2579524708 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be80049f0 con 0x55e352c9d9a0 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 -- 172.21.15.16:0/2579524708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 msgr2=0x55e352c97df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c97df0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6be802a930 tx=0x7f6be8009540 comp rx=0 tx=0).stop 2024-09-10T23:50:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 -- 172.21.15.16:0/2579524708 shutdown_connections 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c9d9a0 0x55e352c97df0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c91a10 0x55e352c978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/2579524708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c910f0 0x55e352ca9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 -- 172.21.15.16:0/2579524708 >> 172.21.15.16:0/2579524708 conn(0x55e352c8ef20 msgr2=0x55e352c9c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 -- 172.21.15.16:0/2579524708 shutdown_connections 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 -- 172.21.15.16:0/2579524708 wait complete. 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 -- start start 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.035+0000 7f6bf97d2740 1 Processor -- start 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c910f0 0x55e352ca20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c91a10 0x55e352ca2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf97d2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352d19380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01acce0 con 0x55e352c910f0 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01ae150 con 0x55e352c9d9a0 2024-09-10T23:50:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf97d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01ad3b0 con 0x55e352c91a10 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf97d2740 10 client.0 _ll_register_callbacks cb 0x7f6be8031910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c910f0 0x55e352ca20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c910f0 0x55e352ca20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32784/0 (socket says 172.21.15.16:32784) 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 -- 172.21.15.16:0/1260955928 learned_addr learned my addr 172.21.15.16:0/1260955928 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf599a640 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352d19380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf4998640 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c91a10 0x55e352ca2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 -- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c91a10 msgr2=0x55e352ca2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c91a10 0x55e352ca2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 -- 172.21.15.16:0/1260955928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 msgr2=0x55e352d19380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352d19380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 -- 172.21.15.16:0/1260955928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e352d19a90 con 0x55e352c910f0 2024-09-10T23:50:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bf5199640 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c910f0 0x55e352ca20f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6bec005a20 tx=0x7f6bec005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75b225102ea1745 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.036+0000 7f6bd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/1260955928 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec034060 con 0x55e352c910f0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/1260955928 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f6bec004410 con 0x55e352c910f0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6be804e070 con 0x55e352c910f0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/1260955928 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bec02f480 con 0x55e352c910f0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 10 client.17376 fetch_fsmap learned FSMap version 25 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e352d1ad00 con 0x55e352c910f0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/1260955928 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be804e070 con 0x55e352c910f0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/1260955928 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bec00f040 con 0x55e352c910f0 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 10 client.17376 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 10 client.17376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 20 client.17376 populate_metadata read hostname 'smithi016' 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352d1d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 4 client.17376 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.037+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 --> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e352c058a0 con 0x55e352cad410 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf4998640 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352d1d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf4998640 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352d1d300 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=312bd26723563c82 server_cookie=566a4685dcd053f9 in_seq=0 out_seq=0 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bd8ff9640 10 client.17376 ms_handle_connect on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bd8ff9640 1 -- 172.21.15.16:0/1260955928 <== mds.0 v2:172.21.15.71:6838/542292698 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e352c058a0 con 0x55e352cad410 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bd8ff9640 10 client.17376 handle_command_reply: tid=0 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 client.17376 shutdown 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c910f0 msgr2=0x55e352ca20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c910f0 0x55e352ca20f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6bec005a20 tx=0x7f6bec005910 comp rx=0 tx=0).stop 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 shutdown_connections 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:6838/542292698,v1:172.21.15.71:6839/542292698] conn(0x55e352cad410 0x55e352d1d300 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e352c9d9a0 0x55e352d19380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e352c91a10 0x55e352ca2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 --2- 172.21.15.16:0/1260955928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e352c910f0 0x55e352ca20f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bd8ff9640 0 client.17376 ms_handle_reset on v2:172.21.15.71:6838/542292698 2024-09-10T23:50:18.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 >> 172.21.15.16:0/1260955928 conn(0x55e352c8ef20 msgr2=0x55e352c8d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:18.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 shutdown_connections 2024-09-10T23:50:18.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.038+0000 7f6bf97d2740 1 -- 172.21.15.16:0/1260955928 wait complete. 2024-09-10T23:50:18.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf97d2740 20 client.17376 trim_cache size 0 max 16384 2024-09-10T23:50:18.048 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6bdc0b5450 msgr2=0x7f6bdc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6bdc0b5450 0x7f6bdc0b7910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6be8005940 tx=0x7f6be8009260 comp rx=0 tx=0).stop 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf01087d0 msgr2=0x7f6bf01997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf01087d0 0x7f6bf01997c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6be000d770 tx=0x7f6be000dc30 comp rx=0 tx=0).stop 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 shutdown_connections 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0109150 0x7f6bf019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bf01087d0 0x7f6bf01997c0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f6bdc0b5450 0x7f6bdc0b7910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 --2- 172.21.15.16:0/3744443594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf0102dc0 0x7f6bf0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 >> 172.21.15.16:0/3744443594 conn(0x7f6bf00fe830 msgr2=0x7f6bf0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:18.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 shutdown_connections 2024-09-10T23:50:18.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.039+0000 7f6bf73fd640 1 -- 172.21.15.16:0/3744443594 wait complete. 2024-09-10T23:50:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:18 smithi016 ceph-mon[30855]: pgmap v629: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:50:18.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:18 smithi016 ceph-mon[30855]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:50:18.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:18 smithi071 ceph-mon[35018]: pgmap v629: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:50:18.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:18 smithi071 ceph-mon[35018]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:50:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:18 smithi066 ceph-mon[34761]: pgmap v629: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-10T23:50:18.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:18 smithi066 ceph-mon[34761]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:50:18.692 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T23:50:18.693 INFO:tasks.fwd_scrub:done joining 2024-09-10T23:50:18.693 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T23:50:18.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 -- 172.21.15.16:0/2050116301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0101c10 msgr2=0x7fd6e0101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/2050116301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0101c10 0x7fd6e0101ff0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009900 tx=0x7fd6c802a410 comp rx=0 tx=0).stop 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 -- 172.21.15.16:0/2050116301 shutdown_connections 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/2050116301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6e0107f90 0x7fd6e010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/2050116301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e0107610 0x7fd6e0107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/2050116301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0101c10 0x7fd6e0101ff0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 -- 172.21.15.16:0/2050116301 >> 172.21.15.16:0/2050116301 conn(0x7fd6e00fd610 msgr2=0x7fd6e00ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 -- 172.21.15.16:0/2050116301 shutdown_connections 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.808+0000 7fd6e6d10640 1 -- 172.21.15.16:0/2050116301 wait complete. 2024-09-10T23:50:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 Processor -- start 2024-09-10T23:50:18.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 -- start start 2024-09-10T23:50:18.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e0101c10 0x7fd6e01991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0107610 0x7fd6e0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6e0107f90 0x7fd6e019eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0111c70 con 0x7fd6e0107610 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0111af0 con 0x7fd6e0107f90 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e6d10640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0111df0 con 0x7fd6e0101c10 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0107610 0x7fd6e0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0107610 0x7fd6e0199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32794/0 (socket says 172.21.15.16:32794) 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6dffff640 1 -- 172.21.15.16:0/3909096455 learned_addr learned my addr 172.21.15.16:0/3909096455 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e4aac640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e0101c10 0x7fd6e01991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.809+0000 7fd6e52ad640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6e0107f90 0x7fd6e019eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6dffff640 1 -- 172.21.15.16:0/3909096455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e0101c10 msgr2=0x7fd6e01991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6dffff640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e0101c10 0x7fd6e01991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6dffff640 1 -- 172.21.15.16:0/3909096455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6e0107f90 msgr2=0x7fd6e019eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6dffff640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6e0107f90 0x7fd6e019eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6dffff640 1 -- 172.21.15.16:0/3909096455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e019f280 con 0x7fd6e0107610 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6dffff640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0107610 0x7fd6e0199720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000cce0 tx=0x7fd6d000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6ddffb640 1 -- 172.21.15.16:0/3909096455 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000f650 con 0x7fd6e0107610 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6ddffb640 1 -- 172.21.15.16:0/3909096455 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6d000fca0 con 0x7fd6e0107610 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e019f570 con 0x7fd6e0107610 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6ddffb640 1 -- 172.21.15.16:0/3909096455 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0018b40 con 0x7fd6e0107610 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.810+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e01a5e10 con 0x7fd6e0107610 2024-09-10T23:50:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.811+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e0101ff0 con 0x7fd6e0107610 2024-09-10T23:50:18.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.812+0000 7fd6ddffb640 1 -- 172.21.15.16:0/3909096455 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd6d000f7f0 con 0x7fd6e0107610 2024-09-10T23:50:18.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.813+0000 7fd6ddffb640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6cc0b54d0 0x7fd6cc0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:18.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.813+0000 7fd6e4aac640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6cc0b54d0 0x7fd6cc0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:18.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.813+0000 7fd6ddffb640 1 -- 172.21.15.16:0/3909096455 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7fd6d00e66e0 con 0x7fd6e0107610 2024-09-10T23:50:18.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.814+0000 7fd6e4aac640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6cc0b54d0 0x7fd6cc0b7990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005ab0 tx=0x7fd6c8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:18.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:18.816+0000 7fd6ddffb640 1 -- 172.21.15.16:0/3909096455 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd6d0014030 con 0x7fd6e0107610 2024-09-10T23:50:19.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.001+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6e010a7f0 con 0x7fd6e0107610 2024-09-10T23:50:19.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.002+0000 7fd6ddffb640 1 -- 172.21.15.16:0/3909096455 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23034 (secure 0 0 0) 0x7fd6d00ad340 con 0x7fd6e0107610 2024-09-10T23:50:19.005 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:50:19.005 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":85,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:50:17.909596+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:50:19.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6cc0b54d0 msgr2=0x7fd6cc0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6cc0b54d0 0x7fd6cc0b7990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005ab0 tx=0x7fd6c8005a20 comp rx=0 tx=0).stop 2024-09-10T23:50:19.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0107610 msgr2=0x7fd6e0199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0107610 0x7fd6e0199720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000cce0 tx=0x7fd6d000a620 comp rx=0 tx=0).stop 2024-09-10T23:50:19.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 shutdown_connections 2024-09-10T23:50:19.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fd6cc0b54d0 0x7fd6cc0b7990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6e0107f90 0x7fd6e019eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e0107610 0x7fd6e0199720 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 --2- 172.21.15.16:0/3909096455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6e0101c10 0x7fd6e01991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 >> 172.21.15.16:0/3909096455 conn(0x7fd6e00fd610 msgr2=0x7fd6e006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 shutdown_connections 2024-09-10T23:50:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.005+0000 7fd6e6d10640 1 -- 172.21.15.16:0/3909096455 wait complete. 2024-09-10T23:50:19.019 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:33:36.795990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:38:08.796841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:38:11.028262+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 84, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:50:19.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:50:19.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 -- 172.21.15.16:0/2767593310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c10d060 msgr2=0x7fdf7c10f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/2767593310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c10d060 0x7fdf7c10f4e0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009900 tx=0x7fdf7402a410 comp rx=0 tx=0).stop 2024-09-10T23:50:19.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 -- 172.21.15.16:0/2767593310 shutdown_connections 2024-09-10T23:50:19.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/2767593310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c10d060 0x7fdf7c10f4e0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/2767593310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf7c104530 0x7fdf7c10ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/2767593310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c103c10 0x7fdf7c103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 -- 172.21.15.16:0/2767593310 >> 172.21.15.16:0/2767593310 conn(0x7fdf7c0fd620 msgr2=0x7fdf7c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 -- 172.21.15.16:0/2767593310 shutdown_connections 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.124+0000 7fdf82d3d640 1 -- 172.21.15.16:0/2767593310 wait complete. 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 Processor -- start 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 -- start start 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c103c10 0x7fdf7c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c104530 0x7fdf7c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf7c10d060 0x7fdf7c19eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c112cf0 con 0x7fdf7c103c10 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c112b70 con 0x7fdf7c10d060 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf82d3d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c112e70 con 0x7fdf7c104530 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c103c10 0x7fdf7c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c103c10 0x7fdf7c1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32806/0 (socket says 172.21.15.16:32806) 2024-09-10T23:50:19.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 -- 172.21.15.16:0/801631257 learned_addr learned my addr 172.21.15.16:0/801631257 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 -- 172.21.15.16:0/801631257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c104530 msgr2=0x7fdf7c199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c104530 0x7fdf7c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 -- 172.21.15.16:0/801631257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf7c10d060 msgr2=0x7fdf7c19eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf7c10d060 0x7fdf7c19eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.125+0000 7fdf80ad9640 1 -- 172.21.15.16:0/801631257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c19f270 con 0x7fdf7c103c10 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.126+0000 7fdf80ad9640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c103c10 0x7fdf7c1991d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e9f0 tx=0x7fdf6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.126+0000 7fdf79ffb640 1 -- 172.21.15.16:0/801631257 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400cd80 con 0x7fdf7c103c10 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.126+0000 7fdf79ffb640 1 -- 172.21.15.16:0/801631257 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf640108e0 con 0x7fdf7c103c10 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.126+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7c19f560 con 0x7fdf7c103c10 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.126+0000 7fdf79ffb640 1 -- 172.21.15.16:0/801631257 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64018980 con 0x7fdf7c103c10 2024-09-10T23:50:19.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.126+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7c1a5c20 con 0x7fdf7c103c10 2024-09-10T23:50:19.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.127+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7c103ff0 con 0x7fdf7c103c10 2024-09-10T23:50:19.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.128+0000 7fdf79ffb640 1 -- 172.21.15.16:0/801631257 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fdf64010430 con 0x7fdf7c103c10 2024-09-10T23:50:19.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.129+0000 7fdf79ffb640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf680b5450 0x7fdf680b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.129+0000 7fdf7bfff640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf680b5450 0x7fdf680b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.129+0000 7fdf79ffb640 1 -- 172.21.15.16:0/801631257 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7fdf640e6970 con 0x7fdf7c103c10 2024-09-10T23:50:19.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.130+0000 7fdf7bfff640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf680b5450 0x7fdf680b7910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009270 tx=0x7fdf6c0091e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:19.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.132+0000 7fdf79ffb640 1 -- 172.21.15.16:0/801631257 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf640ad4c0 con 0x7fdf7c103c10 2024-09-10T23:50:19.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.317+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf7c1a5e80 con 0x7fdf7c103c10 2024-09-10T23:50:19.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.317+0000 7fdf79ffb640 1 -- 172.21.15.16:0/801631257 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7fdf640acdc0 con 0x7fdf7c103c10 2024-09-10T23:50:19.320 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.319+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf680b5450 msgr2=0x7fdf680b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.319+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf680b5450 0x7fdf680b7910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009270 tx=0x7fdf6c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.319+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c103c10 msgr2=0x7fdf7c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.319+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c103c10 0x7fdf7c1991d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e9f0 tx=0x7fdf6400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 shutdown_connections 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fdf680b5450 0x7fdf680b7910 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf7c10d060 0x7fdf7c19eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c104530 0x7fdf7c199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 --2- 172.21.15.16:0/801631257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c103c10 0x7fdf7c1991d0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 >> 172.21.15.16:0/801631257 conn(0x7fdf7c0fd620 msgr2=0x7fdf7c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:19.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 shutdown_connections 2024-09-10T23:50:19.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.320+0000 7fdf82d3d640 1 -- 172.21.15.16:0/801631257 wait complete. 2024-09-10T23:50:19.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:19 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/3909096455' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:50:19.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T23:50:19.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 -- 172.21.15.16:0/724217965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d4109070 msgr2=0x7f41d410f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 --2- 172.21.15.16:0/724217965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d4109070 0x7f41d410f870 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009ca0 tx=0x7f41cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 -- 172.21.15.16:0/724217965 shutdown_connections 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 --2- 172.21.15.16:0/724217965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d4109070 0x7f41d410f870 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 --2- 172.21.15.16:0/724217965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41d41086f0 0x7f41d4108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 --2- 172.21.15.16:0/724217965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41d4102cf0 0x7f41d41030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 -- 172.21.15.16:0/724217965 >> 172.21.15.16:0/724217965 conn(0x7f41d40fe710 msgr2=0x7f41d4100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 -- 172.21.15.16:0/724217965 shutdown_connections 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.437+0000 7f41d896b640 1 -- 172.21.15.16:0/724217965 wait complete. 2024-09-10T23:50:19.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 Processor -- start 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 -- start start 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41d4102cf0 0x7f41d4199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41086f0 0x7f41d4199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41d4109070 0x7f41d419e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4112d30 con 0x7f41d41086f0 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4112bb0 con 0x7f41d4109070 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d896b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4112eb0 con 0x7f41d4102cf0 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41c9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41086f0 0x7f41d4199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41c9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41086f0 0x7f41d4199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32828/0 (socket says 172.21.15.16:32828) 2024-09-10T23:50:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41c9d9b640 1 -- 172.21.15.16:0/59380017 learned_addr learned my addr 172.21.15.16:0/59380017 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d2d9d640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41d4109070 0x7f41d419e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.438+0000 7f41d259c640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41d4102cf0 0x7f41d4199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41c9d9b640 1 -- 172.21.15.16:0/59380017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41d4102cf0 msgr2=0x7f41d4199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41c9d9b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41d4102cf0 0x7f41d4199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41c9d9b640 1 -- 172.21.15.16:0/59380017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41d4109070 msgr2=0x7f41d419e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41c9d9b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41d4109070 0x7f41d419e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41c9d9b640 1 -- 172.21.15.16:0/59380017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d419f1b0 con 0x7f41d41086f0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41c9d9b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41086f0 0x7f41d4199650 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c920 tx=0x7f41bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41cbfff640 1 -- 172.21.15.16:0/59380017 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007c70 con 0x7f41d41086f0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41cbfff640 1 -- 172.21.15.16:0/59380017 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41bc007e10 con 0x7f41d41086f0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d419f4a0 con 0x7f41d41086f0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41cbfff640 1 -- 172.21.15.16:0/59380017 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc018820 con 0x7f41d41086f0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.439+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d41a5b60 con 0x7f41d41086f0 2024-09-10T23:50:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.440+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d41030d0 con 0x7f41d41086f0 2024-09-10T23:50:19.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.441+0000 7f41cbfff640 1 -- 172.21.15.16:0/59380017 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f41bc00f450 con 0x7f41d41086f0 2024-09-10T23:50:19.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.442+0000 7f41cbfff640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f41c00b5450 0x7f41c00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.442+0000 7f41d259c640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f41c00b5450 0x7f41c00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.442+0000 7f41cbfff640 1 -- 172.21.15.16:0/59380017 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f41bc0e63f0 con 0x7f41d41086f0 2024-09-10T23:50:19.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.443+0000 7f41d259c640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f41c00b5450 0x7f41c00b7910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f41c4005fd0 tx=0x7f41c4005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:19.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.445+0000 7f41cbfff640 1 -- 172.21.15.16:0/59380017 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f41bc014030 con 0x7f41d41086f0 2024-09-10T23:50:19.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:19 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/3909096455' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:50:19.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:19 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/3909096455' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:50:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.629+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f41d41a5f90 con 0x7f41d41086f0 2024-09-10T23:50:19.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.630+0000 7f41cbfff640 1 -- 172.21.15.16:0/59380017 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f41bc0acfd0 con 0x7f41d41086f0 2024-09-10T23:50:19.632 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-09-10T23:50:19.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f41c00b5450 msgr2=0x7f41c00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f41c00b5450 0x7f41c00b7910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f41c4005fd0 tx=0x7f41c4005850 comp rx=0 tx=0).stop 2024-09-10T23:50:19.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41086f0 msgr2=0x7f41d4199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41086f0 0x7f41d4199650 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c920 tx=0x7f41bc00cde0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 shutdown_connections 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f41c00b5450 0x7f41c00b7910 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41d4109070 0x7f41d419e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41086f0 0x7f41d4199650 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 --2- 172.21.15.16:0/59380017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41d4102cf0 0x7f41d4199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 >> 172.21.15.16:0/59380017 conn(0x7f41d40fe710 msgr2=0x7f41d4101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 shutdown_connections 2024-09-10T23:50:19.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.632+0000 7f41d896b640 1 -- 172.21.15.16:0/59380017 wait complete. 2024-09-10T23:50:19.646 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T23:50:19.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/1624901373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 msgr2=0x7fbcac10cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/1624901373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac10cad0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009900 tx=0x7fbca002a410 comp rx=0 tx=0).stop 2024-09-10T23:50:19.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/1624901373 shutdown_connections 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/1624901373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcac10d0a0 0x7fbcac10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/1624901373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac10cad0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/1624901373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac103af0 0x7fbcac103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/1624901373 >> 172.21.15.16:0/1624901373 conn(0x7fbcac0fd620 msgr2=0x7fbcac0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/1624901373 shutdown_connections 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/1624901373 wait complete. 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 Processor -- start 2024-09-10T23:50:19.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.750+0000 7fbcb0c2b640 1 -- start start 2024-09-10T23:50:19.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcb0c2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac103af0 0x7fbcac1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcb0c2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcb0c2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcac10d0a0 0x7fbcac19eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcb0c2b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac112d10 con 0x7fbcac1044f0 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcb0c2b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac112b90 con 0x7fbcac103af0 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcb0c2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac112e90 con 0x7fbcac10d0a0 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32848/0 (socket says 172.21.15.16:32848) 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 -- 172.21.15.16:0/2558897731 learned_addr learned my addr 172.21.15.16:0/2558897731 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcaad9d640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcac10d0a0 0x7fbcac19eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcaa59c640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac103af0 0x7fbcac1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 -- 172.21.15.16:0/2558897731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcac10d0a0 msgr2=0x7fbcac19eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcac10d0a0 0x7fbcac19eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 -- 172.21.15.16:0/2558897731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac103af0 msgr2=0x7fbcac1991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac103af0 0x7fbcac1991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 -- 172.21.15.16:0/2558897731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac19f270 con 0x7fbcac1044f0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbcaa59c640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac103af0 0x7fbcac1991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbca9d9b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac199710 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbca0005ab0 tx=0x7fbca0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.751+0000 7fbc9b7fe640 1 -- 172.21.15.16:0/2558897731 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca003f070 con 0x7fbcac1044f0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.752+0000 7fbc9b7fe640 1 -- 172.21.15.16:0/2558897731 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbca0031d60 con 0x7fbcac1044f0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.752+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac19f500 con 0x7fbcac1044f0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.752+0000 7fbc9b7fe640 1 -- 172.21.15.16:0/2558897731 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0035030 con 0x7fbcac1044f0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.752+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac1a5c20 con 0x7fbcac1044f0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.753+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac103ed0 con 0x7fbcac1044f0 2024-09-10T23:50:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.754+0000 7fbc9b7fe640 1 -- 172.21.15.16:0/2558897731 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fbca003b580 con 0x7fbcac1044f0 2024-09-10T23:50:19.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.755+0000 7fbc9b7fe640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbc940b5450 0x7fbc940b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:19.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.755+0000 7fbcaa59c640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbc940b5450 0x7fbc940b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:19.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.755+0000 7fbc9b7fe640 1 -- 172.21.15.16:0/2558897731 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7fbca0106870 con 0x7fbcac1044f0 2024-09-10T23:50:19.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.755+0000 7fbcaa59c640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbc940b5450 0x7fbc940b7910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00baa0 tx=0x7fbc9c005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:19.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.759+0000 7fbc9b7fe640 1 -- 172.21.15.16:0/2558897731 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbca00cd420 con 0x7fbcac1044f0 2024-09-10T23:50:19.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.949+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbcac1a5fc0 con 0x7fbcac1044f0 2024-09-10T23:50:19.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.949+0000 7fbc9b7fe640 1 -- 172.21.15.16:0/2558897731 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7fbca00ccd20 con 0x7fbcac1044f0 2024-09-10T23:50:19.951 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbc940b5450 msgr2=0x7fbc940b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbc940b5450 0x7fbc940b7910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00baa0 tx=0x7fbc9c005d90 comp rx=0 tx=0).stop 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 msgr2=0x7fbcac199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac199710 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbca0005ab0 tx=0x7fbca0003cd0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 shutdown_connections 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbcac10d0a0 0x7fbcac19eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbcac1044f0 0x7fbcac199710 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fbc940b5450 0x7fbc940b7910 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 --2- 172.21.15.16:0/2558897731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcac103af0 0x7fbcac1991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.951+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 >> 172.21.15.16:0/2558897731 conn(0x7fbcac0fd620 msgr2=0x7fbcac10f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.952+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 shutdown_connections 2024-09-10T23:50:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:19.952+0000 7fbcb0c2b640 1 -- 172.21.15.16:0/2558897731 wait complete. 2024-09-10T23:50:19.964 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 -- 172.21.15.16:0/2319960858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c103c20 msgr2=0x7efe3c104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 --2- 172.21.15.16:0/2319960858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c103c20 0x7efe3c104000 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009900 tx=0x7efe2c02a410 comp rx=0 tx=0).stop 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 -- 172.21.15.16:0/2319960858 shutdown_connections 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 --2- 172.21.15.16:0/2319960858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c10d070 0x7efe3c10f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 --2- 172.21.15.16:0/2319960858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c104540 0x7efe3c10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 --2- 172.21.15.16:0/2319960858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c103c20 0x7efe3c104000 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 -- 172.21.15.16:0/2319960858 >> 172.21.15.16:0/2319960858 conn(0x7efe3c0fd610 msgr2=0x7efe3c0ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 -- 172.21.15.16:0/2319960858 shutdown_connections 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.065+0000 7efe423f8640 1 -- 172.21.15.16:0/2319960858 wait complete. 2024-09-10T23:50:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 Processor -- start 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 -- start start 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c103c20 0x7efe3c1018c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c104540 0x7efe3c101e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c10d070 0x7efe3c102340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c112d00 con 0x7efe3c10d070 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c112b80 con 0x7efe3c103c20 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe423f8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c112e80 con 0x7efe3c104540 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe40995640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c10d070 0x7efe3c102340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe40995640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c10d070 0x7efe3c102340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32870/0 (socket says 172.21.15.16:32870) 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.066+0000 7efe40995640 1 -- 172.21.15.16:0/2218141254 learned_addr learned my addr 172.21.15.16:0/2218141254 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe3b7fe640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c104540 0x7efe3c101e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe3bfff640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c103c20 0x7efe3c1018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe40995640 1 -- 172.21.15.16:0/2218141254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c104540 msgr2=0x7efe3c101e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe40995640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c104540 0x7efe3c101e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe40995640 1 -- 172.21.15.16:0/2218141254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c103c20 msgr2=0x7efe3c1018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe40995640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c103c20 0x7efe3c1018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe40995640 1 -- 172.21.15.16:0/2218141254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c1a75d0 con 0x7efe3c10d070 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe40995640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c10d070 0x7efe3c102340 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7efe3400eaa0 tx=0x7efe3400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe397fa640 1 -- 172.21.15.16:0/2218141254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3400cdb0 con 0x7efe3c10d070 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe397fa640 1 -- 172.21.15.16:0/2218141254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe34005020 con 0x7efe3c10d070 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c1a78c0 con 0x7efe3c10d070 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe397fa640 1 -- 172.21.15.16:0/2218141254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340116d0 con 0x7efe3c10d070 2024-09-10T23:50:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.067+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c1a7e60 con 0x7efe3c10d070 2024-09-10T23:50:20.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.068+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c104000 con 0x7efe3c10d070 2024-09-10T23:50:20.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.070+0000 7efe397fa640 1 -- 172.21.15.16:0/2218141254 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7efe3400f040 con 0x7efe3c10d070 2024-09-10T23:50:20.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.070+0000 7efe397fa640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe240b54d0 0x7efe240b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:20.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.071+0000 7efe3bfff640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe240b54d0 0x7efe240b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:20.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.071+0000 7efe397fa640 1 -- 172.21.15.16:0/2218141254 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7efe340e60f0 con 0x7efe3c10d070 2024-09-10T23:50:20.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.071+0000 7efe3bfff640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe240b54d0 0x7efe240b7990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efe2c031440 tx=0x7efe2c005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:20.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.073+0000 7efe397fa640 1 -- 172.21.15.16:0/2218141254 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efe34016030 con 0x7efe3c10d070 2024-09-10T23:50:20.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:20 smithi016 ceph-mon[30855]: pgmap v631: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-10T23:50:20.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:20 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/801631257' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:50:20.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:20 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/59380017' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:50:20.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:20 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2558897731' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:50:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.313+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7efe3c1a8250 con 0x7efe3c10d070 2024-09-10T23:50:20.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.321+0000 7efe397fa640 1 -- 172.21.15.16:0/2218141254 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+828474 (secure 0 0 0) 0x7efe340ac670 con 0x7efe3c10d070 2024-09-10T23:50:20.334 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "epoch": 24, 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "active_gid": 14220, 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "active_name": "x", 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "active_addrs": { 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:6800", 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3253461284 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:6801", 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3253461284 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "active_addr": "172.21.15.16:6801/3253461284", 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "active_change": "2024-09-10T23:31:42.335824+0000", 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "available": true, 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "standbys": [ 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.336 INFO:teuthology.orchestra.run.smithi016.stdout: "gid": 24145, 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "z", 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_features": 4540719139924082687, 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "available_modules": [ 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "alerts", 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.338 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.340 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.341 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.343 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_destination": { 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_destination", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.344 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_from_name": { 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_from_name", 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "Ceph", 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email From: name", 2024-09-10T23:50:20.345 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_host": { 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_host", 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.346 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP server", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_password": { 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_password", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.347 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Password to authenticate with", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_port": { 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_port", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "465", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.348 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP port", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_sender": { 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_sender", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.349 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_ssl": { 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_ssl", 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.350 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_user": { 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_user", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.351 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "User to authenticate as", 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.352 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "balancer", 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.353 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "active": { 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "active", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.354 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_time": { 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_time", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0000", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:50:20.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_weekday": { 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_weekday", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:50:20.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_max_iterations": { 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "25", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "250", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.357 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_metrics": { 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_metrics", 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:50:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_step": { 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_step", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.5", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0.001", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "0.999", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:50:20.359 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "end_time": { 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_time", 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2359", 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.360 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "end_weekday": { 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_weekday", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.361 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.362 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.364 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.365 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.366 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "min_score": { 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_score", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.367 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-10T23:50:20.368 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "upmap", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "crush-compat", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "none", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "read", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap", 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap-read" 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.369 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Balancer mode", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_ids": { 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_ids", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.370 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.371 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.372 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_deviation": { 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_deviation", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:20.373 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_optimizations": { 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.374 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm", 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_down_multiplier": { 2024-09-10T23:50:20.375 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_down_multiplier", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_refresh_rate": { 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_refresh_rate", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "20", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_starting_port": { 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_starting_port", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4721", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.378 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_ptrace": { 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_ptrace", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:50:20.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_interval": { 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_interval", 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:50:20.380 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.7", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.381 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_log_destination": { 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm_log_destination", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "file", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "file,syslog", 2024-09-10T23:50:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: "syslog" 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "cgroups_split": { 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cgroups_split", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.383 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "config_checks_enabled": { 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_checks_enabled", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.384 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "config_dashboard": { 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_dashboard", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.385 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_alertmanager": { 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_alertmanager", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.386 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_base": { 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_base", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.387 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_elasticsearch": { 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.388 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "elasticsearch container image", 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_grafana": { 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_grafana", 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:50:20.389 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_haproxy": { 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_haproxy", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:50:20.390 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "HAproxy container image", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_agent": { 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:50:20.391 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_collector": { 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_query": { 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.393 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger query container image", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_keepalived": { 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_keepalived", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Keepalived container image", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_loki": { 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_loki", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Loki container image", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nginx": { 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nginx", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nginx container image", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_node_exporter": { 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_node_exporter", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nvmeof": { 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nvmeof", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.398 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nvme-of container image", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.399 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_prometheus": { 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_prometheus", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_promtail": { 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_promtail", 2024-09-10T23:50:20.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Promtail container image", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba": { 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba", 2024-09-10T23:50:20.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba_metrics": { 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.403 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_snmp_gateway": { 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:50:20.404 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "container_init": { 2024-09-10T23:50:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_init", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "daemon_cache_timeout": { 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:50:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:50:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "900", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "default_registry": { 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_registry", 2024-09-10T23:50:20.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "device_cache_timeout": { 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_cache_timeout", 2024-09-10T23:50:20.409 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1800", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "device_enhanced_scan": { 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_enhanced_scan", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.410 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "facts_cache_timeout": { 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "facts_cache_timeout", 2024-09-10T23:50:20.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "grafana_dashboards_path": { 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:50:20.412 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.413 INFO:teuthology.orchestra.run.smithi016.stdout: "host_check_interval": { 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "host_check_interval", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "hw_monitoring": { 2024-09-10T23:50:20.414 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hw_monitoring", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "inventory_list_all": { 2024-09-10T23:50:20.415 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "inventory_list_all", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.416 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "log_refresh_metadata": { 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_refresh_metadata", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.418 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.419 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "*", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.424 INFO:teuthology.orchestra.run.smithi016.stdout: "max_count_per_host": { 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_count_per_host", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "max_osd_draining_count": { 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_osd_draining_count", 2024-09-10T23:50:20.425 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "migration_current": { 2024-09-10T23:50:20.426 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "migration_current", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "internal - do not modify", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.427 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "root", 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm-package", 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "root" 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.428 INFO:teuthology.orchestra.run.smithi016.stdout: "oob_default_addr": { 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "oob_default_addr", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "169.254.1.1", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "prometheus_alerts_path": { 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.430 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_insecure": { 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_insecure", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.431 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_password": { 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_password", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.432 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_url": { 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_url", 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.433 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_username": { 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_username", 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.434 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "secure_monitoring_stack": { 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.435 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "service_discovery_port": { 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "service_discovery_port", 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8765", 2024-09-10T23:50:20.436 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.437 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_config_file": { 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_config_file", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.438 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "use_agent": { 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_agent", 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "use_repo_digest": { 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_repo_digest", 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.440 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_failed_host_check": { 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.441 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_daemons": { 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.442 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_hosts": { 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.443 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crash", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.445 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.446 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.447 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.448 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "retain_interval": { 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retain_interval", 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.450 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "31536000", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.451 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_recent_interval": { 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_recent_interval", 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.452 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1209600", 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dashboard", 2024-09-10T23:50:20.453 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.454 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.456 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.457 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.458 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.459 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.460 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.461 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.462 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.463 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.464 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.465 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.466 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.467 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.468 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.469 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_URL": { 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.470 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.471 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.474 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.475 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "[]", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.476 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "{}", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.477 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.478 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.479 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.480 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.481 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.482 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.483 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.484 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.485 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.487 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.488 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.489 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "45", 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.491 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.492 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.493 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.494 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.496 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.497 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.498 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.499 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "cross_origin_url": { 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cross_origin_url", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.500 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "crt_file": { 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crt_file", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.501 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "debug": { 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "debug", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.502 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "jwt_token_ttl": { 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "jwt_token_ttl", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "28800", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.503 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.505 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.506 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.507 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.508 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "motd": { 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "motd", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "The message of the day", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.511 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.512 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8080", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.513 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.514 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.515 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl_server_port": { 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl_server_port", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8443", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.516 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "redirect", 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect" 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.517 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-10T23:50:20.518 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "url_prefix": { 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url_prefix", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.519 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_monitoring": { 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_monitoring", 2024-09-10T23:50:20.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "monitor device health metrics", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.521 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.522 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.523 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.524 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.525 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.526 INFO:teuthology.orchestra.run.smithi016.stdout: "mark_out_threshold": { 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mark_out_threshold", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2419200", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.527 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_name": { 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_name", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "device_health_metrics", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.528 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "retention_period": { 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retention_period", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15552000", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.529 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_frequency": { 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_frequency", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.530 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "self_heal": { 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "self_heal", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.531 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:50:20.532 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.533 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_threshold": { 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_threshold", 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7257600", 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.534 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "diskprediction_local", 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.535 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.536 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.537 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.538 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.539 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.540 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "predict_interval": { 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predict_interval", 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.541 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "predictor_model": { 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predictor_model", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "prophetstor", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.542 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.543 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.544 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "influx", 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": false, 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "batch_size": { 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "batch_size", 2024-09-10T23:50:20.545 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5000", 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.546 INFO:teuthology.orchestra.run.smithi016.stdout: "database": { 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "database", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "ceph", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.547 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": { 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hostname", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.548 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "30", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "5", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.550 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.552 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.553 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.554 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "password": { 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "password", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:50:20.555 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "port": { 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "port", 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8086", 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.556 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server port", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.557 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "false", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:50:20.558 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "threads": { 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threads", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "32", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:50:20.559 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "username": { 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "username", 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.560 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "verify_ssl": { 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "verify_ssl", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "true", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.561 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "insights", 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.562 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.563 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.565 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.566 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.568 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "iostat", 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.569 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.570 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.571 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.572 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.573 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.574 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.575 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "k8sevents", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_event_retention_days": { 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:50:20.576 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "config_check_secs": { 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_check_secs", 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "10", 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.577 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.578 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.580 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.581 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "localpool", 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "failure_domain": { 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "failure_domain", 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.584 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "host", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.585 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.586 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.588 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.589 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "min_size": { 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_size", 2024-09-10T23:50:20.590 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "num_rep": { 2024-09-10T23:50:20.591 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "num_rep", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_num": { 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_num", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "128", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.593 INFO:teuthology.orchestra.run.smithi016.stdout: "prefix": { 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prefix", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.595 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "subtree": { 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "subtree", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "rack", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.596 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mds_autoscaler", 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.598 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.599 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.600 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.602 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirroring", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.604 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.605 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.606 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.607 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.608 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.609 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "nfs", 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.610 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.611 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.612 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.613 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.616 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "fail_fs": { 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "fail_fs", 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.617 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.618 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.620 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.621 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.622 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator": { 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.623 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "rook", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "test_orchestrator" 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Orchestrator backend", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_perf_query", 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.626 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.629 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.630 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.631 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.632 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_support", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.633 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.634 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.636 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.637 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.638 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_autoscaler", 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.639 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.640 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.641 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.644 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.645 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "threshold": { 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threshold", 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1.0", 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "scaling threshold", 2024-09-10T23:50:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "progress", 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_pg_recovery_event": { 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:50:20.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-10T23:50:20.649 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.650 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "max_completed_events": { 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_completed_events", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "50", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.657 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.658 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus", 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.659 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "cache": { 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cache", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.660 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "exclude_perf_counters": { 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "exclude_perf_counters", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:50:20.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.662 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.663 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.664 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.666 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools": { 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.667 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "300", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.668 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_interval": { 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_interval", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15.0", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.669 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.670 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "9283", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.671 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "stale_cache_strategy": { 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stale_cache_strategy", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "log", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.673 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "default", 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.674 INFO:teuthology.orchestra.run.smithi016.stdout: "default", 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "error" 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:20.675 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.676 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.677 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.678 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.679 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.680 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_snap_create": { 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.682 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "trash_purge_schedule": { 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "trash_purge_schedule", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "restful", 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_auth": { 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_auth", 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-10T23:50:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "max_requests": { 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_requests", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rgw", 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rook", 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_class": { 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "storage_class", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "local", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "selftest", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "roption1": { 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption1", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "roption2": { 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption2", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "xyz", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption1": { 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption1", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption2": { 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption2", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption3": { 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption3", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption4": { 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption4", 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption5": { 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption5", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption6": { 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption6", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption7": { 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption7", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "42", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "testkey": { 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testkey", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "testlkey": { 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testlkey", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "testnewline": { 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testnewline", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smb", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "internal_store_backend": { 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "internal_store_backend", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "update_orchestration": { 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "update_orchestration", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-10T23:50:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_m_granularity": { 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_m_granularity", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:50:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "dump_on_update": { 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dump_on_update", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:50:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stats", 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "status", 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telegraf", 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "address": { 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "address", 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:50:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15", 2024-09-10T23:50:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telemetry", 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_basic": { 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_basic", 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_crash": { 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_crash", 2024-09-10T23:50:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_device": { 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_device", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_ident": { 2024-09-10T23:50:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_ident", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_perf": { 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_perf", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "contact": { 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "contact", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "description": { 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "description", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "device_url": { 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_url", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-10T23:50:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "24", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "8", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "last_opt_revision": { 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "last_opt_revision", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard": { 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard_description": { 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard_description", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "organization": { 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "organization", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "proxy": { 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "proxy", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "url": { 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "test_orchestrator", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_clones": { 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_clones", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "periodic_async_work": { 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "periodic_async_work", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Periodically check for async work", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_delay": { 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix", 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "discovery_interval": { 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "discovery_interval", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "100", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "identifier": { 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "identifier", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.821 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.822 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_host": { 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_host", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_port": { 2024-09-10T23:50:20.823 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_port", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10051", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_sender": { 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_sender", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.825 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: "gid": 24149, 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "y", 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_features": 4540719139924082687, 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: "available_modules": [ 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "alerts", 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.826 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.828 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.829 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.830 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.831 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_destination": { 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_destination", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.833 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_from_name": { 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_from_name", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "Ceph", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.834 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email From: name", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_host": { 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_host", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.835 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP server", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_password": { 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_password", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.836 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Password to authenticate with", 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_port": { 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_port", 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "465", 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.837 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP port", 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_sender": { 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_sender", 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.838 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_ssl": { 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_ssl", 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.839 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_user": { 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_user", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "User to authenticate as", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.841 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.842 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "balancer", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "active": { 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "active", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:50:20.843 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_time": { 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_time", 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0000", 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.844 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_weekday": { 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_weekday", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-10T23:50:20.845 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_max_iterations": { 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "25", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "250", 2024-09-10T23:50:20.846 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_metrics": { 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_metrics", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.847 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_step": { 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_step", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.5", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0.001", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "0.999", 2024-09-10T23:50:20.848 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "end_time": { 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_time", 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2359", 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.849 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "end_weekday": { 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_weekday", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-10T23:50:20.850 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.851 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.853 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.854 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.855 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "min_score": { 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_score", 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.856 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-10T23:50:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "upmap", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "crush-compat", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "none", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "read", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap-read" 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Balancer mode", 2024-09-10T23:50:20.858 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_ids": { 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_ids", 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.859 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.860 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.861 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_deviation": { 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_deviation", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:20.862 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_optimizations": { 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.863 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm", 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.864 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_down_multiplier": { 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_down_multiplier", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_refresh_rate": { 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_refresh_rate", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "20", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_starting_port": { 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_starting_port", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4721", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_ptrace": { 2024-09-10T23:50:20.867 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_ptrace", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.868 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_interval": { 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_interval", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.869 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.7", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_log_destination": { 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm_log_destination", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "file", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "file,syslog", 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "syslog" 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.871 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "cgroups_split": { 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cgroups_split", 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.872 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "config_checks_enabled": { 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_checks_enabled", 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.873 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "config_dashboard": { 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_dashboard", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_alertmanager": { 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_alertmanager", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:50:20.875 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_base": { 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_base", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:50:20.876 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_elasticsearch": { 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:50:20.877 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "elasticsearch container image", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_grafana": { 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_grafana", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:50:20.878 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_haproxy": { 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_haproxy", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:50:20.879 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "HAproxy container image", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_agent": { 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.880 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_collector": { 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:50:20.881 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_query": { 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.882 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger query container image", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_keepalived": { 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_keepalived", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.883 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Keepalived container image", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_loki": { 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_loki", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.884 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Loki container image", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nginx": { 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nginx", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.885 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nginx container image", 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_node_exporter": { 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_node_exporter", 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.886 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nvmeof": { 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nvmeof", 2024-09-10T23:50:20.887 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nvme-of container image", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:50:20.888 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_prometheus": { 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_prometheus", 2024-09-10T23:50:20.889 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_promtail": { 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_promtail", 2024-09-10T23:50:20.890 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Promtail container image", 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba": { 2024-09-10T23:50:20.891 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba_metrics": { 2024-09-10T23:50:20.892 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_snmp_gateway": { 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.894 INFO:teuthology.orchestra.run.smithi016.stdout: "container_init": { 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_init", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.895 INFO:teuthology.orchestra.run.smithi016.stdout: "daemon_cache_timeout": { 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.896 INFO:teuthology.orchestra.run.smithi016.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "900", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.897 INFO:teuthology.orchestra.run.smithi016.stdout: "default_registry": { 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_registry", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "device_cache_timeout": { 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_cache_timeout", 2024-09-10T23:50:20.898 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1800", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "device_enhanced_scan": { 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_enhanced_scan", 2024-09-10T23:50:20.899 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "facts_cache_timeout": { 2024-09-10T23:50:20.900 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "facts_cache_timeout", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "grafana_dashboards_path": { 2024-09-10T23:50:20.901 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.902 INFO:teuthology.orchestra.run.smithi016.stdout: "host_check_interval": { 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "host_check_interval", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.903 INFO:teuthology.orchestra.run.smithi016.stdout: "hw_monitoring": { 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hw_monitoring", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "inventory_list_all": { 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "inventory_list_all", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.905 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.906 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "log_refresh_metadata": { 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_refresh_metadata", 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.907 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.908 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.909 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.910 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.911 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.912 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "*", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.913 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "max_count_per_host": { 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_count_per_host", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.914 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "max_osd_draining_count": { 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_osd_draining_count", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.915 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "migration_current": { 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "migration_current", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.916 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "internal - do not modify", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "root", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.917 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm-package", 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "root" 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "oob_default_addr": { 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "oob_default_addr", 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "169.254.1.1", 2024-09-10T23:50:20.918 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "prometheus_alerts_path": { 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.919 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_insecure": { 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_insecure", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_password": { 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_password", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.921 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_url": { 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_url", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.922 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_username": { 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_username", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.923 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "secure_monitoring_stack": { 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.924 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "service_discovery_port": { 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "service_discovery_port", 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.925 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8765", 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.926 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_config_file": { 2024-09-10T23:50:20.927 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_config_file", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "use_agent": { 2024-09-10T23:50:20.928 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_agent", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.929 INFO:teuthology.orchestra.run.smithi016.stdout: "use_repo_digest": { 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_repo_digest", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.930 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_failed_host_check": { 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_daemons": { 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.932 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_hosts": { 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.933 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crash", 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.935 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.936 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.937 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:20.938 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "retain_interval": { 2024-09-10T23:50:20.939 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retain_interval", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "31536000", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.940 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.941 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_recent_interval": { 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_recent_interval", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1209600", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dashboard", 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.943 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.944 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.945 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.946 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.947 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.948 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:50:20.949 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:50:20.950 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:50:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:50:20.952 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.953 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.954 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_URL": { 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "[]", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "{}", 2024-09-10T23:50:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.974 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.976 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.977 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.978 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.979 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.980 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.981 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.982 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "45", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.983 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.984 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.985 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.986 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.988 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:20.989 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.990 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.991 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "cross_origin_url": { 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cross_origin_url", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.992 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "crt_file": { 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crt_file", 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.993 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "debug": { 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "debug", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.994 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "jwt_token_ttl": { 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "jwt_token_ttl", 2024-09-10T23:50:20.995 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "28800", 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-10T23:50:20.996 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:20.997 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:20.998 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:20.999 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.000 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "motd": { 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "motd", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "The message of the day", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.004 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.005 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8080", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.006 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.007 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.008 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl_server_port": { 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl_server_port", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8443", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.009 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "redirect", 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect" 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.010 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.011 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "url_prefix": { 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url_prefix", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.012 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_monitoring": { 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_monitoring", 2024-09-10T23:50:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "monitor device health metrics", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.014 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.015 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.017 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.018 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.019 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "mark_out_threshold": { 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mark_out_threshold", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2419200", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.020 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_name": { 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_name", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "device_health_metrics", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.021 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "retention_period": { 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retention_period", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15552000", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.022 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_frequency": { 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_frequency", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.023 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "self_heal": { 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "self_heal", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.024 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:50:21.025 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.026 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_threshold": { 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_threshold", 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7257600", 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.027 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "diskprediction_local", 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.028 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.029 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.030 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.031 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.032 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "predict_interval": { 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predict_interval", 2024-09-10T23:50:21.033 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "predictor_model": { 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predictor_model", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "prophetstor", 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.035 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.036 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "influx", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": false, 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "batch_size": { 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "batch_size", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5000", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.038 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "database": { 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "database", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "ceph", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.039 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": { 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hostname", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.040 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "30", 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "5", 2024-09-10T23:50:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.046 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "password": { 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "password", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.047 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "port": { 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "port", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.048 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8086", 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server port", 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.049 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-10T23:50:21.050 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "false", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "threads": { 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threads", 2024-09-10T23:50:21.051 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "32", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "username": { 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "username", 2024-09-10T23:50:21.052 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "verify_ssl": { 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "verify_ssl", 2024-09-10T23:50:21.053 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "true", 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "insights", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.055 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.057 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.058 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.059 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.060 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.061 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "iostat", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.062 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.063 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.065 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.067 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "k8sevents", 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_event_retention_days": { 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.068 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "config_check_secs": { 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_check_secs", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.069 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "10", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.070 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.071 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.072 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.073 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.074 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.075 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "localpool", 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "failure_domain": { 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "failure_domain", 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "host", 2024-09-10T23:50:21.077 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.078 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.081 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.082 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "min_size": { 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_size", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.083 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "num_rep": { 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "num_rep", 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.084 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_num": { 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_num", 2024-09-10T23:50:21.085 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "128", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "prefix": { 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prefix", 2024-09-10T23:50:21.086 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.087 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "subtree": { 2024-09-10T23:50:21.088 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "subtree", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "rack", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mds_autoscaler", 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.090 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.091 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.093 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.094 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.095 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirroring", 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.096 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.097 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.098 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.099 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.100 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.101 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.102 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "nfs", 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.103 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.104 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.105 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.106 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.107 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.108 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "fail_fs": { 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "fail_fs", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.110 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.111 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.112 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.113 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.114 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.115 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator": { 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "rook", 2024-09-10T23:50:21.116 INFO:teuthology.orchestra.run.smithi016.stdout: "test_orchestrator" 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Orchestrator backend", 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.117 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_perf_query", 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.118 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.119 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.120 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.121 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.122 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.123 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.124 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_support", 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.125 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.126 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.127 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.128 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.129 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.130 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_autoscaler", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.133 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.135 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.136 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.138 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "threshold": { 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threshold", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1.0", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "scaling threshold", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.139 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "progress", 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_pg_recovery_event": { 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.140 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.141 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.142 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.143 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.145 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "max_completed_events": { 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_completed_events", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "50", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.148 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.149 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus", 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "cache": { 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cache", 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "exclude_perf_counters": { 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "exclude_perf_counters", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.153 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.154 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.155 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.156 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.157 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools": { 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.158 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.159 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "300", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_interval": { 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_interval", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.160 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15.0", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.162 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "9283", 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.163 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "stale_cache_strategy": { 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stale_cache_strategy", 2024-09-10T23:50:21.164 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "log", 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-10T23:50:21.165 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "default", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "default", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "error" 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.168 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.169 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.170 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.171 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.172 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_snap_create": { 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.173 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.174 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.175 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "trash_purge_schedule": { 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "trash_purge_schedule", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "restful", 2024-09-10T23:50:21.177 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.178 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.178 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.178 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_auth": { 2024-09-10T23:50:21.178 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_auth", 2024-09-10T23:50:21.178 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.178 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.178 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.179 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.181 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.183 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.184 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "max_requests": { 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_requests", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.186 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.187 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.189 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rgw", 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.190 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.191 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.192 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.193 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.194 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.196 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rook", 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.198 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.199 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.200 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.201 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.202 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.203 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_class": { 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "storage_class", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.204 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "local", 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "selftest", 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.205 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.206 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.207 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.208 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "roption1": { 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption1", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "roption2": { 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption2", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "xyz", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.212 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption1": { 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption1", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.213 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption2": { 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption2", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.214 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption3": { 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption3", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.215 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption4": { 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption4", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.216 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption5": { 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption5", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.217 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption6": { 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption6", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption7": { 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption7", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "42", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.220 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "testkey": { 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testkey", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.221 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "testlkey": { 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testlkey", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.222 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "testnewline": { 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testnewline", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smb", 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "internal_store_backend": { 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "internal_store_backend", 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.224 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.225 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.226 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.227 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.228 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.229 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.230 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "update_orchestration": { 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "update_orchestration", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.231 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_m_granularity": { 2024-09-10T23:50:21.232 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_m_granularity", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.233 INFO:teuthology.orchestra.run.smithi016.stdout: "dump_on_update": { 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dump_on_update", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.234 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.235 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.236 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.237 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.238 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.240 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stats", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.241 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.242 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.243 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.244 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.245 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.246 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "status", 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.247 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.248 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.249 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.252 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.253 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telegraf", 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "address": { 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "address", 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.254 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.255 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.256 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.257 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.258 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.259 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.260 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.261 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telemetry", 2024-09-10T23:50:21.262 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_basic": { 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_basic", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.263 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_crash": { 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_crash", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_device": { 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_device", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.265 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_ident": { 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_ident", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.266 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_perf": { 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_perf", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.267 INFO:teuthology.orchestra.run.smithi016.stdout: "contact": { 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "contact", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "description": { 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "description", 2024-09-10T23:50:21.268 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "device_url": { 2024-09-10T23:50:21.269 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_url", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-10T23:50:21.270 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.271 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "24", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "8", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.272 INFO:teuthology.orchestra.run.smithi016.stdout: "last_opt_revision": { 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "last_opt_revision", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.273 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard": { 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.274 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard_description": { 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard_description", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.276 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.277 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.279 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.280 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "organization": { 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "organization", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.281 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "proxy": { 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "proxy", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "url": { 2024-09-10T23:50:21.283 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "test_orchestrator", 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.285 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.288 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.290 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-10T23:50:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_clones": { 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_clones", 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4", 2024-09-10T23:50:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "periodic_async_work": { 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "periodic_async_work", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Periodically check for async work", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_delay": { 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix", 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "discovery_interval": { 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "discovery_interval", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "100", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "identifier": { 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "identifier", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_host": { 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_host", 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_port": { 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_port", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10051", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_sender": { 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_sender", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "modules": [ 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "dashboard", 2024-09-10T23:50:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "iostat", 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "nfs", 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "restful", 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "snap_schedule" 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "available_modules": [ 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "alerts", 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.321 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_destination": { 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_destination", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.322 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_from_name": { 2024-09-10T23:50:21.323 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_from_name", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "Ceph", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Email From: name", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.324 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_host": { 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_host", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP server", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.325 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_password": { 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_password", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Password to authenticate with", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_port": { 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_port", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "465", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP port", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_sender": { 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_sender", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SMTP envelope sender", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.328 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_ssl": { 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_ssl", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "smtp_user": { 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smtp_user", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "User to authenticate as", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.330 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "balancer", 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "active": { 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "active", 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_time": { 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_time", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0000", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "begin_weekday": { 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "begin_weekday", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_max_iterations": { 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_max_iterations", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "25", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "250", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_metrics": { 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_metrics", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_compat_step": { 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crush_compat_step", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.5", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0.001", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "0.999", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "aggressiveness of optimization", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "end_time": { 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_time", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2359", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "end_weekday": { 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "end_weekday", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "0", 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "6", 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "min_score": { 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_score", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "upmap", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "crush-compat", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "none", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "read", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap", 2024-09-10T23:50:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap-read" 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Balancer mode", 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_ids": { 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_ids", 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_deviation": { 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_deviation", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "upmap_max_optimizations": { 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "upmap_max_optimizations", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.352 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm", 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_down_multiplier": { 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_down_multiplier", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_refresh_rate": { 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_refresh_rate", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "20", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "agent_starting_port": { 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "agent_starting_port", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4721", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_ptrace": { 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_ptrace", 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T23:50:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_interval": { 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_interval", 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "autotune_memory_target_ratio": { 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0.7", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_log_destination": { 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephadm_log_destination", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "file", 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "file,syslog", 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "syslog" 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "cgroups_split": { 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cgroups_split", 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "config_checks_enabled": { 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_checks_enabled", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "config_dashboard": { 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_dashboard", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_alertmanager": { 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_alertmanager", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_base": { 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_base", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Container image name, without the tag", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_elasticsearch": { 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_elasticsearch", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "elasticsearch container image", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_grafana": { 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_grafana", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T23:50:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_haproxy": { 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_haproxy", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T23:50:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "HAproxy container image", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_agent": { 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_agent", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T23:50:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger agent container image", 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_collector": { 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_collector", 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger collector container image", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_jaeger_query": { 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_jaeger_query", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Jaeger query container image", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_keepalived": { 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_keepalived", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Keepalived container image", 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_loki": { 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_loki", 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Loki container image", 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nginx": { 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nginx", 2024-09-10T23:50:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nginx container image", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_node_exporter": { 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_node_exporter", 2024-09-10T23:50:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_nvmeof": { 2024-09-10T23:50:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_nvmeof", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Nvme-of container image", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_oauth2_proxy": { 2024-09-10T23:50:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "oauth2-proxy container image", 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_prometheus": { 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_prometheus", 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Prometheus container image", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_promtail": { 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_promtail", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Promtail container image", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba": { 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB container image", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_samba_metrics": { 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_samba_metrics", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image_snmp_gateway": { 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_image_snmp_gateway", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "SNMP Gateway container image", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "container_init": { 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "container_init", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "daemon_cache_timeout": { 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "daemon_cache_timeout", 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "default_cephadm_command_timeout": { 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "900", 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "default_registry": { 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default_registry", 2024-09-10T23:50:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "docker.io", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "device_cache_timeout": { 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_cache_timeout", 2024-09-10T23:50:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1800", 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache device inventory", 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "device_enhanced_scan": { 2024-09-10T23:50:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_enhanced_scan", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "facts_cache_timeout": { 2024-09-10T23:50:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "facts_cache_timeout", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "seconds to cache host facts data", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "grafana_dashboards_path": { 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "grafana_dashboards_path", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "host_check_interval": { 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "host_check_interval", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to perform a host check", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "hw_monitoring": { 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hw_monitoring", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "inventory_list_all": { 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "inventory_list_all", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "log_refresh_metadata": { 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_refresh_metadata", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "*", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "max_count_per_host": { 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_count_per_host", 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of daemons per service per host", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "max_osd_draining_count": { 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_osd_draining_count", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "migration_current": { 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "migration_current", 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "internal - do not modify", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "mode": { 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mode", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "root", 2024-09-10T23:50:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm-package", 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "root" 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "oob_default_addr": { 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "oob_default_addr", 2024-09-10T23:50:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "169.254.1.1", 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "prometheus_alerts_path": { 2024-09-10T23:50:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus_alerts_path", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_insecure": { 2024-09-10T23:50:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_insecure", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_password": { 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_password", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_url": { 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_url", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "registry_username": { 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "registry_username", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "secure_monitoring_stack": { 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secure_monitoring_stack", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "service_discovery_port": { 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "service_discovery_port", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8765", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "cephadm service discovery port", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "ssh_config_file": { 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssh_config_file", 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T23:50:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "use_agent": { 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_agent", 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "use_repo_digest": { 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "use_repo_digest", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_failed_host_check": { 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_failed_host_check", 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_daemons": { 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_daemons", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_on_stray_hosts": { 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_on_stray_hosts", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crash", 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "retain_interval": { 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retain_interval", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "31536000", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_recent_interval": { 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_recent_interval", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1209600", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dashboard", 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_ENABLED": { 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T23:50:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T23:50:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T23:50:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T23:50:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T23:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T23:50:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T23:50:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T23:50:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T23:50:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_URL": { 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_URL", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "[]", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "{}", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "45", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "admin", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T23:50:21.477 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T23:50:21.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T23:50:21.479 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "cross_origin_url": { 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cross_origin_url", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.480 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "crt_file": { 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "crt_file", 2024-09-10T23:50:21.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "debug": { 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "debug", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.482 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Enable/disable debug options", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "jwt_token_ttl": { 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "jwt_token_ttl", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.483 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "28800", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.484 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.485 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.486 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.488 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.489 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "motd": { 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "motd", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.490 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "The message of the day", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect_resolve_ip_addr": { 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.491 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.493 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8080", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.495 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl_server_port": { 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl_server_port", 2024-09-10T23:50:21.496 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8443", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-10T23:50:21.497 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "redirect", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect" 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.498 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.499 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "url_prefix": { 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url_prefix", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_monitoring": { 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_monitoring", 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.501 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "monitor device health metrics", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.502 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.503 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.504 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.505 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "mark_out_threshold": { 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mark_out_threshold", 2024-09-10T23:50:21.507 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "2419200", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "pool_name": { 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pool_name", 2024-09-10T23:50:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "device_health_metrics", 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: "retention_period": { 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "retention_period", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15552000", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long to retain device health metrics", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.510 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_frequency": { 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_frequency", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.511 INFO:teuthology.orchestra.run.smithi016.stdout: "self_heal": { 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "self_heal", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.512 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "warn_threshold": { 2024-09-10T23:50:21.514 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "warn_threshold", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7257600", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "diskprediction_local", 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.516 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.517 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.518 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.519 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.520 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "predict_interval": { 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predict_interval", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.521 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "86400", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "predictor_model": { 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "predictor_model", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.522 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "prophetstor", 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.523 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "600", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "influx", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": false, 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "influxdb python module not found", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "batch_size": { 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "batch_size", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5000", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.526 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "database": { 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "database", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "ceph", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": { 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "hostname", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.528 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server hostname", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "30", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "5", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.529 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.530 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.531 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.532 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.533 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.534 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "password": { 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "password", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.535 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "password of InfluxDB server user", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "port": { 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "port", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "8086", 2024-09-10T23:50:21.536 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "InfluxDB server port", 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.537 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "ssl": { 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ssl", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "false", 2024-09-10T23:50:21.538 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "threads": { 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threads", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.539 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "32", 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "username": { 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "username", 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.540 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "username of InfluxDB server user", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "verify_ssl": { 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "verify_ssl", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.541 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "true", 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.542 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "insights", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.543 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.544 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.545 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.546 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.547 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.548 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "iostat", 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.550 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.551 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.552 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.554 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.555 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "k8sevents", 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_event_retention_days": { 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "ceph_event_retention_days", 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.556 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "7", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "config_check_secs": { 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "config_check_secs", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "10", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.558 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.559 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.560 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.561 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.562 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.564 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "localpool", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "failure_domain": { 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "failure_domain", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "host", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "failure domain for any created local pool", 2024-09-10T23:50:21.565 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.566 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.567 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.568 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.569 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.570 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "min_size": { 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "min_size", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.571 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default min_size for any created local pool", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "num_rep": { 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "num_rep", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.572 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default replica count for any created local pool", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_num": { 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_num", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "128", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.573 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "prefix": { 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prefix", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.574 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "name prefix for any created local pool", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.575 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "subtree": { 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "subtree", 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "rack", 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mds_autoscaler", 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.577 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.578 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.579 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.580 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.581 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.582 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirroring", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.584 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.585 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.586 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.587 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "nfs", 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.590 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.591 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.592 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.593 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.594 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.595 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "fail_fs": { 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "fail_fs", 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.597 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.598 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.599 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.600 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.601 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.602 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator": { 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "orchestrator", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.603 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "rook", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "test_orchestrator" 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Orchestrator backend", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.605 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_perf_query", 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.607 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.609 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.610 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.611 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "osd_support", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.615 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.616 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.617 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "pg_autoscaler", 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.619 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.620 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.621 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.622 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.623 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.624 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.625 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "threshold": { 2024-09-10T23:50:21.626 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "threshold", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "3.0", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1.0", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "scaling threshold", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "progress", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_pg_recovery_event": { 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_pg_recovery_event", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.628 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.629 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.630 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.632 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.633 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.634 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "max_completed_events": { 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_completed_events", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "50", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.635 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "number of past completed events to remember", 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "sleep_interval": { 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sleep_interval", 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.636 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "how long the module is going to sleep", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.637 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "prometheus", 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.638 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "cache": { 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cache", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.639 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "exclude_perf_counters": { 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "exclude_perf_counters", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.640 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.641 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.642 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.643 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.644 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.645 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools": { 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.646 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "300", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.647 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "scrape_interval": { 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "scrape_interval", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15.0", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.648 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "::", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.649 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "9283", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.650 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.651 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "stale_cache_strategy": { 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stale_cache_strategy", 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "log", 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.652 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_behaviour": { 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_behaviour", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "default", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "default", 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "error" 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "standby_error_status_code": { 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "standby_error_status_code", 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.654 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "400", 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "599", 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.655 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.656 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.660 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_snap_create": { 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_snap_create", 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10", 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.661 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "mirror_snapshot_schedule": { 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.662 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.663 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "trash_purge_schedule": { 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "trash_purge_schedule", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.664 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "restful", 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.665 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_auth": { 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enable_auth", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "key_file": { 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "key_file", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.668 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.669 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.670 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.671 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.672 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "max_requests": { 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_requests", 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "500", 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.673 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "server_addr": { 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_addr", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.674 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "server_port": { 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "server_port", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rgw", 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.677 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.678 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.679 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.680 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "5", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.683 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.684 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rook", 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.685 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.686 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.687 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.690 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.691 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_class": { 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "storage_class", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "local", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "selftest", 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.693 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.696 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "roption1": { 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption1", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.698 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "roption2": { 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "roption2", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.699 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "xyz", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption1": { 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption1", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption2": { 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption2", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.701 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption3": { 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption3", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "float", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.702 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption4": { 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption4", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption5": { 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption5", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption6": { 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption6", 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.705 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "rwoption7": { 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rwoption7", 2024-09-10T23:50:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "1", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "42", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "testkey": { 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testkey", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "testlkey": { 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testlkey", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "testnewline": { 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "testnewline", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "smb", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "internal_store_backend": { 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "internal_store_backend", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.712 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.713 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.715 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.716 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.717 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.718 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "update_orchestration": { 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "update_orchestration", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.719 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "allow_m_granularity": { 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "allow_m_granularity", 2024-09-10T23:50:21.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "dump_on_update": { 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "dump_on_update", 2024-09-10T23:50:21.721 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "dump database to debug log on update", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.723 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.724 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.725 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "stats", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.729 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.730 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.732 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.733 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.734 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "status", 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.736 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.737 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.738 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.739 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.740 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telegraf", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "address": { 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "address", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.742 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "15", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.743 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.744 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.745 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.746 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.747 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.748 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.749 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "telemetry", 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.750 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_basic": { 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_basic", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_crash": { 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_crash", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_device": { 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_device", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_ident": { 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_ident", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "channel_perf": { 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "channel_perf", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.755 INFO:teuthology.orchestra.run.smithi016.stdout: "contact": { 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "contact", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": { 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "description", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "device_url": { 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "device_url", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": { 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "enabled", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.759 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "24", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "8", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.760 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "last_opt_revision": { 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "last_opt_revision", 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "1", 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.761 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard": { 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard", 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "leaderboard_description": { 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "leaderboard_description", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.764 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.767 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "organization": { 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "organization", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.769 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "proxy": { 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "proxy", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.770 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "url": { 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "url", 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.772 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "test_orchestrator", 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.774 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.775 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.776 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.777 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.778 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.779 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.780 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.781 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.782 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.783 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.784 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "max_concurrent_clones": { 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "max_concurrent_clones", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "4", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "periodic_async_work": { 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "periodic_async_work", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.786 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Periodically check for async work", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_delay": { 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_delay", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.787 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "snapshot_clone_no_wait": { 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "True", 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix", 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "can_run": true, 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "error_string": "", 2024-09-10T23:50:21.790 INFO:teuthology.orchestra.run.smithi016.stdout: "module_options": { 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "discovery_interval": { 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "discovery_interval", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "uint", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "100", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "identifier": { 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "identifier", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "interval": { 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "interval", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "secs", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "60", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "log_level": { 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_level", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster": { 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster", 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.795 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_cluster_level": { 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_cluster_level", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.796 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "info", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [ 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "critical", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "debug", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "error", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "info", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "warning" 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.797 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": { 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "log_to_file", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "bool", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "False", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.798 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "sqlite3_killpoint": { 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "sqlite3_killpoint", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "dev", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 1, 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "0", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_host": { 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_host", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_port": { 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_port", 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "int", 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "10051", 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.801 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "zabbix_sender": { 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "zabbix_sender", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "str", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "level": "advanced", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "flags": 0, 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "min": "", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "max": "", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "enum_allowed": [], 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "desc": "", 2024-09-10T23:50:21.802 INFO:teuthology.orchestra.run.smithi016.stdout: "long_desc": "", 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "see_also": [] 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "services": { 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "dashboard": "https://172.21.15.16:8443/" 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "always_on_modules": { 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "octopus": [ 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-10T23:50:21.803 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "pacific": [ 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-10T23:50:21.804 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "quincy": [ 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-10T23:50:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "reef": [ 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-10T23:50:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: "squid": [ 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "balancer", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "devicehealth", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "orchestrator", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "pg_autoscaler", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "progress", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_support", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "status", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "telemetry", 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "volumes" 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "force_disabled_modules": {}, 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "last_failure_osd_epoch": 5, 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: "active_clients": [ 2024-09-10T23:50:21.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "devicehealth", 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 1958865271 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "libcephsqlite", 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 2802449427 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "rbd_support", 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 1298509223 2024-09-10T23:50:21.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 749685875 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.810 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "snap_schedule", 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 1754983385 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "volumes", 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "addrvec": [ 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v2", 2024-09-10T23:50:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "172.21.15.16:0", 2024-09-10T23:50:21.812 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3689396158 2024-09-10T23:50:21.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:21.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-10T23:50:21.812 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:50:21.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe240b54d0 msgr2=0x7efe240b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:21.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe240b54d0 0x7efe240b7990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efe2c031440 tx=0x7efe2c005b50 comp rx=0 tx=0).stop 2024-09-10T23:50:21.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c10d070 msgr2=0x7efe3c102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c10d070 0x7efe3c102340 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7efe3400eaa0 tx=0x7efe3400ef60 comp rx=0 tx=0).stop 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 shutdown_connections 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c10d070 0x7efe3c102340 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe3c104540 0x7efe3c101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7efe240b54d0 0x7efe240b7990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 --2- 172.21.15.16:0/2218141254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c103c20 0x7efe3c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 >> 172.21.15.16:0/2218141254 conn(0x7efe3c0fd610 msgr2=0x7efe3c0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 shutdown_connections 2024-09-10T23:50:21.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:20.328+0000 7efe423f8640 1 -- 172.21.15.16:0/2218141254 wait complete. 2024-09-10T23:50:21.821 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T23:50:21.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T23:50:21.822 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:21 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2218141254' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:50:21.823 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:20 smithi066 ceph-mon[34761]: pgmap v631: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-10T23:50:21.823 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:20 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/801631257' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:50:21.823 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:20 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/59380017' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:50:21.823 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:20 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2558897731' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:50:21.823 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:21 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2218141254' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:50:21.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:20 smithi071 ceph-mon[35018]: pgmap v631: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-10T23:50:21.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:20 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/801631257' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:50:21.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:20 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/59380017' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T23:50:21.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:20 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2558897731' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T23:50:21.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:21 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2218141254' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T23:50:22.092 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:22.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:22 smithi016 ceph-mon[30855]: pgmap v632: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-10T23:50:22.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:22 smithi071 ceph-mon[35018]: pgmap v632: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-10T23:50:22.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:22 smithi066 ceph-mon[34761]: pgmap v632: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-10T23:50:22.732 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:50:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 210, 2024-09-10T23:50:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 203, 2024-09-10T23:50:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 830384, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 123872, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 0, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.037002404, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.017272609, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.023580307, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 203, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.016399236, 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000080784 2024-09-10T23:50:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 830384, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 123872 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 152, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:50:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 106992, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 3, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.014917030, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.011968602, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.001236086, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 150, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.008180905, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000054539 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 106992 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 0, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 2, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 0, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 2, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.000310046, 2024-09-10T23:50:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.000224048, 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 0, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 148984, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 30, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 968, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 2, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 207, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 798285, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 207, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 207, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 798285, 2024-09-10T23:50:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-10T23:50:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:22.744 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:50:23.424 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-10T23:50:23.424 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-10T23:50:23.424 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-10T23:50:23.424 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-10T23:50:23.424 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-10T23:50:23.424 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-10T23:50:23.424 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-10T23:50:23.424 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T23:50:23.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T23:50:23.684 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:24.351 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 4, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 4, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 2992, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 448, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 0, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.003486460, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.000040713, 2024-09-10T23:50:24.352 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.002301319, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.004192312, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.001397437 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:50:24.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 156, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 107696, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 3, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.014919082, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.012054901, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.001202465, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:24.354 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 154, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.007907169, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000051345 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 107696 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:24.355 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 212, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 207, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 829088, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 126784, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 2, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.037921850, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.018160938, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.026106046, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 206, 2024-09-10T23:50:24.356 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.011068845, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000053732 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 829088, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 126784 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 0, 2024-09-10T23:50:24.357 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:24.358 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:24.360 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:24.360 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:24.360 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:24.360 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:24.360 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:24.360 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:24.360 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:24.361 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 148967, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 29, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:24.362 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 968, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 2, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-10T23:50:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 213, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 799129, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 213, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 213, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 799129, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:24.364 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:50:24.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:24 smithi016 ceph-mon[30855]: pgmap v633: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:24.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:24 smithi071 ceph-mon[35018]: pgmap v633: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:24.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:24 smithi066 ceph-mon[34761]: pgmap v633: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:25.040 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T23:50:25.040 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T23:50:25.040 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-10T23:50:25.040 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-10T23:50:25.040 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-10T23:50:25.040 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-10T23:50:25.040 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-10T23:50:25.041 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T23:50:25.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T23:50:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:25.819 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:50:25.819 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:25.819 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 211, 2024-09-10T23:50:25.819 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 204, 2024-09-10T23:50:25.819 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 830656, 2024-09-10T23:50:25.819 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 124512, 2024-09-10T23:50:25.819 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 0, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.039388164, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.018708741, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.025337837, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 204, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.016078878, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000078818 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:25.820 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 830656, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 124512 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 154, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 107344, 2024-09-10T23:50:25.821 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 3, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.014333679, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.011324150, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.001437807, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 152, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.007382770, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000048570 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:25.822 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 107344 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 0, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 2, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 0, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 2, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.000381902, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:50:25.823 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.000318523, 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:25.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 0, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:25.825 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-10T23:50:25.827 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 148967, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 29, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-10T23:50:25.828 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 968, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 2, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 208, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 798415, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:25.830 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 208, 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 208, 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 798415, 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:25.831 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:50:26.457 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:26 smithi016 ceph-mon[30855]: pgmap v634: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:26.488 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-10T23:50:26.488 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-10T23:50:26.488 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-10T23:50:26.488 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-10T23:50:26.488 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-10T23:50:26.488 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-10T23:50:26.488 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-10T23:50:26.488 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T23:50:26.488 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T23:50:26.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:26 smithi071 ceph-mon[35018]: pgmap v634: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:26.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:26 smithi066 ceph-mon[34761]: pgmap v634: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:26.745 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:27.253 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-10T23:50:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 4, 2024-09-10T23:50:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 4, 2024-09-10T23:50:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 2992, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 448, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 0, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.004507945, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.000044276, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.003291099, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.006008613, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.002002871 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 213, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 208, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 829360, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 127424, 2024-09-10T23:50:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 2, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.036584706, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.018549205, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.023772424, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 207, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.012077729, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000058346 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 829360, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 127424 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 158, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 108048, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 3, 2024-09-10T23:50:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.015865842, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.012644277, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.001337840, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 156, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.008679279, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000055636 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 108048 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 0, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 148967, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 29, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 968, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 2, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 214, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 799259, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 214, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 214, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 799259, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-10T23:50:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-10T23:50:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-10T23:50:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-10T23:50:27.265 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-10T23:50:28.022 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T23:50:28.022 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T23:50:28.023 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-10T23:50:28.023 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-10T23:50:28.023 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-10T23:50:28.023 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-10T23:50:28.023 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-10T23:50:28.023 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T23:50:28.023 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T23:50:28.302 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:50:28.353 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:28 smithi066 ceph-mon[34761]: pgmap v635: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:28.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:28 smithi016 ceph-mon[30855]: pgmap v635: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:28.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:28 smithi071 ceph-mon[35018]: pgmap v635: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-10T23:50:28.821 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-10T23:50:28.821 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:28.821 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 101, 2024-09-10T23:50:28.821 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 129, 2024-09-10T23:50:28.821 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 32945, 2024-09-10T23:50:28.821 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 93166, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 15, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.021625124, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.005345889, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.011713270, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000844068, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 128, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.029526967, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000230679 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:28.822 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 165, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000035814, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000217 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 7712, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 12800 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1275, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1085, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1163854, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 891401, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 40, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-09-10T23:50:28.823 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.150805138, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.066216631, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.098913698, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.004446552, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1086, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.065023625, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000059874 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1804, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000323974, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000179 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.824 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 869120, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 130656 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 21, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 203, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 4166, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 398789, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 10, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 6, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.022709427, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.012439742, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.007734386, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000296856, 2024-09-10T23:50:28.825 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 199, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.021004539, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000105550 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 49, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000010526, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000214 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 357408 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-10T23:50:28.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 44, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.002533537, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000057580 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000021556, 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000010778 2024-09-10T23:50:28.827 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 8, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 5, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 5, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000928596, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000185719 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 3, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 11, 2024-09-10T23:50:28.828 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 17, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 1, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 16, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 13, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 8, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 1, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 2, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 3, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 19, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 13, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-10T23:50:28.829 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 4, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 4, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 234, 2024-09-10T23:50:28.830 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 6, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:50:28.831 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 1 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 13, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 8, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 10, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-10T23:50:28.832 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:50:28.833 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 6, 2024-09-10T23:50:28.834 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 6, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 2, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4196123, 2024-09-10T23:50:28.835 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 0, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 5, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.008962545, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001792509 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 0 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 21, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 27, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 6, 2024-09-10T23:50:28.836 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 20, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 25, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 5, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 17, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 25, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 8, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 2, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 3, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 1, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 51064, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 258727936 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.837 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 9, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 8, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 21, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000816624, 2024-09-10T23:50:28.838 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000204156 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.839 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000111972, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000111972 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.840 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.842 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-10T23:50:28.842 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.842 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.842 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.843 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.844 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.845 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.847 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.848 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.849 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 2, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 3, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 2, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 3, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 1, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 589, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.850 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:28.851 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:28.852 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 247837, 2024-09-10T23:50:28.853 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 90, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 88, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 1, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 8064, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 178, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 89733, 2024-09-10T23:50:28.854 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 345, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 42, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 12211, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 28, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 42, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 42, 2024-09-10T23:50:28.855 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.256998004, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.006119000 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 42, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 64 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 42, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 0, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 42, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 0, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 10, 2024-09-10T23:50:28.856 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 5, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 8, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 6, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 20, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:50:28.857 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-10T23:50:28.858 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-10T23:50:28.859 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 85, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 10, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 9, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 9, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 14, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 0, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 1 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 1, 2024-09-10T23:50:28.860 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:28.861 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 1393, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1058930, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 1393, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1393, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1058930, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.862 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 42, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 12211, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 42, 2024-09-10T23:50:28.863 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 12211, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:28.864 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 42, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 42, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 42, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 42, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-10T23:50:28.865 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.866 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x558737e28960": { 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 6, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1819, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 6, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 5, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1819, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:28.867 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:28.868 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.868 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:28.868 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-09-10T23:50:28.868 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-10T23:50:28.868 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:28.868 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-10T23:50:29.646 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-10T23:50:29.647 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-10T23:50:29.647 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-09-10T23:50:29.647 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=13 2024-09-10T23:50:29.647 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-10T23:50:29.647 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:50:29.647 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:50:29.647 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T23:50:29.647 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T23:50:29.917 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:50:30.302 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:30 smithi066 ceph-mon[34761]: pgmap v636: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:50:30.480 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-10T23:50:30.480 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:30.480 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 231, 2024-09-10T23:50:30.480 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 224, 2024-09-10T23:50:30.480 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 858482, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 130340, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 5, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.043507616, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.019395590, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.033115440, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000019703, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 223, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.014369555, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000064437 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.481 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 857648, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 130016 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 650, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 806, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 159836, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 562867, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 5, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-09-10T23:50:30.482 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.085143377, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.039888185, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.015738461, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.021898882, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 804, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.033855487, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000042108 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 356480 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1464, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1464, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 440824, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 464786, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.179976679, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.084484965, 2024-09-10T23:50:30.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.039170993, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.041923063, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1463, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.067609767, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000046213 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T23:50:30.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3496, 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.098053765, 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000028047 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-10T23:50:30.487 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-09-10T23:50:30.488 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-10T23:50:30.489 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-10T23:50:30.490 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-10T23:50:30.491 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-10T23:50:30.492 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-10T23:50:30.493 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 5, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-09-10T23:50:30.494 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4195815, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 4195424, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 5 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.495 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 3, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 3, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 1, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 1, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 48400, 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 248242176 2024-09-10T23:50:30.496 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.497 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.499 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.500 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.501 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.502 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-10T23:50:30.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.505 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-10T23:50:30.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.508 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 2, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 1931, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:30.509 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:30.510 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:30.511 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 189400, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 51, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-10T23:50:30.512 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 8064, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 178, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 8672, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 13, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-10T23:50:30.513 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 2110, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 2110, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2110, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 1.000991996, 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000474403 2024-09-10T23:50:30.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2110, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2111 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 2110, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 2110, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1374, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 734, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-09-10T23:50:30.515 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:50:30.516 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-10T23:50:30.517 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 85, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 10, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 5, 2024-09-10T23:50:30.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 5, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-10T23:50:30.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:30.520 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 2341, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1233646, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 2341, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2341, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1233646, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.521 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2110, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 1516, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2110, 2024-09-10T23:50:30.522 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1516, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:30.523 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2110, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2110, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2110, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2110, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:30.524 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.525 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x5632d1e50c80": { 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-10T23:50:30.526 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:30.527 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-10T23:50:30.528 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:30 smithi071 ceph-mon[35018]: pgmap v636: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:50:30.528 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:30 smithi016 ceph-mon[30855]: pgmap v636: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T23:50:31.429 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:31 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:31.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:31 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:31.495 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:31 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:31.528 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T23:50:31.529 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T23:50:31.529 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-10T23:50:31.529 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-10T23:50:31.529 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-10T23:50:31.529 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:50:31.529 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:50:31.529 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T23:50:31.529 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T23:50:32.434 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:50:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:32 smithi016 ceph-mon[30855]: pgmap v637: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:32 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:32 smithi071 ceph-mon[35018]: pgmap v637: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:32 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:32 smithi066 ceph-mon[34761]: pgmap v637: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:32.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:32.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:32 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 2114, 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 2116, 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 599760, 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 672259, 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:33.096 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.199263607, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.089885531, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.041904002, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.053263797, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2114, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.078666354, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000037212 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.097 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 3, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 158, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 716, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 358634, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.012980404, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.009160911, 2024-09-10T23:50:33.098 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.002028524, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000056592, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 156, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.009715646, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000062279 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:33.099 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 357936 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 232, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 223, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 860028, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 129342, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 3, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.044242356, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.019349178, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.034595774, 2024-09-10T23:50:33.100 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000030610, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 223, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.018753149, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000084094 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 859760, 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 129024 2024-09-10T23:50:33.101 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3577, 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.086518271, 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000024187 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-10T23:50:33.102 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.103 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 0, 2024-09-10T23:50:33.104 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-10T23:50:33.105 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:50:33.106 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-10T23:50:33.107 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-10T23:50:33.108 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-10T23:50:33.109 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 6, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-10T23:50:33.110 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4196123, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 4195732, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 6 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 3, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 3, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 0, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 1, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 1, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 0, 2024-09-10T23:50:33.111 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 47996, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 248246272 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-10T23:50:33.112 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.114 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.116 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-10T23:50:33.117 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-10T23:50:33.118 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.119 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.120 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-10T23:50:33.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.122 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-10T23:50:33.123 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 2, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 3, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 2, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 1934, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:33.124 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:33.125 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:33.126 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 181360, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 48, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 8064, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 178, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:33.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 8672, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 13, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 2117, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-09-10T23:50:33.128 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 2117, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2117, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 1.153990765, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000545106 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2117, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2118 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 2117, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 2117, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-10T23:50:33.129 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1378, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 737, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-10T23:50:33.130 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-10T23:50:33.131 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-10T23:50:33.132 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 85, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 10, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 4, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 4, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-10T23:50:33.133 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-10T23:50:33.134 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 2345, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1234804, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 2345, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:33.135 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2345, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1234804, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:33.136 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2117, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 1824, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2117, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1824, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.137 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2117, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2117, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2117, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2117, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.138 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:33.139 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x55cd1c6aec80": { 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-10T23:50:33.140 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-10T23:50:33.141 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:33.142 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-10T23:50:33.901 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T23:50:33.901 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T23:50:33.901 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-10T23:50:33.901 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-10T23:50:33.901 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-10T23:50:33.901 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:50:33.901 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:50:33.901 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T23:50:33.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T23:50:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:50:34.477 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:34 smithi066 ceph-mon[34761]: pgmap v638: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:50:34.477 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:34 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:34.477 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:34 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:34 smithi016 ceph-mon[30855]: pgmap v638: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:50:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:34 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:34.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:34 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:34 smithi071 ceph-mon[35018]: pgmap v638: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:50:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:34 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:34.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:34 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 0, 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 2, 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 0, 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 0, 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 0, 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.001290882, 2024-09-10T23:50:34.693 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.000331056, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:50:34.694 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 160, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 108400, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 3, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.013496526, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.010373096, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.001099390, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:34.695 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 158, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.010575031, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000066930 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 108400 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 220, 2024-09-10T23:50:34.696 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 213, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 833168, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 129792, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 2, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.041418173, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.018182066, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.030599834, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 213, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.018520422, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000086950 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.697 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 833168, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 129792 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 0, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:34.698 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:34.699 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:34.700 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 148984, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 30, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-10T23:50:34.701 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 968, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 2, 2024-09-10T23:50:34.702 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 217, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 799649, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 217, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-10T23:50:34.703 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 217, 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 799649, 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-10T23:50:34.704 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-10T23:50:35.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:35 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:35.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:35 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:35.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:35 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:35.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:35 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:35.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:35 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:35.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:35 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:35.549 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:35 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:35.549 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:35 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:35.549 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:35 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' 2024-09-10T23:50:35.582 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-10T23:50:35.582 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-10T23:50:35.582 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-10T23:50:35.582 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-10T23:50:35.583 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-10T23:50:35.583 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-10T23:50:35.583 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-10T23:50:35.583 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T23:50:35.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T23:50:35.846 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:50:36.380 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T23:50:36.380 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:36.380 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 335, 2024-09-10T23:50:36.380 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 324, 2024-09-10T23:50:36.380 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 893629, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 186600, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 11, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.053879113, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.022559126, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.035111758, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000320969, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 324, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.030090669, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000092872 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.381 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 97, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000016837, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000173 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 871232, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 135840 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 27, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 197, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 6093, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 424994, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 12, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-10T23:50:36.382 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.017049777, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.010284613, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.004584226, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000464917, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 195, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.023317013, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000119574 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 34, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000006996, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000205 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.383 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 363280 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1019, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 852, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 294890, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 666086, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 40, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.108771571, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.051999215, 2024-09-10T23:50:36.384 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.057151093, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.003856508, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 850, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.042501550, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000050001 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1800, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000290832, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000161 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.385 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 35, 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001713125, 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000048946 2024-09-10T23:50:36.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000024800, 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000012400 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-10T23:50:36.387 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 11, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 17, 2024-09-10T23:50:36.388 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 1, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 16, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 13, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 8, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 3, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 9, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 6, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 3, 2024-09-10T23:50:36.389 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-10T23:50:36.390 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:50:36.391 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 15, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 9, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 10, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-10T23:50:36.392 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:50:36.393 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_started": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_succeeded": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_write_failed": 0 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 5, 2024-09-10T23:50:36.394 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 5, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 2, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-10T23:50:36.395 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4195815, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.007816530, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001954132 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 21, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 27, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 6, 2024-09-10T23:50:36.396 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 20, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 26, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 6, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 17, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 25, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 8, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 50352, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 257683456 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-10T23:50:36.397 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 12, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.398 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-10T23:50:36.399 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.401 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.402 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.402 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-10T23:50:36.402 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.402 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-10T23:50:36.404 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.406 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.407 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.408 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.409 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-10T23:50:36.410 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 2, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 1, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 1, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 571, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:36.411 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:36.412 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:36.413 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 245991, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 76, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:36.414 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8064, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 178, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 89077, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 339, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-10T23:50:36.415 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 40, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 11813, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 33, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 40, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 40, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.214996194, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005374904 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 40, 2024-09-10T23:50:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 62 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 40, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 0, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 40, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 10, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 0, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 4, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 7, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-10T23:50:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 6, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 20, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-10T23:50:36.418 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-10T23:50:36.419 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 85, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 10, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 8, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 8, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-10T23:50:36.420 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 14, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 1 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-10T23:50:36.421 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 1377, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1053940, 2024-09-10T23:50:36.422 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 1377, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1377, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1053940, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:36.423 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 40, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 11813, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 40, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 11813, 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:36.424 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 40, 2024-09-10T23:50:36.425 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 40, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 40, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 40, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:36.426 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x5649787d6960": { 2024-09-10T23:50:36.427 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 5, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1511, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 5, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 4, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1511, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:36.428 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:36.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:36.429 INFO:teuthology.orchestra.run.smithi071.stdout: "trackedop": { 2024-09-10T23:50:36.429 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-10T23:50:36.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:36.429 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T23:50:36.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:36 smithi016 ceph-mon[30855]: pgmap v639: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:50:36.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:36 smithi071 ceph-mon[35018]: pgmap v639: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:50:36.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:36 smithi066 ceph-mon[34761]: pgmap v639: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:50:37.375 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T23:50:37.375 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T23:50:37.375 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-10T23:50:37.376 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=15 2024-09-10T23:50:37.376 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-10T23:50:37.376 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:50:37.376 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:50:37.376 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T23:50:37.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T23:50:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:50:38.170 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1710, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1703, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 5485552, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 600982, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.223421622, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.096965258, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.067729115, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.052310093, 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:38.171 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1702, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.076395987, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000044886 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 857744, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 130656 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 612, 2024-09-10T23:50:38.172 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 767, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 5410394, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 553476, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.084385360, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.040094825, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.020343847, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.016893625, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 766, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.039839012, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000052009 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.173 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 360384 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 190, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 192, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 4241230, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 60427, 2024-09-10T23:50:38.174 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.022633235, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.009714795, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.005790112, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.005485569, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 190, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.007022477, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000036960 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:38.175 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-10T23:50:38.176 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3767, 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.108897480, 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000028908 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.177 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-10T23:50:38.178 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 1234, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 1234, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 1234, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 2, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-10T23:50:38.179 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-10T23:50:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:50:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-10T23:50:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-10T23:50:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_started": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_succeeded": 0, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_write_failed": 0 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 6158, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 8, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-10T23:50:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 17831200, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 17831088, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 6158 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 21, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 1232, 2024-09-10T23:50:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 1211, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 16, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 21, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 5, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 1234, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 1240, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 6, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 50588, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 253931520 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-10T23:50:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-10T23:50:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-10T23:50:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-10T23:50:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 3, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 1, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 1983, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 189497, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 53, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8064, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 178, 2024-09-10T23:50:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 919203, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 5328, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-10T23:50:38.204 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 2276, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 26, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 4, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 2276, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2276, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.150979441, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000505702 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2276, 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2277 2024-09-10T23:50:38.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 2276, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 2276, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 1464, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 809, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-10T23:50:38.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 2, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-10T23:50:38.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-10T23:50:38.208 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 85, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 10, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 5, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 5, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.209 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-10T23:50:38.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2508, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 14896604, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2508, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2508, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 14896604, 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:38.211 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2276, 2024-09-10T23:50:38.212 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 13636906, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2276, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 13636906, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:38.213 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2276, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 2276, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2276, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2276, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:38.214 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x5599b1422c80": { 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:38.216 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout: "trackedop": { 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:38.217 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T23:50:38.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:38 smithi016 ceph-mon[30855]: pgmap v640: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:50:38.490 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:38 smithi071 ceph-mon[35018]: pgmap v640: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:50:38.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:38 smithi066 ceph-mon[34761]: pgmap v640: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:50:38.879 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T23:50:38.879 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T23:50:38.879 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-10T23:50:38.879 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-10T23:50:38.879 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-10T23:50:38.879 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-10T23:50:38.879 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T23:50:38.880 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T23:50:38.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T23:50:39.126 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:50:39.620 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T23:50:39.620 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:39.620 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 4383, 2024-09-10T23:50:39.620 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 4009, 2024-09-10T23:50:39.620 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1374183, 2024-09-10T23:50:39.620 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 9846036, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 22, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.425322610, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.183735691, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.129189768, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.096360138, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4007, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.680312461, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000169780 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:39.621 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2594, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000547546, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000211 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 303536, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 85600 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 3319, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 3638, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 986214, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 7339686, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 130, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 8, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.345131075, 2024-09-10T23:50:39.622 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.156014737, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.127144813, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.054411570, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3640, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.475195766, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000130548 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1880, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000316656, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000168 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 368160 2024-09-10T23:50:39.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 7569, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 11735, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 3291283, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 5851319, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 14, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 7, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.707287307, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.361833046, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.311244079, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.084866629, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 11731, 2024-09-10T23:50:39.624 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.508684184, 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000043362 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 13608, 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002180753, 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000160 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 933472, 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 185568 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-10T23:50:39.625 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4658, 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2.181655018, 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000468367 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-10T23:50:39.626 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 5064, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.205655003, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000040611 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 2573, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 2573, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2573, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2.770163554, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001076627 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-10T23:50:39.627 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 12, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 27, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 27, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 26, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 3, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 3, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 2, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 2702, 2024-09-10T23:50:39.628 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 2689, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 200, 2024-09-10T23:50:39.629 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 200, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 128, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 18, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 110, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 72, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 33, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 3639, 2024-09-10T23:50:39.630 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 2450, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 1212, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 11, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 1240 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 11, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 20, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 1, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-10T23:50:39.631 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 1212, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 1211, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 18, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-10T23:50:39.632 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_started": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_succeeded": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "uninline_write_failed": 0 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 6158, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 6158, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-10T23:50:39.633 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 8, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 8, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 17831200, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2479, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 3.619096667, 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001459901 2024-09-10T23:50:39.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 24, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 1253, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 1229, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 19, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 24, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 5, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 27, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 1244, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 1217, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 3, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 1226, 2024-09-10T23:50:39.635 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 1223, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 60412, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 275636224 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 2878, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 2573, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 24, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1210, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.136818057, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000939519 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.636 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 97, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.017890097, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000184433 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000184341, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000184341 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.638 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.639 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 10, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001485446, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000148544 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 12, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.014972793, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001247732 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.640 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 10, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.048968873, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.004896887 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000287217, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000287217 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.641 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 6, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.008638938, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001439823 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001977494, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000988747 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.642 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 6, 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.034285602, 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005714267 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-10T23:50:39.643 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.016924918, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.004231229 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000862942, 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000862942 2024-09-10T23:50:39.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.645 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 7, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.020668872, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002952696 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1206, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.466197964, 2024-09-10T23:50:39.646 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001215752 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 3, 2024-09-10T23:50:39.647 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 1, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 34, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 17, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 605, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:39.648 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:39.649 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 331594, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 141, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 704, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 8, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8064, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 178, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 114787, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 883, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 6868, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 13878019, 2024-09-10T23:50:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 31, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 6868, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 6868, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 29.765465947, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.004333935 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 6868, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 6938 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 6868, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 260, 2024-09-10T23:50:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 6608, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 11, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 42, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 2503, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 34, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 4012, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-10T23:50:39.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 218, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 22, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-10T23:50:39.655 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 85, 2024-09-10T23:50:39.656 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 10, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 12, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 12, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 77, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 19 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-10T23:50:39.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 14, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 8, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 3497, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 1211, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 15267, 2024-09-10T23:50:39.658 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 4222286, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 15267, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 15267, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 4222286, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:39.659 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 6868, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 14000330, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 6868, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 14000330, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.660 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 6868, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 6868, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 6868, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 6868, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.661 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 1211, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 122311, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 1211, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 24, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 122311, 2024-09-10T23:50:39.662 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x55a3d9d4e960": { 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 6158, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 13636896, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 6158, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:39.663 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2479, 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 13636896, 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: "trackedop": { 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:39.664 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T23:50:40.260 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T23:50:40.260 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T23:50:40.260 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=11 2024-09-10T23:50:40.260 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-09-10T23:50:40.260 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-10T23:50:40.260 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=10 2024-09-10T23:50:40.260 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=4 2024-09-10T23:50:40.260 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T23:50:40.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T23:50:40.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:40 smithi016 ceph-mon[30855]: pgmap v641: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:50:40.505 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:50:40.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:40 smithi071 ceph-mon[35018]: pgmap v641: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:50:40.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:40 smithi066 ceph-mon[34761]: pgmap v641: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 4, 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 4, 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 2992, 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 448, 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 4, 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 0, 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.003044657, 2024-09-10T23:50:41.005 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.000035756, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.002162374, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.003907865, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001302621 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.006 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 218, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 213, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 830720, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 130624, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 2, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 1, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.038213632, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.018509632, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.027514163, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 212, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.014415886, 2024-09-10T23:50:41.007 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000067999 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 830720, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 130624 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 162, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 160, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 108752, 2024-09-10T23:50:41.008 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 3, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.013237325, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.010693575, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.000587264, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 160, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.010869439, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000067933 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:41.009 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 108752 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 0, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:50:41.010 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:50:41.011 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:50:41.012 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 148967, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 29, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:50:41.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 968, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 2, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-10T23:50:41.014 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 219, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 799909, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 219, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 219, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 799909, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T23:50:41.015 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T23:50:41.706 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-10T23:50:41.706 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-10T23:50:41.707 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-10T23:50:41.707 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-10T23:50:41.707 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-10T23:50:41.707 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-10T23:50:41.707 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-10T23:50:41.707 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T23:50:41.716 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T23:50:41.717 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:50:41.717 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:50:41.738 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-10T23:50:41.738 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:50:41.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:50:42.107 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:42.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:42 smithi016 ceph-mon[30855]: pgmap v642: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:42.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:42 smithi071 ceph-mon[35018]: pgmap v642: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:42.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:42 smithi066 ceph-mon[34761]: pgmap v642: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:50:42.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 -- 172.21.15.16:0/4120213569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 msgr2=0x7f8ab0111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:42.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/4120213569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab0111810 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009ca0 tx=0x7f8aa802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 -- 172.21.15.16:0/4120213569 shutdown_connections 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/4120213569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab0111810 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/4120213569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ab0102190 0x7f8ab010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/4120213569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ab0101870 0x7f8ab0101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 -- 172.21.15.16:0/4120213569 >> 172.21.15.16:0/4120213569 conn(0x7f8ab00fd700 msgr2=0x7f8ab00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 -- 172.21.15.16:0/4120213569 shutdown_connections 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.596+0000 7f8ab7d21640 1 -- 172.21.15.16:0/4120213569 wait complete. 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 Processor -- start 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 -- start start 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ab0101870 0x7f8ab019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ab0102190 0x7f8ab019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab01a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0114f80 con 0x7f8ab010f420 2024-09-10T23:50:42.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0114e00 con 0x7f8ab0101870 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab7d21640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0115100 con 0x7f8ab0102190 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab01a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab01a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60190/0 (socket says 172.21.15.16:60190) 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 -- 172.21.15.16:0/793825735 learned_addr learned my addr 172.21.15.16:0/793825735 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab5abd640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ab0101870 0x7f8ab019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab52bc640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ab0102190 0x7f8ab019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 -- 172.21.15.16:0/793825735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ab0102190 msgr2=0x7f8ab019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ab0102190 0x7f8ab019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 -- 172.21.15.16:0/793825735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ab0101870 msgr2=0x7f8ab019b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ab0101870 0x7f8ab019b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.597+0000 7f8ab62be640 1 -- 172.21.15.16:0/793825735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab01a1480 con 0x7f8ab010f420 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.598+0000 7f8ab62be640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab01a0cb0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80319f0 tx=0x7f8aa8031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.598+0000 7f8aa6ffd640 1 -- 172.21.15.16:0/793825735 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8003bf0 con 0x7f8ab010f420 2024-09-10T23:50:42.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.598+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab01a1710 con 0x7f8ab010f420 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.598+0000 7f8aa6ffd640 1 -- 172.21.15.16:0/793825735 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aa8003d90 con 0x7f8ab010f420 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.598+0000 7f8aa6ffd640 1 -- 172.21.15.16:0/793825735 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa802fc00 con 0x7f8ab010f420 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.598+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab01a7e30 con 0x7f8ab010f420 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.599+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab0101c50 con 0x7f8ab010f420 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.600+0000 7f8aa6ffd640 1 -- 172.21.15.16:0/793825735 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f8aa8004610 con 0x7f8ab010f420 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.601+0000 7f8aa6ffd640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8a9c0b5450 0x7f8a9c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.601+0000 7f8ab5abd640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8a9c0b5450 0x7f8a9c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.601+0000 7f8aa6ffd640 1 -- 172.21.15.16:0/793825735 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f8aa8107520 con 0x7f8ab010f420 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.602+0000 7f8ab5abd640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8a9c0b5450 0x7f8a9c0b7910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00abe0 tx=0x7f8aac00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:42.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.604+0000 7f8aa6ffd640 1 -- 172.21.15.16:0/793825735 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8aa80ce070 con 0x7f8ab010f420 2024-09-10T23:50:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.815+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8ab01a80c0 con 0x7f8ab010f420 2024-09-10T23:50:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.815+0000 7f8aa6ffd640 1 -- 172.21.15.16:0/793825735 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v85) ==== 81+0+886 (secure 0 0 0) 0x7f8aa80098b0 con 0x7f8ab010f420 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/3183663764 2024-09-11T23:31:42.335701+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2040139033 2024-09-11T23:30:16.164092+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/1838016037 2024-09-11T23:30:16.164092+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1952619887 2024-09-11T23:31:42.335701+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/1838016037 2024-09-11T23:30:16.164092+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3343059075 2024-09-11T23:31:42.335701+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1489458820 2024-09-11T23:30:39.646876+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/3183663764 2024-09-11T23:31:42.335701+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3511379318 2024-09-11T23:30:16.164092+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1963800074 2024-09-11T23:30:39.646876+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3428304012 2024-09-11T23:30:16.164092+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/83801371 2024-09-11T23:30:39.646876+0000 2024-09-10T23:50:42.817 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/3233639538 2024-09-11T23:30:39.646876+0000 2024-09-10T23:50:42.818 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/3233639538 2024-09-11T23:30:39.646876+0000 2024-09-10T23:50:42.818 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2667683333 2024-09-11T23:31:42.335701+0000 2024-09-10T23:50:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:listed 15 entries 2024-09-10T23:50:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8a9c0b5450 msgr2=0x7f8a9c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8a9c0b5450 0x7f8a9c0b7910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00abe0 tx=0x7f8aac00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 msgr2=0x7f8ab01a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab01a0cb0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80319f0 tx=0x7f8aa8031a20 comp rx=0 tx=0).stop 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 shutdown_connections 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ab010f420 0x7f8ab01a0cb0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ab0102190 0x7f8ab019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f8a9c0b5450 0x7f8a9c0b7910 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 --2- 172.21.15.16:0/793825735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ab0101870 0x7f8ab019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.817+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 >> 172.21.15.16:0/793825735 conn(0x7f8ab00fd700 msgr2=0x7f8ab0110720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.818+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 shutdown_connections 2024-09-10T23:50:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:42.818+0000 7f8ab7d21640 1 -- 172.21.15.16:0/793825735 wait complete. 2024-09-10T23:50:43.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:43 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/793825735' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:50:43.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:43 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/793825735' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:50:43.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:43 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/793825735' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:50:43.592 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T23:50:43.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:50:43.592 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T23:50:43.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:50:43.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:50:43.638 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:50:43.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:50:43.678 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-09-10T23:50:43.736 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:50:43.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:50:43.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:50:43.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:50:43.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-09-10T23:50:43.901 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T23:50:43.914 INFO:tasks.cephadm:Teardown begin 2024-09-10T23:50:43.915 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:50:43.915 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:50:44.175 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:44.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:44 smithi071 ceph-mon[35018]: pgmap v643: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:50:44.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:44 smithi066 ceph-mon[34761]: pgmap v643: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:50:44.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:44 smithi016 ceph-mon[30855]: pgmap v643: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T23:50:44.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/849938600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec81076c0 msgr2=0x7f1ec8107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:44.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/849938600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec81076c0 0x7f1ec8107b00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009900 tx=0x7f1ebc02a410 comp rx=0 tx=0).stop 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/849938600 shutdown_connections 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/849938600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ec8108040 0x7f1ec810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/849938600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec81076c0 0x7f1ec8107b00 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/849938600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec8101cb0 0x7f1ec8102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/849938600 >> 172.21.15.16:0/849938600 conn(0x7f1ec80fd700 msgr2=0x7f1ec80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/849938600 shutdown_connections 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.643+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/849938600 wait complete. 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 Processor -- start 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 -- start start 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec8101cb0 0x7f1ec81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec81076c0 0x7f1ec8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ec8108040 0x7f1ec819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:44.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8111d90 con 0x7f1ec8101cb0 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8111c10 con 0x7f1ec8108040 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecf0b4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8111f10 con 0x7f1ec81076c0 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecce50640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec8101cb0 0x7f1ec81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecce50640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec8101cb0 0x7f1ec81993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43464/0 (socket says 172.21.15.16:43464) 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecce50640 1 -- 172.21.15.16:0/2502599145 learned_addr learned my addr 172.21.15.16:0/2502599145 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ec7fff640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec81076c0 0x7f1ec8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.644+0000 7f1ecd651640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ec8108040 0x7f1ec819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecce50640 1 -- 172.21.15.16:0/2502599145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec81076c0 msgr2=0x7f1ec8199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecce50640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec81076c0 0x7f1ec8199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecce50640 1 -- 172.21.15.16:0/2502599145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ec8108040 msgr2=0x7f1ec819ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecce50640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ec8108040 0x7f1ec819ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecce50640 1 -- 172.21.15.16:0/2502599145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec819f480 con 0x7f1ec8101cb0 2024-09-10T23:50:44.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecce50640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec8101cb0 0x7f1ec81993d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800b4a0 tx=0x7f1eb800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:44.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ec5ffb640 1 -- 172.21.15.16:0/2502599145 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8014070 con 0x7f1ec8101cb0 2024-09-10T23:50:44.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec819f770 con 0x7f1ec8101cb0 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ec5ffb640 1 -- 172.21.15.16:0/2502599145 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8010ac0 con 0x7f1ec8101cb0 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ec5ffb640 1 -- 172.21.15.16:0/2502599145 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8017c30 con 0x7f1ec8101cb0 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.645+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec81a5eb0 con 0x7f1ec8101cb0 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.646+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec8102110 con 0x7f1ec8101cb0 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.648+0000 7f1ec5ffb640 1 -- 172.21.15.16:0/2502599145 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f1eb8010610 con 0x7f1ec8101cb0 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.648+0000 7f1ec5ffb640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1eb00b5450 0x7f1eb00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.648+0000 7f1ec7fff640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1eb00b5450 0x7f1eb00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:44.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.648+0000 7f1ec5ffb640 1 -- 172.21.15.16:0/2502599145 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f1eb80e5920 con 0x7f1ec8101cb0 2024-09-10T23:50:44.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.649+0000 7f1ec7fff640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1eb00b5450 0x7f1eb00b7910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc000c00 tx=0x7f1ebc031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:44.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.653+0000 7f1ec5ffb640 1 -- 172.21.15.16:0/2502599145 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1eb80ac4d0 con 0x7f1ec8101cb0 2024-09-10T23:50:44.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.875+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ec81a6290 con 0x7f1ec8101cb0 2024-09-10T23:50:44.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.876+0000 7f1ec5ffb640 1 -- 172.21.15.16:0/2502599145 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f1eb80abdd0 con 0x7f1ec8101cb0 2024-09-10T23:50:44.877 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:50:44.877 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:50:44.878 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.878+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1eb00b5450 msgr2=0x7f1eb00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.878+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1eb00b5450 0x7f1eb00b7910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc000c00 tx=0x7f1ebc031400 comp rx=0 tx=0).stop 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.878+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec8101cb0 msgr2=0x7f1ec81993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.878+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec8101cb0 0x7f1ec81993d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800b4a0 tx=0x7f1eb800b960 comp rx=0 tx=0).stop 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 shutdown_connections 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f1eb00b5450 0x7f1eb00b7910 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ec8108040 0x7f1ec819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ec81076c0 0x7f1ec8199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 --2- 172.21.15.16:0/2502599145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ec8101cb0 0x7f1ec81993d0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:44.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 >> 172.21.15.16:0/2502599145 conn(0x7f1ec80fd700 msgr2=0x7f1ec8104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:44.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 shutdown_connections 2024-09-10T23:50:44.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:44.879+0000 7f1ecf0b4640 1 -- 172.21.15.16:0/2502599145 wait complete. 2024-09-10T23:50:45.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:45 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2502599145' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:45.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:45 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2502599145' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:45.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:45 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2502599145' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:45.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:50:45.971 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:46.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:46 smithi016 ceph-mon[30855]: pgmap v644: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 -- 172.21.15.16:0/2670349789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0101cd0 msgr2=0x7f16f01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2670349789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0101cd0 0x7f16f01020b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009900 tx=0x7f16e002a410 comp rx=0 tx=0).stop 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 -- 172.21.15.16:0/2670349789 shutdown_connections 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2670349789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16f0108060 0x7f16f010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2670349789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f01076e0 0x7f16f0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2670349789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0101cd0 0x7f16f01020b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 -- 172.21.15.16:0/2670349789 >> 172.21.15.16:0/2670349789 conn(0x7f16f00fd700 msgr2=0x7f16f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 -- 172.21.15.16:0/2670349789 shutdown_connections 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.426+0000 7f16f49bd640 1 -- 172.21.15.16:0/2670349789 wait complete. 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 Processor -- start 2024-09-10T23:50:46.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 -- start start 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16f0101cd0 0x7f16f0103590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f01076e0 0x7f16f0103ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0108060 0x7f16f0104010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0111d70 con 0x7f16f0108060 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0111bf0 con 0x7f16f01076e0 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16f49bd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0111ef0 con 0x7f16f0101cd0 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16eed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0108060 0x7f16f0104010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16eed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0108060 0x7f16f0104010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43482/0 (socket says 172.21.15.16:43482) 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16eed9d640 1 -- 172.21.15.16:0/2913500013 learned_addr learned my addr 172.21.15.16:0/2913500013 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16ee59c640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16f0101cd0 0x7f16f0103590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.427+0000 7f16e7fff640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f01076e0 0x7f16f0103ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16eed9d640 1 -- 172.21.15.16:0/2913500013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16f0101cd0 msgr2=0x7f16f0103590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16eed9d640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16f0101cd0 0x7f16f0103590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16eed9d640 1 -- 172.21.15.16:0/2913500013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f01076e0 msgr2=0x7f16f0103ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16eed9d640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f01076e0 0x7f16f0103ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16eed9d640 1 -- 172.21.15.16:0/2913500013 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f01a7690 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16ee59c640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16f0101cd0 0x7f16f0103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16eed9d640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0108060 0x7f16f0104010 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f16e800cce0 tx=0x7f16e800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16e77fe640 1 -- 172.21.15.16:0/2913500013 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e800f450 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f01a7980 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16e77fe640 1 -- 172.21.15.16:0/2913500013 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e800faa0 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16e77fe640 1 -- 172.21.15.16:0/2913500013 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8018b70 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.428+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f01a7e70 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.429+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f01020b0 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.430+0000 7f16e77fe640 1 -- 172.21.15.16:0/2913500013 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f16e800f5f0 con 0x7f16f0108060 2024-09-10T23:50:46.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.431+0000 7f16e77fe640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f16dc0b5450 0x7f16dc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.431+0000 7f16ee59c640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f16dc0b5450 0x7f16dc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.431+0000 7f16e77fe640 1 -- 172.21.15.16:0/2913500013 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f16e80e6850 con 0x7f16f0108060 2024-09-10T23:50:46.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.432+0000 7f16ee59c640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f16dc0b5450 0x7f16dc0b7910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f16e0000c00 tx=0x7f16e0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:46.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.434+0000 7f16e77fe640 1 -- 172.21.15.16:0/2913500013 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f16e8014030 con 0x7f16f0108060 2024-09-10T23:50:46.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:46 smithi071 ceph-mon[35018]: pgmap v644: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:50:46.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:46 smithi066 ceph-mon[34761]: pgmap v644: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-10T23:50:46.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.656+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16f01a8260 con 0x7f16f0108060 2024-09-10T23:50:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.657+0000 7f16e77fe640 1 -- 172.21.15.16:0/2913500013 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11897 (secure 0 0 0) 0x7f16e80ad490 con 0x7f16f0108060 2024-09-10T23:50:46.658 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:50:46.658 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-09-10T23:40:03:757411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/3416253581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":3416253581},{"type":"v1","addr":"172.21.15.16:6835","nonce":3416253581}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3189484685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":3189484685},{"type":"v1","addr":"172.21.15.16:6837","nonce":3189484685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/1264367217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":1264367217},{"type":"v1","addr":"172.21.15.16:6839","nonce":1264367217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6841/3690738179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6840","nonce":3690738179},{"type":"v1","addr":"172.21.15.16:6841","nonce":3690738179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1708771330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1708771330},{"type":"v1","addr":"172.21.15.66:6833","nonce":1708771330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24550,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/3386039321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3386039321},{"type":"v1","addr":"172.21.15.71:6833","nonce":3386039321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:38:12.987884+0000","modified":"2024-09-10T23:40:03.709888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24610,"mds_1":24608,"mds_2":24595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24563":{"gid":24563,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1868979678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1868979678},{"type":"v1","addr":"172.21.15.66:6835","nonce":1868979678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6837/3622450021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3622450021},{"type":"v1","addr":"172.21.15.66:6837","nonce":3622450021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24589":{"gid":24589,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/583734619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":583734619},{"type":"v1","addr":"172.21.15.71:6835","nonce":583734619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6837/1674889906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":1674889906},{"type":"v1","addr":"172.21.15.71:6837","nonce":1674889906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.66:6839/3877648369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3877648369},{"type":"v1","addr":"172.21.15.66:6839","nonce":3877648369}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.71:6839/542292698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":542292698},{"type":"v1","addr":"172.21.15.71:6839","nonce":542292698}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24610,"qdb_cluster":[24610,24608,24595]},"id":1}]} 2024-09-10T23:50:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-09-10T23:50:46.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f16dc0b5450 msgr2=0x7f16dc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f16dc0b5450 0x7f16dc0b7910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f16e0000c00 tx=0x7f16e0031400 comp rx=0 tx=0).stop 2024-09-10T23:50:46.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0108060 msgr2=0x7f16f0104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0108060 0x7f16f0104010 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f16e800cce0 tx=0x7f16e800a620 comp rx=0 tx=0).stop 2024-09-10T23:50:46.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 shutdown_connections 2024-09-10T23:50:46.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16f0108060 0x7f16f0104010 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f16dc0b5450 0x7f16dc0b7910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16f01076e0 0x7f16f0103ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 --2- 172.21.15.16:0/2913500013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16f0101cd0 0x7f16f0103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 >> 172.21.15.16:0/2913500013 conn(0x7f16f00fd700 msgr2=0x7f16f00ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 shutdown_connections 2024-09-10T23:50:46.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:46.659+0000 7f16f49bd640 1 -- 172.21.15.16:0/2913500013 wait complete. 2024-09-10T23:50:47.466 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:47 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/2913500013' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:47.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:50:47.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:47 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/2913500013' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:47.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:47 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/2913500013' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:50:47.757 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/1287064249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc102dc0 msgr2=0x7f5ccc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/1287064249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc102dc0 0x7f5ccc1031a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009900 tx=0x7f5cbc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/1287064249 shutdown_connections 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/1287064249 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ccc109150 0x7f5ccc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/1287064249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ccc1087d0 0x7f5ccc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/1287064249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc102dc0 0x7f5ccc1031a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/1287064249 >> 172.21.15.16:0/1287064249 conn(0x7f5ccc0fe830 msgr2=0x7f5ccc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/1287064249 shutdown_connections 2024-09-10T23:50:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/1287064249 wait complete. 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 Processor -- start 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.235+0000 7f5cd1ea5640 1 -- start start 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cd1ea5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ccc102dc0 0x7f5ccc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cd1ea5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc1087d0 0x7f5ccc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cd1ea5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ccc109150 0x7f5ccc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cd1ea5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc112e10 con 0x7f5ccc1087d0 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cd1ea5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc112c90 con 0x7f5ccc102dc0 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cd1ea5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc112f90 con 0x7f5ccc109150 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc1087d0 0x7f5ccc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc1087d0 0x7f5ccc0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43498/0 (socket says 172.21.15.16:43498) 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 -- 172.21.15.16:0/38056716 learned_addr learned my addr 172.21.15.16:0/38056716 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5ccb7fe640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ccc102dc0 0x7f5ccc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:48.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5ccbfff640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ccc109150 0x7f5ccc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 -- 172.21.15.16:0/38056716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ccc109150 msgr2=0x7f5ccc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ccc109150 0x7f5ccc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 -- 172.21.15.16:0/38056716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ccc102dc0 msgr2=0x7f5ccc0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ccc102dc0 0x7f5ccc0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 -- 172.21.15.16:0/38056716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc1a76c0 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.236+0000 7f5cc3fff640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc1087d0 0x7f5ccc0759e0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400c920 tx=0x7f5cb400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.237+0000 7f5cc97fa640 1 -- 172.21.15.16:0/38056716 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4007c70 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.237+0000 7f5cc97fa640 1 -- 172.21.15.16:0/38056716 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cb4007e10 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.237+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ccc1a79b0 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.237+0000 7f5cc97fa640 1 -- 172.21.15.16:0/38056716 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4018820 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.237+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ccc1a7f70 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.238+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ccc1031a0 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.239+0000 7f5cc97fa640 1 -- 172.21.15.16:0/38056716 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f5cb400f450 con 0x7f5ccc1087d0 2024-09-10T23:50:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.240+0000 7f5cc97fa640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cb80b5450 0x7f5cb80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.240+0000 7f5ccb7fe640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cb80b5450 0x7f5cb80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.240+0000 7f5cc97fa640 1 -- 172.21.15.16:0/38056716 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f5cb40e60e0 con 0x7f5ccc1087d0 2024-09-10T23:50:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.241+0000 7f5ccb7fe640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cb80b5450 0x7f5cb80b7910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc031440 tx=0x7f5cbc005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.244+0000 7f5cc97fa640 1 -- 172.21.15.16:0/38056716 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5cb4014030 con 0x7f5ccc1087d0 2024-09-10T23:50:48.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.432+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ccc10a9a0 con 0x7f5ccc1087d0 2024-09-10T23:50:48.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:48 smithi016 ceph-mon[30855]: pgmap v645: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:50:48.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.434+0000 7f5cc97fa640 1 -- 172.21.15.16:0/38056716 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23034 (secure 0 0 0) 0x7f5cb40acc30 con 0x7f5ccc1087d0 2024-09-10T23:50:48.435 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-10T23:50:48.435 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":85,"fsid":"65d5fa74-6fcc-11ef-bcea-c7b262605968","created":"2024-09-10T23:29:41.593723+0000","modified":"2024-09-10T23:50:17.909596+0000","last_up_change":"2024-09-10T23:37:21.528060+0000","last_in_change":"2024-09-10T23:36:59.165900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:33:36.795990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:38:08.796841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:38:11.028262+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"763805be-7761-4d09-a36e-ae89566679dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6803","nonce":709153273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6805","nonce":709153273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6809","nonce":709153273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":709153273},{"type":"v1","addr":"172.21.15.16:6807","nonce":709153273}]},"public_addr":"172.21.15.16:6803/709153273","cluster_addr":"172.21.15.16:6805/709153273","heartbeat_back_addr":"172.21.15.16:6809/709153273","heartbeat_front_addr":"172.21.15.16:6807/709153273","state":["exists","up"]},{"osd":1,"uuid":"36db88e0-9ce6-4c36-9b9f-a96493341bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6801","nonce":842526831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6803","nonce":842526831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6807","nonce":842526831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":842526831},{"type":"v1","addr":"172.21.15.66:6805","nonce":842526831}]},"public_addr":"172.21.15.66:6801/842526831","cluster_addr":"172.21.15.66:6803/842526831","heartbeat_back_addr":"172.21.15.66:6807/842526831","heartbeat_front_addr":"172.21.15.66:6805/842526831","state":["exists","up"]},{"osd":2,"uuid":"60a55961-0d3d-415c-8e44-f72d0f544182","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6801","nonce":3069059707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6803","nonce":3069059707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6807","nonce":3069059707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3069059707},{"type":"v1","addr":"172.21.15.71:6805","nonce":3069059707}]},"public_addr":"172.21.15.71:6801/3069059707","cluster_addr":"172.21.15.71:6803/3069059707","heartbeat_back_addr":"172.21.15.71:6807/3069059707","heartbeat_front_addr":"172.21.15.71:6805/3069059707","state":["exists","up"]},{"osd":3,"uuid":"4451b800-b930-497f-8377-21700cc37299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6811","nonce":2604369772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6813","nonce":2604369772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6817","nonce":2604369772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2604369772},{"type":"v1","addr":"172.21.15.16:6815","nonce":2604369772}]},"public_addr":"172.21.15.16:6811/2604369772","cluster_addr":"172.21.15.16:6813/2604369772","heartbeat_back_addr":"172.21.15.16:6817/2604369772","heartbeat_front_addr":"172.21.15.16:6815/2604369772","state":["exists","up"]},{"osd":4,"uuid":"5bbe8aa1-89f3-4850-99aa-5601e9ca5152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6809","nonce":2175362919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6811","nonce":2175362919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6815","nonce":2175362919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2175362919},{"type":"v1","addr":"172.21.15.66:6813","nonce":2175362919}]},"public_addr":"172.21.15.66:6809/2175362919","cluster_addr":"172.21.15.66:6811/2175362919","heartbeat_back_addr":"172.21.15.66:6815/2175362919","heartbeat_front_addr":"172.21.15.66:6813/2175362919","state":["exists","up"]},{"osd":5,"uuid":"9699d403-60cd-4ba2-b896-9b03c18b2128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6809","nonce":2984688439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6811","nonce":2984688439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6815","nonce":2984688439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2984688439},{"type":"v1","addr":"172.21.15.71:6813","nonce":2984688439}]},"public_addr":"172.21.15.71:6809/2984688439","cluster_addr":"172.21.15.71:6811/2984688439","heartbeat_back_addr":"172.21.15.71:6815/2984688439","heartbeat_front_addr":"172.21.15.71:6813/2984688439","state":["exists","up"]},{"osd":6,"uuid":"c2ff1e51-01cb-4ecc-bf83-f6250f3c724b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6819","nonce":3830581477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6821","nonce":3830581477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6825","nonce":3830581477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3830581477},{"type":"v1","addr":"172.21.15.16:6823","nonce":3830581477}]},"public_addr":"172.21.15.16:6819/3830581477","cluster_addr":"172.21.15.16:6821/3830581477","heartbeat_back_addr":"172.21.15.16:6825/3830581477","heartbeat_front_addr":"172.21.15.16:6823/3830581477","state":["exists","up"]},{"osd":7,"uuid":"c1985bc1-0f65-4d7f-af2e-aeaaa3db7fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6817","nonce":3815713704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6819","nonce":3815713704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6823","nonce":3815713704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3815713704},{"type":"v1","addr":"172.21.15.66:6821","nonce":3815713704}]},"public_addr":"172.21.15.66:6817/3815713704","cluster_addr":"172.21.15.66:6819/3815713704","heartbeat_back_addr":"172.21.15.66:6823/3815713704","heartbeat_front_addr":"172.21.15.66:6821/3815713704","state":["exists","up"]},{"osd":8,"uuid":"6d5d9f7e-74ab-4da2-8f91-7bfafb05cb38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6817","nonce":2889878704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6819","nonce":2889878704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6823","nonce":2889878704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2889878704},{"type":"v1","addr":"172.21.15.71:6821","nonce":2889878704}]},"public_addr":"172.21.15.71:6817/2889878704","cluster_addr":"172.21.15.71:6819/2889878704","heartbeat_back_addr":"172.21.15.71:6823/2889878704","heartbeat_front_addr":"172.21.15.71:6821/2889878704","state":["exists","up"]},{"osd":9,"uuid":"b87feb45-8cb5-4818-983d-4aa333e0276b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6827","nonce":2503971838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6829","nonce":2503971838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6833","nonce":2503971838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2503971838},{"type":"v1","addr":"172.21.15.16:6831","nonce":2503971838}]},"public_addr":"172.21.15.16:6827/2503971838","cluster_addr":"172.21.15.16:6829/2503971838","heartbeat_back_addr":"172.21.15.16:6833/2503971838","heartbeat_front_addr":"172.21.15.16:6831/2503971838","state":["exists","up"]},{"osd":10,"uuid":"9675564e-158f-4242-b54a-4a710e94ef77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6825","nonce":168536242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6827","nonce":168536242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6831","nonce":168536242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":168536242},{"type":"v1","addr":"172.21.15.66:6829","nonce":168536242}]},"public_addr":"172.21.15.66:6825/168536242","cluster_addr":"172.21.15.66:6827/168536242","heartbeat_back_addr":"172.21.15.66:6831/168536242","heartbeat_front_addr":"172.21.15.66:6829/168536242","state":["exists","up"]},{"osd":11,"uuid":"c04a8c27-b84e-48ef-ad2e-5d5e19e7f59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6825","nonce":2875208782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6827","nonce":2875208782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6831","nonce":2875208782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2875208782},{"type":"v1","addr":"172.21.15.71:6829","nonce":2875208782}]},"public_addr":"172.21.15.71:6825/2875208782","cluster_addr":"172.21.15.71:6827/2875208782","heartbeat_back_addr":"172.21.15.71:6831/2875208782","heartbeat_front_addr":"172.21.15.71:6829/2875208782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:32:43.820250+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:09.343547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:33.447985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:33:58.468676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:23.878596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:34:49.172673+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:14.983296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:35:39.958737+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:04.810763+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:29.820601+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:36:55.388215+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:37:20.457521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/2040139033":"2024-09-11T23:30:16.164092+0000","172.21.15.16:6800/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1952619887":"2024-09-11T23:31:42.335701+0000","172.21.15.16:6801/1838016037":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/3343059075":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/1489458820":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3183663764":"2024-09-11T23:31:42.335701+0000","172.21.15.16:0/3511379318":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/1963800074":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/3428304012":"2024-09-11T23:30:16.164092+0000","172.21.15.16:0/83801371":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6801/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:6800/3233639538":"2024-09-11T23:30:39.646876+0000","172.21.15.16:0/2667683333":"2024-09-11T23:31:42.335701+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:50:48.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cb80b5450 msgr2=0x7f5cb80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:48.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cb80b5450 0x7f5cb80b7910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc031440 tx=0x7f5cbc005e80 comp rx=0 tx=0).stop 2024-09-10T23:50:48.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc1087d0 msgr2=0x7f5ccc0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc1087d0 0x7f5ccc0759e0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400c920 tx=0x7f5cb400cde0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 shutdown_connections 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ccc109150 0x7f5ccc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ccc1087d0 0x7f5ccc0759e0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f5cb80b5450 0x7f5cb80b7910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 --2- 172.21.15.16:0/38056716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ccc102dc0 0x7f5ccc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 >> 172.21.15.16:0/38056716 conn(0x7f5ccc0fe830 msgr2=0x7f5ccc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 shutdown_connections 2024-09-10T23:50:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:48.436+0000 7f5cd1ea5640 1 -- 172.21.15.16:0/38056716 wait complete. 2024-09-10T23:50:48.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:48 smithi071 ceph-mon[35018]: pgmap v645: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:50:48.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:48 smithi066 ceph-mon[34761]: pgmap v645: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T23:50:49.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T23:50:49.425 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:49.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:49 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/38056716' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:50:49.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:49 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/38056716' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:50:49.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:49 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/38056716' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 -- 172.21.15.16:0/1286820618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c1045c0 msgr2=0x7f4f7c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1286820618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c1045c0 0x7f4f7c10cab0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009900 tx=0x7f4f7002a410 comp rx=0 tx=0).stop 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 -- 172.21.15.16:0/1286820618 shutdown_connections 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1286820618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f7c10d100 0x7f4f7c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1286820618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c1045c0 0x7f4f7c10cab0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1286820618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f7c103ca0 0x7f4f7c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 -- 172.21.15.16:0/1286820618 >> 172.21.15.16:0/1286820618 conn(0x7f4f7c0fd700 msgr2=0x7f4f7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 -- 172.21.15.16:0/1286820618 shutdown_connections 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 -- 172.21.15.16:0/1286820618 wait complete. 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 Processor -- start 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.945+0000 7f4f8382d640 1 -- start start 2024-09-10T23:50:49.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c103ca0 0x7f4f7c101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f7c1045c0 0x7f4f7c101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f7c10d100 0x7f4f7c1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c112d70 con 0x7f4f7c103ca0 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c112bf0 con 0x7f4f7c10d100 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c112ef0 con 0x7f4f7c1045c0 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c103ca0 0x7f4f7c101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c103ca0 0x7f4f7c101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43528/0 (socket says 172.21.15.16:43528) 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 -- 172.21.15.16:0/1966013670 learned_addr learned my addr 172.21.15.16:0/1966013670 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f81dca640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f7c10d100 0x7f4f7c1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f80dc8640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f7c1045c0 0x7f4f7c101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 -- 172.21.15.16:0/1966013670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f7c1045c0 msgr2=0x7f4f7c101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:49.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f7c1045c0 0x7f4f7c101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 -- 172.21.15.16:0/1966013670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f7c10d100 msgr2=0x7f4f7c1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f7c10d100 0x7f4f7c1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 -- 172.21.15.16:0/1966013670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c1a7680 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f815c9640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c103ca0 0x7f4f7c101950 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00db80 tx=0x7f4f6c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f7a7fc640 1 -- 172.21.15.16:0/1966013670 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c017070 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c1a7970 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f7a7fc640 1 -- 172.21.15.16:0/1966013670 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f6c003b70 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f7a7fc640 1 -- 172.21.15.16:0/1966013670 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0106c0 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.946+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c1a7e80 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.948+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c104080 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.949+0000 7f4f7a7fc640 1 -- 172.21.15.16:0/1966013670 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4f6c023060 con 0x7f4f7c103ca0 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.950+0000 7f4f7a7fc640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f640b5450 0x7f4f640b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:49.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.950+0000 7f4f80dc8640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f640b5450 0x7f4f640b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:49.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.950+0000 7f4f7a7fc640 1 -- 172.21.15.16:0/1966013670 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8470+0+0 (secure 0 0 0) 0x7f4f6c0e60d0 con 0x7f4f7c103ca0 2024-09-10T23:50:49.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.950+0000 7f4f80dc8640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f640b5450 0x7f4f640b7910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f70000c00 tx=0x7f4f70031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:49.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:49.953+0000 7f4f7a7fc640 1 -- 172.21.15.16:0/1966013670 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4f6c0acd20 con 0x7f4f7c103ca0 2024-09-10T23:50:50.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.177+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4f7c1a8270 con 0x7f4f7c103ca0 2024-09-10T23:50:50.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.180+0000 7f4f7a7fc640 1 -- 172.21.15.16:0/1966013670 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f4f6c0ac620 con 0x7f4f7c103ca0 2024-09-10T23:50:50.181 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:50:50.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f640b5450 msgr2=0x7f4f640b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:50.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f640b5450 0x7f4f640b7910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f70000c00 tx=0x7f4f70031400 comp rx=0 tx=0).stop 2024-09-10T23:50:50.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c103ca0 msgr2=0x7f4f7c101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:50.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c103ca0 0x7f4f7c101950 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00db80 tx=0x7f4f6c00b630 comp rx=0 tx=0).stop 2024-09-10T23:50:50.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 shutdown_connections 2024-09-10T23:50:50.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f4f640b5450 0x7f4f640b7910 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:50.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f7c10d100 0x7f4f7c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:50.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4f7c1045c0 0x7f4f7c101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:50.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 --2- 172.21.15.16:0/1966013670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f7c103ca0 0x7f4f7c101950 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:50.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 >> 172.21.15.16:0/1966013670 conn(0x7f4f7c0fd700 msgr2=0x7f4f7c10f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:50.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 shutdown_connections 2024-09-10T23:50:50.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:50.183+0000 7f4f8382d640 1 -- 172.21.15.16:0/1966013670 wait complete. 2024-09-10T23:50:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a[30851]: 2024-09-10T23:50:50.178+0000 7fa08262d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:50:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-mon[30855]: pgmap v646: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T23:50:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1966013670' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:50:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-mon[30855]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:50:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-mon[30855]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:50:50.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1966013670' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:50:50.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-mon[30855]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:50:50.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:50 smithi016 ceph-mon[30855]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T23:50:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mon[35018]: pgmap v646: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T23:50:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1966013670' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:50:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mon[35018]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:50:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mon[35018]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:50:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1966013670' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:50:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mon[35018]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:50:50.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mon[35018]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c[65980]: ignoring --setuser ceph since I am not root 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c[65980]: ignoring --setgroup ceph since I am not root 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mds[65984]: -- 172.21.15.71:0/365494557 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637b01a1860 con 0x5637b017f400 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c[65980]: starting mds.c at 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f[65678]: ignoring --setuser ceph since I am not root 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f[65678]: ignoring --setgroup ceph since I am not root 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mds[65682]: -- 172.21.15.71:0/2597660082 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b451f4aea0 con 0x55b451f1f400 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mds[65682]: -- 172.21.15.71:0/2597660082 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b451f41860 con 0x55b451f1f400 2024-09-10T23:50:50.521 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f[65678]: starting mds.f at 2024-09-10T23:50:50.522 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: ignoring --setuser ceph since I am not root 2024-09-10T23:50:50.522 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: ignoring --setgroup ceph since I am not root 2024-09-10T23:50:50.522 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-mds[66285]: -- 172.21.15.71:0/3779396625 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f6bb7bb860 con 0x55f6bb799400 2024-09-10T23:50:50.522 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:50:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: starting mds.i at 2024-09-10T23:50:50.552 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b[65917]: ignoring --setuser ceph since I am not root 2024-09-10T23:50:50.552 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b[65917]: ignoring --setgroup ceph since I am not root 2024-09-10T23:50:50.552 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mds[65921]: -- 172.21.15.66:0/490131845 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56000ac05860 con 0x56000abe3000 2024-09-10T23:50:50.552 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b[65917]: starting mds.b at 2024-09-10T23:50:50.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e[65304]: ignoring --setuser ceph since I am not root 2024-09-10T23:50:50.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e[65304]: ignoring --setgroup ceph since I am not root 2024-09-10T23:50:50.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mds[65308]: -- 172.21.15.66:0/548204981 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5602d202f860 con 0x5602d200d400 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e[65304]: starting mds.e at 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mon[34761]: pgmap v646: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1966013670' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mon[34761]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mon[34761]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1966013670' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mon[34761]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mon[34761]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T23:50:50.553 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h[65604]: ignoring --setuser ceph since I am not root 2024-09-10T23:50:50.554 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h[65604]: ignoring --setgroup ceph since I am not root 2024-09-10T23:50:50.554 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-mds[65608]: -- 172.21.15.66:0/3798123833 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560945ddd860 con 0x560945dba800 2024-09-10T23:50:50.554 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:50:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h[65604]: starting mds.h at 2024-09-10T23:50:50.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:50:51.075 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 -- 172.21.15.16:0/400350615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f4102dc0 msgr2=0x7f91f41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 --2- 172.21.15.16:0/400350615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f4102dc0 0x7f91f41031a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009ca0 tx=0x7f91e402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 -- 172.21.15.16:0/400350615 shutdown_connections 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 --2- 172.21.15.16:0/400350615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f4109150 0x7f91f410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 --2- 172.21.15.16:0/400350615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f41087d0 0x7f91f4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 --2- 172.21.15.16:0/400350615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f4102dc0 0x7f91f41031a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 -- 172.21.15.16:0/400350615 >> 172.21.15.16:0/400350615 conn(0x7f91f40fe830 msgr2=0x7f91f4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 -- 172.21.15.16:0/400350615 shutdown_connections 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 -- 172.21.15.16:0/400350615 wait complete. 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 Processor -- start 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.589+0000 7f91f9a57640 1 -- start start 2024-09-10T23:50:51.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f9a57640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f4102dc0 0x7f91f40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f9a57640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f41087d0 0x7f91f40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f9a57640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f4109150 0x7f91f4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f9a57640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f91f4112e60 con 0x7f91f41087d0 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f9a57640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f91f4112ce0 con 0x7f91f4109150 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f9a57640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91f4112fe0 con 0x7f91f4102dc0 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f41087d0 0x7f91f40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f41087d0 0x7f91f40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43542/0 (socket says 172.21.15.16:43542) 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 -- 172.21.15.16:0/4194485540 learned_addr learned my addr 172.21.15.16:0/4194485540 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f37fe640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f4109150 0x7f91f4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f2ffd640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f4102dc0 0x7f91f40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 -- 172.21.15.16:0/4194485540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f4102dc0 msgr2=0x7f91f40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f4102dc0 0x7f91f40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 -- 172.21.15.16:0/4194485540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f4109150 msgr2=0x7f91f4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f4109150 0x7f91f4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:51.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 -- 172.21.15.16:0/4194485540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f41a76f0 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f27fc640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f41087d0 0x7f91f40759e0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f91e800d770 tx=0x7f91e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f8a55640 1 -- 172.21.15.16:0/4194485540 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8017070 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.590+0000 7f91f8a55640 1 -- 172.21.15.16:0/4194485540 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91e80054d0 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.591+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f41a79e0 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.591+0000 7f91f8a55640 1 -- 172.21.15.16:0/4194485540 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8004c30 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.591+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f41a7f20 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.592+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91f41031a0 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.593+0000 7f91f8a55640 1 -- 172.21.15.16:0/4194485540 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f91e8004dd0 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.594+0000 7f91f8a55640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91dc0b54d0 0x7f91dc0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.594+0000 7f91f2ffd640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91dc0b54d0 0x7f91dc0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.594+0000 7f91f8a55640 1 -- 172.21.15.16:0/4194485540 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8684+0+0 (secure 0 0 0) 0x7f91e80e5e60 con 0x7f91f41087d0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.594+0000 7f91f2ffd640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91dc0b54d0 0x7f91dc0b7990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91e4006010 tx=0x7f91e4009820 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:51.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.597+0000 7f91f8a55640 1 -- 172.21.15.16:0/4194485540 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f91e80ac310 con 0x7f91f41087d0 2024-09-10T23:50:51.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:51.822+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f91f402e5c0 con 0x7f91f41087d0 2024-09-10T23:50:52.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.261+0000 7f91f8a55640 1 -- 172.21.15.16:0/4194485540 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f91e80b0d40 con 0x7f91f41087d0 2024-09-10T23:50:52.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91dc0b54d0 msgr2=0x7f91dc0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91dc0b54d0 0x7f91dc0b7990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91e4006010 tx=0x7f91e4009820 comp rx=0 tx=0).stop 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f41087d0 msgr2=0x7f91f40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f41087d0 0x7f91f40759e0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f91e800d770 tx=0x7f91e800dc30 comp rx=0 tx=0).stop 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 shutdown_connections 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f91dc0b54d0 0x7f91dc0b7990 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f4109150 0x7f91f4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91f41087d0 0x7f91f40759e0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 --2- 172.21.15.16:0/4194485540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91f4102dc0 0x7f91f40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 >> 172.21.15.16:0/4194485540 conn(0x7f91f40fe830 msgr2=0x7f91f4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 shutdown_connections 2024-09-10T23:50:52.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:52.264+0000 7f91f9a57640 1 -- 172.21.15.16:0/4194485540 wait complete. 2024-09-10T23:50:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: pgmap v648: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:50:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6834/2080662560,v1:172.21.15.71:6838/2080662560] up:boot 2024-09-10T23:50:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6835/433504664,v1:172.21.15.71:6837/433504664] up:boot 2024-09-10T23:50:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.71:6836/4178939765,v1:172.21.15.71:6839/4178939765] up:boot 2024-09-10T23:50:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6834/3214738288,v1:172.21.15.66:6835/3214738288] up:boot 2024-09-10T23:50:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6837/2703555289,v1:172.21.15.66:6839/2703555289] up:boot 2024-09-10T23:50:52.485 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: mds.? [v2:172.21.15.66:6836/4088091100,v1:172.21.15.66:6838/4088091100] up:boot 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:50:52.486 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:52 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4194485540' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: pgmap v648: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6834/2080662560,v1:172.21.15.71:6838/2080662560] up:boot 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6835/433504664,v1:172.21.15.71:6837/433504664] up:boot 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.71:6836/4178939765,v1:172.21.15.71:6839/4178939765] up:boot 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6834/3214738288,v1:172.21.15.66:6835/3214738288] up:boot 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6837/2703555289,v1:172.21.15.66:6839/2703555289] up:boot 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: mds.? [v2:172.21.15.66:6836/4088091100,v1:172.21.15.66:6838/4088091100] up:boot 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:50:52.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:50:52.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:50:52.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:50:52.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:50:52.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:50:52.521 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:52 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/4194485540' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: pgmap v648: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6834/2080662560,v1:172.21.15.71:6838/2080662560] up:boot 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6835/433504664,v1:172.21.15.71:6837/433504664] up:boot 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.71:6836/4178939765,v1:172.21.15.71:6839/4178939765] up:boot 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6834/3214738288,v1:172.21.15.66:6835/3214738288] up:boot 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6837/2703555289,v1:172.21.15.66:6839/2703555289] up:boot 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: mds.? [v2:172.21.15.66:6836/4088091100,v1:172.21.15.66:6838/4088091100] up:boot 2024-09-10T23:50:52.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T23:50:52.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:50:52.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:50:52.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:50:52.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:50:52.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:50:52.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: from='mgr.14220 172.21.15.16:0/3340037984' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:50:52.553 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:52 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/4194485540' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:50:52.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:50:53.202 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:53.463 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:53 smithi016 ceph-mon[30855]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:50:53.463 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:53 smithi016 ceph-mon[30855]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:50:53.463 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:53 smithi016 ceph-mon[30855]: Cluster is now healthy 2024-09-10T23:50:53.463 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:53 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/4194485540' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:50:53.464 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:53 smithi016 ceph-mon[30855]: fsmap 12 up:standby 2024-09-10T23:50:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:53 smithi071 ceph-mon[35018]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:50:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:53 smithi071 ceph-mon[35018]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:50:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:53 smithi071 ceph-mon[35018]: Cluster is now healthy 2024-09-10T23:50:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:53 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/4194485540' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:50:53.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:53 smithi071 ceph-mon[35018]: fsmap 12 up:standby 2024-09-10T23:50:53.551 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:53 smithi066 ceph-mon[34761]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T23:50:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:53 smithi066 ceph-mon[34761]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T23:50:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:53 smithi066 ceph-mon[34761]: Cluster is now healthy 2024-09-10T23:50:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:53 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/4194485540' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:50:53.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:53 smithi066 ceph-mon[34761]: fsmap 12 up:standby 2024-09-10T23:50:53.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 -- 172.21.15.16:0/2265391334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 msgr2=0x7fe998108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:53.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 --2- 172.21.15.16:0/2265391334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe998108c10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe980009900 tx=0x7fe98002a410 comp rx=0 tx=0).stop 2024-09-10T23:50:53.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 -- 172.21.15.16:0/2265391334 shutdown_connections 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 --2- 172.21.15.16:0/2265391334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe998109150 0x7fe99810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 --2- 172.21.15.16:0/2265391334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe998108c10 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 --2- 172.21.15.16:0/2265391334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe998102dc0 0x7fe9981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 -- 172.21.15.16:0/2265391334 >> 172.21.15.16:0/2265391334 conn(0x7fe9980fe830 msgr2=0x7fe998100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 -- 172.21.15.16:0/2265391334 shutdown_connections 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.689+0000 7fe99e41c640 1 -- 172.21.15.16:0/2265391334 wait complete. 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 Processor -- start 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 -- start start 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe998102dc0 0x7fe9980754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe9980759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe998109150 0x7fe998075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:53.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe998112e60 con 0x7fe9981087d0 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe998112ce0 con 0x7fe998109150 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe99e41c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe998112fe0 con 0x7fe998102dc0 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe98ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe9980759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe98ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe9980759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43820/0 (socket says 172.21.15.16:43820) 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.690+0000 7fe98ffff640 1 -- 172.21.15.16:0/1150340160 learned_addr learned my addr 172.21.15.16:0/1150340160 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe997fff640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe998102dc0 0x7fe9980754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe99c9b9640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe998109150 0x7fe998075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe98ffff640 1 -- 172.21.15.16:0/1150340160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe998102dc0 msgr2=0x7fe9980754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe98ffff640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe998102dc0 0x7fe9980754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe98ffff640 1 -- 172.21.15.16:0/1150340160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe998109150 msgr2=0x7fe998075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe98ffff640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe998109150 0x7fe998075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe98ffff640 1 -- 172.21.15.16:0/1150340160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9981a76f0 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe99c9b9640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe998109150 0x7fe998075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe98ffff640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe9980759e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe980005ab0 tx=0x7fe980003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe995ffb640 1 -- 172.21.15.16:0/1150340160 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98003f070 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe995ffb640 1 -- 172.21.15.16:0/1150340160 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe980031d60 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9981a7980 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe995ffb640 1 -- 172.21.15.16:0/1150340160 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980035030 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.691+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9981a7eb0 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.692+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9981031a0 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.694+0000 7fe995ffb640 1 -- 172.21.15.16:0/1150340160 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe98003b560 con 0x7fe9981087d0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.695+0000 7fe995ffb640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe9840b54d0 0x7fe9840b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.695+0000 7fe997fff640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe9840b54d0 0x7fe9840b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.695+0000 7fe995ffb640 1 -- 172.21.15.16:0/1150340160 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8684+0+0 (secure 0 0 0) 0x7fe980107130 con 0x7fe9981087d0 2024-09-10T23:50:53.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.695+0000 7fe997fff640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe9840b54d0 0x7fe9840b7990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe98800bbe0 tx=0x7fe98800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:53.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.698+0000 7fe995ffb640 1 -- 172.21.15.16:0/1150340160 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe9800cdc10 con 0x7fe9981087d0 2024-09-10T23:50:53.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:53.883+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe99802e5c0 con 0x7fe9981087d0 2024-09-10T23:50:54.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.269+0000 7fe995ffb640 1 -- 172.21.15.16:0/1150340160 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7fe9800cd510 con 0x7fe9981087d0 2024-09-10T23:50:54.270 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:50:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe9840b54d0 msgr2=0x7fe9840b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe9840b54d0 0x7fe9840b7990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe98800bbe0 tx=0x7fe98800b390 comp rx=0 tx=0).stop 2024-09-10T23:50:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 msgr2=0x7fe9980759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe9980759e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe980005ab0 tx=0x7fe980003cd0 comp rx=0 tx=0).stop 2024-09-10T23:50:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 shutdown_connections 2024-09-10T23:50:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7fe9840b54d0 0x7fe9840b7990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe998109150 0x7fe998075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9981087d0 0x7fe9980759e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 --2- 172.21.15.16:0/1150340160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe998102dc0 0x7fe9980754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.272+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 >> 172.21.15.16:0/1150340160 conn(0x7fe9980fe830 msgr2=0x7fe998100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.273+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 shutdown_connections 2024-09-10T23:50:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:54.273+0000 7fe99e41c640 1 -- 172.21.15.16:0/1150340160 wait complete. 2024-09-10T23:50:54.519 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:54 smithi071 ceph-mon[35018]: pgmap v649: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:50:54.520 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:54 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1150340160' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:50:54.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:54 smithi066 ceph-mon[34761]: pgmap v649: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:50:54.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:54 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1150340160' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:50:54.592 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:54 smithi016 ceph-mon[30855]: pgmap v649: 97 pgs: 97 active+clean; 14 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T23:50:54.592 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:54 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1150340160' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:50:54.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:50:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:50:55.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:55 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/1150340160' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:50:55.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:55 smithi066 ceph-mon[34761]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:50:55.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:55 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/1150340160' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:50:55.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:55 smithi016 ceph-mon[30855]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:50:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.681+0000 7f7f01a2e640 1 -- 172.21.15.16:0/3145653042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc1076a0 msgr2=0x7f7efc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.681+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/3145653042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc1076a0 0x7f7efc107ae0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009900 tx=0x7f7ee402a410 comp rx=0 tx=0).stop 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 -- 172.21.15.16:0/3145653042 shutdown_connections 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/3145653042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7efc108020 0x7f7efc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/3145653042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc1076a0 0x7f7efc107ae0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/3145653042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7efc101c90 0x7f7efc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 -- 172.21.15.16:0/3145653042 >> 172.21.15.16:0/3145653042 conn(0x7f7efc0fd700 msgr2=0x7f7efc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 -- 172.21.15.16:0/3145653042 shutdown_connections 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 -- 172.21.15.16:0/3145653042 wait complete. 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 Processor -- start 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.682+0000 7f7f01a2e640 1 -- start start 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f01a2e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc101c90 0x7f7efc199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f01a2e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7efc1076a0 0x7f7efc199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f01a2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7efc108020 0x7f7efc19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f01a2e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc112dc0 con 0x7f7efc101c90 2024-09-10T23:50:55.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f01a2e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc112c40 con 0x7f7efc1076a0 2024-09-10T23:50:55.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f01a2e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc112f40 con 0x7f7efc108020 2024-09-10T23:50:55.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc101c90 0x7f7efc199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:55.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc101c90 0x7f7efc199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43842/0 (socket says 172.21.15.16:43842) 2024-09-10T23:50:55.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 -- 172.21.15.16:0/101748691 learned_addr learned my addr 172.21.15.16:0/101748691 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efa7fc640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7efc1076a0 0x7f7efc199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efb7fe640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7efc108020 0x7f7efc19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 -- 172.21.15.16:0/101748691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7efc108020 msgr2=0x7f7efc19eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7efc108020 0x7f7efc19eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 -- 172.21.15.16:0/101748691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7efc1076a0 msgr2=0x7f7efc199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7efc1076a0 0x7f7efc199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 -- 172.21.15.16:0/101748691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc19f2c0 con 0x7f7efc101c90 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efb7fe640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7efc108020 0x7f7efc19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7efaffd640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc101c90 0x7f7efc199210 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00c920 tx=0x7f7eec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f00a2c640 1 -- 172.21.15.16:0/101748691 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec007c70 con 0x7f7efc101c90 2024-09-10T23:50:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f00a2c640 1 -- 172.21.15.16:0/101748691 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7eec007e10 con 0x7f7efc101c90 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc19f5b0 con 0x7f7efc101c90 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.683+0000 7f7f00a2c640 1 -- 172.21.15.16:0/101748691 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec018820 con 0x7f7efc101c90 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.684+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1a5e40 con 0x7f7efc101c90 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.684+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc102070 con 0x7f7efc101c90 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.686+0000 7f7f00a2c640 1 -- 172.21.15.16:0/101748691 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f7eec00f450 con 0x7f7efc101c90 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.687+0000 7f7f00a2c640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7ee80b54d0 0x7f7ee80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.687+0000 7f7efa7fc640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7ee80b54d0 0x7f7ee80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.687+0000 7f7f00a2c640 1 -- 172.21.15.16:0/101748691 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8188+0+0 (secure 0 0 0) 0x7f7eec0e6190 con 0x7f7efc101c90 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.687+0000 7f7efa7fc640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7ee80b54d0 0x7f7ee80b7990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4031440 tx=0x7f7ee4005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.690+0000 7f7f00a2c640 1 -- 172.21.15.16:0/101748691 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7eec014030 con 0x7f7efc101c90 2024-09-10T23:50:55.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:55 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/1150340160' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:50:55.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:55 smithi071 ceph-mon[35018]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:50:55.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:55.884+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7efc19a340 con 0x7f7efc101c90 2024-09-10T23:50:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.283+0000 7f7f00a2c640 1 -- 172.21.15.16:0/101748691 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7f7eec0acf70 con 0x7f7efc101c90 2024-09-10T23:50:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-09-10T23:50:56.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.286+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7ee80b54d0 msgr2=0x7f7ee80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:56.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.286+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7ee80b54d0 0x7f7ee80b7990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4031440 tx=0x7f7ee4005b50 comp rx=0 tx=0).stop 2024-09-10T23:50:56.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.286+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc101c90 msgr2=0x7f7efc199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.286+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc101c90 0x7f7efc199210 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00c920 tx=0x7f7eec00cde0 comp rx=0 tx=0).stop 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 shutdown_connections 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7efc108020 0x7f7efc19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:6800/3253461284,v1:172.21.15.16:6801/3253461284] conn(0x7f7ee80b54d0 0x7f7ee80b7990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7efc1076a0 0x7f7efc199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 --2- 172.21.15.16:0/101748691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7efc101c90 0x7f7efc199210 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 >> 172.21.15.16:0/101748691 conn(0x7f7efc0fd700 msgr2=0x7f7efc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 shutdown_connections 2024-09-10T23:50:56.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-10T23:50:56.287+0000 7f7f01a2e640 1 -- 172.21.15.16:0/101748691 wait complete. 2024-09-10T23:50:56.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:56 smithi066 ceph-mon[34761]: pgmap v651: 65 pgs: 65 active+clean; 577 KiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:50:56.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:56 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/101748691' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:50:56.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:56 smithi016 ceph-mon[30855]: pgmap v651: 65 pgs: 65 active+clean; 577 KiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:50:56.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:56 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/101748691' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:50:56.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:56 smithi071 ceph-mon[35018]: pgmap v651: 65 pgs: 65 active+clean; 577 KiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:50:56.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:56 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/101748691' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T23:50:56.964 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:50:56.994 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:50:57.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:50:57.060 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T23:50:57.061 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:50:57.078 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:50:57.097 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:50:57.117 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T23:50:57.117 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T23:50:57.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:50:57.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 systemd[1]: Stopping Ceph mon.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:50:57.298 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:57 smithi071 ceph-mon[35018]: from='client.? 172.21.15.16:0/101748691' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:50:57.298 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:57 smithi071 ceph-mon[35018]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T23:50:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:57 smithi066 ceph-mon[34761]: from='client.? 172.21.15.16:0/101748691' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:50:57.552 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:57 smithi066 ceph-mon[34761]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T23:50:57.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 ceph-mon[30855]: from='client.? 172.21.15.16:0/101748691' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T23:50:57.735 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 ceph-mon[30855]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T23:50:57.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a[30851]: 2024-09-10T23:50:57.430+0000 7fa087e38640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:50:57.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a[30851]: 2024-09-10T23:50:57.430+0000 7fa087e38640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T23:50:57.736 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 podman[105893]: 2024-09-10 23:50:57.472070692 +0000 UTC m=+0.149735530 container died 3e2df7a6de6013abc5dd495cadb142345433d4d8a6c8cb482aa87e7391cd1bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:50:58.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 podman[105893]: 2024-09-10 23:50:57.86399352 +0000 UTC m=+0.541658355 container cleanup 3e2df7a6de6013abc5dd495cadb142345433d4d8a6c8cb482aa87e7391cd1bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T23:50:58.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:Sep 10 23:50:57 smithi016 bash[105893]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:50:58.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T23:50:58.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:50:58.347 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T23:50:58.347 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T23:50:58.348 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.b 2024-09-10T23:50:58.720 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:58 smithi066 systemd[1]: Stopping Ceph mon.b for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:50:59.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-b[34757]: 2024-09-10T23:50:58.718+0000 7f79be73c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:50:59.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-b[34757]: 2024-09-10T23:50:58.718+0000 7f79be73c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T23:50:59.052 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:58 smithi066 podman[70072]: 2024-09-10 23:50:58.790652663 +0000 UTC m=+0.226913878 container died 28f2cdd56786236125e8a80b27bceef593b56fa4f3e1902f6ed5f4e6d936e284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T23:50:59.376 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:59 smithi066 podman[70072]: 2024-09-10 23:50:59.269059549 +0000 UTC m=+0.705320764 container cleanup 28f2cdd56786236125e8a80b27bceef593b56fa4f3e1902f6ed5f4e6d936e284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-b, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T23:50:59.376 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:59 smithi066 bash[70072]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-b 2024-09-10T23:50:59.659 INFO:journalctl@ceph.mon.b.smithi066.stdout:Sep 10 23:50:59 smithi066 podman[70084]: 2024-09-10 23:50:59.512460331 +0000 UTC m=+0.719351931 container remove 28f2cdd56786236125e8a80b27bceef593b56fa4f3e1902f6ed5f4e6d936e284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T23:50:59.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T23:50:59.726 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:50:59.726 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T23:50:59.727 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T23:50:59.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.c 2024-09-10T23:51:00.020 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:50:59 smithi071 systemd[1]: Stopping Ceph mon.c for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:00.463 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:51:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-c[35014]: 2024-09-10T23:51:00.052+0000 7f5da6092640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:00.464 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:51:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-c[35014]: 2024-09-10T23:51:00.052+0000 7f5da6092640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T23:51:00.464 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:51:00 smithi071 podman[70513]: 2024-09-10 23:51:00.175276595 +0000 UTC m=+0.255639812 container died 6101ca668f715a24fc0be431d674524e2e1d3afd1fa4ab74fdd8f4efbeb66a67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T23:51:00.485 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:51:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:51:00.205+0000 7f9e812ed640 -1 client.14232: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-09-10T23:51:00.769 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:51:00 smithi071 podman[70513]: 2024-09-10 23:51:00.578552818 +0000 UTC m=+0.658916037 container cleanup 6101ca668f715a24fc0be431d674524e2e1d3afd1fa4ab74fdd8f4efbeb66a67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:00.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 10 23:51:00 smithi071 bash[70513]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mon-c 2024-09-10T23:51:00.976 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T23:51:01.039 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:01.040 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T23:51:01.040 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T23:51:01.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:51:01.336 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:51:01 smithi016 systemd[1]: Stopping Ceph mgr.x for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:01.662 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:51:01 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:51:01.335+0000 7f9f303ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:01.663 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:51:01 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x[31083]: 2024-09-10T23:51:01.335+0000 7f9f303ed640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T23:51:01.663 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:51:01 smithi016 podman[106014]: 2024-09-10 23:51:01.366311216 +0000 UTC m=+0.125393119 container died 73263e313d13751c2eb70955d752629b9288948f8d05d198aec0d5f4af2c19c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-10T23:51:01.985 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:51:01 smithi016 podman[106014]: 2024-09-10 23:51:01.769583249 +0000 UTC m=+0.528665148 container cleanup 73263e313d13751c2eb70955d752629b9288948f8d05d198aec0d5f4af2c19c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T23:51:01.985 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Sep 10 23:51:01 smithi016 bash[106014]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-x 2024-09-10T23:51:02.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T23:51:02.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:02.203 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T23:51:02.203 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T23:51:02.203 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.y 2024-09-10T23:51:02.552 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:51:02 smithi066 systemd[1]: Stopping Ceph mgr.y for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:02.935 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:51:02 smithi066 podman[70202]: 2024-09-10 23:51:02.661307386 +0000 UTC m=+0.257106893 container died 2bf6133cebaacedea921c37933b297983b34f9019f919d37afa3d6243c8e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T23:51:03.302 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:51:03 smithi066 podman[70202]: 2024-09-10 23:51:03.024448611 +0000 UTC m=+0.620248124 container cleanup 2bf6133cebaacedea921c37933b297983b34f9019f919d37afa3d6243c8e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T23:51:03.302 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Sep 10 23:51:03 smithi066 bash[70202]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-y 2024-09-10T23:51:03.463 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T23:51:03.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:03.501 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T23:51:03.501 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T23:51:03.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.z 2024-09-10T23:51:03.829 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:51:03 smithi071 systemd[1]: Stopping Ceph mgr.z for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:04.127 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:51:03 smithi071 podman[70634]: 2024-09-10 23:51:03.829225071 +0000 UTC m=+0.123353752 container died ddc124c97762cfe018056fd87b14330e81c2a9797045a2e37fc2931a01fa7bf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:04.419 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:51:04 smithi071 podman[70634]: 2024-09-10 23:51:04.217478655 +0000 UTC m=+0.511607326 container cleanup ddc124c97762cfe018056fd87b14330e81c2a9797045a2e37fc2931a01fa7bf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T23:51:04.419 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 10 23:51:04 smithi071 bash[70634]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mgr-z 2024-09-10T23:51:04.631 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T23:51:04.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:04.665 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T23:51:04.666 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T23:51:04.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.0 2024-09-10T23:51:04.983 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:04 smithi016 systemd[1]: Stopping Ceph osd.0 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:05.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0[46340]: 2024-09-10T23:51:04.982+0000 7f109383f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:05.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0[46340]: 2024-09-10T23:51:04.982+0000 7f109383f640 -1 osd.0 88 *** Got signal Terminated *** 2024-09-10T23:51:05.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0[46340]: 2024-09-10T23:51:04.982+0000 7f109383f640 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:51:10.727 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:10 smithi016 podman[106134]: 2024-09-10 23:51:10.419927066 +0000 UTC m=+5.558428214 container died 2b03f206679322730c592ec442c9311171c2b1eb4a5a57646b1de79465fca02c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T23:51:10.985 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:10 smithi016 podman[106134]: 2024-09-10 23:51:10.82453825 +0000 UTC m=+5.963039385 container cleanup 2b03f206679322730c592ec442c9311171c2b1eb4a5a57646b1de79465fca02c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:51:10.985 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:10 smithi016 bash[106134]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0 2024-09-10T23:51:11.485 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:11 smithi016 podman[106150]: 2024-09-10 23:51:11.076318727 +0000 UTC m=+0.654815437 container remove 2b03f206679322730c592ec442c9311171c2b1eb4a5a57646b1de79465fca02c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T23:51:11.814 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:11 smithi016 podman[106242]: 2024-09-10 23:51:11.412163081 +0000 UTC m=+0.016467050 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:51:11.814 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:11 smithi016 podman[106242]: 2024-09-10 23:51:11.543873075 +0000 UTC m=+0.148177037 container create 6d3049bd61c0af822bac24b9ac9c3a0d26009da9830f52fd68fffef683cd36e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:12.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:11 smithi016 podman[106242]: 2024-09-10 23:51:11.813374062 +0000 UTC m=+0.417678027 container init 6d3049bd61c0af822bac24b9ac9c3a0d26009da9830f52fd68fffef683cd36e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T23:51:12.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:11 smithi016 podman[106242]: 2024-09-10 23:51:11.817480924 +0000 UTC m=+0.421784886 container start 6d3049bd61c0af822bac24b9ac9c3a0d26009da9830f52fd68fffef683cd36e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:51:12.235 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:11 smithi016 podman[106242]: 2024-09-10 23:51:11.913304669 +0000 UTC m=+0.517608638 container attach 6d3049bd61c0af822bac24b9ac9c3a0d26009da9830f52fd68fffef683cd36e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T23:51:12.236 INFO:journalctl@ceph.osd.0.smithi016.stdout:Sep 10 23:51:12 smithi016 podman[106242]: 2024-09-10 23:51:12.010941368 +0000 UTC m=+0.615245344 container died 6d3049bd61c0af822bac24b9ac9c3a0d26009da9830f52fd68fffef683cd36e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:51:12.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T23:51:12.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:12.672 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T23:51:12.672 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T23:51:12.672 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.1 2024-09-10T23:51:12.998 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:12 smithi066 systemd[1]: Stopping Ceph osd.1 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:13.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1[40304]: 2024-09-10T23:51:12.996+0000 7f1fba6ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:13.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1[40304]: 2024-09-10T23:51:12.996+0000 7f1fba6ee640 -1 osd.1 88 *** Got signal Terminated *** 2024-09-10T23:51:13.302 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1[40304]: 2024-09-10T23:51:12.996+0000 7f1fba6ee640 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:51:18.791 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:18 smithi066 podman[70326]: 2024-09-10 23:51:18.476080763 +0000 UTC m=+5.603480577 container died 21f6520f3f2fd71ab86cb3145f249746a23db5e6cfd97801c2623c420adaa220 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T23:51:19.052 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:18 smithi066 podman[70326]: 2024-09-10 23:51:18.880129324 +0000 UTC m=+6.007529144 container cleanup 21f6520f3f2fd71ab86cb3145f249746a23db5e6cfd97801c2623c420adaa220 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:51:19.052 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:18 smithi066 bash[70326]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1 2024-09-10T23:51:19.509 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:19 smithi066 podman[70342]: 2024-09-10 23:51:19.165222087 +0000 UTC m=+0.682275694 container remove 21f6520f3f2fd71ab86cb3145f249746a23db5e6cfd97801c2623c420adaa220 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T23:51:19.761 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:19 smithi066 podman[70431]: 2024-09-10 23:51:19.412152672 +0000 UTC m=+0.016081887 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:51:19.761 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:19 smithi066 podman[70431]: 2024-09-10 23:51:19.524434935 +0000 UTC m=+0.128364175 container create 7046c3269b7b83f7913f6830c9039bd761998cfbb4f7b86c7475bf2efaff2526 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:51:20.052 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:19 smithi066 podman[70431]: 2024-09-10 23:51:19.760432494 +0000 UTC m=+0.364361703 container init 7046c3269b7b83f7913f6830c9039bd761998cfbb4f7b86c7475bf2efaff2526 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:51:20.052 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:19 smithi066 podman[70431]: 2024-09-10 23:51:19.764715088 +0000 UTC m=+0.368644294 container start 7046c3269b7b83f7913f6830c9039bd761998cfbb4f7b86c7475bf2efaff2526 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-10T23:51:20.052 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:19 smithi066 podman[70431]: 2024-09-10 23:51:19.843726414 +0000 UTC m=+0.447655615 container attach 7046c3269b7b83f7913f6830c9039bd761998cfbb4f7b86c7475bf2efaff2526 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T23:51:20.052 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 10 23:51:19 smithi066 podman[70431]: 2024-09-10 23:51:19.960996066 +0000 UTC m=+0.564925265 container died 7046c3269b7b83f7913f6830c9039bd761998cfbb4f7b86c7475bf2efaff2526 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:51:20.622 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T23:51:20.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:20.666 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T23:51:20.666 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T23:51:20.667 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.2 2024-09-10T23:51:20.988 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:20 smithi071 systemd[1]: Stopping Ceph osd.2 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:21.269 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2[41310]: 2024-09-10T23:51:20.986+0000 7ff954ec5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:21.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2[41310]: 2024-09-10T23:51:20.986+0000 7ff954ec5640 -1 osd.2 88 *** Got signal Terminated *** 2024-09-10T23:51:21.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2[41310]: 2024-09-10T23:51:20.986+0000 7ff954ec5640 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:51:26.770 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:26 smithi071 podman[70758]: 2024-09-10 23:51:26.455343573 +0000 UTC m=+5.602518454 container died 4e6520f9ee1b2fb8a4976fdfee918b5279c8ba40edf3cecb7dc14e555f2725ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:51:27.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:26 smithi071 podman[70758]: 2024-09-10 23:51:26.878595069 +0000 UTC m=+6.025769939 container cleanup 4e6520f9ee1b2fb8a4976fdfee918b5279c8ba40edf3cecb7dc14e555f2725ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:27.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:26 smithi071 bash[70758]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2 2024-09-10T23:51:27.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:27 smithi071 podman[70772]: 2024-09-10 23:51:27.105109706 +0000 UTC m=+0.644025380 container remove 4e6520f9ee1b2fb8a4976fdfee918b5279c8ba40edf3cecb7dc14e555f2725ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T23:51:27.809 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:27 smithi071 podman[70860]: 2024-09-10 23:51:27.444724368 +0000 UTC m=+0.016035755 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:51:27.809 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:27 smithi071 podman[70860]: 2024-09-10 23:51:27.556115278 +0000 UTC m=+0.127426701 container create 051f098c2c5b74d0c8f4388af5ef722a099f4537a552e1160f8a7a189a1c04c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:51:28.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:27 smithi071 podman[70860]: 2024-09-10 23:51:27.808872419 +0000 UTC m=+0.380183796 container init 051f098c2c5b74d0c8f4388af5ef722a099f4537a552e1160f8a7a189a1c04c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T23:51:28.270 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:27 smithi071 podman[70860]: 2024-09-10 23:51:27.812368012 +0000 UTC m=+0.383679392 container start 051f098c2c5b74d0c8f4388af5ef722a099f4537a552e1160f8a7a189a1c04c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T23:51:28.271 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:27 smithi071 podman[70860]: 2024-09-10 23:51:27.934170541 +0000 UTC m=+0.505481934 container attach 051f098c2c5b74d0c8f4388af5ef722a099f4537a552e1160f8a7a189a1c04c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T23:51:28.271 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 23:51:28 smithi071 podman[70883]: 2024-09-10 23:51:28.02950263 +0000 UTC m=+0.018170988 container died 051f098c2c5b74d0c8f4388af5ef722a099f4537a552e1160f8a7a189a1c04c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T23:51:28.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T23:51:28.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:28.644 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T23:51:28.644 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T23:51:28.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.3 2024-09-10T23:51:28.985 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:28 smithi016 systemd[1]: Stopping Ceph osd.3 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:29.485 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:28 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:51:28.985+0000 7f6fcf4bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:29.485 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:28 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:51:28.985+0000 7f6fcf4bd640 -1 osd.3 88 *** Got signal Terminated *** 2024-09-10T23:51:29.485 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:28 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:51:28.985+0000 7f6fcf4bd640 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:51:32.235 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:31 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:51:31.882+0000 7f6fc7aca640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:05.587182+0000 front 2024-09-10T23:51:05.587220+0000 (oldest deadline 2024-09-10T23:51:31.487288+0000) 2024-09-10T23:51:32.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:31 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:31.822+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:33.235 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:32 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:51:32.857+0000 7f6fc7aca640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:05.587182+0000 front 2024-09-10T23:51:05.587220+0000 (oldest deadline 2024-09-10T23:51:31.487288+0000) 2024-09-10T23:51:33.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:32 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:32.769+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:33.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:32.820+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:34.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:33 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:33.609+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:34.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:33 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:33.747+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:34.235 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:33 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3[53057]: 2024-09-10T23:51:33.895+0000 7f6fc7aca640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:05.587182+0000 front 2024-09-10T23:51:05.587220+0000 (oldest deadline 2024-09-10T23:51:31.487288+0000) 2024-09-10T23:51:34.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:33.858+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:34.671 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:34 smithi016 podman[106345]: 2024-09-10 23:51:34.384017759 +0000 UTC m=+5.531540917 container died 64e95a26ab4ccf40d52022e372912e943944f8640359d0d475c85640db333646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T23:51:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:34.338+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:34.985 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:34 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:34.791+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:34.985 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:34 smithi016 podman[106345]: 2024-09-10 23:51:34.870254038 +0000 UTC m=+6.017777237 container cleanup 64e95a26ab4ccf40d52022e372912e943944f8640359d0d475c85640db333646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T23:51:34.985 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:34 smithi016 bash[106345]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3 2024-09-10T23:51:35.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:34 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:34.591+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:35.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:34.880+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:35.449 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:35 smithi016 podman[106360]: 2024-09-10 23:51:35.113285203 +0000 UTC m=+0.726117875 container remove 64e95a26ab4ccf40d52022e372912e943944f8640359d0d475c85640db333646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-10T23:51:35.598 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:35.312+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:35.701 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:35 smithi016 podman[106450]: 2024-09-10 23:51:35.351511513 +0000 UTC m=+0.016012235 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:51:35.701 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:35 smithi016 podman[106450]: 2024-09-10 23:51:35.456079249 +0000 UTC m=+0.120580009 container create 82418be208ce25dcc922ed872d239ba2ec4ddb17f3b9eafff4591606d6517ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:51:35.876 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:35.597+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:35.985 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:35 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:35.807+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:35.986 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:35 smithi016 podman[106450]: 2024-09-10 23:51:35.700386582 +0000 UTC m=+0.364887301 container init 82418be208ce25dcc922ed872d239ba2ec4ddb17f3b9eafff4591606d6517ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:35.986 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:35 smithi016 podman[106450]: 2024-09-10 23:51:35.703784665 +0000 UTC m=+0.368285381 container start 82418be208ce25dcc922ed872d239ba2ec4ddb17f3b9eafff4591606d6517ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:35.986 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:35 smithi016 podman[106450]: 2024-09-10 23:51:35.800461709 +0000 UTC m=+0.464962430 container attach 82418be208ce25dcc922ed872d239ba2ec4ddb17f3b9eafff4591606d6517ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:35.986 INFO:journalctl@ceph.osd.3.smithi016.stdout:Sep 10 23:51:35 smithi016 podman[106450]: 2024-09-10 23:51:35.898715441 +0000 UTC m=+0.563216167 container died 82418be208ce25dcc922ed872d239ba2ec4ddb17f3b9eafff4591606d6517ba9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T23:51:36.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:35 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:35.572+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:36.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:35.875+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:36.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:36 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:36.085+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:36.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T23:51:36.578 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:36.578 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T23:51:36.578 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T23:51:36.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.4 2024-09-10T23:51:36.597 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:36.333+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:36.902 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:36 smithi066 systemd[1]: Stopping Ceph osd.4 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:36.902 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:36 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:36.585+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:37.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:36.596+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:37.020 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:36.837+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:37.125 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:36 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:36.858+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:37.302 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:36 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:51:36.900+0000 7f82f90d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:37.302 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:36 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:51:36.900+0000 7f82f90d3640 -1 osd.4 88 *** Got signal Terminated *** 2024-09-10T23:51:37.302 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:36 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:51:36.900+0000 7f82f90d3640 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:51:37.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:37 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:37.124+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:37.591 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:37.320+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:37.867 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:37.589+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:38.131 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:37 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:37.601+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:38.133 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:37 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:37.866+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:38.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:37.866+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:38.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:38 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:38.131+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:38.634 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:38 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:38.298+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:38.909 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:38 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:38.633+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:38.923 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:38 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:38.637+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:39.123 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:38 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:38.855+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:39.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:38 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:38.908+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:39.302 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:38 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:51:38.922+0000 7f82f56e8640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.644447+0000 front 2024-09-10T23:51:17.644495+0000 (oldest deadline 2024-09-10T23:51:38.744656+0000) 2024-09-10T23:51:39.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:39 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:39.122+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:39.599 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:39 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:39.274+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:39.940 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:39 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:39.597+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:39.960 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:39 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:39.644+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:39.961 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:39 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:39.644+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:39.961 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:39 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:39.647+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:40.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:40 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:40.095+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:40.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:40 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:40.095+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:40.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:39 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:39.904+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:40.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:39 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:39.938+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:40.302 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:39 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:51:39.959+0000 7f82f56e8640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.644447+0000 front 2024-09-10T23:51:17.644495+0000 (oldest deadline 2024-09-10T23:51:38.744656+0000) 2024-09-10T23:51:40.621 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:40 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:40.282+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:40.942 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:40 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:40.619+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:40.957 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:40 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:40.679+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:40.957 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:40 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:40.679+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:40.957 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:40 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:40.683+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:41.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:41.145+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:41.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:41.145+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:41.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:40 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:40.938+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:41.249 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:40 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:40.940+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:41.249 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:40 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:40.940+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:41.302 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:40 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4[46939]: 2024-09-10T23:51:40.955+0000 7f82f56e8640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.644447+0000 front 2024-09-10T23:51:17.644495+0000 (oldest deadline 2024-09-10T23:51:38.744656+0000) 2024-09-10T23:51:41.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:41 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:41.247+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:41.975 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:41 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:41.601+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:42.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:41 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:41.723+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:42.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:41 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:41.714+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:42.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:41 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:41.714+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:42.194 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:41.904+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:42.194 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:41 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:41.904+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:42.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:41 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:41.973+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:42.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:41 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:41.973+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:42.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:42 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:42.218+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:42.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:42 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:42.218+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:42.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:42 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:42.193+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:42.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:42 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:42.193+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:42.552 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:42 smithi066 podman[70549]: 2024-09-10 23:51:42.330611882 +0000 UTC m=+5.548226376 container died 3bcd6853d887d7df3b34680c66a51cecbb9bc591fafed7bd93385100bcb933fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T23:51:43.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:42 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:42.637+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:43.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:42 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:42.692+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:43.052 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:42 smithi066 podman[70549]: 2024-09-10 23:51:42.684721688 +0000 UTC m=+5.902336191 container cleanup 3bcd6853d887d7df3b34680c66a51cecbb9bc591fafed7bd93385100bcb933fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:51:43.052 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:42 smithi066 bash[70549]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4 2024-09-10T23:51:43.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:42 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:42.747+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:43.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:42 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:42.747+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:43.181 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:42 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:42.912+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:43.181 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:42 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:42.912+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:43.458 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:43 smithi066 podman[70565]: 2024-09-10 23:51:43.085752826 +0000 UTC m=+0.747423006 container remove 3bcd6853d887d7df3b34680c66a51cecbb9bc591fafed7bd93385100bcb933fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T23:51:43.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:43 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:43.180+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:43.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:43 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:43.180+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:43.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:43 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:43.021+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:43.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:43 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:43.021+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:43.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:43 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:43.176+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:43.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:43 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:43.176+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:43.715 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:43 smithi066 podman[70653]: 2024-09-10 23:51:43.360680136 +0000 UTC m=+0.016336086 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:51:43.716 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:43 smithi066 podman[70653]: 2024-09-10 23:51:43.461718605 +0000 UTC m=+0.117374584 container create 72e7e0fb45d33453ab25b18eb873f88034b0b83444497e3204ac56014722e392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:51:43.716 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:43 smithi066 podman[70653]: 2024-09-10 23:51:43.715053809 +0000 UTC m=+0.370709746 container init 72e7e0fb45d33453ab25b18eb873f88034b0b83444497e3204ac56014722e392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T23:51:44.019 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:43 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:43.643+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:44.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:43 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:43.643+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.533441+0000 front 2024-09-10T23:51:17.533488+0000 (oldest deadline 2024-09-10T23:51:42.833482+0000) 2024-09-10T23:51:44.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:43 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:43.729+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:44.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:43 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:43.716+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:44.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:43 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:43.716+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:44.052 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:43 smithi066 podman[70653]: 2024-09-10 23:51:43.718594617 +0000 UTC m=+0.374250553 container start 72e7e0fb45d33453ab25b18eb873f88034b0b83444497e3204ac56014722e392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:51:44.052 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:43 smithi066 podman[70653]: 2024-09-10 23:51:43.81489953 +0000 UTC m=+0.470555476 container attach 72e7e0fb45d33453ab25b18eb873f88034b0b83444497e3204ac56014722e392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T23:51:44.052 INFO:journalctl@ceph.osd.4.smithi066.stdout:Sep 10 23:51:43 smithi066 podman[70653]: 2024-09-10 23:51:43.915250935 +0000 UTC m=+0.570906883 container died 72e7e0fb45d33453ab25b18eb873f88034b0b83444497e3204ac56014722e392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T23:51:44.216 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:43 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:43.885+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:44.216 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:43 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:43.885+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:44.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:44 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:44.214+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:44.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:44 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:44.214+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:44.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:44 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:44.055+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:44.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:44 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:44.055+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:44.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:44 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:44.201+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:44.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:44 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:44.201+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:44.656 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T23:51:44.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:44.700 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T23:51:44.701 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T23:51:44.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.5 2024-09-10T23:51:44.710 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:44 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:44.698+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:44.711 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:44 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:44.698+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:45.019 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:44 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:44.599+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:45.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:44 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:44.599+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.533441+0000 front 2024-09-10T23:51:17.533488+0000 (oldest deadline 2024-09-10T23:51:42.833482+0000) 2024-09-10T23:51:45.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:44 smithi071 systemd[1]: Stopping Ceph osd.5 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:45.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:44 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:44.707+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:45.200 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:44 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:44.890+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:45.200 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:44 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:44.890+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:45.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:45 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:45.199+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:45.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:45 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:45.199+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:45.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:45.032+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:45.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:45.032+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:45.520 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:45.031+0000 7fe134cfd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:45.520 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:45.031+0000 7fe134cfd640 -1 osd.5 88 *** Got signal Terminated *** 2024-09-10T23:51:45.520 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:45.031+0000 7fe134cfd640 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:51:45.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:45.215+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:45.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:45.215+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:46.001 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:45.646+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:46.001 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:45 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:45.646+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.533441+0000 front 2024-09-10T23:51:17.533488+0000 (oldest deadline 2024-09-10T23:51:42.833482+0000) 2024-09-10T23:51:46.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:45 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:45.662+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:46.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:45 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:45.746+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:46.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:45 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:45.746+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:46.156 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:45 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:45.895+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:46.156 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:45 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:45.895+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:46.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:46 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:45.999+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:46.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:46 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:45.999+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:46.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:46 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:46.188+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:46.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:46 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:46.188+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:46.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:46.154+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:46.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:46.154+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:47.008 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:46 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:46.604+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:47.008 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:46 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:46.604+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.533441+0000 front 2024-09-10T23:51:17.533488+0000 (oldest deadline 2024-09-10T23:51:42.833482+0000) 2024-09-10T23:51:47.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:46 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:46.641+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:47.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:46 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:46.774+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:47.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:46 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:46.774+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:47.204 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:46.940+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:47.204 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:46.940+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:47.204 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:46 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:46.940+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:47.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:47.006+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:47.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:47.006+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:47.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:47.161+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:47.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:47.161+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:47.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:47 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:47.202+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:47.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:47 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:47.202+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:47.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:47 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:47.202+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:47.981 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:47.586+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:47.981 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:47.586+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.533441+0000 front 2024-09-10T23:51:17.533488+0000 (oldest deadline 2024-09-10T23:51:42.833482+0000) 2024-09-10T23:51:47.981 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:47.586+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:22.833760+0000 front 2024-09-10T23:51:22.833798+0000 (oldest deadline 2024-09-10T23:51:46.933984+0000) 2024-09-10T23:51:48.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:47 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:47.662+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:48.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:47 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:47.822+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:48.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:47 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:47.822+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:48.160 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:47 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:47.901+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:48.160 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:47 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:47.901+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:48.160 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:47 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:47.901+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:48.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:47.979+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:48.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:47.979+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:48.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:47 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:47.979+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:48.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:48.112+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:48.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:48.112+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:48.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:48.112+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:48.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:48.159+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:48.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:48.159+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:48.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:48.159+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:48.993 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:48.568+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:48.993 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:48.568+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.533441+0000 front 2024-09-10T23:51:17.533488+0000 (oldest deadline 2024-09-10T23:51:42.833482+0000) 2024-09-10T23:51:48.993 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:48.568+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:22.833760+0000 front 2024-09-10T23:51:22.833798+0000 (oldest deadline 2024-09-10T23:51:46.933984+0000) 2024-09-10T23:51:49.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:48 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:48.649+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:49.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:48 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:48.649+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:49.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:48 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:48.785+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:49.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:48 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:48.785+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:49.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:48 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:48.785+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:49.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:48.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:49.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:48.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:49.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:48.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:49.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:49 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:49.118+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:49.236 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:49 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:49.118+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:49.236 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:49 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:49.118+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:49.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:48.992+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:49.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:48.992+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:49.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:48 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:48.992+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:49.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:49 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:49.137+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:49.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:49 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:49.137+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:49.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:49 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:49.137+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:50.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:49 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:49.529+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.932052+0000 front 2024-09-10T23:51:09.932137+0000 (oldest deadline 2024-09-10T23:51:34.632170+0000) 2024-09-10T23:51:50.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:49 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:49.529+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:17.533441+0000 front 2024-09-10T23:51:17.533488+0000 (oldest deadline 2024-09-10T23:51:42.833482+0000) 2024-09-10T23:51:50.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:49 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5[47751]: 2024-09-10T23:51:49.529+0000 7fe12d30a640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:22.833760+0000 front 2024-09-10T23:51:22.833798+0000 (oldest deadline 2024-09-10T23:51:46.933984+0000) 2024-09-10T23:51:50.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:49 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:49.624+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:50.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:49 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:49.624+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:50.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:49 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:49.826+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:50.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:49 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:49.826+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:50.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:49 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:49.826+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:50.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:50 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:50.109+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:50.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:50 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:50.109+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:50.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:50 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:50.109+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:50.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:49 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:49.883+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:50.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:49 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:49.883+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:50.236 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:49 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:49.883+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:50.400 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:50.029+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:50.400 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:50.029+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:50.401 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:50.029+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:50.401 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:50.088+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:50.401 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:50.088+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:50.401 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:50 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:50.088+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:50.700 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:50 smithi071 podman[70977]: 2024-09-10 23:51:50.39969534 +0000 UTC m=+5.502945261 container died c6880f6a8d54e4b1df7a3b163020431b872a515aa4dd9e659fd4ffe3bd646452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T23:51:50.983 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:50 smithi071 podman[70977]: 2024-09-10 23:51:50.797987532 +0000 UTC m=+5.901237450 container cleanup c6880f6a8d54e4b1df7a3b163020431b872a515aa4dd9e659fd4ffe3bd646452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T23:51:50.983 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:50 smithi071 bash[70977]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5 2024-09-10T23:51:51.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:50.621+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:51.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:50.621+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:51.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:50.852+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:51.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:50.852+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:51.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:50 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:50.852+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:51.129 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:50 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:50.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:51.129 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:50 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:50.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:51.129 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:50 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:50.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:51.269 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:50 smithi071 podman[70992]: 2024-09-10 23:51:50.982745409 +0000 UTC m=+0.578776665 container remove c6880f6a8d54e4b1df7a3b163020431b872a515aa4dd9e659fd4ffe3bd646452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:51:51.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:51 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:51.073+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:51.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:51 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:51.073+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:51.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:51 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:51.073+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:51.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:51 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:51.067+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:51.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:51 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:51.067+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:51.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:51 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:51.067+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:51.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:51 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:51.127+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:51.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:51 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:51.127+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:51.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:51 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:51.127+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:51.678 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:51 smithi071 podman[71083]: 2024-09-10 23:51:51.311396202 +0000 UTC m=+0.016403947 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:51:51.678 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:51 smithi071 podman[71083]: 2024-09-10 23:51:51.441944494 +0000 UTC m=+0.146952230 container create 35cf3ff3f3b13145daf5c4ad47c011e394ebfc8c86048ea3c08d8c32352b8139 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T23:51:52.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:51 smithi071 podman[71083]: 2024-09-10 23:51:51.677567969 +0000 UTC m=+0.382575709 container init 35cf3ff3f3b13145daf5c4ad47c011e394ebfc8c86048ea3c08d8c32352b8139 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T23:51:52.020 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:51 smithi071 podman[71083]: 2024-09-10 23:51:51.680982469 +0000 UTC m=+0.385990212 container start 35cf3ff3f3b13145daf5c4ad47c011e394ebfc8c86048ea3c08d8c32352b8139 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T23:51:52.021 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:51 smithi071 podman[71083]: 2024-09-10 23:51:51.785917054 +0000 UTC m=+0.490924799 container attach 35cf3ff3f3b13145daf5c4ad47c011e394ebfc8c86048ea3c08d8c32352b8139 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:51:52.021 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 10 23:51:51 smithi071 podman[71083]: 2024-09-10 23:51:51.876927121 +0000 UTC m=+0.581934861 container died 35cf3ff3f3b13145daf5c4ad47c011e394ebfc8c86048ea3c08d8c32352b8139 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T23:51:52.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:51 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:51.657+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:52.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:51 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:51.657+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:52.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:51 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:51.849+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:52.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:51 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:51.849+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:52.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:51 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:51.849+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:52.132 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:51 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:51.873+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:52.132 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:51 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:51.873+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:52.132 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:51 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:51.873+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:52.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:52.131+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:52.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:52.131+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:52.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:52.131+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:52.507 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:52 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:52.022+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:52.507 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:52 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:52.022+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:52.507 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:52 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:52.022+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:52.507 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:52 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:52.086+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:52.507 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:52 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:52.086+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:52.508 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:52 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:52.086+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:52.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T23:51:52.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:51:52.570 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T23:51:52.571 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T23:51:52.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.6 2024-09-10T23:51:52.874 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:52 smithi016 systemd[1]: Stopping Ceph osd.6 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:51:53.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:52 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:52.705+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:53.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:52 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:52.705+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:53.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:52 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:52.896+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:53.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:52 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:52.896+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:53.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:52 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:52.896+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:53.145 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:52.872+0000 7fcbb835e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:51:53.145 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:52.872+0000 7fcbb835e640 -1 osd.6 88 *** Got signal Terminated *** 2024-09-10T23:51:53.145 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:52.872+0000 7fcbb835e640 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:51:53.146 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:52.875+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:53.146 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:52.875+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:53.146 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:52.875+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:53.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:53 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:53.144+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:53.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:53 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:53.144+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:53.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:53 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:53.144+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:53.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:53.117+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:53.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:53.117+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:53.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:53.117+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:53.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:53.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:53.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:53.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:53.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:53.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:54.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:53 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:53.751+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:54.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:53 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:53.751+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:54.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:53 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:53.847+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:54.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:53 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:53.847+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:54.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:53 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:53.847+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:54.170 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:53 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:53.890+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:54.170 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:53 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:53.890+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:54.170 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:53 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:53.890+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:54.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:53.980+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:54.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:53.980+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:54.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:53 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:53.980+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:54.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:54 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:54.142+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:54.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:54 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:54.142+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:54.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:54 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:54.142+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:54.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:54 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:54.169+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:54.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:54 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:54.169+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:54.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:54 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:54.169+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:55.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:54 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:54.810+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:55.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:54 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:54.810+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:55.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:54 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:54.810+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:55.053 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:54 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:54.760+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:55.053 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:54 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:54.760+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:55.054 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:54 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:54.760+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:51:55.193 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:54 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:54.932+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:55.194 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:54 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:54.932+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:55.194 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:54 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:54.932+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:55.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:55 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:55.192+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:55.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:55 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:55.192+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:55.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:55 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:55.192+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:55.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:55 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:55.026+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:55.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:55 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:55.026+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:55.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:55 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:55.026+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:55.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:55 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:55.119+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:55.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:55 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:55.119+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:55.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:55 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:55.119+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:56.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:55 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:55.712+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:56.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:55 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:55.712+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:56.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:55 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:55.712+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:51:56.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:55 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:55.853+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:56.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:55 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:55.853+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:56.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:55 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:55.853+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:56.204 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:55 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:55.908+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:56.204 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:55 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:55.908+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:56.204 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:55 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:55.908+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:56.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:56 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:56.006+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:56.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:56 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:56.006+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:56.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:56 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:56.006+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:56.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:56 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:56.161+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:56.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:56 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:56.161+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:56.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:56 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:56.161+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:56.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:56.202+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:56.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:56.202+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:56.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:56.202+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:57.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:56.722+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:57.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:56.722+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:57.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:56.722+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:51:57.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:56.851+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:57.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:56.851+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:57.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:56.851+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:57.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:56.851+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:51:57.172 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:56.898+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:57.172 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:56.898+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:57.172 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:56 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:56.898+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:57.288 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:57 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:57.032+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:57.289 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:57 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:57.032+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:57.289 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:57 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:57.032+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:57.289 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:57 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:57.146+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:57.289 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:57 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:57.146+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:57.289 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:57 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:57.146+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:57.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:57.170+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.094595+0000 front 2024-09-10T23:51:08.094688+0000 (oldest deadline 2024-09-10T23:51:35.095528+0000) 2024-09-10T23:51:57.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:57.170+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:15.096368+0000 front 2024-09-10T23:51:15.096237+0000 (oldest deadline 2024-09-10T23:51:39.196263+0000) 2024-09-10T23:51:57.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6[59957]: 2024-09-10T23:51:57.170+0000 7fcbb4973640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.097499+0000 front 2024-09-10T23:51:25.097625+0000 (oldest deadline 2024-09-10T23:51:46.797509+0000) 2024-09-10T23:51:58.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:57 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:57.715+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:58.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:57 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:57.715+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:58.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:57 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:57.715+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:51:58.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:57 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:57.855+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:58.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:57 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:57.855+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:58.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:57 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:57.855+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:58.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:57 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:57.855+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:51:58.199 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:57.919+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:58.199 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:57.919+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:58.199 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:57 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:57.919+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:58.485 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:58 smithi016 podman[106553]: 2024-09-10 23:51:58.19908412 +0000 UTC m=+5.430152439 container died 65abd48b420518cd716317a266eb0171849b7b0eec5a999e52c32ee422bae0c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T23:51:58.494 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:58 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:58.123+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:58.494 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:58 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:58.123+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:58.494 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:58 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:58.123+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:58.494 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:58 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:58.028+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:58.495 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:58 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:58.028+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:58.495 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:58 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:58.028+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:58.842 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:58 smithi016 podman[106553]: 2024-09-10 23:51:58.639869647 +0000 UTC m=+5.870937953 container cleanup 65abd48b420518cd716317a266eb0171849b7b0eec5a999e52c32ee422bae0c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:51:58.842 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:58 smithi016 bash[106553]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6 2024-09-10T23:51:59.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:58.764+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:51:59.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:58.764+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:51:59.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:58.764+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:51:59.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:58.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:51:59.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:58.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:51:59.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:58.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:51:59.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:58 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:58.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:51:59.235 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:58 smithi016 podman[106571]: 2024-09-10 23:51:58.841392823 +0000 UTC m=+0.640307985 container remove 65abd48b420518cd716317a266eb0171849b7b0eec5a999e52c32ee422bae0c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:51:59.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:58 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:58.964+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:51:59.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:58 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:58.964+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:51:59.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:51:58 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:51:58.964+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:51:59.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:59 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:59.170+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:51:59.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:59 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:59.170+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:51:59.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:51:59 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:51:59.170+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:51:59.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:59 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:59.041+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:51:59.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:59 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:59.041+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:51:59.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:59 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:59.041+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:51:59.521 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:51:59 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:51:59.041+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:51:59.628 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:59 smithi016 podman[106661]: 2024-09-10 23:51:59.16476577 +0000 UTC m=+0.016124048 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:51:59.629 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:59 smithi016 podman[106661]: 2024-09-10 23:51:59.292284276 +0000 UTC m=+0.143642599 container create a3d71d6af62c5a5e3621a4b4cdb502eafd1ee4e088ef25d964fb9c36edc06d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True) 2024-09-10T23:51:59.629 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:59 smithi016 podman[106661]: 2024-09-10 23:51:59.628086271 +0000 UTC m=+0.479444549 container init a3d71d6af62c5a5e3621a4b4cdb502eafd1ee4e088ef25d964fb9c36edc06d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T23:51:59.985 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:59 smithi016 podman[106661]: 2024-09-10 23:51:59.631731161 +0000 UTC m=+0.483089438 container start a3d71d6af62c5a5e3621a4b4cdb502eafd1ee4e088ef25d964fb9c36edc06d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T23:51:59.985 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:59 smithi016 podman[106661]: 2024-09-10 23:51:59.745008695 +0000 UTC m=+0.596366973 container attach a3d71d6af62c5a5e3621a4b4cdb502eafd1ee4e088ef25d964fb9c36edc06d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:51:59.985 INFO:journalctl@ceph.osd.6.smithi016.stdout:Sep 10 23:51:59 smithi016 podman[106661]: 2024-09-10 23:51:59.826434921 +0000 UTC m=+0.677793207 container died a3d71d6af62c5a5e3621a4b4cdb502eafd1ee4e088ef25d964fb9c36edc06d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T23:52:00.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:59.791+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:52:00.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:59.791+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:52:00.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:51:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:51:59.791+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:52:00.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:59.868+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:00.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:59.868+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:00.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:59.868+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:00.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:51:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:51:59.868+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:00.483 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:00.003+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:00.483 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:00.003+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:00.483 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:00.003+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:00.510 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T23:52:00.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:00.185+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:00.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:00.185+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:00.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:00.185+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:00.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:00.019+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:00.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:00.019+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:00.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:00.019+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:00.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:00 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:00.019+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:00.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:00.550 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T23:52:00.550 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T23:52:00.551 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.7 2024-09-10T23:52:00.881 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:00 smithi066 systemd[1]: Stopping Ceph osd.7 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:00.882 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:00.756+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:52:00.882 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:00.756+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:52:00.882 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:00.756+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:52:01.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:00.957+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:01.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:00.957+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:01.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:00.957+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:01.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:00 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:00.957+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:01.302 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:00.878+0000 7ff8cbcc9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:01.302 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:00.878+0000 7ff8cbcc9640 -1 osd.7 88 *** Got signal Terminated *** 2024-09-10T23:52:01.302 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:00.878+0000 7ff8cbcc9640 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:52:01.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:00.908+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:01.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:00.908+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:01.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:00.908+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:01.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:00 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:00.908+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:01.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:01 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:01.213+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:01.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:01 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:01.213+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:01.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:01 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:01.213+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:01.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:01 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:01.047+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:01.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:01 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:01.047+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:01.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:01 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:01.047+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:01.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:01 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:01.047+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:01.954 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:01.727+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:52:01.954 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:01.727+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:52:01.954 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:01.727+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:52:02.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:01 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:01.974+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:02.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:01 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:01.974+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:02.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:01 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:01.974+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:02.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:01 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:01.974+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:02.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:01.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:02.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:01.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:02.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:01.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:02.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:01 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:01.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:02.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:02.234+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:02.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:02.234+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:02.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:02.234+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:02.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:02.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:02.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:02.521 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:02.957 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:02 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:02.763+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:52:02.957 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:02 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:02.764+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:52:02.957 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:02 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:02.764+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:52:03.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:02 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:02.941+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:03.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:02 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:02.941+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:03.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:02 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:02.941+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:03.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:02 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:02.941+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.986+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.986+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.986+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:02 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:02.986+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:03.231+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:03.231+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:03.231+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:03.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:03.231+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:03.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:02 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:02.955+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:03.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:02 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:02.955+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:03.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:02 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:02.955+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:03.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:02 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:02.955+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:04.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:03.752+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:52:04.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:03.752+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:52:04.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:03.752+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:52:04.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:03.752+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.673292+0000 front 2024-09-10T23:51:41.673342+0000 (oldest deadline 2024-09-10T23:52:03.273706+0000) 2024-09-10T23:52:04.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:03.934+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:04.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:03.934+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:04.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:03.934+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:04.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:03.934+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:04.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:03 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:03.934+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:04.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:03 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:03.934+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:04.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:03 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:03.934+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:04.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:03 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:03.934+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:04.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:03.964+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:04.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:03.964+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:04.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:03.964+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:04.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:03 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:03.964+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:04.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:04 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:04.198+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:04.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:04 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:04.198+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:04.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:04 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:04.198+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:04.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:04 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:04.198+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:05.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:04.787+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:52:05.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:04.787+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:52:05.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:04.787+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:52:05.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:04.787+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.673292+0000 front 2024-09-10T23:51:41.673342+0000 (oldest deadline 2024-09-10T23:52:03.273706+0000) 2024-09-10T23:52:05.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:04.975+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:05.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:04.975+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:05.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:04.975+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:05.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:04 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:04.975+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:05.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:04.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:05.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:04.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:05.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:04.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:05.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:04.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:05.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:04 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:04.891+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:05.001+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:05.001+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:05.001+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:05.001+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:05.207+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:05.207+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:05.207+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:05.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:05 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:05.207+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:06.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:05 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:05.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:06.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:05 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:05.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:06.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:05 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:05.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:06.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:05 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:05.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:06.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:05 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:05.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:06.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.002+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:06.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.002+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:06.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.002+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:06.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.002+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:06.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:06.177+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:06.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:06.177+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:06.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:06.177+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:06.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:06.177+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:06.298 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:05.814+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.269717+0000 front 2024-09-10T23:51:14.269879+0000 (oldest deadline 2024-09-10T23:51:39.569688+0000) 2024-09-10T23:52:06.298 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:05.814+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.971029+0000 front 2024-09-10T23:51:25.971205+0000 (oldest deadline 2024-09-10T23:51:47.670907+0000) 2024-09-10T23:52:06.298 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:05.814+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:30.571914+0000 front 2024-09-10T23:51:30.571857+0000 (oldest deadline 2024-09-10T23:51:54.671854+0000) 2024-09-10T23:52:06.298 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7[53734]: 2024-09-10T23:52:05.814+0000 7ff8c42d6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.673292+0000 front 2024-09-10T23:51:41.673342+0000 (oldest deadline 2024-09-10T23:52:03.273706+0000) 2024-09-10T23:52:06.299 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:05.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:06.299 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:05.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:06.299 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:05.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:06.299 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:05 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:05.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:06.552 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:06 smithi066 podman[70754]: 2024-09-10 23:52:06.29771411 +0000 UTC m=+5.536404857 container died 20e8707b6bf54ed40dfca5f4c4bc3c69a4bdfceda1cf6572120c5ad2cfc6a5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T23:52:06.907 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:06 smithi066 podman[70754]: 2024-09-10 23:52:06.646639237 +0000 UTC m=+5.885329983 container cleanup 20e8707b6bf54ed40dfca5f4c4bc3c69a4bdfceda1cf6572120c5ad2cfc6a5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T23:52:06.907 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:06 smithi066 bash[70754]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7 2024-09-10T23:52:07.225 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.970+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:07.225 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.970+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:07.225 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.970+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:07.225 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:06 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:06.970+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:07.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:06 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:06.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:07.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:06 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:06.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:07.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:06 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:06.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:07.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:06 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:06.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:07.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:06 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:06.856+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:07.274 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:06 smithi066 podman[70782]: 2024-09-10 23:52:06.906234117 +0000 UTC m=+0.605245345 container remove 20e8707b6bf54ed40dfca5f4c4bc3c69a4bdfceda1cf6572120c5ad2cfc6a5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T23:52:07.274 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:06 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:06.962+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:07.275 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:06 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:06.962+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:07.275 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:06 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:06.962+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:07.275 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:06 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:06.962+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:07.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:07 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:07.224+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:07.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:07 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:07.224+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:07.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:07 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:07.224+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:07.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:07 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:07.224+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:07.526 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:07 smithi066 podman[70871]: 2024-09-10 23:52:07.274007841 +0000 UTC m=+0.110634349 container create debb7c67508915321b2c70147fe559f25bc4154c3b14d39476acbe83c3661142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T23:52:07.526 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:07 smithi066 podman[70871]: 2024-09-10 23:52:07.179604365 +0000 UTC m=+0.016230830 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:52:07.777 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:07 smithi066 podman[70871]: 2024-09-10 23:52:07.668072045 +0000 UTC m=+0.504698507 container init debb7c67508915321b2c70147fe559f25bc4154c3b14d39476acbe83c3661142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T23:52:07.777 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:07 smithi066 podman[70871]: 2024-09-10 23:52:07.67164565 +0000 UTC m=+0.508272118 container start debb7c67508915321b2c70147fe559f25bc4154c3b14d39476acbe83c3661142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:07.777 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:07 smithi066 podman[70871]: 2024-09-10 23:52:07.776452143 +0000 UTC m=+0.613078617 container attach debb7c67508915321b2c70147fe559f25bc4154c3b14d39476acbe83c3661142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T23:52:08.052 INFO:journalctl@ceph.osd.7.smithi066.stdout:Sep 10 23:52:07 smithi066 podman[70871]: 2024-09-10 23:52:07.869610143 +0000 UTC m=+0.706236608 container died debb7c67508915321b2c70147fe559f25bc4154c3b14d39476acbe83c3661142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T23:52:08.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:07 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:07.959+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:08.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:07 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:07.959+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:08.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:07 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:07.959+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:08.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:07 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:07.959+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:08.053 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:07 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:07.959+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:08.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:07 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:07.831+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:08.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:07 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:07.831+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:08.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:07 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:07.831+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:08.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:07 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:07.831+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:08.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:07 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:07.831+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:08.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:07.999+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:08.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:07.999+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:08.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:07.999+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:08.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:07.999+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:08.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:08.176+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:08.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:08.176+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:08.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:08.176+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:08.271 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:08 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:08.176+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:08.499 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T23:52:08.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:08.879 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T23:52:08.879 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T23:52:08.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.8 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:08 smithi071 systemd[1]: Stopping Ceph osd.8 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:09.031+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:09.031+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:09.031+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:09.031+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:09.174+0000 7fed406d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:09.174+0000 7fed406d3640 -1 osd.8 88 *** Got signal Terminated *** 2024-09-10T23:52:09.177 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:09.174+0000 7fed406d3640 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:52:09.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:08 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:08.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:09.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:08 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:08.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:09.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:08 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:08.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:09.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:08 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:08.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:09.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:08 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:08.854+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:09.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:08 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:08.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:09.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:08 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:08.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:09.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:08 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:08.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:09.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:08 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:08.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:09.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:08 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:08.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:09.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:09.221+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:09.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:09.221+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:09.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:09.221+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:09.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:09 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:09.221+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:10.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:09 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:09.853+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:10.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:09 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:09.853+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:10.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:09 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:09.853+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:10.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:09 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:09.853+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:10.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:09 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:09.853+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:10.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:09 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:09.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:10.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:09 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:09.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:10.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:09 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:09.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:10.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:09 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:09.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:10.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:09 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:09.987+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:10.050+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:10.050+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:10.050+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:10.050+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:10.179+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:10.179+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:10.179+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:10.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:10 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:10.179+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:11.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:10 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:10.888+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:11.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:10 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:10.888+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:11.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:10 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:10.888+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:11.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:10 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:10.888+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:11.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:10 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:10.888+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:11.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:10 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:10.963+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:11.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:10 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:10.963+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:11.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:10 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:10.963+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:11.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:10 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:10.963+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:11.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:10 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:10.963+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:11.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:11.039+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:11.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:11.039+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:11.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:11.039+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:11.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:11.039+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:11.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:11.204+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:11.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:11.204+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:11.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:11.204+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:11.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:11.204+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:11.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:11 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:11.204+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:12.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:11 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:11.923+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:12.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:11 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:11.923+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:12.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:11 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:11.923+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:12.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:11 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:11.923+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:12.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:11 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:11.923+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:12.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:11 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:11.923+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:12.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:12.017+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:12.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:12.017+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:12.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:12.017+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:12.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:12.017+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:12.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:12.189+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:12.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:12.189+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:12.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:12.189+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:12.271 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:12.189+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:12.271 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:12.189+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:12.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:11 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:11.924+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:12.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:11 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:11.924+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:12.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:11 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:11.924+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:12.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:11 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:11.924+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:12.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:11 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:11.924+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:13.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:12 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:12.966+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:13.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:12 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:12.966+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:13.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:12 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:12.966+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:13.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:12 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:12.966+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:13.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:12 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:12.966+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:13.236 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:12 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:12.966+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:13.008+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:13.008+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:13.008+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:13.008+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:13.008+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.797371+0000 front 2024-09-10T23:51:47.797391+0000 (oldest deadline 2024-09-10T23:52:12.497541+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:13.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:13.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:13.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:13.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:13.271 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:13.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:13.271 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:13 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:13.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:13.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:12.961+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:13.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:12.961+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:13.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:12.961+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:13.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:12.961+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:13.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:12.961+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:13.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:12 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:12.961+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:14.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:13 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:13.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:14.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:13 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:13.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:14.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:13 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:13.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:14.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:13 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:13.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:14.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:13 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:13.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:14.236 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:13 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:13.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:14.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:13 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:13.936+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:14.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:13 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:13.936+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:14.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:13 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:13.936+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:14.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:13 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:13.936+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:14.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:13 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:13.936+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:14.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:13 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:13.936+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:14.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:14.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:14.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:14.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:14.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:14.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:14.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:14.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:14.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:14.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:14.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:14.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.692262+0000 front 2024-09-10T23:51:08.692344+0000 (oldest deadline 2024-09-10T23:51:31.592111+0000) 2024-09-10T23:52:14.520 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:14.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:14.894361+0000 front 2024-09-10T23:51:14.894281+0000 (oldest deadline 2024-09-10T23:51:40.194340+0000) 2024-09-10T23:52:14.521 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:14.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.095204+0000 front 2024-09-10T23:51:23.095263+0000 (oldest deadline 2024-09-10T23:51:47.795427+0000) 2024-09-10T23:52:14.521 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:14.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.096595+0000 front 2024-09-10T23:51:33.096483+0000 (oldest deadline 2024-09-10T23:51:58.996330+0000) 2024-09-10T23:52:14.521 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:14 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8[54279]: 2024-09-10T23:52:14.023+0000 7fed38ce0640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.797371+0000 front 2024-09-10T23:51:47.797391+0000 (oldest deadline 2024-09-10T23:52:12.497541+0000) 2024-09-10T23:52:14.925 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:14 smithi071 podman[71196]: 2024-09-10 23:52:14.631072936 +0000 UTC m=+5.560164934 container died a1bab1a882fdc54be7d01ee401895d05591eb5e92cf4dae510b0b9a7e19f2b5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:52:15.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:14 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:14.971+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:15.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:14 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:14.971+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:15.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:14 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:14.971+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:15.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:14 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:14.971+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:15.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:14 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:14.971+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:15.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:14 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:14.971+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:15.269 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 podman[71196]: 2024-09-10 23:52:15.015726095 +0000 UTC m=+5.944818083 container cleanup a1bab1a882fdc54be7d01ee401895d05591eb5e92cf4dae510b0b9a7e19f2b5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:15.270 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 bash[71196]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8 2024-09-10T23:52:15.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:15 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:15.145+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:15.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:15 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:15.145+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:15.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:15 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:15.145+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:15.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:15 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:15.145+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:15.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:15 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:15.145+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:15.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:14 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:14.890+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:15.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:14 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:14.890+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:15.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:14 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:14.890+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:15.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:14 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:14.891+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:15.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:14 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:14.891+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:15.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:14 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:14.891+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:15.627 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 podman[71211]: 2024-09-10 23:52:15.275147135 +0000 UTC m=+0.638770982 container remove a1bab1a882fdc54be7d01ee401895d05591eb5e92cf4dae510b0b9a7e19f2b5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:15.904 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 podman[71299]: 2024-09-10 23:52:15.52988061 +0000 UTC m=+0.015749160 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:52:15.904 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 podman[71299]: 2024-09-10 23:52:15.642623884 +0000 UTC m=+0.128492420 container create 960245c405d7bf1f538a337bd84bf163478e09b8d641b41a9ade3ec91c625284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-10T23:52:16.173 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 podman[71299]: 2024-09-10 23:52:15.903392099 +0000 UTC m=+0.389260636 container init 960245c405d7bf1f538a337bd84bf163478e09b8d641b41a9ade3ec91c625284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:16.173 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 podman[71299]: 2024-09-10 23:52:15.906915022 +0000 UTC m=+0.392783559 container start 960245c405d7bf1f538a337bd84bf163478e09b8d641b41a9ade3ec91c625284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T23:52:16.174 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:15 smithi071 podman[71299]: 2024-09-10 23:52:15.986637179 +0000 UTC m=+0.472505719 container attach 960245c405d7bf1f538a337bd84bf163478e09b8d641b41a9ade3ec91c625284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:52:16.174 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 10 23:52:16 smithi071 podman[71299]: 2024-09-10 23:52:16.089213195 +0000 UTC m=+0.575081743 container died 960245c405d7bf1f538a337bd84bf163478e09b8d641b41a9ade3ec91c625284 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T23:52:16.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:15.927+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:16.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:15.927+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:16.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:15.927+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:16.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:15.927+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:16.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:15.927+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:16.236 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:15 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:15.927+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:16.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:15 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:15.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:16.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:15 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:15.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:16.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:15 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:15.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:16.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:15 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:15.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:16.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:15 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:15.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:16.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:15 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:15.863+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:16.449 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:16 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:16.171+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:16.449 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:16 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:16.171+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:16.449 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:16 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:16.171+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:16.449 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:16 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:16.171+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:16.450 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:16 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:16.171+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:16.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T23:52:16.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:16.807 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T23:52:16.807 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T23:52:16.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.9 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:16 smithi016 systemd[1]: Stopping Ceph osd.9 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:16 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:16.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:16 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:16.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:16 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:16.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:16 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:16.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:16 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:16.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:16 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:16.970+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.108+0000 7f59ea427640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:17.110 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.108+0000 7f59ea427640 -1 osd.9 88 *** Got signal Terminated *** 2024-09-10T23:52:17.111 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.108+0000 7f59ea427640 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:52:17.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:16 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:16.884+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:17.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:16 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:16.884+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:17.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:16 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:16.884+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:17.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:16 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:16.884+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:17.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:16 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:16.884+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:17.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:16 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:16.884+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:17.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:17 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:17.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:17.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:17 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:17.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:17.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:17 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:17.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:17.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:17 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:17.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:17.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:17 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:17.158+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:18.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.963+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:18.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.963+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:18.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.963+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:18.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.963+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:18.236 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.963+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:18.236 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:17 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:17.963+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:18.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:17 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:17.915+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:18.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:17 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:17.915+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:18.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:17 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:17.915+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:18.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:17 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:17.915+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:18.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:17 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:17.915+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:18.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:17 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:17.915+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:18.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:18 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:18.209+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:18.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:18 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:18.209+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:18.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:18 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:18.209+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:18.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:18 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:18.209+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:18.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:18 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:18.209+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:19.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:18 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:18.945+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:19.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:18 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:18.945+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:19.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:18 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:18.945+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:19.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:18 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:18.945+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:19.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:18 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:18.945+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:19.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:18 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:18.945+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:19.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:18 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:18.905+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:19.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:18 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:18.905+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:19.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:18 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:18.905+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:19.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:18 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:18.905+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:19.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:18 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:18.905+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:19.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:18 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:18.905+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:19.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:19.253+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:19.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:19.253+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:19.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:19.253+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:19.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:19.253+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:19.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:19.253+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:20.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:19.954+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:20.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:19.954+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:20.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:19.954+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:20.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:19.954+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:20.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:19.954+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:20.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:19 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:19.954+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:20.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:19 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:19.930+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:20.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:19 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:19.930+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:20.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:19 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:19.930+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:20.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:19 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:19.930+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:20.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:19 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:19.930+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:20.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:19 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:19.930+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:20.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:19 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:19.930+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:20.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:20.250+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:20.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:20.250+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:20.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:20.250+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:20.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:20.250+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:20.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:20 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:20.250+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:21.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:20.936+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:21.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:20.936+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:21.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:20.936+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:21.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:20.936+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:21.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:20.936+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:21.236 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:20 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:20.936+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:21.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:20 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:20.971+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:21.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:20 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:20.971+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:21.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:20 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:20.971+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:21.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:20 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:20.971+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:21.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:20 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:20.971+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:21.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:20 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:20.971+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:21.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:20 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:20.971+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:21.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:21 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:21.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:21.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:21 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:21.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:21.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:21 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:21.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:21.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:21 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:21.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:21.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:21 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:21.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:21.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:21 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:21.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:22.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:21 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:21.955+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:09.135534+0000 front 2024-09-10T23:51:09.135582+0000 (oldest deadline 2024-09-10T23:51:32.035789+0000) 2024-09-10T23:52:22.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:21 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:21.955+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:13.137015+0000 front 2024-09-10T23:51:13.136927+0000 (oldest deadline 2024-09-10T23:51:41.337689+0000) 2024-09-10T23:52:22.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:21 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:21.955+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:21.338238+0000 front 2024-09-10T23:51:21.338107+0000 (oldest deadline 2024-09-10T23:51:46.638203+0000) 2024-09-10T23:52:22.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:21 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:21.955+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:32.439593+0000 front 2024-09-10T23:51:32.439619+0000 (oldest deadline 2024-09-10T23:52:00.040170+0000) 2024-09-10T23:52:22.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:21 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:21.955+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:41.141146+0000 front 2024-09-10T23:51:41.141363+0000 (oldest deadline 2024-09-10T23:52:03.941177+0000) 2024-09-10T23:52:22.235 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:21 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9[66638]: 2024-09-10T23:52:21.955+0000 7f59e2a34640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.042233+0000 front 2024-09-10T23:51:48.042384+0000 (oldest deadline 2024-09-10T23:52:11.542112+0000) 2024-09-10T23:52:22.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:21 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:21.990+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:22.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:21 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:21.990+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:22.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:21 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:21.990+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:22.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:21 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:21.990+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:22.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:21 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:21.990+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:22.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:21 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:21.990+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:22.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:21 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:21.990+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:22.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:22 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:22.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:22.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:22 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:22.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:22.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:22 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:22.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:22.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:22 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:22.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:22.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:22 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:22.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:22.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:22 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:22.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:22.985 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:22 smithi016 podman[106762]: 2024-09-10 23:52:22.62106861 +0000 UTC m=+5.610890366 container died 64a4a71425d342773cfe12f2f58cc332f4382cda34cba9c6cf02bc39744ddfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T23:52:23.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:23 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:23.026+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:23.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:23 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:23.026+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:23.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:23 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:23.026+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:23.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:23 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:23.026+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:23.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:23 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:23.026+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:23.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:23 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:23.026+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:23.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:23 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:23.026+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:23.419 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:23 smithi016 podman[106762]: 2024-09-10 23:52:23.167130563 +0000 UTC m=+6.156952318 container cleanup 64a4a71425d342773cfe12f2f58cc332f4382cda34cba9c6cf02bc39744ddfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T23:52:23.419 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:23 smithi016 bash[106762]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9 2024-09-10T23:52:23.735 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:23 smithi016 podman[106777]: 2024-09-10 23:52:23.418462704 +0000 UTC m=+0.798678958 container remove 64a4a71425d342773cfe12f2f58cc332f4382cda34cba9c6cf02bc39744ddfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T23:52:23.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:23.274+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:23.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:23.274+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:23.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:23.274+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:23.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:23.274+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:23.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:23.274+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:23.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:23.274+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:23.988 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:23 smithi016 podman[106865]: 2024-09-10 23:52:23.735925143 +0000 UTC m=+0.110856841 container create f5d7c976aee61f84b513b4046dbdbe540146bb706fa7c6350f9ad7df15a672a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:23.988 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:23 smithi016 podman[106865]: 2024-09-10 23:52:23.64106698 +0000 UTC m=+0.015998688 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:52:23.988 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:23 smithi016 podman[106865]: 2024-09-10 23:52:23.988128489 +0000 UTC m=+0.363060198 container init f5d7c976aee61f84b513b4046dbdbe540146bb706fa7c6350f9ad7df15a672a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:52:24.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.037+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:24.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.037+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:24.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.037+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:24.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.037+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:24.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.037+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:24.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.037+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:24.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.037+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:24.485 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:23 smithi016 podman[106865]: 2024-09-10 23:52:23.991669674 +0000 UTC m=+0.366601374 container start f5d7c976aee61f84b513b4046dbdbe540146bb706fa7c6350f9ad7df15a672a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:52:24.485 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:24 smithi016 podman[106865]: 2024-09-10 23:52:24.05469911 +0000 UTC m=+0.429630834 container attach f5d7c976aee61f84b513b4046dbdbe540146bb706fa7c6350f9ad7df15a672a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T23:52:24.485 INFO:journalctl@ceph.osd.9.smithi016.stdout:Sep 10 23:52:24 smithi016 podman[106865]: 2024-09-10 23:52:24.186746652 +0000 UTC m=+0.561678354 container died f5d7c976aee61f84b513b4046dbdbe540146bb706fa7c6350f9ad7df15a672a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T23:52:24.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:24 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:24.316+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:24.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:24 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:24.316+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:24.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:24 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:24.316+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:24.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:24 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:24.316+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:24.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:24 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:24.316+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:24.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:24 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:24.316+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:25.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T23:52:25.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:25.050 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T23:52:25.051 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T23:52:25.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.10 2024-09-10T23:52:25.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:25.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:25.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:25.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:25.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:25.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:25.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:24 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:24.989+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:25.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 systemd[1]: Stopping Ceph osd.10 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:25.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:25 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:25.323+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:25.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:25 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:25.323+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:25.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:25 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:25.323+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:25.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:25 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:25.323+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:25.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:25 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:25.323+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:25.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:25 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:25.323+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:25.802 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.374+0000 7f2b31ebe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:25.802 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.374+0000 7f2b31ebe640 -1 osd.10 88 *** Got signal Terminated *** 2024-09-10T23:52:25.802 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.374+0000 7f2b31ebe640 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:52:26.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.953+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:26.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.953+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:26.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.953+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:26.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.953+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:26.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.953+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:26.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.953+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:26.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:25 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:25.953+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:26.671 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:26 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:26.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:26.671 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:26 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:26.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:26.671 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:26 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:26.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:26.671 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:26 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:26.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:26.672 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:26 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:26.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:26.672 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:26 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:26.299+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:27.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:26 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:26.926+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:27.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:26 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:26.926+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:27.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:26 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:26.926+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:27.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:26 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:26.926+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:27.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:26 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:26.926+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:27.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:26 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:26.926+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:27.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:26 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:26.926+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:27.614 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:27 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:27.318+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:27.614 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:27 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:27.318+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:27.614 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:27 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:27.318+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:27.614 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:27 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:27.318+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:27.614 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:27 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:27.318+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:27.615 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:27 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:27.318+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:28.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:27 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:27.948+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:28.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:27 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:27.948+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:28.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:27 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:27.948+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:28.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:27 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:27.948+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:28.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:27 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:27.948+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:28.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:27 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:27.948+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:28.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:27 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:27.948+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:28.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:28 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:28.321+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:28.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:28 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:28.321+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:28.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:28 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:28.321+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:28.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:28 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:28.321+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:28.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:28 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:28.321+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:28.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:28 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:28.321+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:29.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:28 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:28.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:29.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:28 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:28.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:29.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:28 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:28.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:29.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:28 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:28.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:29.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:28 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:28.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:29.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:28 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:28.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:29.303 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:28 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:28.952+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:29.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:29 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:29.288+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:29.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:29 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:29.288+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:29.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:29 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:29.288+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:29.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:29 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:29.288+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:29.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:29 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:29.288+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:29.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:29 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:29.288+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:30.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:29 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:29.925+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:07.453546+0000 front 2024-09-10T23:51:07.453578+0000 (oldest deadline 2024-09-10T23:51:32.753239+0000) 2024-09-10T23:52:30.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:29 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:29.925+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.854267+0000 front 2024-09-10T23:51:16.854184+0000 (oldest deadline 2024-09-10T23:51:39.154346+0000) 2024-09-10T23:52:30.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:29 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:29.925+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:25.555787+0000 front 2024-09-10T23:51:25.555771+0000 (oldest deadline 2024-09-10T23:51:47.855893+0000) 2024-09-10T23:52:30.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:29 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:29.925+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6814 osd.3 since back 2024-09-10T23:51:33.157167+0000 front 2024-09-10T23:51:33.157083+0000 (oldest deadline 2024-09-10T23:51:56.057041+0000) 2024-09-10T23:52:30.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:29 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:29.925+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:36.057446+0000 front 2024-09-10T23:51:36.057424+0000 (oldest deadline 2024-09-10T23:52:07.858028+0000) 2024-09-10T23:52:30.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:29 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:29.925+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:47.858463+0000 front 2024-09-10T23:51:47.858643+0000 (oldest deadline 2024-09-10T23:52:11.958444+0000) 2024-09-10T23:52:30.302 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:29 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10[60713]: 2024-09-10T23:52:29.925+0000 7f2b2a4cb640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:54.859724+0000 front 2024-09-10T23:51:54.859646+0000 (oldest deadline 2024-09-10T23:52:19.559551+0000) 2024-09-10T23:52:30.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:30 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:30.264+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:30.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:30 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:30.264+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:30.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:30 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:30.264+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:30.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:30 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:30.264+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:30.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:30 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:30.264+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:30.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:30 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:30.264+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:31.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:30 smithi066 podman[70973]: 2024-09-10 23:52:30.739491457 +0000 UTC m=+5.481336786 container died b11ded34a55d5b61beb0a3bd515c6c7151b7549d287903749a5417cce7d04584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:52:31.368 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:31 smithi066 podman[70973]: 2024-09-10 23:52:31.166071383 +0000 UTC m=+5.907916712 container cleanup b11ded34a55d5b61beb0a3bd515c6c7151b7549d287903749a5417cce7d04584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T23:52:31.368 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:31 smithi066 bash[70973]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10 2024-09-10T23:52:31.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:31 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:31.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:31.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:31 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:31.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:31.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:31 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:31.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:31.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:31 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:31.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:31.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:31 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:31.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:31.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:31 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:31.283+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:31.777 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:31 smithi066 podman[70988]: 2024-09-10 23:52:31.367304284 +0000 UTC m=+0.621065294 container remove b11ded34a55d5b61beb0a3bd515c6c7151b7549d287903749a5417cce7d04584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T23:52:32.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:31 smithi066 podman[71072]: 2024-09-10 23:52:31.776551887 +0000 UTC m=+0.092767841 container create 390eedb36d82d8bf0217ad8ccfcc34930c03ce5eda50c9ceed14ec7295d989bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T23:52:32.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:31 smithi066 podman[71072]: 2024-09-10 23:52:31.700243597 +0000 UTC m=+0.016459518 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:52:32.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:31 smithi066 podman[71072]: 2024-09-10 23:52:31.9955772 +0000 UTC m=+0.311793118 container init 390eedb36d82d8bf0217ad8ccfcc34930c03ce5eda50c9ceed14ec7295d989bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:52:32.052 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:31 smithi066 podman[71072]: 2024-09-10 23:52:31.999333514 +0000 UTC m=+0.315549423 container start 390eedb36d82d8bf0217ad8ccfcc34930c03ce5eda50c9ceed14ec7295d989bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:32.482 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:32 smithi066 podman[71072]: 2024-09-10 23:52:32.073334931 +0000 UTC m=+0.389550849 container attach 390eedb36d82d8bf0217ad8ccfcc34930c03ce5eda50c9ceed14ec7295d989bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T23:52:32.483 INFO:journalctl@ceph.osd.10.smithi066.stdout:Sep 10 23:52:32 smithi066 podman[71072]: 2024-09-10 23:52:32.194925215 +0000 UTC m=+0.511141124 container died 390eedb36d82d8bf0217ad8ccfcc34930c03ce5eda50c9ceed14ec7295d989bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T23:52:32.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:32.258+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:32.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:32.258+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:32.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:32.258+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:32.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:32.258+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:32.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:32.258+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:32.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:32.258+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:32.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:32.258+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-09-10T23:52:05.650169+0000 front 2024-09-10T23:52:05.650271+0000 (oldest deadline 2024-09-10T23:52:31.450517+0000) 2024-09-10T23:52:32.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T23:52:32.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:32.800 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T23:52:32.800 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T23:52:32.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.11 2024-09-10T23:52:33.093 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:32 smithi071 systemd[1]: Stopping Ceph osd.11 for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:33.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.091+0000 7f255e63c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:33.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.091+0000 7f255e63c640 -1 osd.11 88 *** Got signal Terminated *** 2024-09-10T23:52:33.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.091+0000 7f255e63c640 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T23:52:33.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.245+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:33.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.245+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:33.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.245+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:33.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.245+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:33.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.245+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:33.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.245+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:33.521 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:33 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:33.245+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-09-10T23:52:05.650169+0000 front 2024-09-10T23:52:05.650271+0000 (oldest deadline 2024-09-10T23:52:31.450517+0000) 2024-09-10T23:52:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:34.284+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:34.284+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:34.284+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:34.284+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:34.284+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:34.284+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:34.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:34 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:34.284+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-09-10T23:52:05.650169+0000 front 2024-09-10T23:52:05.650271+0000 (oldest deadline 2024-09-10T23:52:31.450517+0000) 2024-09-10T23:52:35.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:35.295+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:35.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:35.295+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:35.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:35.295+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:35.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:35.295+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:35.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:35.295+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:35.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:35.295+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:35.770 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:35 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:35.295+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-09-10T23:52:05.650169+0000 front 2024-09-10T23:52:05.650271+0000 (oldest deadline 2024-09-10T23:52:31.450517+0000) 2024-09-10T23:52:36.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:36.259+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:36.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:36.259+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:36.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:36.259+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:36.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:36.259+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:36.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:36.259+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:36.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:36.259+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:36.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:36 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:36.259+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-09-10T23:52:05.650169+0000 front 2024-09-10T23:52:05.650271+0000 (oldest deadline 2024-09-10T23:52:31.450517+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-09-10T23:51:08.641037+0000 front 2024-09-10T23:51:08.640817+0000 (oldest deadline 2024-09-10T23:51:33.940856+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-09-10T23:51:16.242044+0000 front 2024-09-10T23:51:16.242029+0000 (oldest deadline 2024-09-10T23:51:41.542025+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-10T23:51:23.842953+0000 front 2024-09-10T23:51:23.842929+0000 (oldest deadline 2024-09-10T23:51:47.843428+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-09-10T23:51:39.446210+0000 front 2024-09-10T23:51:39.446221+0000 (oldest deadline 2024-09-10T23:52:02.946241+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-10T23:51:48.247070+0000 front 2024-09-10T23:51:48.247099+0000 (oldest deadline 2024-09-10T23:52:10.547262+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.16:6822 osd.6 since back 2024-09-10T23:51:53.349049+0000 front 2024-09-10T23:51:53.349062+0000 (oldest deadline 2024-09-10T23:52:20.349285+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-09-10T23:52:05.650169+0000 front 2024-09-10T23:52:05.650271+0000 (oldest deadline 2024-09-10T23:52:31.450517+0000) 2024-09-10T23:52:37.520 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:37 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11[60842]: 2024-09-10T23:52:37.261+0000 7f255ac51640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.71:6820 osd.8 since back 2024-09-10T23:52:13.651524+0000 front 2024-09-10T23:52:13.651544+0000 (oldest deadline 2024-09-10T23:52:37.151599+0000) 2024-09-10T23:52:38.916 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:38 smithi071 podman[71419]: 2024-09-10 23:52:38.589753097 +0000 UTC m=+5.592579220 container died 4d3bb3aab0a54d56bc059b43dfe023a983baca3f7cc94f86d6382c6e680f6119 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T23:52:39.270 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:38 smithi071 podman[71419]: 2024-09-10 23:52:38.915844874 +0000 UTC m=+5.918671000 container cleanup 4d3bb3aab0a54d56bc059b43dfe023a983baca3f7cc94f86d6382c6e680f6119 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:52:39.599 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:38 smithi071 bash[71419]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11 2024-09-10T23:52:39.599 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:39 smithi071 podman[71434]: 2024-09-10 23:52:39.10865284 +0000 UTC m=+0.512893837 container remove 4d3bb3aab0a54d56bc059b43dfe023a983baca3f7cc94f86d6382c6e680f6119 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T23:52:39.845 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:39 smithi071 podman[71523]: 2024-09-10 23:52:39.534496351 +0000 UTC m=+0.112444367 container create 61fe101da0c230db3f9a48320b30870b8e3eb4a64aaa78f40139b0096910e079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T23:52:39.845 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:39 smithi071 podman[71523]: 2024-09-10 23:52:39.438024189 +0000 UTC m=+0.015972172 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:52:39.845 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:39 smithi071 podman[71523]: 2024-09-10 23:52:39.770085719 +0000 UTC m=+0.348033694 container init 61fe101da0c230db3f9a48320b30870b8e3eb4a64aaa78f40139b0096910e079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T23:52:39.845 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:39 smithi071 podman[71523]: 2024-09-10 23:52:39.7732131 +0000 UTC m=+0.351161076 container start 61fe101da0c230db3f9a48320b30870b8e3eb4a64aaa78f40139b0096910e079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:39.846 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:39 smithi071 podman[71523]: 2024-09-10 23:52:39.845044717 +0000 UTC m=+0.422992699 container attach 61fe101da0c230db3f9a48320b30870b8e3eb4a64aaa78f40139b0096910e079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T23:52:40.265 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:39 smithi071 podman[71523]: 2024-09-10 23:52:39.97531941 +0000 UTC m=+0.553267402 container died 61fe101da0c230db3f9a48320b30870b8e3eb4a64aaa78f40139b0096910e079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T23:52:40.519 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 10 23:52:40 smithi071 podman[71546]: 2024-09-10 23:52:40.506238141 +0000 UTC m=+0.524682546 container remove 61fe101da0c230db3f9a48320b30870b8e3eb4a64aaa78f40139b0096910e079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:40.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T23:52:40.562 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:40.562 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T23:52:40.563 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T23:52:40.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.a 2024-09-10T23:52:40.870 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 10 23:52:40 smithi016 systemd[1]: Stopping Ceph mds.a for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:41.235 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 10 23:52:40 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-a[73687]: 2024-09-10T23:52:40.867+0000 7ff4a1501640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:41.235 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 10 23:52:40 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-a[73687]: 2024-09-10T23:52:40.867+0000 7ff4a1501640 -1 mds.a *** got signal Terminated *** 2024-09-10T23:52:42.653 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 10 23:52:42 smithi016 podman[106968]: 2024-09-10 23:52:42.377408972 +0000 UTC m=+1.611139721 container died 6d55afa028d94d7d24c3bb18624967ba82fca7d44b3a97de28cbe31ce489dc77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T23:52:42.985 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 10 23:52:42 smithi016 podman[106968]: 2024-09-10 23:52:42.826695176 +0000 UTC m=+2.060425956 container cleanup 6d55afa028d94d7d24c3bb18624967ba82fca7d44b3a97de28cbe31ce489dc77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:52:42.985 INFO:journalctl@ceph.mds.a.smithi016.stdout:Sep 10 23:52:42 smithi016 bash[106968]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-a 2024-09-10T23:52:43.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T23:52:43.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:43.298 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T23:52:43.298 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T23:52:43.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.d 2024-09-10T23:52:43.615 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:43 smithi016 systemd[1]: Stopping Ceph mds.d for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:43.985 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:43 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d[72505]: 2024-09-10T23:52:43.613+0000 7fc751fa5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:43.985 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:43 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d[72505]: 2024-09-10T23:52:43.613+0000 7fc751fa5640 -1 mds.d *** got signal Terminated *** 2024-09-10T23:52:47.891 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:47 smithi016 podman[107090]: 2024-09-10 23:52:47.576884911 +0000 UTC m=+4.050598687 container stop 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T23:52:47.891 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:47 smithi016 podman[107090]: 2024-09-10 23:52:47.602547757 +0000 UTC m=+4.076261532 container died 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T23:52:48.150 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:47 smithi016 podman[107090]: 2024-09-10 23:52:47.971933257 +0000 UTC m=+4.445647034 container cleanup 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T23:52:48.151 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:47 smithi016 bash[107090]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d 2024-09-10T23:52:48.401 INFO:journalctl@ceph.mds.d.smithi016.stdout:Sep 10 23:52:48 smithi016 podman[107102]: 2024-09-10 23:52:48.150189995 +0000 UTC m=+0.565545038 container remove 7bc8860cb09cc8aec338e68aaee6cbc4763b7f0342132ed13283087d3bc777e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T23:52:48.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T23:52:48.437 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:48.438 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T23:52:48.438 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T23:52:48.438 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.g 2024-09-10T23:52:48.735 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 10 23:52:48 smithi016 systemd[1]: Stopping Ceph mds.g for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:49.235 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 10 23:52:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-g[73305]: 2024-09-10T23:52:48.773+0000 7f3425b48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:49.235 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 10 23:52:48 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-g[73305]: 2024-09-10T23:52:48.773+0000 7f3425b48640 -1 mds.g *** got signal Terminated *** 2024-09-10T23:52:51.605 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 10 23:52:51 smithi016 podman[107210]: 2024-09-10 23:52:51.277089895 +0000 UTC m=+2.614458536 container died 107126098c056bb0fbd7e5ad08f3a95f00495b7b0accac63b1f24531cf6c9874 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:52:51.895 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 10 23:52:51 smithi016 podman[107210]: 2024-09-10 23:52:51.669208669 +0000 UTC m=+3.006577315 container cleanup 107126098c056bb0fbd7e5ad08f3a95f00495b7b0accac63b1f24531cf6c9874 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:51.895 INFO:journalctl@ceph.mds.g.smithi016.stdout:Sep 10 23:52:51 smithi016 bash[107210]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-g 2024-09-10T23:52:52.035 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T23:52:52.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:52.070 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T23:52:52.070 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T23:52:52.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.j 2024-09-10T23:52:52.485 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:52:52 smithi016 systemd[1]: Stopping Ceph mds.j for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:52.485 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:52:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j[72085]: 2024-09-10T23:52:52.397+0000 7fe78a660640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:52.485 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:52:52 smithi016 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j[72085]: 2024-09-10T23:52:52.397+0000 7fe78a660640 -1 mds.j *** got signal Terminated *** 2024-09-10T23:52:55.985 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:52:55 smithi016 podman[107327]: 2024-09-10 23:52:55.723137452 +0000 UTC m=+3.427247875 container died ce66644e9da97a8b1598ec7e3e4bebe1433379161fc403b436dc08d77c4656e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:52:56.357 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:52:56 smithi016 podman[107327]: 2024-09-10 23:52:56.10615195 +0000 UTC m=+3.810262372 container cleanup ce66644e9da97a8b1598ec7e3e4bebe1433379161fc403b436dc08d77c4656e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:56.358 INFO:journalctl@ceph.mds.j.smithi016.stdout:Sep 10 23:52:56 smithi016 bash[107327]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-j 2024-09-10T23:52:56.497 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T23:52:56.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:56.532 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T23:52:56.532 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T23:52:56.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.b 2024-09-10T23:52:56.817 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:52:56 smithi066 systemd[1]: Stopping Ceph mds.b for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:57.301 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:52:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b[65917]: 2024-09-10T23:52:56.816+0000 7ff138a06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:57.302 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:52:56 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b[65917]: 2024-09-10T23:52:56.816+0000 7ff138a06640 -1 mds.b *** got signal Terminated *** 2024-09-10T23:52:58.552 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:52:58 smithi066 podman[71173]: 2024-09-10 23:52:58.261426482 +0000 UTC m=+1.526799553 container died d3f88bd26baa7c071104820043cb3f4306bad8acdac9f9af91b07667e4e00184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T23:52:58.924 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:52:58 smithi066 podman[71173]: 2024-09-10 23:52:58.57402752 +0000 UTC m=+1.839400588 container cleanup d3f88bd26baa7c071104820043cb3f4306bad8acdac9f9af91b07667e4e00184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:52:58.924 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:52:58 smithi066 bash[71173]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b 2024-09-10T23:52:58.924 INFO:journalctl@ceph.mds.b.smithi066.stdout:Sep 10 23:52:58 smithi066 podman[71184]: 2024-09-10 23:52:58.792082767 +0000 UTC m=+0.523651887 container remove d3f88bd26baa7c071104820043cb3f4306bad8acdac9f9af91b07667e4e00184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T23:52:58.938 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T23:52:58.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:52:58.977 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T23:52:58.977 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T23:52:58.977 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.e 2024-09-10T23:52:59.287 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:52:59 smithi066 systemd[1]: Stopping Ceph mds.e for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:52:59.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:52:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e[65304]: 2024-09-10T23:52:59.286+0000 7f914989e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:52:59.552 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:52:59 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e[65304]: 2024-09-10T23:52:59.286+0000 7f914989e640 -1 mds.e *** got signal Terminated *** 2024-09-10T23:53:02.521 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:53:02 smithi066 podman[71295]: 2024-09-10 23:53:02.24975613 +0000 UTC m=+3.054045104 container died 3fc3d5aeb3bd012164db6a53418cfdae62bf6d009215d25df8b53b6e96f466b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T23:53:02.802 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:53:02 smithi066 podman[71295]: 2024-09-10 23:53:02.627766215 +0000 UTC m=+3.432055174 container cleanup 3fc3d5aeb3bd012164db6a53418cfdae62bf6d009215d25df8b53b6e96f466b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T23:53:02.802 INFO:journalctl@ceph.mds.e.smithi066.stdout:Sep 10 23:53:02 smithi066 bash[71295]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-e 2024-09-10T23:53:03.025 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T23:53:03.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:53:03.061 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T23:53:03.061 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T23:53:03.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.h 2024-09-10T23:53:03.391 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:53:03 smithi066 systemd[1]: Stopping Ceph mds.h for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:53:03.802 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:53:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h[65604]: 2024-09-10T23:53:03.390+0000 7fbf47fce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:53:03.802 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:53:03 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h[65604]: 2024-09-10T23:53:03.390+0000 7fbf47fce640 -1 mds.h *** got signal Terminated *** 2024-09-10T23:53:06.542 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:53:06 smithi066 podman[71425]: 2024-09-10 23:53:06.258995203 +0000 UTC m=+2.968914877 container died 6ca599a42820ab6c623871f107bff2041e42f1bf5ef64e1590ec444b301893ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T23:53:06.802 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:53:06 smithi066 podman[71425]: 2024-09-10 23:53:06.631689677 +0000 UTC m=+3.341609345 container cleanup 6ca599a42820ab6c623871f107bff2041e42f1bf5ef64e1590ec444b301893ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T23:53:06.802 INFO:journalctl@ceph.mds.h.smithi066.stdout:Sep 10 23:53:06 smithi066 bash[71425]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-h 2024-09-10T23:53:07.018 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T23:53:07.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:53:07.053 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T23:53:07.053 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T23:53:07.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.k 2024-09-10T23:53:07.302 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:53:07 smithi066 systemd[1]: Stopping Ceph mds.k for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:53:07.802 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:53:07 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k[65003]: 2024-09-10T23:53:07.394+0000 7f3f0a8f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:53:07.802 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:53:07 smithi066 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k[65003]: 2024-09-10T23:53:07.394+0000 7f3f0a8f1640 -1 mds.k *** got signal Terminated *** 2024-09-10T23:53:11.670 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:53:11 smithi066 podman[71547]: 2024-09-10 23:53:11.405223136 +0000 UTC m=+4.135650962 container died 70f9ee2e6735d428c5ff77572f5d6c47d77bb986f411e1277acfc09784c9ccf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:53:11.995 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:53:11 smithi066 podman[71547]: 2024-09-10 23:53:11.768535887 +0000 UTC m=+4.498963704 container cleanup 70f9ee2e6735d428c5ff77572f5d6c47d77bb986f411e1277acfc09784c9ccf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T23:53:11.995 INFO:journalctl@ceph.mds.k.smithi066.stdout:Sep 10 23:53:11 smithi066 bash[71547]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-k 2024-09-10T23:53:12.129 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T23:53:12.164 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:53:12.164 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T23:53:12.164 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T23:53:12.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.c 2024-09-10T23:53:12.463 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:53:12 smithi071 systemd[1]: Stopping Ceph mds.c for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:53:12.769 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:53:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c[65980]: 2024-09-10T23:53:12.461+0000 7fd376dc5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:53:12.770 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:53:12 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c[65980]: 2024-09-10T23:53:12.462+0000 7fd376dc5640 -1 mds.c *** got signal Terminated *** 2024-09-10T23:53:14.519 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:53:14 smithi071 podman[71624]: 2024-09-10 23:53:14.238760408 +0000 UTC m=+1.888967131 container died e5a938f68e6196b8ff81a3cdea8eb713d5920a6de3ed6d892c6483b25e7028b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T23:53:14.830 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:53:14 smithi071 podman[71624]: 2024-09-10 23:53:14.594978863 +0000 UTC m=+2.245185597 container cleanup e5a938f68e6196b8ff81a3cdea8eb713d5920a6de3ed6d892c6483b25e7028b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:53:14.830 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 10 23:53:14 smithi071 bash[71624]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-c 2024-09-10T23:53:14.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T23:53:15.015 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:53:15.016 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T23:53:15.016 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T23:53:15.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.f 2024-09-10T23:53:15.520 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:53:15 smithi071 systemd[1]: Stopping Ceph mds.f for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:53:15.520 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:53:15 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f[65678]: 2024-09-10T23:53:15.315+0000 7f5a913dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:53:15.520 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:53:15 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f[65678]: 2024-09-10T23:53:15.315+0000 7f5a913dc640 -1 mds.f *** got signal Terminated *** 2024-09-10T23:53:18.500 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:53:18 smithi071 podman[71759]: 2024-09-10 23:53:18.245428445 +0000 UTC m=+3.008690105 container died f9294f6f77cc56639b68bf7370c68958c9c9263457bad50ac79292dfb9cd0436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T23:53:18.769 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:53:18 smithi071 podman[71759]: 2024-09-10 23:53:18.59856643 +0000 UTC m=+3.361828089 container cleanup f9294f6f77cc56639b68bf7370c68958c9c9263457bad50ac79292dfb9cd0436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:53:18.770 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 10 23:53:18 smithi071 bash[71759]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-f 2024-09-10T23:53:19.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T23:53:19.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:53:19.046 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T23:53:19.046 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T23:53:19.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.i 2024-09-10T23:53:19.269 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:53:19 smithi071 systemd[1]: Stopping Ceph mds.i for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:53:19.770 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:53:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: 2024-09-10T23:53:19.368+0000 7f2e0df19640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:53:19.770 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:53:19 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i[66281]: 2024-09-10T23:53:19.368+0000 7f2e0df19640 -1 mds.i *** got signal Terminated *** 2024-09-10T23:53:22.520 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:53:22 smithi071 podman[71882]: 2024-09-10 23:53:22.247482292 +0000 UTC m=+2.989497045 container died 5587b0520d03799d94c521e9e060255bc81f49c7d34e1995141a8ab71df9b3fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:53:22.920 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:53:22 smithi071 podman[71882]: 2024-09-10 23:53:22.61008961 +0000 UTC m=+3.352104364 container cleanup 5587b0520d03799d94c521e9e060255bc81f49c7d34e1995141a8ab71df9b3fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T23:53:22.920 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 10 23:53:22 smithi071 bash[71882]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-i 2024-09-10T23:53:23.100 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T23:53:23.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:53:23.133 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T23:53:23.133 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T23:53:23.134 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.l 2024-09-10T23:53:23.519 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:53:23 smithi071 systemd[1]: Stopping Ceph mds.l for 65d5fa74-6fcc-11ef-bcea-c7b262605968... 2024-09-10T23:53:24.019 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:53:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l[65376]: 2024-09-10T23:53:23.553+0000 7f1ddee59640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:53:24.020 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:53:23 smithi071 ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l[65376]: 2024-09-10T23:53:23.553+0000 7f1ddee59640 -1 mds.l *** got signal Terminated *** 2024-09-10T23:53:25.939 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:53:25 smithi071 podman[72002]: 2024-09-10 23:53:25.671426013 +0000 UTC m=+2.326932023 container died 44f070f54c21da7b39b27c4960bbc12ac998888685e07164f7b40f5a9b95d177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T23:53:26.270 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:53:26 smithi071 podman[72002]: 2024-09-10 23:53:26.055258812 +0000 UTC m=+2.710764819 container cleanup 44f070f54c21da7b39b27c4960bbc12ac998888685e07164f7b40f5a9b95d177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:53:26.270 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 10 23:53:26 smithi071 bash[72002]: ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968-mds-l 2024-09-10T23:53:26.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-65d5fa74-6fcc-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T23:53:26.502 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T23:53:26.502 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T23:53:26.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:53:26.721 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:53:29.277 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:53:29.491 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:53:31.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T23:53:32.191 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:53:34.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:34.590 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:34.623 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:53:34.650 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T23:53:34.652 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi016/crash 2024-09-10T23:53:34.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:53:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:tar: /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:53:34.691 INFO:teuthology.orchestra.run.smithi016.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:53:34.692 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi066/crash 2024-09-10T23:53:34.693 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:53:34.792 INFO:teuthology.orchestra.run.smithi066.stderr:tar: /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:53:34.792 INFO:teuthology.orchestra.run.smithi066.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:53:34.794 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi071/crash 2024-09-10T23:53:34.795 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash -- . 2024-09-10T23:53:34.832 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T23:53:34.832 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-09-10T23:53:34.833 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T23:53:34.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T23:53:34.877 INFO:tasks.cephadm:Compressing logs... 2024-09-10T23:53:34.877 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:53:34.919 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:53:34.922 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:53:34.944 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T23:53:34.944 INFO:teuthology.orchestra.run.smithi016.stderr:: No such file or directory 2024-09-10T23:53:34.945 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T23:53:34.946 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:53:34.946 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:53:34.946 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T23:53:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:53:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-09-10T23:53:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr: 81.7%/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.11.log: -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.5.log: /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log: 90.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:53:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T23:53:34.952 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:53:34.952 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T23:53:34.952 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T23:53:34.953 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.4% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:53:34.953 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T23:53:34.953 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:53:34.953 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.6.log: /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:53:34.955 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.l.log: 87.6% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:53:34.955 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T23:53:34.957 INFO:teuthology.orchestra.run.smithi066.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T23:53:34.957 INFO:teuthology.orchestra.run.smithi066.stderr:: No such file or directory 2024-09-10T23:53:34.957 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T23:53:34.957 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T23:53:34.957 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T23:53:34.958 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T23:53:34.958 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T23:53:34.958 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T23:53:34.958 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.b.log: /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T23:53:34.958 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T23:53:34.959 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.9% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T23:53:34.959 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T23:53:34.960 INFO:teuthology.orchestra.run.smithi016.stderr: 95.1% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T23:53:34.960 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T23:53:34.961 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T23:53:34.961 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.d.log: 95.1% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T23:53:34.961 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:53:34.961 INFO:teuthology.orchestra.run.smithi016.stderr: 90.9% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:53:34.962 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:53:34.964 INFO:teuthology.orchestra.run.smithi016.stderr: 95.1% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T23:53:34.964 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T23:53:34.964 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T23:53:34.965 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:53:34.968 INFO:teuthology.orchestra.run.smithi071.stderr: 92.5% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T23:53:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T23:53:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.4.log: 94.9% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr: 90.3%/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log: -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr: 81.7% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T23:53:34.969 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T23:53:34.970 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.b.log: 92.5% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T23:53:34.970 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 95.0% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T23:53:34.970 INFO:teuthology.orchestra.run.smithi016.stderr: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:53:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T23:53:34.988 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:53:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T23:53:35.047 INFO:teuthology.orchestra.run.smithi066.stderr: 93.0% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T23:53:35.051 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T23:53:35.054 INFO:teuthology.orchestra.run.smithi066.stderr: 94.4% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T23:53:35.100 INFO:teuthology.orchestra.run.smithi066.stderr: 94.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T23:53:35.200 INFO:teuthology.orchestra.run.smithi016.stderr: 90.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T23:53:35.285 INFO:teuthology.orchestra.run.smithi066.stderr: 91.8% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T23:53:35.353 INFO:teuthology.orchestra.run.smithi071.stderr: 91.8% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T23:53:35.428 INFO:teuthology.orchestra.run.smithi071.stderr: 95.7% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T23:53:35.885 INFO:teuthology.orchestra.run.smithi016.stderr: 90.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T23:53:36.042 INFO:teuthology.orchestra.run.smithi016.stderr: 92.4% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T23:53:36.209 INFO:teuthology.orchestra.run.smithi016.stderr: 91.9% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T23:53:36.243 INFO:teuthology.orchestra.run.smithi066.stderr: 92.2% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T23:53:36.260 INFO:teuthology.orchestra.run.smithi071.stderr: 92.4% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T23:53:36.689 INFO:teuthology.orchestra.run.smithi016.stderr: 92.6% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T23:53:36.719 INFO:teuthology.orchestra.run.smithi066.stderr: 92.7% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T23:53:36.863 INFO:teuthology.orchestra.run.smithi016.stderr: 92.7% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T23:53:36.865 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-10T23:53:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m1.932s 2024-09-10T23:53:36.866 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m7.020s 2024-09-10T23:53:36.866 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.233s 2024-09-10T23:53:36.963 INFO:teuthology.orchestra.run.smithi066.stderr: 92.7% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T23:53:36.980 INFO:teuthology.orchestra.run.smithi071.stderr: 92.8% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T23:53:37.139 INFO:teuthology.orchestra.run.smithi071.stderr: 92.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T23:53:37.367 INFO:teuthology.orchestra.run.smithi066.stderr: 92.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T23:53:37.370 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-10T23:53:37.370 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m2.432s 2024-09-10T23:53:37.370 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m7.836s 2024-09-10T23:53:37.370 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m0.256s 2024-09-10T23:53:38.784 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T23:53:39.316 INFO:teuthology.orchestra.run.smithi071.stderr: 95.4% -- replaced with /var/log/ceph/65d5fa74-6fcc-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T23:53:39.318 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-10T23:53:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m4.381s 2024-09-10T23:53:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m14.224s 2024-09-10T23:53:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.494s 2024-09-10T23:53:39.319 INFO:tasks.cephadm:Archiving logs... 2024-09-10T23:53:39.319 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi016/log 2024-09-10T23:53:39.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:53:40.367 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi066/log 2024-09-10T23:53:40.368 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:53:41.436 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi071/log 2024-09-10T23:53:41.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:53:43.356 INFO:tasks.cephadm:Removing cluster... 2024-09-10T23:53:43.357 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 --force 2024-09-10T23:53:43.569 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:53:43.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 --force 2024-09-10T23:53:44.055 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:53:44.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 65d5fa74-6fcc-11ef-bcea-c7b262605968 --force 2024-09-10T23:53:44.525 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 65d5fa74-6fcc-11ef-bcea-c7b262605968 2024-09-10T23:53:44.804 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T23:53:44.804 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:53:44.824 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:53:44.840 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T23:53:44.856 INFO:tasks.cephadm:Teardown complete 2024-09-10T23:53:44.856 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T23:53:44.867 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T23:53:44.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:53:44.871 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:53:44.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:53:45.025 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T23:53:45.036 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T23:53:45.036 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:53:45.039 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:53:45.041 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:53:45.054 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:53:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:53:45.058 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:53:45.058 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-10T23:53:45.058 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -380us[ -376us] +/- 58ms 2024-09-10T23:53:45.059 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +452us[ +452us] +/- 64ms 2024-09-10T23:53:45.059 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +11us[ +11us] +/- 73ms 2024-09-10T23:53:45.059 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:53:45.059 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:53:45.060 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:53:45.061 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-09-10T23:53:45.061 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 7 377 126 -335us[ -311us] +/- 57ms 2024-09-10T23:53:45.061 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +501us[ +501us] +/- 64ms 2024-09-10T23:53:45.061 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +70us[ +70us] +/- 73ms 2024-09-10T23:53:45.061 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:53:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:53:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-10T23:53:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -418us[ -420us] +/- 58ms 2024-09-10T23:53:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +466us[ +464us] +/- 64ms 2024-09-10T23:53:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +21us[ +21us] +/- 73ms 2024-09-10T23:53:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:53:45.064 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T23:53:45.074 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T23:53:45.074 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T23:53:45.085 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:53:45.191 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:53:45.260 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T23:53:45.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:53:45.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:53:45.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:53:45.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:53:45.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:53:45.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:53:45.417 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T23:53:45.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T23:53:45.489 INFO:teuthology.task.internal:Duration was 1860.129584 seconds 2024-09-10T23:53:45.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T23:53:45.499 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T23:53:45.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:53:45.502 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:53:45.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:53:45.543 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:53:45.544 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:53:45.544 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:53:46.059 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T23:53:46.060 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-09-10T23:53:46.060 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:53:46.089 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-09-10T23:53:46.089 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:53:46.119 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T23:53:46.119 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:53:46.146 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T23:53:46.146 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:53:46.148 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:53:46.162 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:53:46.214 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T23:53:46.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:53:46.219 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:53:46.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:53:47.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T23:53:47.327 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T23:53:47.327 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:53:47.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:53:47.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:53:47.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T23:53:47.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:53:47.427 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:53:47.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:53:47.448 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-09-10T23:53:47.453 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-09-10T23:53:47.479 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-10T23:53:47.526 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:53:47.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:53:47.541 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:53:47.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:53:47.557 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:53:47.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:53:47.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T23:53:47.593 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T23:53:47.594 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi016 2024-09-10T23:53:47.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:53:47.650 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi066 2024-09-10T23:53:47.651 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:53:47.688 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899791/remote/smithi071 2024-09-10T23:53:47.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:53:47.726 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T23:53:47.726 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:53:47.729 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:53:47.731 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:53:47.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T23:53:47.788 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T23:53:47.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T23:53:47.799 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T23:53:47.799 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:53:47.802 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:53:47.804 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:53:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:53 /home/ubuntu/cephtest 2024-09-10T23:53:47.818 INFO:teuthology.orchestra.run.smithi066.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:53 /home/ubuntu/cephtest 2024-09-10T23:53:47.830 INFO:teuthology.orchestra.run.smithi071.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:53 /home/ubuntu/cephtest 2024-09-10T23:53:47.831 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T23:53:47.842 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T23:53:47.901 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/direct_io}} duration: 1860.1295838356018 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-10T23:53:47.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:53:48.007 INFO:teuthology.run:pass